-- Logs begin at Sun 2022-08-28 00:10:45 UTC, end at Sun 2022-08-28 02:57:55 UTC. -- Aug 28 00:50:26.439308 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 00:50:26.448315 n-d-master-1 devstack@keystone.service[81996]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 00:50:26 2022] *** Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: nodename: n-d-master-1 Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: machine: x86_64 Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: clock source: unix Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: pcre jit disabled Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: detected number of CPU cores: 4 Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: current working directory: / Aug 28 00:50:26.450341 n-d-master-1 devstack@keystone.service[81996]: detected binary path: /usr/bin/uwsgi-core Aug 28 00:50:26.450916 n-d-master-1 devstack@keystone.service[81996]: your processes number limit is 47680 Aug 28 00:50:26.450916 n-d-master-1 devstack@keystone.service[81996]: your memory page size is 4096 bytes Aug 28 00:50:26.450916 n-d-master-1 devstack@keystone.service[81996]: detected max file descriptor number: 2048 Aug 28 00:50:26.450916 n-d-master-1 devstack@keystone.service[81996]: lock engine: pthread robust mutexes Aug 28 00:50:26.450916 n-d-master-1 devstack@keystone.service[81996]: thunder lock: enabled Aug 28 00:50:26.450916 n-d-master-1 devstack@keystone.service[81996]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 00:50:26.450916 n-d-master-1 devstack@keystone.service[81996]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 00:50:26.491406 n-d-master-1 devstack@keystone.service[81996]: Python main interpreter initialized at 0x55ee9c1559c0 Aug 28 00:50:26.491406 n-d-master-1 devstack@keystone.service[81996]: python threads support enabled Aug 28 00:50:26.491406 n-d-master-1 devstack@keystone.service[81996]: your server socket listen backlog is limited to 100 connections Aug 28 00:50:26.491406 n-d-master-1 devstack@keystone.service[81996]: your mercy for graceful operations on workers is 90 seconds Aug 28 00:50:26.491803 n-d-master-1 devstack@keystone.service[81996]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 00:50:26.491876 n-d-master-1 devstack@keystone.service[81996]: *** Operational MODE: preforking *** Aug 28 00:50:26.492111 n-d-master-1 devstack@keystone.service[81996]: *** uWSGI is running in multiple interpreter mode *** Aug 28 00:50:26.492111 n-d-master-1 devstack@keystone.service[81996]: spawned uWSGI master process (pid: 81996) Aug 28 00:50:26.492325 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Aug 28 00:50:26.493461 n-d-master-1 devstack@keystone.service[81996]: spawned uWSGI worker 1 (pid: 82006, cores: 1) Aug 28 00:50:26.493461 n-d-master-1 devstack@keystone.service[81996]: spawned uWSGI worker 2 (pid: 82007, cores: 1) Aug 28 00:50:26.493461 n-d-master-1 devstack@keystone.service[81996]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 00:50:30.888356 n-d-master-1 devstack@keystone.service[82006]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:50:30.888356 n-d-master-1 devstack@keystone.service[82006]: from cryptography.utils import int_from_bytes Aug 28 00:50:30.889184 n-d-master-1 devstack@keystone.service[82006]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:50:30.889184 n-d-master-1 devstack@keystone.service[82006]: from cryptography.utils import int_from_bytes Aug 28 00:50:30.889312 n-d-master-1 devstack@keystone.service[82007]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:50:30.889312 n-d-master-1 devstack@keystone.service[82007]: from cryptography.utils import int_from_bytes Aug 28 00:50:30.889312 n-d-master-1 devstack@keystone.service[82007]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:50:30.889312 n-d-master-1 devstack@keystone.service[82007]: from cryptography.utils import int_from_bytes Aug 28 00:50:30.939440 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:50:30.939674 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:50:30.939817 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] command line args: [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:50:30.940061 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:50:30.940239 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ================================================================================ {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:50:30.940351 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:50:30.940482 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:50:30.940612 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] admin_token = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.940724 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] command line args: [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:50:30.940853 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] config_dir = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.940973 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.941091 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:50:30.941202 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] config_source = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.941327 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ================================================================================ {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:50:30.941437 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] debug = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.941554 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] admin_token = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.941663 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.942064 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] config_dir = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.942064 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.942364 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.942523 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] config_source = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.942676 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.942836 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] debug = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.942991 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.943155 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.943341 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.943492 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.943661 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] list_limit = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.943805 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.943969 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] log_config_append = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.944115 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.944264 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.944428 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.944591 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] log_dir = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.944591 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] log_file = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.944921 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] list_limit = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.944921 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] log_config_append = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.945186 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.945305 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.945438 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.945555 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] log_dir = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.945687 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.945849 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] log_file = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.945849 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.946119 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.946119 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.946393 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.946520 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.946646 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.946776 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.946895 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.947071 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.947195 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.947370 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.947486 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.947660 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.947775 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.947947 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948072 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948188 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948310 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948429 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948557 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948681 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948855 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.948855 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949103 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949228 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949228 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949457 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949457 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] publish_errors = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949690 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949829 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.949829 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.950145 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.950276 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.950392 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] publish_errors = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.950525 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.950631 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.950759 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.950873 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951004 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] standard_threads = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951123 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951248 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951367 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951474 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951593 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951709 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951827 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] standard_threads = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951932 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] use_journal = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.951932 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] use_json = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952157 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952267 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] use_stderr = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952386 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952510 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] use_syslog = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952625 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952732 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952855 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] use_journal = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.952855 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] use_json = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.953055 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.953238 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] use_stderr = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.953358 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.953474 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] use_syslog = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.953584 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.953705 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:50:30.953850 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.953980 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954087 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954207 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954323 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954438 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954551 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954672 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954779 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.954889 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.955006 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.955112 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.955222 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.955348 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.955453 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.955573 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.955942 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956064 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956185 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956309 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956418 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956527 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956635 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956744 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956878 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.956987 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957095 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957204 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957312 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957430 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957547 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957661 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957768 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.957917 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958034 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958149 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958268 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958374 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958482 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958591 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958699 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.958807 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959002 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959110 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959220 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959338 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959452 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959560 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959685 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959791 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.959901 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960010 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960118 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960227 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960347 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960460 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960566 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960675 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960785 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.960898 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961017 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961122 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961240 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961355 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961461 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961570 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961700 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961842 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.961968 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962075 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962185 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962304 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962422 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962532 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962641 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962750 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.962902 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963025 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963144 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963259 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963374 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963482 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963592 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963713 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963820 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.963929 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964048 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964160 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964282 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964401 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964524 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964641 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964764 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964873 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.964983 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965093 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965204 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965327 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965444 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965553 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965666 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965788 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.965954 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966075 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966186 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966300 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966413 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966527 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966641 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966767 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.966878 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967000 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967110 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967224 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967354 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967465 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967578 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967691 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967805 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.967932 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968041 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968166 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968278 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968391 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968505 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968627 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968751 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968864 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.968970 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969076 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969191 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969295 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969407 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969519 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969621 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969720 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.969865 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.970192 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.970300 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.970513 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.970628 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.970735 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.970842 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.970960 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971067 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971190 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971299 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971406 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971521 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971628 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971754 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.971884 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972012 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972121 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972230 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972339 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972457 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972571 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972689 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972796 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.972897 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973001 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973108 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973202 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973310 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973410 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973513 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973616 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973725 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.973914 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974047 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974162 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974274 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974385 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974496 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974619 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974742 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974852 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.974961 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975072 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975191 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975293 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975411 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975507 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975610 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975721 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975835 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.975835 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976061 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976177 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976288 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976397 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976510 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976619 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976802 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.976914 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977033 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977154 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977258 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977368 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977472 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977472 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977654 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977752 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977877 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.977978 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978098 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978221 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978325 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] auth.external = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978429 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978584 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978704 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978810 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.978920 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979041 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979150 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] auth.external = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979266 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] auth.password = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979375 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979482 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] auth.token = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979482 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979689 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979798 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.979912 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980031 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980163 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] auth.password = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980269 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980385 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] auth.token = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980385 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980605 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980721 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980831 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.980931 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981051 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981160 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981272 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] credential.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981386 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981503 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981616 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981740 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.981740 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982034 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982147 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982259 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] credential.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982370 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982511 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982636 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982748 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982870 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.982994 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983126 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983236 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983346 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983457 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983569 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983692 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983692 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.983970 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.984098 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.984207 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.984320 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.984431 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.984555 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.984665 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.984665 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.985413 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.985532 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.985801 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986002 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986113 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986226 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986347 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986457 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986582 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986705 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986816 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.986928 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987041 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987158 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987270 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987394 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987506 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987618 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987730 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987842 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.987952 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988075 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988186 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988297 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988409 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988521 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988639 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988762 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988871 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.988984 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989095 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989208 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989316 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989437 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989552 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989663 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989663 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989887 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.989887 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990112 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990233 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990343 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990455 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990566 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990677 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990800 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.990909 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991019 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991132 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991242 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991242 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991460 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991569 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991686 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991796 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.991907 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992019 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992142 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992252 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992365 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992486 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992595 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992716 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992827 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.992937 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993049 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993164 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993275 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993398 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993508 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993620 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993733 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993861 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.993984 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994110 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994220 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994331 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994443 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994555 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994667 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994794 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.994904 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995015 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995127 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995247 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995357 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995480 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995590 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995710 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995819 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.995930 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996041 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996164 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996274 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996390 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996524 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996634 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996745 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996866 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.996975 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.997086 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.997196 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.997307 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.997418 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.997542 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.997652 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.997763 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998021 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998135 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998249 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998394 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998522 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998634 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998755 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998865 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.998977 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999101 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999211 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999324 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999447 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999558 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999674 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999798 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:30.999908 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.000020 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.000131 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.000261 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.000369 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.000498 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.000669 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.001277 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.001389 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.001501 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.001614 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.001739 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.001910 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002022 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002160 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002271 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002388 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002519 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002638 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002753 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002869 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.002984 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003099 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003226 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003339 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003471 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003584 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003701 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003819 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.003947 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004061 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004177 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004301 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004417 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004530 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004658 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004771 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.004886 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005005 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005127 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005242 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005370 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005482 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005598 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005712 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005846 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.005967 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006101 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006212 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006328 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006447 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006560 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006691 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006804 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.006920 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.007132 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.007246 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.007364 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.007560 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.007682 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.007796 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.007912 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008027 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008142 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008268 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008382 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008502 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008617 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008732 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008732 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.008959 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.009071 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.009187 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.009303 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.009434 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.009597 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.009719 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.009892 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010004 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010119 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010237 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010400 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010529 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010641 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010757 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010872 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.010988 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011103 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011232 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011344 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011459 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011573 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011688 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011804 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.011936 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012048 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012164 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012279 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012396 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] role.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012510 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012637 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] role.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012749 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012864 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.012979 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013094 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013208 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013338 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013454 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] role.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013569 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013685 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] role.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013800 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.013951 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014134 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014246 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014362 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014476 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014589 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014701 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014827 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.014938 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015053 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015171 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015284 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015396 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015522 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015633 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015747 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015860 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.015974 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016087 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016087 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016338 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016459 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016568 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016679 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016801 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.016915 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017035 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017035 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017258 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017384 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017511 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017627 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017745 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.017880 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018007 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018122 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018262 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018373 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018498 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018613 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018729 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018846 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.018973 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019087 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019204 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019320 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019436 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019552 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019681 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019802 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.019918 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020034 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020150 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020266 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020390 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020506 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020627 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020747 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020866 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.020986 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.021117 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.021117 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.021343 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.021460 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.021579 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.021699 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.021906 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022019 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022136 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022252 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022367 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022483 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022616 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022727 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022842 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.022957 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023088 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023199 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023327 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023439 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023556 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023671 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023785 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.023900 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024028 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024138 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024254 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024368 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024483 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024616 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024742 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024867 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.024978 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025095 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025210 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.connection = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025324 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025451 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025574 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025703 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025832 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.025957 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026075 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.connection = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026193 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026315 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026515 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026628 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026748 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026866 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.026983 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027099 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027228 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027342 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027459 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027570 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027681 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027854 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.027986 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028102 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028226 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028344 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028474 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028589 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028721 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028836 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.028956 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029075 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029195 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029313 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029444 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029559 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029678 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029802 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.029979 n-d-master-1 devstack@keystone.service[82007]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:50:31.030097 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.030097 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.030097 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:50:31.030097 n-d-master-1 devstack@keystone.service[82006]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:50:31.054727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.054953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.055177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.055464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.055695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.055927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.064087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.064987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.101418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.101639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.101895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.102132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.160655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.160913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.212071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.212312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.213191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.213433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.381257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.381479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.381685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.381778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.381972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.382061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.382164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.382244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.382359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.382444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.382578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.382794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.406116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.406343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.406508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.406610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.406690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.407970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.408114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.419578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.419939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.436931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.437024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.437148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.437231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.437360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82006) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.437442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82007) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:50:31.455085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.455085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:50:31.455297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.455417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.455548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:50:31.455985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:50:31.456138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.456231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.456306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:50:31.456383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.456563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.456656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.456830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.456914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.457354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.457617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.466661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.466938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.467113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.467197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.467395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.467479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.467667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.467949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.475105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.482644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.482769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.482769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.482769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.482983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.483049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.483123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.483209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.483774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.483857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.483934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.484755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.504531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.505084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.506032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.506322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.506594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.506891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.510837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.511109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.511393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.511654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.512056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.515430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.517935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.518227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.518732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.519026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.522174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.522477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.522759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.523043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.523267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.523390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.523572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.523890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.524172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.524463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.524742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.525026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.525306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.525471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.525768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.526154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.542289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.542595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.543368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.543646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.546392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.548182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.550202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.550482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.551449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.551748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.554834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.555991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.558052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.559194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.561089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.561390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.561713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.561995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.562278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.562664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.562758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.563048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.563340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.563630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.563930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.564219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.578512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.579337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.579611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.579875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.580907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.581213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.581479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.581754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.587110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.588676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.595781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.595942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.596316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.596632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.596632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.606258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.606526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.606810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.607096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.607381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.607660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.607747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.607950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.608036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.608375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.608665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.608955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.609238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.609617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.623390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.625048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.630557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.630656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.630736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.630736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.630941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.632184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.632480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.632585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.632749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.634078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.634368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.634653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.639240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.640701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.641022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.643079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.644363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.644654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.644942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.645222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.646125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.646419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.646708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.646998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.653218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.659209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.659209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.659362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.659362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.659362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.661519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82007) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.661791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.662096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.662376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.662654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.662940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.663077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82006) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:50:31.663235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.663364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.663516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.663642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.663769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.663901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.664983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.665112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.665324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82007) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.665412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.665648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.665934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.666225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.668394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82006) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:50:31.704222 n-d-master-1 devstack@keystone.service[82007]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee9c1559c0 pid: 82007 (default app) Aug 28 00:50:31.704409 n-d-master-1 devstack@keystone.service[82006]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee9c1559c0 pid: 82006 (default app) Aug 28 00:50:31.704550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981824-16c9-4fb2-831c-1967acde174b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:31.704676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981824-16c9-4fb2-831c-1967acde174b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:31.704907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c981824-16c9-4fb2-831c-1967acde174b None None] PATH_INFO: `/v3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:31.709478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Sun Aug 28 00:50:31 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:39.346318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19660822-f563-4cf2-8d34-cfcbcea11fef None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:39.346866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19660822-f563-4cf2-8d34-cfcbcea11fef None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:39.346866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19660822-f563-4cf2-8d34-cfcbcea11fef None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:39.351092 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:50:39.356849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:39.357396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:39.357396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:39.426589 n-d-master-1 devstack@keystone.service[82007]: INFO dbcounter [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] Registered counter for database keystone Aug 28 00:50:39.448372 n-d-master-1 devstack@keystone.service[82007]: DEBUG oslo_db.sqlalchemy.engines [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:50:39.455563 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writer thread running {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:50:39.637622 n-d-master-1 devstack@keystone.service[82007]: DEBUG passlib.handlers.bcrypt [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82007) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:50:39.638001 n-d-master-1 devstack@keystone.service[82007]: DEBUG passlib.handlers.bcrypt [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82007) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:50:39.694460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:39.696075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:39.827016 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 28 00:50:40.283725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19660822-f563-4cf2-8d34-cfcbcea11fef None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:40.353670 n-d-master-1 devstack@keystone.service[82006]: INFO dbcounter [None req-19660822-f563-4cf2-8d34-cfcbcea11fef None None] Registered counter for database keystone Aug 28 00:50:40.373243 n-d-master-1 devstack@keystone.service[82006]: DEBUG oslo_db.sqlalchemy.engines [None req-19660822-f563-4cf2-8d34-cfcbcea11fef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:50:40.380215 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writer thread running {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:50:40.499210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19660822-f563-4cf2-8d34-cfcbcea11fef None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:40.503799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1a6b4-056d-4657-8418-690da26e6940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:40.504700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1a6b4-056d-4657-8418-690da26e6940 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:40.504978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1a6b4-056d-4657-8418-690da26e6940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:40.505243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1a6b4-056d-4657-8418-690da26e6940 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:40.513454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1a6b4-056d-4657-8418-690da26e6940 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:40.567286 n-d-master-1 devstack@keystone.service[82006]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f6d1a6b4-056d-4657-8418-690da26e6940 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:50:40.567548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1a6b4-056d-4657-8418-690da26e6940 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:40.577763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Sun Aug 28 00:50:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 00:50:40.584716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:40.599767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70f33f-6531-48ab-94f0-ecb754743d59 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:40.604208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1d041-ce54-42b1-9943-27eecf875db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:40.605326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d041-ce54-42b1-9943-27eecf875db5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:40.605611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d041-ce54-42b1-9943-27eecf875db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:40.605915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d041-ce54-42b1-9943-27eecf875db5 admin admin] PATH_INFO: `/v3/projects/651780a5477f4d4a87199d4613e97281` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:40.607486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1d041-ce54-42b1-9943-27eecf875db5 admin admin] RBAC: Authorizing `identity:get_project(project_id=651780a5477f4d4a87199d4613e97281)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:40.661737 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.common.rbac_enforcer.enforcer [None req-48e1d041-ce54-42b1-9943-27eecf875db5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:50:40.662099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1d041-ce54-42b1-9943-27eecf875db5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:40.666887 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Sun Aug 28 00:50:40 2022] GET /identity/v3/projects/651780a5477f4d4a87199d4613e97281 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:42.632108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a6eb-3be5-4b22-9055-3bb27ab5ebb9 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:42.632654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a6eb-3be5-4b22-9055-3bb27ab5ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:42.632654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a6eb-3be5-4b22-9055-3bb27ab5ebb9 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:42.636927 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:42.642384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d04cb-e628-4d9e-9425-342cab3a318f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:42.642825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d04cb-e628-4d9e-9425-342cab3a318f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:42.642912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d04cb-e628-4d9e-9425-342cab3a318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:42.663735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-962d04cb-e628-4d9e-9425-342cab3a318f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:42.665181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-962d04cb-e628-4d9e-9425-342cab3a318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:42.673864 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 00:50:42.946188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87a6eb-3be5-4b22-9055-3bb27ab5ebb9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:42.959125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87a6eb-3be5-4b22-9055-3bb27ab5ebb9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:42.963336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591f36d-909f-4ad0-8c5b-5f28666b31c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:42.963936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591f36d-909f-4ad0-8c5b-5f28666b31c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:42.964218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591f36d-909f-4ad0-8c5b-5f28666b31c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:42.964493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591f36d-909f-4ad0-8c5b-5f28666b31c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:42.972722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591f36d-909f-4ad0-8c5b-5f28666b31c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:42.974546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591f36d-909f-4ad0-8c5b-5f28666b31c6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:42.983245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Sun Aug 28 00:50:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 00:50:42.988996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d04cb-e628-4d9e-9425-342cab3a318f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:42.998181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d04cb-e628-4d9e-9425-342cab3a318f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:43.002607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c15c7d-db40-4f78-b442-7b5030aedeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:43.003238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c15c7d-db40-4f78-b442-7b5030aedeee admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:43.003515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c15c7d-db40-4f78-b442-7b5030aedeee admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:43.003790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c15c7d-db40-4f78-b442-7b5030aedeee admin admin] PATH_INFO: `/v3/users/e9cd3966716148c5879c1ebdf2fbb39a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:43.005092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c15c7d-db40-4f78-b442-7b5030aedeee admin admin] RBAC: Authorizing `identity:get_user(user_id=e9cd3966716148c5879c1ebdf2fbb39a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:43.006961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c15c7d-db40-4f78-b442-7b5030aedeee admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:43.008523 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Sun Aug 28 00:50:42 2022] GET /identity/v3/users/e9cd3966716148c5879c1ebdf2fbb39a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:44.961663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b2025-7e8a-4ab6-9513-767f8c7bf047 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:44.962239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b2025-7e8a-4ab6-9513-767f8c7bf047 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:44.962239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b2025-7e8a-4ab6-9513-767f8c7bf047 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:44.963672 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:44.969128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fc29b-938f-4042-9503-8989ba2a69ab None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:44.969560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fc29b-938f-4042-9503-8989ba2a69ab None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:44.969778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fc29b-938f-4042-9503-8989ba2a69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:44.987529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-559fc29b-938f-4042-9503-8989ba2a69ab None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:44.988707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-559fc29b-938f-4042-9503-8989ba2a69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:45.071687 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 6/11] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:45.092037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eef4f-be32-48b5-afcd-f4d61e978418 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:45.092326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eef4f-be32-48b5-afcd-f4d61e978418 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:45.092605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eef4f-be32-48b5-afcd-f4d61e978418 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:45.094227 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 6/12] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:45.100265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0b2a6-5067-4d31-ac9c-25940aaf06f9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:45.100265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0b2a6-5067-4d31-ac9c-25940aaf06f9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:45.100265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0b2a6-5067-4d31-ac9c-25940aaf06f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:45.119638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b4f0b2a6-5067-4d31-ac9c-25940aaf06f9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:45.120825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b4f0b2a6-5067-4d31-ac9c-25940aaf06f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:45.137803 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:45.190425 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:45.336449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207eef4f-be32-48b5-afcd-f4d61e978418 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:45.466010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0b2a6-5067-4d31-ac9c-25940aaf06f9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:45.479954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207eef4f-be32-48b5-afcd-f4d61e978418 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:45.516306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:45.517160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:45.517441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:45.517716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:45.529476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:45.538394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:45.539367 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:50:45.540807 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:45.545278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:45.575894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0b2a6-5067-4d31-ac9c-25940aaf06f9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:45.586330 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:45.611369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:45.611909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:45.612185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:45.612455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:45.633304 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:45.659768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907950a-d688-4fb2-96ff-7f6d5a8cce42 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:45.681482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:45.683126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:45.695922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:45.696542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:45.696817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:45.697090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:45.697762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:45.698096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:45.699467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:45.711861 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:45.717108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:45.787581 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:50:45.793187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:45.810819 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:45.817493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1d4a7-2ac3-408f-80f5-cedf3ae6ae04 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:45.846803 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:45.853185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:45.853839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:45.854122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:45.854412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] PATH_INFO: `/v3/users/e9cd3966716148c5879c1ebdf2fbb39a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:45.855950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] RBAC: Authorizing `identity:get_user(user_id=e9cd3966716148c5879c1ebdf2fbb39a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:45.857399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:45.859340 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:50:45 2022] GET /identity/v3/users/e9cd3966716148c5879c1ebdf2fbb39a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:45.864816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:45.896859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b42b2-e27d-4c38-b71a-dbc671f4865b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:45.931428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:45.932056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:45.932336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:45.932608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:45.943523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:45.944982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:45.962992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:45.964116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:45.965140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:45.965140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:45.965140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:50:45.965140 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:50:45.969797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665cf83-ab27-440a-bc5d-3f638c45a99d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:45.970849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:46.003485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:46.004119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:46.004400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:46.004668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:46.005962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:46.007395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:46.009038 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:46.014890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:46.046443 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:46.075416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a9dcf-91eb-43bb-9888-15a2709e1876 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:46.078314 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:46.110397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bcaa0-e26c-4f1a-abe8-adfad6dbc6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:46.111001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcaa0-e26c-4f1a-abe8-adfad6dbc6b3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:46.111287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcaa0-e26c-4f1a-abe8-adfad6dbc6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:46.111562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcaa0-e26c-4f1a-abe8-adfad6dbc6b3 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:46.112207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bcaa0-e26c-4f1a-abe8-adfad6dbc6b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:46.112512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bcaa0-e26c-4f1a-abe8-adfad6dbc6b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:46.113953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bcaa0-e26c-4f1a-abe8-adfad6dbc6b3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:46.117779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e151a-72ad-4386-93b4-5087ec4eda96 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:46.131448 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:46.156465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacd472-96d4-42d6-aa77-ffc07b2d3cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:46.157332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacd472-96d4-42d6-aa77-ffc07b2d3cef None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:46.157619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacd472-96d4-42d6-aa77-ffc07b2d3cef None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:46.157933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacd472-96d4-42d6-aa77-ffc07b2d3cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:46.158690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacd472-96d4-42d6-aa77-ffc07b2d3cef None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.domain.id=default, user.id=e9cd3966716148c5879c1ebdf2fbb39a) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:46.159004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacd472-96d4-42d6-aa77-ffc07b2d3cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:46.160565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacd472-96d4-42d6-aa77-ffc07b2d3cef None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:46.170178 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Sun Aug 28 00:50:46 2022] GET /identity/v3/role_assignments?user.id=e9cd3966716148c5879c1ebdf2fbb39a&scope.domain.id=default&role.id=6ef968d350d64b4496757a252fa42707 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:48.226844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4bb88-85f4-4808-854d-6421a4423ab2 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.227367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4bb88-85f4-4808-854d-6421a4423ab2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.227476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4bb88-85f4-4808-854d-6421a4423ab2 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.228953 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:48.234526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28b62-257b-4f26-9d08-b1a89995be73 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.234997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28b62-257b-4f26-9d08-b1a89995be73 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.235271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28b62-257b-4f26-9d08-b1a89995be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.260476 n-d-master-1 devstack@keystone.service[82006]: DEBUG passlib.handlers.bcrypt [None req-f7a28b62-257b-4f26-9d08-b1a89995be73 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82006) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:50:48.260911 n-d-master-1 devstack@keystone.service[82006]: DEBUG passlib.handlers.bcrypt [None req-f7a28b62-257b-4f26-9d08-b1a89995be73 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82006) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:50:48.307252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f7a28b62-257b-4f26-9d08-b1a89995be73 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:48.308878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f7a28b62-257b-4f26-9d08-b1a89995be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:48.416162 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:48.659322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861185-9d97-46fa-b60e-2668dcd422d4 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.660037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861185-9d97-46fa-b60e-2668dcd422d4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.660542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32861185-9d97-46fa-b60e-2668dcd422d4 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.662189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:48.668248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cbf2-1e35-4e1a-9f32-bba27a1289a8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.668848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cbf2-1e35-4e1a-9f32-bba27a1289a8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.669324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cbf2-1e35-4e1a-9f32-bba27a1289a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.694896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d024cbf2-1e35-4e1a-9f32-bba27a1289a8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:48.696513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d024cbf2-1e35-4e1a-9f32-bba27a1289a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:48.725192 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:48.777143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dc510-087f-4dce-b44e-5b2e433b4ce7 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.777461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dc510-087f-4dce-b44e-5b2e433b4ce7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.777702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dc510-087f-4dce-b44e-5b2e433b4ce7 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.779114 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 13/25] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:50:48.784317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53797cf-e44a-4007-81ed-4c765b4e3583 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.784605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53797cf-e44a-4007-81ed-4c765b4e3583 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.784886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53797cf-e44a-4007-81ed-4c765b4e3583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.812679 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 13/26] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:48.813612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f53797cf-e44a-4007-81ed-4c765b4e3583 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:48.814955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f53797cf-e44a-4007-81ed-4c765b4e3583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:48.913564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18945e25-9eed-4503-a6c3-1bd4930d4916 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.913873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18945e25-9eed-4503-a6c3-1bd4930d4916 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.914074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18945e25-9eed-4503-a6c3-1bd4930d4916 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.915450 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 14/27] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:50:48.916456 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 14/28] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:50:48.920998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa962492-5dd9-4568-940f-2595702e2d44 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.921840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa962492-5dd9-4568-940f-2595702e2d44 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.922122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa962492-5dd9-4568-940f-2595702e2d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.946261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aa962492-5dd9-4568-940f-2595702e2d44 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:48.947467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aa962492-5dd9-4568-940f-2595702e2d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:49.010912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53797cf-e44a-4007-81ed-4c765b4e3583 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:49.080437 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 15/29] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:50:49.157526 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:49.174545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53797cf-e44a-4007-81ed-4c765b4e3583 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:49.219512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:49.220521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:49.221012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:49.221491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:49.240458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:49.247699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa962492-5dd9-4568-940f-2595702e2d44 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:49.248404 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:49.249231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:49.250566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:50:49.252823 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 15/30] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:50:49.258788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:49.425596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650467-0b04-442b-a2a8-0df9560d40fc None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:49.442915 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:49.474573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa962492-5dd9-4568-940f-2595702e2d44 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:49.497328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:49.498073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:49.498351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:49.500388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:49.501196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:49.501504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:49.502939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:49.519695 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 16/31] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:49.525303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:49.529541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:49.530261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:49.530532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:49.531031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:49.531734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:49.533173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:49.547985 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:49.631618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d13389-7ef5-47be-80e6-dbef3e3410b6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:49.674703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:49.675574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:49.676102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:49.676521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:49.689182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:49.691096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:50:49.707245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:49.708360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:50:49.709363 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:50:49.709363 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:50:49.709363 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:50:49.710822 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 17/32] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:49.711784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:49.771660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 16/33] 10.222.0.59 () {60 vars in 1131 bytes} [Sun Aug 28 00:50:49 2022] POST /identity/v3/roles => generated 219 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:50:49.772945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:49.813904 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:49.864547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b266-6d81-4b11-b927-7600baf4a837 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:49.895754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f5217-8939-45ce-8811-3926fab96032 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:49.913114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a61ba4-dd14-4601-a79e-6bc998193b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:49.913831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61ba4-dd14-4601-a79e-6bc998193b50 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:49.914269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61ba4-dd14-4601-a79e-6bc998193b50 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:49.914556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61ba4-dd14-4601-a79e-6bc998193b50 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:49.915706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a61ba4-dd14-4601-a79e-6bc998193b50 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:49.917508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a61ba4-dd14-4601-a79e-6bc998193b50 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:49.942433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:49.942433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:49.942433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:49.942433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] PATH_INFO: `/v3/users/e9cd3966716148c5879c1ebdf2fbb39a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:49.943259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cd3966716148c5879c1ebdf2fbb39a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:49.944912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:49.946869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 17/34] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:50:49 2022] GET /identity/v3/users/e9cd3966716148c5879c1ebdf2fbb39a => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:49.947497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:49.964978 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:50.057251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65836c-dc72-4773-a960-ead34bb655a8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:50.093936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:50.094507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.094787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.095062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.095734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:50.096033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:50.097404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:50.118107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 18/35] 10.222.0.59 () {60 vars in 1131 bytes} [Sun Aug 28 00:50:49 2022] POST /identity/v3/roles => generated 225 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:50:50.125338 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 18/36] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:50.125338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:50.131654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2b0c-ef84-4c82-aa2e-1579f42eb3ca None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.132288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2b0c-ef84-4c82-aa2e-1579f42eb3ca None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.132800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2b0c-ef84-4c82-aa2e-1579f42eb3ca None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.134541 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 19/37] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:50 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:50.136476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b2b0c-ef84-4c82-aa2e-1579f42eb3ca None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:50.237521 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:50.276437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3fea3-1729-4dec-8cae-5af3b08313c4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:50.278101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b2b0c-ef84-4c82-aa2e-1579f42eb3ca None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:50.308166 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:50.320271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82697-ae77-461e-b93e-747c1573231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:50.320897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82697-ae77-461e-b93e-747c1573231f None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.321183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82697-ae77-461e-b93e-747c1573231f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.321464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82697-ae77-461e-b93e-747c1573231f None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.322171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a82697-ae77-461e-b93e-747c1573231f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:50.324863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a82697-ae77-461e-b93e-747c1573231f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:50.326267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ad447-0ed4-4375-8b71-ea51b4dbb103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:50.327175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ad447-0ed4-4375-8b71-ea51b4dbb103 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.328365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ad447-0ed4-4375-8b71-ea51b4dbb103 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.329085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ad447-0ed4-4375-8b71-ea51b4dbb103 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.330777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ad447-0ed4-4375-8b71-ea51b4dbb103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:50.332316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ad447-0ed4-4375-8b71-ea51b4dbb103 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:50.334263 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 19/38] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:50.335566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b5dea-85d3-4c16-847e-2d6943a9a2b9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.335858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b5dea-85d3-4c16-847e-2d6943a9a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.336141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b5dea-85d3-4c16-847e-2d6943a9a2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.356376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b38b5dea-85d3-4c16-847e-2d6943a9a2b9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:50.357985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b38b5dea-85d3-4c16-847e-2d6943a9a2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:50.426234 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 20/39] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:50.427568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956634f9-5216-4a70-a58f-6ea7ad0bdee3 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.427884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956634f9-5216-4a70-a58f-6ea7ad0bdee3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.428140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956634f9-5216-4a70-a58f-6ea7ad0bdee3 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.429425 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 21/40] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:50.434777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956634f9-5216-4a70-a58f-6ea7ad0bdee3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:50.462699 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:50:50 2022] POST /identity/v3/projects => generated 301 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:50:50.464220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa36b2-a599-44bb-bb28-6d2207be8d8e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.464515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa36b2-a599-44bb-bb28-6d2207be8d8e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.464790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa36b2-a599-44bb-bb28-6d2207be8d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.498435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-44fa36b2-a599-44bb-bb28-6d2207be8d8e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:50.501359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-44fa36b2-a599-44bb-bb28-6d2207be8d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:50.548396 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:50.571497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956634f9-5216-4a70-a58f-6ea7ad0bdee3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:50.597031 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 21/42] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:50.612288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:50.612969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.613282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.613538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] PATH_INFO: `/v3/domains/default/users/e9cd3966716148c5879c1ebdf2fbb39a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.616060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e9cd3966716148c5879c1ebdf2fbb39a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:50.617553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:50.706853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa36b2-a599-44bb-bb28-6d2207be8d8e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:50.728358 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 22/43] 10.222.0.59 () {58 vars in 1361 bytes} [Sun Aug 28 00:50:50 2022] PUT /identity/v3/domains/default/users/e9cd3966716148c5879c1ebdf2fbb39a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:50:50.879757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:50.947571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa36b2-a599-44bb-bb28-6d2207be8d8e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:50.960521 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:50.986977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e26d5f-fcb4-4c5d-8f7d-5db5c64c85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:50.987597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26d5f-fcb4-4c5d-8f7d-5db5c64c85ba None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:50.987882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26d5f-fcb4-4c5d-8f7d-5db5c64c85ba None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:50.988166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26d5f-fcb4-4c5d-8f7d-5db5c64c85ba None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:50.988836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e26d5f-fcb4-4c5d-8f7d-5db5c64c85ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:50.990328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e26d5f-fcb4-4c5d-8f7d-5db5c64c85ba None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:50.994729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd84f12-d394-4f52-a837-4411663217d7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:51.025086 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:51.029899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:51.030582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:51.030868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:51.031148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:51.032253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:51.033731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:51.039626 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 23/44] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:51.040964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:51.079248 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1131 bytes} [Sun Aug 28 00:50:50 2022] POST /identity/v3/roles => generated 223 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:50:51.155327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04d6d0-ad21-4995-aa2e-e0050ee5c122 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:51.196211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a72a6-0f6f-45c9-bad2-5f9391d6cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:51.196856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a72a6-0f6f-45c9-bad2-5f9391d6cf39 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:51.197141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a72a6-0f6f-45c9-bad2-5f9391d6cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:51.197414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a72a6-0f6f-45c9-bad2-5f9391d6cf39 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:51.198127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a72a6-0f6f-45c9-bad2-5f9391d6cf39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:51.199615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a72a6-0f6f-45c9-bad2-5f9391d6cf39 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:51.302665 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:50:51 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:50:52.667965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ff96-6c13-4144-85d3-0f3e6b686938 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:52.668461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ff96-6c13-4144-85d3-0f3e6b686938 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:52.668461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ff96-6c13-4144-85d3-0f3e6b686938 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:52.670022 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 23/47] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:52.675870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0b97e-8c17-4c27-860e-41829e3e766c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:52.676278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0b97e-8c17-4c27-860e-41829e3e766c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:52.676441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0b97e-8c17-4c27-860e-41829e3e766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:52.695303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-35e0b97e-8c17-4c27-860e-41829e3e766c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:52.696490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-35e0b97e-8c17-4c27-860e-41829e3e766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:52.743179 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:52.764046 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 25/48] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:53.033953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ff96-6c13-4144-85d3-0f3e6b686938 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:53.135388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ff96-6c13-4144-85d3-0f3e6b686938 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:53.168967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd6a15-2e8a-4e52-abca-c6659ca65f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:53.169600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd6a15-2e8a-4e52-abca-c6659ca65f79 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.169922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd6a15-2e8a-4e52-abca-c6659ca65f79 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.170201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd6a15-2e8a-4e52-abca-c6659ca65f79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.181215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd6a15-2e8a-4e52-abca-c6659ca65f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-41fd6a15-2e8a-4e52-abca-c6659ca65f79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:50:53.186083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:50:53.186979 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:50:53.188011 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 24/49] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:50:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:50:53.193155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0b97e-8c17-4c27-860e-41829e3e766c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:53.290539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5b5a-613a-4fb3-803e-35745f7293f7 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.290766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5b5a-613a-4fb3-803e-35745f7293f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.291040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de5b5a-613a-4fb3-803e-35745f7293f7 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.292441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 25/50] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:53.294967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0b97e-8c17-4c27-860e-41829e3e766c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:53.298182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3191f6-8730-452c-86b3-faf809096776 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.298485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3191f6-8730-452c-86b3-faf809096776 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.298768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3191f6-8730-452c-86b3-faf809096776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.316736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0b3191f6-8730-452c-86b3-faf809096776 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:53.318024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0b3191f6-8730-452c-86b3-faf809096776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:53.330747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:53.331364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.331647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.331921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.332589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:53.332899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:53.334367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:53.342629 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 26/51] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:50:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:53.344252 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:53.348622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:53.387659 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 26/52] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:50:53.401099 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:53.566190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634837-a663-4e98-916e-15c7b66e9726 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:53.600574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:53.601211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.601498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.601776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] PATH_INFO: `/v3/users/e9cd3966716148c5879c1ebdf2fbb39a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.602987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] RBAC: Authorizing `identity:get_user(user_id=e9cd3966716148c5879c1ebdf2fbb39a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:53.604436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:53.606099 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 27/53] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:50:53 2022] GET /identity/v3/users/e9cd3966716148c5879c1ebdf2fbb39a => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:53.612575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3191f6-8730-452c-86b3-faf809096776 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:53.659746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:53.717480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3191f6-8730-452c-86b3-faf809096776 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:53.751539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:53.752171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.752456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.752734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.753904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:53.755373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:53.756983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 27/54] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:53.762660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:53.764977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceea5b-0164-465b-965d-7690af05f19a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:53.777771 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:53.791143 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:53.799027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:53.799660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.799941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.800218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.801325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:53.802893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:53.804489 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 28/55] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:53.810144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:53.864922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea201-bfbf-445b-a7a8-ae8361eb19cc None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:53.901535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865730d-b48e-4f7f-96c4-737501143c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:53.902167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865730d-b48e-4f7f-96c4-737501143c5b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.902449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865730d-b48e-4f7f-96c4-737501143c5b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.902730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865730d-b48e-4f7f-96c4-737501143c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.903450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865730d-b48e-4f7f-96c4-737501143c5b None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.domain.id=default, user.id=e9cd3966716148c5879c1ebdf2fbb39a) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:50:53.903756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865730d-b48e-4f7f-96c4-737501143c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:53.905210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865730d-b48e-4f7f-96c4-737501143c5b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:53.912495 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 28/56] 10.222.0.59 () {56 vars in 1322 bytes} [Sun Aug 28 00:50:53 2022] GET /identity/v3/role_assignments?user.id=e9cd3966716148c5879c1ebdf2fbb39a&scope.domain.id=default&role.id=6ef968d350d64b4496757a252fa42707 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:50:53.915791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ce834-329f-46d9-8eb0-3a0e1aa3cc4b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:53.954814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78abf61-043a-450b-9726-b1d5ff818add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:53.955438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abf61-043a-450b-9726-b1d5ff818add None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:53.955722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abf61-043a-450b-9726-b1d5ff818add None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:53.955997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abf61-043a-450b-9726-b1d5ff818add None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:53.956690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78abf61-043a-450b-9726-b1d5ff818add None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:53.958204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78abf61-043a-450b-9726-b1d5ff818add None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:54.045661 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 29/57] 10.222.0.59 () {60 vars in 1140 bytes} [Sun Aug 28 00:50:53 2022] POST /identity/v3/projects => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:50:56.013058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c790b-fcef-4df5-9d8b-7b67a33a070a None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:56.013620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c790b-fcef-4df5-9d8b-7b67a33a070a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:56.013620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c790b-fcef-4df5-9d8b-7b67a33a070a None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:56.015071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 29/58] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:56.020533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b72bcb-74fe-4f41-b477-337802438904 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:56.020957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b72bcb-74fe-4f41-b477-337802438904 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:56.021084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b72bcb-74fe-4f41-b477-337802438904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:56.039068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-69b72bcb-74fe-4f41-b477-337802438904 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:56.040261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69b72bcb-74fe-4f41-b477-337802438904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:56.065896 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:56.106481 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 30/59] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:50:56.380981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c790b-fcef-4df5-9d8b-7b67a33a070a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:56.473931 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:56.483289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c790b-fcef-4df5-9d8b-7b67a33a070a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:56.515832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e12f4c-ebee-4ae8-bfd9-91489b89ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:56.516443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12f4c-ebee-4ae8-bfd9-91489b89ac6d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:56.516727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12f4c-ebee-4ae8-bfd9-91489b89ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:56.516996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12f4c-ebee-4ae8-bfd9-91489b89ac6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:56.518179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e12f4c-ebee-4ae8-bfd9-91489b89ac6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:56.519629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e12f4c-ebee-4ae8-bfd9-91489b89ac6d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:56.521207 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 30/60] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:50:56.526991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b72bcb-74fe-4f41-b477-337802438904 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:56.623722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b72bcb-74fe-4f41-b477-337802438904 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:56.659530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc39f3-d7ca-495c-9634-9f190482047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:56.660074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc39f3-d7ca-495c-9634-9f190482047a None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:56.660361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc39f3-d7ca-495c-9634-9f190482047a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:56.660641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc39f3-d7ca-495c-9634-9f190482047a None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:56.661308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc39f3-d7ca-495c-9634-9f190482047a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:56.662893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc39f3-d7ca-495c-9634-9f190482047a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:56.844312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 31/61] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:50:56 2022] POST /identity/v3/users => generated 275 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:00.021391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699368b2-109b-4e8a-a7f7-c5d75a075981 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.022471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699368b2-109b-4e8a-a7f7-c5d75a075981 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.022958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699368b2-109b-4e8a-a7f7-c5d75a075981 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.024547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 31/62] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:00.029983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d570-0b1c-4c2d-bb2c-f37058ea7c09 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.032065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d1da-dcb2-4631-8fa3-4374baec83b9 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.032595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d1da-dcb2-4631-8fa3-4374baec83b9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.033067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d1da-dcb2-4631-8fa3-4374baec83b9 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.034661 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 32/63] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:00.035100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d570-0b1c-4c2d-bb2c-f37058ea7c09 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.035588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065d570-0b1c-4c2d-bb2c-f37058ea7c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.039791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22132-c139-4f82-b90e-97e947c9582e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.040323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22132-c139-4f82-b90e-97e947c9582e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.040798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe22132-c139-4f82-b90e-97e947c9582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.070156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fbe22132-c139-4f82-b90e-97e947c9582e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:00.071864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fbe22132-c139-4f82-b90e-97e947c9582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:00.078368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c065d570-0b1c-4c2d-bb2c-f37058ea7c09 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:00.081015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c065d570-0b1c-4c2d-bb2c-f37058ea7c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:00.103501 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:00.160616 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 32/64] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:00.162349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e6a9e-761c-4056-8237-a62b6260edd2 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.162869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e6a9e-761c-4056-8237-a62b6260edd2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.163341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e6a9e-761c-4056-8237-a62b6260edd2 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.164090 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 33/65] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:00.165200 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 33/66] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:00.171404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576d209-c14a-4ca7-bfd7-79b8aa840b96 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.171699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576d209-c14a-4ca7-bfd7-79b8aa840b96 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.171981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576d209-c14a-4ca7-bfd7-79b8aa840b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.200768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1576d209-c14a-4ca7-bfd7-79b8aa840b96 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:00.202001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1576d209-c14a-4ca7-bfd7-79b8aa840b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:00.300566 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 34/67] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:00.431193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e6a9e-761c-4056-8237-a62b6260edd2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:00.490651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08e4d-b7f8-457f-8c8e-35a44e40f605 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.491325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08e4d-b7f8-457f-8c8e-35a44e40f605 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.491797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08e4d-b7f8-457f-8c8e-35a44e40f605 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.493378 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 35/68] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:00.499711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa61cf-935a-4a07-8e3c-210a3bac4df7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.500002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa61cf-935a-4a07-8e3c-210a3bac4df7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.500280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa61cf-935a-4a07-8e3c-210a3bac4df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.534577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a1aa61cf-935a-4a07-8e3c-210a3bac4df7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:00.536335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1aa61cf-935a-4a07-8e3c-210a3bac4df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:00.552466 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:00.584704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e6a9e-761c-4056-8237-a62b6260edd2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:00.608156 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 36/69] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:00.609785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e50089-0b37-467d-bdd9-bc3d4e4b6571 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.610494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e50089-0b37-467d-bdd9-bc3d4e4b6571 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.610778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e50089-0b37-467d-bdd9-bc3d4e4b6571 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.616193 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 37/70] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:00.616193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e50089-0b37-467d-bdd9-bc3d4e4b6571 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:00.635174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528ca76-e8b5-4590-a86e-a3a70f33cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:00.636255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ca76-e8b5-4590-a86e-a3a70f33cde6 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.636682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ca76-e8b5-4590-a86e-a3a70f33cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.637366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ca76-e8b5-4590-a86e-a3a70f33cde6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.651901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528ca76-e8b5-4590-a86e-a3a70f33cde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-3528ca76-e8b5-4590-a86e-a3a70f33cde6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:00.658571 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:00.659616 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:00.660552 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:00.663745 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 34/71] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:00.671614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ed7d-73e2-42f1-b7de-f07fb6209812 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.672086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ed7d-73e2-42f1-b7de-f07fb6209812 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.672593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ed7d-73e2-42f1-b7de-f07fb6209812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.693801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b2a7ed7d-73e2-42f1-b7de-f07fb6209812 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:00.695166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2a7ed7d-73e2-42f1-b7de-f07fb6209812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:00.697214 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:00.738085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e50089-0b37-467d-bdd9-bc3d4e4b6571 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:00.769023 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 35/72] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:00.769994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7ed7d-73e2-42f1-b7de-f07fb6209812 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:00.776779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:00.777672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.778173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.778653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.790602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:00.795740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:00.797259 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:00.798122 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:00.800338 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 38/73] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:00.806047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:00.819349 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:00.883884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7ed7d-73e2-42f1-b7de-f07fb6209812 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:00.915326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ca45-9409-4b3f-9530-38a89d4ff55e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:00.920634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:00.921791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.922129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.922471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.923144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:00.923876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:00.925648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:00.931788 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:00.935826 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 36/74] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:00.941916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:00.951381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:00.951991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.952321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.952598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.963563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:00.968512 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:00.969395 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 39/75] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:00.970574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.044502 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.059417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2456e-a71f-40be-acd0-e39eb93a2b04 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.075721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9662-c32d-40b5-9aa1-74bf9ea2fc1d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.094119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.094750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.095032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.095303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.095975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:01.096278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.097663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.106046 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 37/76] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:01.106760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.115557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.116201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.116488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.116769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.117922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.119402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.120998 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 40/77] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:01.121756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.173668 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.213648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66e34f-7b41-48e8-b536-7e42cd9053ae None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.223440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fd4d-b15a-4db1-89c7-1e7b76b316b1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.246506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.247196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.247484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.247763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.258171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.258786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.259054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.259327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.259994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:01.260298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.261672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.263215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.264658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.267526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 38/78] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:01.267643 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.268074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.276772 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 41/79] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:01.276772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.368405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd254ded-5c07-4503-be47-ec7bd1930643 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.379819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def5a1-34a5-4008-9213-a7841ae503fc None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.390930 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.409266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.409947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.410233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.410510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.418480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.419150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.419445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.419727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] PATH_INFO: `/v3/users/e9cd3966716148c5879c1ebdf2fbb39a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.420869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:01.421007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cd3966716148c5879c1ebdf2fbb39a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.423020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.424680 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 42/80] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/users/e9cd3966716148c5879c1ebdf2fbb39a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:01.425434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:01.425913 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:01.426904 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:01.428068 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 39/81] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:01.430496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.501214 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.535725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b5eb3-3424-43fb-b567-44df70f981f9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.536118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6398b-1843-4916-96f8-73dcee574bf8 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.570117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.570397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.570723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.570995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.571098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.571270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.571368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.571535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.572177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.573634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.625186 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.643593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.645062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.660651 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 43/82] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:01 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:01.662155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.759515 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 40/83] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:01.760390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.793463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79524c-d5ed-479d-bfb4-fa31564a1e13 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.822759 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.837068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.837714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.838076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.838357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.840044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.841557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.843668 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 44/84] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:01.844528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.854989 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.875491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7c4c-2635-4d5b-96d7-2b4e9f3b0758 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.914735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.915369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.915658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.915944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.971436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd1f9-b9e0-403e-bc91-d1c0d4049122 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.019471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.020633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.020919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.021476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.022538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:02.022862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.024960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.035767 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 45/85] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:02.036641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.038993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.040725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.115345 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:02.149052 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:02.170942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b57e3-5bdc-49e2-9838-6a54416e387d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.173546 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 41/86] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:02.178496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.216029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.216910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.217305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.218646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.219829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.221300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.223062 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 46/87] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:02.224404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.296767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903cabf-0ce9-4e1a-b958-264776627805 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.337835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.338534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.338826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.339115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.365038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9eae5b-8403-4b40-810b-10c5c1693b1b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.389066 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:02.406019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.406019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.406019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.406019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.406384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.406645 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:02.407237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.409752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 47/88] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:02.410775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.432403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.433989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.518696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a52a62-3494-4cf1-bc9a-fd94d1fa5fd6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.559966 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 42/89] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:02.561195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.564670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.566187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.566679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.567154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.568564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.570286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.572466 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 48/90] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:02.573502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.637266 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:02.662844 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:02.683051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aef8e-1783-4cf9-a795-71c97c3def42 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.685318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6a17d-bbc1-4437-b3d3-c52a25e93e59 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.721725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.722637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.722944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.723226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.724069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] RBAC: Adding query filter params (role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=1bf5e8c2f99d4f90b8f75c87bbe55274) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:02.724385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.724794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.725679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.725887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.726392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.726857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.731828 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 43/91] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/role_assignments?user.id=1bf5e8c2f99d4f90b8f75c87bbe55274&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:02.732633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.814527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.816390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.887802 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:02.929862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fee0f2-8829-489b-a4fd-993dfeb2c663 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:02.958587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 49/92] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:02.959349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:02.979402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:02.980057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:02.980345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:02.980624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:02.981947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:02.983491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:02.985474 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 44/93] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:02.986375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:03.007493 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:03.113038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9358c87-eb7f-4b12-b59d-650301d4c7dd None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:03.167087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:03.168849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:03.169933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:03.170614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] PATH_INFO: `/v3/projects/01132bd325044f4e90a80f171f83404e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:03.175053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b1087-bb1e-4755-a745-d4159c154d74 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:03.175596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] RBAC: Authorizing `identity:get_project(project_id=01132bd325044f4e90a80f171f83404e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:03.177287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:03.180649 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 45/94] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/projects/01132bd325044f4e90a80f171f83404e => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:03.181878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:03.254772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:03.257099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:03.257590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:03.258118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:03.260024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=e9cd3966716148c5879c1ebdf2fbb39a) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:03.263069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:03.264596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:03.271689 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 50/95] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:02 2022] GET /identity/v3/role_assignments?user.id=e9cd3966716148c5879c1ebdf2fbb39a&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:03.272470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:03.300513 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:03.319357 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:03.344311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812a4f2-6c1b-45fb-b03c-0d7481d690c0 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:03.382839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbbd05-a44d-4431-a957-b7e1e7ad1285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:03.383824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbbd05-a44d-4431-a957-b7e1e7ad1285 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:03.384654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbbd05-a44d-4431-a957-b7e1e7ad1285 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:03.385148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbbd05-a44d-4431-a957-b7e1e7ad1285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:03.386204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbbd05-a44d-4431-a957-b7e1e7ad1285 None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=1bf5e8c2f99d4f90b8f75c87bbe55274) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:03.386732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbbd05-a44d-4431-a957-b7e1e7ad1285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:03.388497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbbd05-a44d-4431-a957-b7e1e7ad1285 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:03.402844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 46/96] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:03 2022] GET /identity/v3/role_assignments?user.id=1bf5e8c2f99d4f90b8f75c87bbe55274&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:03.448284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c1b9-b038-4e63-b153-4747e3891c5b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:03.500508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561f8b9-fd04-4cb6-b735-8e3d719c6333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:03.500949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561f8b9-fd04-4cb6-b735-8e3d719c6333 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:03.501240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561f8b9-fd04-4cb6-b735-8e3d719c6333 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:03.501523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561f8b9-fd04-4cb6-b735-8e3d719c6333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:03.502333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561f8b9-fd04-4cb6-b735-8e3d719c6333 None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=01132bd325044f4e90a80f171f83404e, user.id=1bf5e8c2f99d4f90b8f75c87bbe55274) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:03.502652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561f8b9-fd04-4cb6-b735-8e3d719c6333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:03.504185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561f8b9-fd04-4cb6-b735-8e3d719c6333 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:03.511442 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 51/97] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:03 2022] GET /identity/v3/role_assignments?user.id=1bf5e8c2f99d4f90b8f75c87bbe55274&scope.project.id=01132bd325044f4e90a80f171f83404e&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:04.039476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac182e02-9026-427f-8386-76cf6af98956 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.040130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac182e02-9026-427f-8386-76cf6af98956 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.040610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac182e02-9026-427f-8386-76cf6af98956 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.042242 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 47/98] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:04.048768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac9f8-b233-443e-b45d-6924068ac968 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.049295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac9f8-b233-443e-b45d-6924068ac968 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.049838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ac9f8-b233-443e-b45d-6924068ac968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.073545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d34ac9f8-b233-443e-b45d-6924068ac968 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:04.075126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d34ac9f8-b233-443e-b45d-6924068ac968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:04.173429 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 52/99] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:04.272587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029caf-031c-414c-af05-680f1d279d6d None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.273128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029caf-031c-414c-af05-680f1d279d6d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.273128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029caf-031c-414c-af05-680f1d279d6d None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.274722 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 48/100] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:04.283072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f10e-198a-423e-a397-b23647ac972b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.283945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f10e-198a-423e-a397-b23647ac972b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.284449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f10e-198a-423e-a397-b23647ac972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.310002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f1f2f10e-198a-423e-a397-b23647ac972b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:04.312202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1f2f10e-198a-423e-a397-b23647ac972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:04.329774 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:04.410329 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 53/101] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:04.518577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029caf-031c-414c-af05-680f1d279d6d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:04.632126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029caf-031c-414c-af05-680f1d279d6d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:04.669625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:04.670305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.670596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.671675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.672834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:04.674322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:04.676004 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 49/102] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:04.681598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f10e-198a-423e-a397-b23647ac972b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:04.817633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f10e-198a-423e-a397-b23647ac972b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:04.865104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:04.866036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.866498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.866976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.867804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:04.869460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:04.931516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:04.940885 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:04.950105 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 54/103] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/projects => generated 302 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:04.956495 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:05.085227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd083de6-ff29-4db5-97e1-e2bd7c196079 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.134566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee6b7-c129-476b-9c11-d5f38b1dd631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.135223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee6b7-c129-476b-9c11-d5f38b1dd631 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.135508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee6b7-c129-476b-9c11-d5f38b1dd631 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.135786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee6b7-c129-476b-9c11-d5f38b1dd631 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.154080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ee6b7-c129-476b-9c11-d5f38b1dd631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-447ee6b7-c129-476b-9c11-d5f38b1dd631 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:05.159686 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:05.160544 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:05.161312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 50/104] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:05.167128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.306054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383a28f-553d-4e5b-95b8-4bf1a86e2cc5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.348476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340a36c-b9e2-4778-b4f0-82cbb72da51f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.348993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340a36c-b9e2-4778-b4f0-82cbb72da51f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.349097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340a36c-b9e2-4778-b4f0-82cbb72da51f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.350545 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 51/105] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:05.357061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e854-ef92-417e-907b-752448417028 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.357363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e854-ef92-417e-907b-752448417028 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.357863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e854-ef92-417e-907b-752448417028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.362770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.363394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.363681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.363957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.364635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] RBAC: Adding query filter params (name=reader) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:05.364943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.366377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.384373 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 55/106] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:05.393055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.394386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aec1e854-ef92-417e-907b-752448417028 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:05.395605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aec1e854-ef92-417e-907b-752448417028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.487560 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 52/107] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:05.550185 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:05.616693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a82809-fc31-408f-b69a-ecb0c6b175df None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.667564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.668205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.668488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.668766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] PATH_INFO: `/v3/users/d2da160ee1dd45a3beb29a63da5612bd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.692238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] RBAC: Authorizing `identity:get_user(user_id=d2da160ee1dd45a3beb29a63da5612bd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.693704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.695782 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 56/108] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:05 2022] GET /identity/v3/users/d2da160ee1dd45a3beb29a63da5612bd => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:05.701286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e854-ef92-417e-907b-752448417028 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.704882 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:05.833420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e854-ef92-417e-907b-752448417028 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.871183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.872160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.872634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.873095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.878958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.954354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.956416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.958603 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.073692 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 53/109] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:06.081398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:06.113838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6428f8-5504-49b1-8a4a-cabeb344622e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:06.182278 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.247155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:06.247831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.248109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.248394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.257917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874a81-8a71-45b7-9336-668323f75756 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:06.260022 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.282814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:06.287765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:06.288654 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:06.289411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:06.293610 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 57/110] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:06.294554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:06.351911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:06.352559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.352842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.353123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.358623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:06.360094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:06.361846 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 54/111] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:06 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:06.371120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:06.564090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c80a9-fa6e-49f7-b9f9-3a22bc4ed16a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:06.613339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e29676-3433-4cab-90ea-369435acc2a9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:06.620835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abad698-5356-4a5a-868b-5c062ca66007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:06.621448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abad698-5356-4a5a-868b-5c062ca66007 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.621872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abad698-5356-4a5a-868b-5c062ca66007 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.622157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abad698-5356-4a5a-868b-5c062ca66007 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.622830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abad698-5356-4a5a-868b-5c062ca66007 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:06.623132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abad698-5356-4a5a-868b-5c062ca66007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:06.625306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abad698-5356-4a5a-868b-5c062ca66007 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:06.634635 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 58/112] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:06.635781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b5f7-967d-430a-8c31-9977c1a37ecf None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.636067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b5f7-967d-430a-8c31-9977c1a37ecf None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.636339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b5f7-967d-430a-8c31-9977c1a37ecf None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.637774 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 59/113] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:06.638694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5808-c67a-4d50-b6fc-4c387568564e None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.639158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5808-c67a-4d50-b6fc-4c387568564e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.639281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d5808-c67a-4d50-b6fc-4c387568564e None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.641363 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 60/114] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:06.642374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e410-d1b6-4a01-ae76-c0fab34d6e87 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.642660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e410-d1b6-4a01-ae76-c0fab34d6e87 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.642934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e410-d1b6-4a01-ae76-c0fab34d6e87 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.648177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 61/115] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:06.648985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4e410-d1b6-4a01-ae76-c0fab34d6e87 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:06.657957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4a376-6cbb-4383-aa2a-370ae626b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:06.658630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4a376-6cbb-4383-aa2a-370ae626b747 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.658920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4a376-6cbb-4383-aa2a-370ae626b747 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.659197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4a376-6cbb-4383-aa2a-370ae626b747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.659932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4a376-6cbb-4383-aa2a-370ae626b747 None admin] RBAC: Adding query filter params (role.id=0c6e2ebeb67d499588437086fbe9fc5d, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=d2da160ee1dd45a3beb29a63da5612bd) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:06.660246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4a376-6cbb-4383-aa2a-370ae626b747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:06.661681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4a376-6cbb-4383-aa2a-370ae626b747 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:06.673851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 55/116] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:06 2022] GET /identity/v3/role_assignments?user.id=d2da160ee1dd45a3beb29a63da5612bd&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=0c6e2ebeb67d499588437086fbe9fc5d => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:06.673851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431ff65-cbfa-47e9-b9b3-80410fc0cb99 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.673851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431ff65-cbfa-47e9-b9b3-80410fc0cb99 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.673851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431ff65-cbfa-47e9-b9b3-80410fc0cb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.696199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9431ff65-cbfa-47e9-b9b3-80410fc0cb99 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:06.697676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9431ff65-cbfa-47e9-b9b3-80410fc0cb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:06.701395 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.746210 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:06.778311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4e410-d1b6-4a01-ae76-c0fab34d6e87 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:06.801685 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 56/117] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:06.807730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac89c-5b12-4a00-a226-d796212f90fd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.808124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac89c-5b12-4a00-a226-d796212f90fd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.808500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ac89c-5b12-4a00-a226-d796212f90fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.831720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b572-415a-4f15-acc4-d3110cf75f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:06.832600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b572-415a-4f15-acc4-d3110cf75f77 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.833033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b572-415a-4f15-acc4-d3110cf75f77 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.833457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b572-415a-4f15-acc4-d3110cf75f77 None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.834794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b572-415a-4f15-acc4-d3110cf75f77 None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:06.835687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-878ac89c-5b12-4a00-a226-d796212f90fd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:06.836798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b572-415a-4f15-acc4-d3110cf75f77 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:06.837095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-878ac89c-5b12-4a00-a226-d796212f90fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:06.839241 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 62/118] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:06 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:06.840719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730f53-7f2a-46bd-be4c-95c5381ad12c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:06.841150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730f53-7f2a-46bd-be4c-95c5381ad12c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:06.841555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730f53-7f2a-46bd-be4c-95c5381ad12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:06.874062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-35730f53-7f2a-46bd-be4c-95c5381ad12c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:06.875808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35730f53-7f2a-46bd-be4c-95c5381ad12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:06.993501 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 57/119] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:06.994398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac89c-5b12-4a00-a226-d796212f90fd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.068851 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 63/120] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:07.112338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35730f53-7f2a-46bd-be4c-95c5381ad12c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.149346 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.157803 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.164603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ac89c-5b12-4a00-a226-d796212f90fd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.213524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.215438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.219388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.220865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.222621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:07.225564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:07.228235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 58/121] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:06 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:07.233724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.243237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35730f53-7f2a-46bd-be4c-95c5381ad12c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.335924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.336572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.336853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.337128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.366905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:07.371730 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:07.372589 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:07.374487 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 64/122] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:07.382775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.424659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98307df-003e-4f67-8c33-2eb1cc923174 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.477607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.478381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.478671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.478953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476/users/1bf5e8c2f99d4f90b8f75c87bbe55274/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.481394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2be326599045af941a207eb00a1476, user_id=1bf5e8c2f99d4f90b8f75c87bbe55274, role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:07.482978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:07.520611 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.524696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70e33-265d-4d1c-bb32-5317239bfd5c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.549098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 59/123] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:07 2022] PUT /identity/v3/projects/ce2be326599045af941a207eb00a1476/users/1bf5e8c2f99d4f90b8f75c87bbe55274/roles/91d76748bf16477db62b3cd689f60fd2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:07.550698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.574719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.575384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.575670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.576202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.576724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:07.577130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:07.578934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:07.585251 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.598181 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 65/124] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:07.599095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.691652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4cf3-1ec1-4f00-a730-f59622a1d9c6 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.736979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.738383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.738992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.739479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.754405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:07.760917 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:07.761841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:07.762610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:07.765436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 60/125] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:07.766566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.827529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c008e-e9b7-4bfe-982a-d14339ab76d0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.871814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.872458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.872743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.873020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.884779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:07.891597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:07.892779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 66/126] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:07.893750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:07.899318 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.927655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bb449-f939-440e-a92a-8a9592dc39d4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:07.938302 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.968252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f1990-4549-482d-8f89-6cba26cc3563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:07.969236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f1990-4549-482d-8f89-6cba26cc3563 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.969672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f1990-4549-482d-8f89-6cba26cc3563 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.970131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f1990-4549-482d-8f89-6cba26cc3563 None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.971490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f1990-4549-482d-8f89-6cba26cc3563 None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:07.973083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f1990-4549-482d-8f89-6cba26cc3563 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:07.974991 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 61/127] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:07.976357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31da8d-1520-4017-82e5-6fbf9b322b9e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.976792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31da8d-1520-4017-82e5-6fbf9b322b9e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.977201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31da8d-1520-4017-82e5-6fbf9b322b9e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.978691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 62/128] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:07.983731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31da8d-1520-4017-82e5-6fbf9b322b9e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.027725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e041525-dbc7-4db6-b907-91e82fa7117e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.074514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.075138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.075423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.075727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.076419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:08.078278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.080689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.092422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 67/129] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:08.093707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.111294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31da8d-1520-4017-82e5-6fbf9b322b9e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.157335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d030309-30df-4e4b-81c2-41a5a1affe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.157992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d030309-30df-4e4b-81c2-41a5a1affe70 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.158268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d030309-30df-4e4b-81c2-41a5a1affe70 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.158663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d030309-30df-4e4b-81c2-41a5a1affe70 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.159281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d030309-30df-4e4b-81c2-41a5a1affe70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:08.159589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d030309-30df-4e4b-81c2-41a5a1affe70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.160969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d030309-30df-4e4b-81c2-41a5a1affe70 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.173863 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 63/130] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:08.173863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f28ce-8c22-4a72-81a5-86aa29a0034c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.173863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f28ce-8c22-4a72-81a5-86aa29a0034c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.173863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f28ce-8c22-4a72-81a5-86aa29a0034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.192129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3b4f28ce-8c22-4a72-81a5-86aa29a0034c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:08.193904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b4f28ce-8c22-4a72-81a5-86aa29a0034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:08.201650 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.214216 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.234457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863def0-39cd-4925-b12b-ce3c9369c4d9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.278544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.279103 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 64/131] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:08.279503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.280059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f28ce-8c22-4a72-81a5-86aa29a0034c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.286273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.286681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.288733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.290364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.292185 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 68/132] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:08 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:08.293102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.391653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f28ce-8c22-4a72-81a5-86aa29a0034c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.491105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae089112-6e6f-4193-b417-af0cd877747f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.520675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.521389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.521681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.521984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.526289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.526499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.526915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.527199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.527468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] PATH_INFO: `/v3/users/e9cd3966716148c5879c1ebdf2fbb39a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.528076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.528576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cd3966716148c5879c1ebdf2fbb39a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.529857 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 65/133] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:08 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:08.530760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.531150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.532478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 69/134] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:08 2022] GET /identity/v3/users/e9cd3966716148c5879c1ebdf2fbb39a => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:08.536893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.562463 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.566235 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.657070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2465-7bd2-498d-a4b9-4096f55312a9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.704556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.705200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.705481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.705781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] PATH_INFO: `/v3/projects/01132bd325044f4e90a80f171f83404e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.706950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] RBAC: Authorizing `identity:get_project(project_id=01132bd325044f4e90a80f171f83404e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.707935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31199b-a92c-41dd-9ee3-83b2cd3f9b4e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.708412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.710106 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 70/135] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:08 2022] GET /identity/v3/projects/01132bd325044f4e90a80f171f83404e => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:08.710874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.752918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.753935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.754249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.754521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476/users/1bf5e8c2f99d4f90b8f75c87bbe55274/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.756854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2be326599045af941a207eb00a1476, user_id=1bf5e8c2f99d4f90b8f75c87bbe55274, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.758968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.805246 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.825597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c625cd-f9fa-417b-bb5f-2d79e9401383 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.839183 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 66/136] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:08 2022] PUT /identity/v3/projects/ce2be326599045af941a207eb00a1476/users/1bf5e8c2f99d4f90b8f75c87bbe55274/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:08.840565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.884410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.885182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.885509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.885787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.887557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.889077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.891707 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 71/137] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:08 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:08.892488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.939493 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.977889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945717f1-f849-4e94-a9ab-869d78e4e91a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:09.022864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:09.023756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.024191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.024652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.026763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:09.028246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:09.030911 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 67/138] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:09.031217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:09.049590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45733ca-fc20-4c0f-b787-2e5045d9a427 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:09.091015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ef285-ee73-46a8-8a76-34910884a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:09.091682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef285-ee73-46a8-8a76-34910884a080 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.091966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef285-ee73-46a8-8a76-34910884a080 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.092241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef285-ee73-46a8-8a76-34910884a080 None admin] PATH_INFO: `/v3/projects/01132bd325044f4e90a80f171f83404e/users/1bf5e8c2f99d4f90b8f75c87bbe55274/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.094313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ef285-ee73-46a8-8a76-34910884a080 None admin] RBAC: Authorizing `identity:create_grant(project_id=01132bd325044f4e90a80f171f83404e, user_id=1bf5e8c2f99d4f90b8f75c87bbe55274, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:09.095765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ef285-ee73-46a8-8a76-34910884a080 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:09.147652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85699d48-6abc-4e80-80b4-5cf2e5b8832a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:09.177787 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 72/139] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:08 2022] PUT /identity/v3/projects/01132bd325044f4e90a80f171f83404e/users/1bf5e8c2f99d4f90b8f75c87bbe55274/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:09.179562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf302e-65d3-471a-9371-3fcfe7fcd1d3 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.180078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf302e-65d3-471a-9371-3fcfe7fcd1d3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.180542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf302e-65d3-471a-9371-3fcfe7fcd1d3 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.186144 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 73/140] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:09.186144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf302e-65d3-471a-9371-3fcfe7fcd1d3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:09.204425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560d67e-e64a-4c3a-975f-e4b1f4ffc2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:09.205136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560d67e-e64a-4c3a-975f-e4b1f4ffc2d5 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.205490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560d67e-e64a-4c3a-975f-e4b1f4ffc2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.205860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560d67e-e64a-4c3a-975f-e4b1f4ffc2d5 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476/users/e9cd3966716148c5879c1ebdf2fbb39a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.209086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560d67e-e64a-4c3a-975f-e4b1f4ffc2d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2be326599045af941a207eb00a1476, user_id=e9cd3966716148c5879c1ebdf2fbb39a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:09.210780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560d67e-e64a-4c3a-975f-e4b1f4ffc2d5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:09.225346 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:09.294384 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 68/141] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:09 2022] PUT /identity/v3/projects/ce2be326599045af941a207eb00a1476/users/e9cd3966716148c5879c1ebdf2fbb39a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:09.295857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a912-86a3-4432-9cfb-4f91da5f8974 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.296150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a912-86a3-4432-9cfb-4f91da5f8974 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.296474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388a912-86a3-4432-9cfb-4f91da5f8974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.302960 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:09.339944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6388a912-86a3-4432-9cfb-4f91da5f8974 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:09.341190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6388a912-86a3-4432-9cfb-4f91da5f8974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:09.388829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf302e-65d3-471a-9371-3fcfe7fcd1d3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:09.438511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7ded0-d0aa-4fd9-88bd-f1f0021e323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:09.439636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7ded0-d0aa-4fd9-88bd-f1f0021e323f None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.440119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7ded0-d0aa-4fd9-88bd-f1f0021e323f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.440664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7ded0-d0aa-4fd9-88bd-f1f0021e323f None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.441613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7ded0-d0aa-4fd9-88bd-f1f0021e323f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:09.443440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7ded0-d0aa-4fd9-88bd-f1f0021e323f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:09.487202 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 69/142] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:09.575222 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 74/143] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:09 2022] POST /identity/v3/users => generated 283 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:09.833409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388a912-86a3-4432-9cfb-4f91da5f8974 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:09.903386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070cd1-5318-4bca-ad5d-8e56f8dab9b5 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.903900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070cd1-5318-4bca-ad5d-8e56f8dab9b5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.904221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5070cd1-5318-4bca-ad5d-8e56f8dab9b5 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.905735 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 75/144] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:09.913350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0093ce-ce9f-4096-837b-8fdd36941e30 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.913755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0093ce-ce9f-4096-837b-8fdd36941e30 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.914216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0093ce-ce9f-4096-837b-8fdd36941e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.947140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0c0093ce-ce9f-4096-837b-8fdd36941e30 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:09.948534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0c0093ce-ce9f-4096-837b-8fdd36941e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:10.032424 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.034818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388a912-86a3-4432-9cfb-4f91da5f8974 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.037885 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 76/145] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:10.091283 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.101083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.102082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.102566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.103056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.115267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:10.120816 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:10.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:10.122793 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:10.125945 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 70/146] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:10.132158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0093ce-ce9f-4096-837b-8fdd36941e30 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.261294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0093ce-ce9f-4096-837b-8fdd36941e30 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.299464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.300432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.300911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.301405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.302298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:10.302800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:10.304494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:10.314200 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 77/147] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:10.324540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.361689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.487411 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.520747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece78e7-691b-4a06-80cb-eace6861ba39 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.553317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d2bcc-65b6-4c12-8b84-af6975cdfca0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.573452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.574145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.574427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.574711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] PATH_INFO: `/v3/users/d2da160ee1dd45a3beb29a63da5612bd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.576005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] RBAC: Authorizing `identity:get_user(user_id=d2da160ee1dd45a3beb29a63da5612bd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:10.579837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:10.585952 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 71/148] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:10 2022] GET /identity/v3/users/d2da160ee1dd45a3beb29a63da5612bd => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:10.587634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.615441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.616012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.616297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.616685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.642655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:10.649110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:10.651250 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:10.653027 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 78/149] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:10.658305 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.663549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.714249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ff97f-39f8-4662-9cc8-ab4f819ea849 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.755099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.755818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.756212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.756493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.758962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:10.760478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:10.762434 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 72/150] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:10 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:10.768866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.816968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca862b-f8bd-4cb1-80af-7ba1d42232a2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.851976 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.878141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.878770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.879215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.879685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.881622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:10.881622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:10.884330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:10.886276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485421c7-07d1-41a0-a484-7a7ec38a8c3d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.904548 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 79/151] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:10.912746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.914869 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.929465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.930318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.930601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.930878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476/users/d2da160ee1dd45a3beb29a63da5612bd/roles/0c6e2ebeb67d499588437086fbe9fc5d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.933323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2be326599045af941a207eb00a1476, user_id=d2da160ee1dd45a3beb29a63da5612bd, role_id=0c6e2ebeb67d499588437086fbe9fc5d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:10.934795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:11.078215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9d280-23b6-43c2-856c-e5ae0af4d6c0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:11.101862 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 73/152] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:10 2022] PUT /identity/v3/projects/ce2be326599045af941a207eb00a1476/users/d2da160ee1dd45a3beb29a63da5612bd/roles/0c6e2ebeb67d499588437086fbe9fc5d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:51:11.138763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:11.139521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:11.139811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:11.140216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:11.141575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:11.143181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:11.145114 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 80/153] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:10 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:11.151445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:11.287718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1529a-2506-46de-b9ae-478164bde337 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:11.334638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:11.335283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:11.335568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:11.335847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:11.409901 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:11.443418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:11.444607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:11.572328 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 74/154] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:11.578845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:11.637766 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:11.694617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14ccbe-34e6-4363-8958-0be9463ec16c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:11.736268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579d89c-43cc-48ee-b0fa-08ffa75bbb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:11.736903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579d89c-43cc-48ee-b0fa-08ffa75bbb32 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:11.737181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579d89c-43cc-48ee-b0fa-08ffa75bbb32 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:11.737452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579d89c-43cc-48ee-b0fa-08ffa75bbb32 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:11.740111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579d89c-43cc-48ee-b0fa-08ffa75bbb32 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:11.741564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579d89c-43cc-48ee-b0fa-08ffa75bbb32 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:11.743497 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 81/155] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:11 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:11.750399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:11.849360 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:11.867399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70c020-05db-4b70-aa3f-19b6504aaa70 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:11.904191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f65727-fd3d-464e-bd1f-b68b1c3f8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:11.905485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f65727-fd3d-464e-bd1f-b68b1c3f8447 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:11.905634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f65727-fd3d-464e-bd1f-b68b1c3f8447 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:11.905928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f65727-fd3d-464e-bd1f-b68b1c3f8447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:11.906756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f65727-fd3d-464e-bd1f-b68b1c3f8447 None admin] RBAC: Adding query filter params (role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=1bf5e8c2f99d4f90b8f75c87bbe55274) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:11.907065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f65727-fd3d-464e-bd1f-b68b1c3f8447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:11.908516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f65727-fd3d-464e-bd1f-b68b1c3f8447 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:11.915248 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 75/156] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:11 2022] GET /identity/v3/role_assignments?user.id=1bf5e8c2f99d4f90b8f75c87bbe55274&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:12.372866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463cb1b-710a-4b6f-9c18-adfcbdf15117 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:12.373713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463cb1b-710a-4b6f-9c18-adfcbdf15117 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:12.373713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463cb1b-710a-4b6f-9c18-adfcbdf15117 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:12.375040 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 82/157] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:12.381507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d1a0-d6af-4922-a9c5-6a6dc7453e88 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:12.381781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d1a0-d6af-4922-a9c5-6a6dc7453e88 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:12.382087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d1a0-d6af-4922-a9c5-6a6dc7453e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:12.406964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4938d1a0-d6af-4922-a9c5-6a6dc7453e88 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:12.409959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4938d1a0-d6af-4922-a9c5-6a6dc7453e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:12.458436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f825-a19d-4799-834c-88f22103881f None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:12.458760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f825-a19d-4799-834c-88f22103881f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:12.458989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f825-a19d-4799-834c-88f22103881f None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:12.460367 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 83/158] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:12.473386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652c7e8-7290-42ad-a941-76264900ee2a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:12.473753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652c7e8-7290-42ad-a941-76264900ee2a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:12.473952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652c7e8-7290-42ad-a941-76264900ee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:12.502626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b652c7e8-7290-42ad-a941-76264900ee2a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:12.504160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b652c7e8-7290-42ad-a941-76264900ee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:12.513686 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 76/159] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:12.616325 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 84/160] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:12.935151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d1a0-d6af-4922-a9c5-6a6dc7453e88 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:13.014600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73fb7-7880-4bd3-bb95-ae5deb802778 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.015141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73fb7-7880-4bd3-bb95-ae5deb802778 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.015578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73fb7-7880-4bd3-bb95-ae5deb802778 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.017469 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 85/161] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:13.022289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0e2cd-7270-40ef-abeb-c548966f2fa2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.022859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0e2cd-7270-40ef-abeb-c548966f2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.023337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0e2cd-7270-40ef-abeb-c548966f2fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.042430 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:13.057335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-78d0e2cd-7270-40ef-abeb-c548966f2fa2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:13.062740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78d0e2cd-7270-40ef-abeb-c548966f2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:13.078799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d1a0-d6af-4922-a9c5-6a6dc7453e88 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:13.142913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:13.143583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.143861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.144134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.164439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:13.169632 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:13.170907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:13.171714 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 77/162] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:13.175903 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:13.181834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:13.224536 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 86/163] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:13.262321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0e2cd-7270-40ef-abeb-c548966f2fa2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:13.365619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313b753-f17f-4fdc-9b6d-81763c2e539b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:13.438610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10471112-206b-479d-9d66-d7157e544aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:13.439357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10471112-206b-479d-9d66-d7157e544aac None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.439706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10471112-206b-479d-9d66-d7157e544aac None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.440056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10471112-206b-479d-9d66-d7157e544aac None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.440916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10471112-206b-479d-9d66-d7157e544aac None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:13.441289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10471112-206b-479d-9d66-d7157e544aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:13.445832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10471112-206b-479d-9d66-d7157e544aac None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:13.450149 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:13.460352 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 78/164] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:13.469482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10471112-206b-479d-9d66-d7157e544aac None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:13.536700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0e2cd-7270-40ef-abeb-c548966f2fa2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:13.602134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:13.602134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.602134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.602134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.619820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:13.624741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10471112-206b-479d-9d66-d7157e544aac None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:13.625165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:13.630298 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:13.631171 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 87/165] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:13.655542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:13.678058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:13.679057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.679514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.679935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.681272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:13.683099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:13.685336 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 79/166] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:13 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:13.690991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:13.729484 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:13.794277 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:13.829239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeba68-53e6-45d5-935d-6855f8d60746 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:13.848281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17133d-6019-4938-a07e-8b4dadbdcd9f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:13.887983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:13.888611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.889527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.890004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.890689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:13.891002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:13.892427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:13.910094 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 88/167] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:13.911105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:13.911242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:13.911744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.912028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.912309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.037942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:14.039433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:14.067337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6160e-1b58-47bb-927e-18b2319b6184 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:14.068838 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.151747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:14.152405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.152685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.152962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.177471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:14.183408 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:14.184321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:14.185110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 89/168] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:14.185844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:14.254185 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.362986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 80/169] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:51:14.364612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:14.397742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ebae9-a34c-4447-ab65-5467c6484dd7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:14.460749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a99f0b-719c-4623-b5ce-cf040058e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:14.461416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99f0b-719c-4623-b5ce-cf040058e18e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.461692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99f0b-719c-4623-b5ce-cf040058e18e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.461993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99f0b-719c-4623-b5ce-cf040058e18e None admin] PATH_INFO: `/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.463251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a99f0b-719c-4623-b5ce-cf040058e18e None admin] RBAC: Authorizing `identity:get_user(user_id=1bf5e8c2f99d4f90b8f75c87bbe55274)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:14.464710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a99f0b-719c-4623-b5ce-cf040058e18e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:14.466708 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 90/170] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:14 2022] GET /identity/v3/users/1bf5e8c2f99d4f90b8f75c87bbe55274 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:14.467947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b8db-71cc-49c5-956f-8269322792ce None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.468229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b8db-71cc-49c5-956f-8269322792ce None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.468498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b8db-71cc-49c5-956f-8269322792ce None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.469955 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 91/171] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:14.474764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b8db-71cc-49c5-956f-8269322792ce None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:14.525632 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.566929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff808b8-e2fd-4c3a-bb80-3d32ef3356f5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:14.606970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:14.608103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.608380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.608650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.609321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:14.609618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:14.612629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:14.622216 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 81/172] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:14.626764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:14.637107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b8db-71cc-49c5-956f-8269322792ce None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:14.663038 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.682256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98789c2c-4df0-457a-98f4-2635538423ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:14.683687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789c2c-4df0-457a-98f4-2635538423ee None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.684253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789c2c-4df0-457a-98f4-2635538423ee None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.684698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789c2c-4df0-457a-98f4-2635538423ee None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.686201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98789c2c-4df0-457a-98f4-2635538423ee None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:14.688108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98789c2c-4df0-457a-98f4-2635538423ee None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:14.690332 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 92/173] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:14 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:14.692354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c2801-9701-42b2-bc32-50a851957058 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.692920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c2801-9701-42b2-bc32-50a851957058 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.693374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c2801-9701-42b2-bc32-50a851957058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.716226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fe8c2801-9701-42b2-bc32-50a851957058 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:14.718672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fe8c2801-9701-42b2-bc32-50a851957058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:14.744019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de788f3-83f5-4498-b580-6e66b5feadec None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:14.781242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbf918-820a-4e55-ab86-d3bc33a1ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:14.781907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf918-820a-4e55-ab86-d3bc33a1ade2 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.782183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf918-820a-4e55-ab86-d3bc33a1ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.782462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf918-820a-4e55-ab86-d3bc33a1ade2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.794619 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 93/174] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:14.796005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3d3c-ffba-4589-8733-b2a8bcb25ec3 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.796375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3d3c-ffba-4589-8733-b2a8bcb25ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.796652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b3d3c-ffba-4589-8733-b2a8bcb25ec3 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.801961 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 94/175] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:14.801961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b3d3c-ffba-4589-8733-b2a8bcb25ec3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:14.845250 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.872036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbf918-820a-4e55-ab86-d3bc33a1ade2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:14.874326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbf918-820a-4e55-ab86-d3bc33a1ade2 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:14.931196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b3d3c-ffba-4589-8733-b2a8bcb25ec3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:14.948135 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.976117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:14.976905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.977185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.977761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] PATH_INFO: `/v3/users/e9cd3966716148c5879c1ebdf2fbb39a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.979202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] RBAC: Authorizing `identity:get_user(user_id=e9cd3966716148c5879c1ebdf2fbb39a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:14.981087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:14.983032 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 95/176] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:14 2022] GET /identity/v3/users/e9cd3966716148c5879c1ebdf2fbb39a => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:14.983648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.024160 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 82/177] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:15.025511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf057b-077b-40d7-8f14-5bcb8d9eb98e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.025881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf057b-077b-40d7-8f14-5bcb8d9eb98e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.026223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf057b-077b-40d7-8f14-5bcb8d9eb98e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.027750 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 83/178] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:15.028869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6b0be-9abb-4725-b405-41b66e9a75e5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.028972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6b0be-9abb-4725-b405-41b66e9a75e5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.029252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6b0be-9abb-4725-b405-41b66e9a75e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.051889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-09f6b0be-9abb-4725-b405-41b66e9a75e5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:15.053786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-09f6b0be-9abb-4725-b405-41b66e9a75e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:15.102855 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:15.109212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331189e-0a42-4cb6-b670-81959c83e749 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:15.131697 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 84/179] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:15.132873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef30c2-8615-4e1a-8982-2d0c0217bda6 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.133492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef30c2-8615-4e1a-8982-2d0c0217bda6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.133492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef30c2-8615-4e1a-8982-2d0c0217bda6 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.134818 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 85/180] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:15.135430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef30c2-8615-4e1a-8982-2d0c0217bda6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.148104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:15.148702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.148975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.149239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.150024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=1bf5e8c2f99d4f90b8f75c87bbe55274) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:15.150328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:15.151761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:15.157892 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 96/181] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:14 2022] GET /identity/v3/role_assignments?user.id=1bf5e8c2f99d4f90b8f75c87bbe55274&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:15.158757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.244933 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:15.276824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adbbc7-750d-4e0c-aa72-3403ab37686b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:15.309704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef30c2-8615-4e1a-8982-2d0c0217bda6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:15.328867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630777f-514d-4b35-9c60-28abbae44ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:15.329515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630777f-514d-4b35-9c60-28abbae44ebc None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.329793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630777f-514d-4b35-9c60-28abbae44ebc None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.330112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630777f-514d-4b35-9c60-28abbae44ebc None admin] PATH_INFO: `/v3/projects/01132bd325044f4e90a80f171f83404e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.331268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630777f-514d-4b35-9c60-28abbae44ebc None admin] RBAC: Authorizing `identity:get_project(project_id=01132bd325044f4e90a80f171f83404e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:15.332719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630777f-514d-4b35-9c60-28abbae44ebc None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:15.334704 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 97/182] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/projects/01132bd325044f4e90a80f171f83404e => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:15.335600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27d2a-eb23-4ae2-a65d-653bacf10d85 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.335884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27d2a-eb23-4ae2-a65d-653bacf10d85 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.336155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b27d2a-eb23-4ae2-a65d-653bacf10d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.356603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b8b27d2a-eb23-4ae2-a65d-653bacf10d85 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:15.358189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b8b27d2a-eb23-4ae2-a65d-653bacf10d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:15.367394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42b939-0c05-427c-9376-7e00a4de00f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:15.368023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42b939-0c05-427c-9376-7e00a4de00f7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.368306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42b939-0c05-427c-9376-7e00a4de00f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.368579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42b939-0c05-427c-9376-7e00a4de00f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.387106 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:15.446353 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 98/183] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:15.447274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27d2a-eb23-4ae2-a65d-653bacf10d85 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.463105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42b939-0c05-427c-9376-7e00a4de00f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:15.465492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42b939-0c05-427c-9376-7e00a4de00f7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:15.526271 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:15.556417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b27d2a-eb23-4ae2-a65d-653bacf10d85 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:15.581612 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 86/184] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:15.587368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af85ab-335b-4e97-b1c8-e7252840f408 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.587612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af85ab-335b-4e97-b1c8-e7252840f408 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.587885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af85ab-335b-4e97-b1c8-e7252840f408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.593691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:15.594544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.594881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.595994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.607481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:15.609871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-30af85ab-335b-4e97-b1c8-e7252840f408 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:15.611702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-30af85ab-335b-4e97-b1c8-e7252840f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:15.613236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:15.614180 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:15.614999 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 99/185] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:15.615658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.639852 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:15.689897 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 87/186] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:15.689897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af85ab-335b-4e97-b1c8-e7252840f408 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.737585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b8585-24be-4448-9f67-c04d13e8af48 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:15.774294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:15.774904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.775179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.775456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.776184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=01132bd325044f4e90a80f171f83404e, user.id=1bf5e8c2f99d4f90b8f75c87bbe55274) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:15.776494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:15.778019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:15.784404 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 100/187] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/role_assignments?user.id=1bf5e8c2f99d4f90b8f75c87bbe55274&scope.project.id=01132bd325044f4e90a80f171f83404e&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:15.785208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.803249 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:15.816212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af85ab-335b-4e97-b1c8-e7252840f408 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:15.860533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:15.861521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.862027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.862308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.875920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:15.880970 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:15.882037 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:15.882856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 88/188] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:15.883537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:15.908950 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:15.941545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a119d4-4209-454e-802b-5bca8c861133 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:15.988198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:15.988832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:15.989144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:15.989375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:15.990517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:15.991976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:15.993940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 101/189] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:15.994678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.019821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd7587-cfce-453b-91ed-9db2bdd51b2b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.059308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.059930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.060179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.060450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.061981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:16.062530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.063671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.072020 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 89/190] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:16.072593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.089578 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.108967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b3d3-ac91-49d2-88b1-d427165a4b13 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.144583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.145212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.145494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.145767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.146900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.148365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.150005 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 102/191] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:16.150809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.169851 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.184233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead19ad5-6d62-481c-88b4-9311b045f45d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.218395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.219157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.219466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.219740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.220408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:16.220708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.222155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.230361 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 90/192] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:16.235672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.251673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd43dbb-3762-45ce-9047-3a5856f8fc27 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.284848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.285478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.285754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.286053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.296960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:16.302217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:16.303282 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 103/193] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:16.304245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.307088 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.333207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f341d8f-346b-4a3c-a5bf-19c8a4c766c5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.367961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.368565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.368850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.369125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.369894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=e9cd3966716148c5879c1ebdf2fbb39a) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:16.370211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.371673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.378623 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 91/194] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/role_assignments?user.id=e9cd3966716148c5879c1ebdf2fbb39a&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:16.379395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.383353 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.413655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9ff0-dde8-45a1-b900-4da65b4ad1a3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.455579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.456143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.456420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.456693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] PATH_INFO: `/v3/users/5b7ad553ed424605b4c488319060ddb9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.472137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7ad553ed424605b4c488319060ddb9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.473636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.475601 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 104/195] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/users/5b7ad553ed424605b4c488319060ddb9 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:16.476221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.506347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d04a-28d4-4c09-b96d-43593c982883 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.552133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.552426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.552655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.553375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.554471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.555368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.565751 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.596459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4a7f-3188-4f20-8f7b-7f00bea53151 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.633184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.633825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.634137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.634405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] PATH_INFO: `/v3/users/5b7ad553ed424605b4c488319060ddb9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.635536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] RBAC: Authorizing `identity:get_user(user_id=5b7ad553ed424605b4c488319060ddb9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.637010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.639182 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 105/196] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/users/5b7ad553ed424605b4c488319060ddb9 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:16.640049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.645118 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.705887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 92/197] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:16 2022] POST /identity/v3/users => generated 297 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:16.706664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.748621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c53ca-e8b6-4f22-b22d-c84aaf5ed5df None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.790478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.791099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.791377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.791648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.792327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] RBAC: Adding query filter params (name=reader) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:16.792635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.794098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:16.805858 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 106/198] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:16.805858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:16.835784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c8c58-2c20-4cbb-9f4f-d22a70924d21 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.878860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.879484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.879767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.880044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.884467 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.924205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e6baa-9748-48ad-a47f-5aaa97280aab None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:16.963336 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:16.965116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:16.965745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:16.966076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:16.966352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:16.970811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:16.972303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.061486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:17.063570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.095731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 93/199] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:17.097235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.143961 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.187050 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 107/200] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:17.188648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.226193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518e475-0aa3-43b3-ad2a-375fed8cb84b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:17.235457 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.269437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:17.270274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.270628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.271147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] PATH_INFO: `/v3/users/d2da160ee1dd45a3beb29a63da5612bd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.272823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] RBAC: Authorizing `identity:get_user(user_id=d2da160ee1dd45a3beb29a63da5612bd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:17.274864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.277418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 94/201] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/users/d2da160ee1dd45a3beb29a63da5612bd => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:17.278228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.333909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e951b-f48c-484f-a5b9-6043a3958dc6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:17.381903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:17.382908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.383192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.383463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.384909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:17.386723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.394000 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 108/202] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:17.394907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.421929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cea4-1823-4e00-a7f6-a7d2f261df45 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:17.448649 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.477285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:17.478335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.478685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.479027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.480585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:17.482264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.489843 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 95/203] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:17.489843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.524306 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.536878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a282b-d794-48af-930a-bed3ac7305de None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:17.587236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:17.587848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.588124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.588393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.609719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c59455-5277-4ef4-b083-98f945813a89 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:17.647898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:17.648905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.649394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.649937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.651031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=5b7ad553ed424605b4c488319060ddb9) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:17.651569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:17.653326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.661158 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 96/204] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/role_assignments?user.id=5b7ad553ed424605b4c488319060ddb9&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:17.662505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.694838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:17.698116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.775394 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.847422 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.855155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed69a5-6ff7-4a82-801c-544c047c15d5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:17.885969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 109/205] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:17.892726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.894542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:17.895460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.895696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.896084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.897547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] RBAC: Adding query filter params (role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=5b7ad553ed424605b4c488319060ddb9) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:17.897547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:17.898898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:17.905404 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 97/206] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/role_assignments?user.id=5b7ad553ed424605b4c488319060ddb9&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:18.051257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8bd0d-0f7c-4f0c-886a-2f10a41cc9ff None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:18.103884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e08ab0-30fc-4210-97fb-4f1bfa5c8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:18.104517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e08ab0-30fc-4210-97fb-4f1bfa5c8da9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:18.104795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e08ab0-30fc-4210-97fb-4f1bfa5c8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:18.105069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e08ab0-30fc-4210-97fb-4f1bfa5c8da9 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:18.106223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e08ab0-30fc-4210-97fb-4f1bfa5c8da9 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:18.108295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e08ab0-30fc-4210-97fb-4f1bfa5c8da9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:18.110603 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 110/207] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:18.116333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:18.238409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8332d5-f4c4-4527-80bb-97b489e66b91 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:18.272739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60994d3-5a5f-4c58-a380-eab03887dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:18.273346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60994d3-5a5f-4c58-a380-eab03887dee1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:18.273622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60994d3-5a5f-4c58-a380-eab03887dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:18.273924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60994d3-5a5f-4c58-a380-eab03887dee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:18.274655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60994d3-5a5f-4c58-a380-eab03887dee1 None admin] RBAC: Adding query filter params (role.id=0c6e2ebeb67d499588437086fbe9fc5d, scope.project.id=ce2be326599045af941a207eb00a1476, user.id=d2da160ee1dd45a3beb29a63da5612bd) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:18.274958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60994d3-5a5f-4c58-a380-eab03887dee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:18.276433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60994d3-5a5f-4c58-a380-eab03887dee1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:18.283885 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 98/208] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:18 2022] GET /identity/v3/role_assignments?user.id=d2da160ee1dd45a3beb29a63da5612bd&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=0c6e2ebeb67d499588437086fbe9fc5d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:19.017656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b145-6278-42e7-8b89-431d45465ff7 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.018221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b145-6278-42e7-8b89-431d45465ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.018221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b145-6278-42e7-8b89-431d45465ff7 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.019874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 111/209] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:19.025609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb443-eb2c-490d-92b0-d32f651fa7bb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.026209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb443-eb2c-490d-92b0-d32f651fa7bb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.026698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb443-eb2c-490d-92b0-d32f651fa7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.046233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-25ceb443-eb2c-490d-92b0-d32f651fa7bb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:19.047733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-25ceb443-eb2c-490d-92b0-d32f651fa7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:19.058684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de221-ed54-46b6-86cf-feea1810903f None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.058962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de221-ed54-46b6-86cf-feea1810903f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.059232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de221-ed54-46b6-86cf-feea1810903f None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.060821 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 112/210] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:19.065785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424c367-2e8a-41e9-94ae-5a0ff29954db None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.066095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424c367-2e8a-41e9-94ae-5a0ff29954db None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.066367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424c367-2e8a-41e9-94ae-5a0ff29954db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.067327 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:19.072585 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:19.088651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d424c367-2e8a-41e9-94ae-5a0ff29954db None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:19.089972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d424c367-2e8a-41e9-94ae-5a0ff29954db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:19.120844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 99/211] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:19.170731 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 113/212] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:19.398214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceb443-eb2c-490d-92b0-d32f651fa7bb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:19.443069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424c367-2e8a-41e9-94ae-5a0ff29954db None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:19.520907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceb443-eb2c-490d-92b0-d32f651fa7bb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:19.560348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:19.561005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.561276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.561551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.562888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:19.564339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:19.570704 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 100/213] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:19.572130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:19.574809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424c367-2e8a-41e9-94ae-5a0ff29954db None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:19.596360 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:19.608483 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:19.614275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:19.615030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.615375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.615712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.627103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:19.632115 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:19.633079 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:19.633890 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 114/214] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:19.641633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:19.694188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a6008-505e-4ee4-a124-21a673353961 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:19.733455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e4685-f891-403b-9e9d-f65d340acbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:19.734467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e4685-f891-403b-9e9d-f65d340acbf0 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.734965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e4685-f891-403b-9e9d-f65d340acbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.735434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e4685-f891-403b-9e9d-f65d340acbf0 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.736282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e4685-f891-403b-9e9d-f65d340acbf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:19.738018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e4685-f891-403b-9e9d-f65d340acbf0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:19.752537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a4e84-a399-4ee1-9e04-614d9a5f391c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:19.789908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:19.790510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.790788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.791058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.791714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:19.792013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:19.793515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:19.804230 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 115/215] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:19.809570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:19.873309 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:19.894452 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 101/216] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:19 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:19.895977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eaca1-56e1-4c7c-86d3-44c2c35a71a4 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.896572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eaca1-56e1-4c7c-86d3-44c2c35a71a4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.896679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00eaca1-56e1-4c7c-86d3-44c2c35a71a4 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.898071 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 102/217] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:19.903593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf46a-9e1d-4809-9915-dcbfba0c5794 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.903879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf46a-9e1d-4809-9915-dcbfba0c5794 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.909906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf46a-9e1d-4809-9915-dcbfba0c5794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:19.924495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8dabf46a-9e1d-4809-9915-dcbfba0c5794 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:19.925706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8dabf46a-9e1d-4809-9915-dcbfba0c5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:19.942323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263beb56-923d-4a2e-b068-10227640c9e2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:19.989604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:19.990220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:19.990501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:19.990774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] PATH_INFO: `/v3/users/1ba78789dd7e408793f4059222e2e90a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.006761 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 103/218] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:20.008578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148177e-01ab-4f75-98a0-9aa2710e8b7f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.008863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148177e-01ab-4f75-98a0-9aa2710e8b7f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.009136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148177e-01ab-4f75-98a0-9aa2710e8b7f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.010733 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 104/219] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:20.015537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba78789dd7e408793f4059222e2e90a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:20.016684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98ab7-cb76-459f-978c-43953dccf137 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.016970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98ab7-cb76-459f-978c-43953dccf137 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.017242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c98ab7-cb76-459f-978c-43953dccf137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.018113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:20.020486 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 116/220] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:19 2022] GET /identity/v3/users/1ba78789dd7e408793f4059222e2e90a => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:20.026437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.036622 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.043482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-82c98ab7-cb76-459f-978c-43953dccf137 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:20.045126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-82c98ab7-cb76-459f-978c-43953dccf137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:20.137010 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 105/221] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:20.164864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99457374-1bd4-4ff8-8813-a2b5730a2f78 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.180886 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.204414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.205027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.205357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.205635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.285546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:20.287069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:20.298999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98ab7-cb76-459f-978c-43953dccf137 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.414687 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 117/222] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:51:20.423646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.438181 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.440397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c98ab7-cb76-459f-978c-43953dccf137 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.488778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.489995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.490443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.490867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.494575 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.505732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:20.512591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:20.514623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:20.515618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:20.518413 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 106/223] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:20.524728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.542034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d9e4-9092-44d0-a4ce-ac701d6dc7f1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.580295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.580941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.581223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.581499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.582881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:20.584399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:20.586651 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 118/224] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:20.587532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.653955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4bb0b-df5d-40bf-b9a1-6ee413f26f8d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.696096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.696742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.697336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.697336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.702449 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.710047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:20.714932 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:20.715837 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:20.717200 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 107/225] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:20.718778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.723926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3947-2398-4029-ac5b-7960b2d6aa2e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.766559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.767178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.767459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.767736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.768415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:20.768721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:20.770148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:20.779573 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 119/226] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:20.784362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.799407 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.847466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86f1e5-9d68-435e-b57f-b94e71d83d71 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.884841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.885904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.886416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.886889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.887815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=1ba78789dd7e408793f4059222e2e90a) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:20.887942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458a5c-3263-4647-bad8-6da90258d969 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.890022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:20.891761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:20.897936 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 108/227] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/role_assignments?user.id=1ba78789dd7e408793f4059222e2e90a&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:20.899041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.925624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.926295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.926581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.926857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.927591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:20.927849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:20.929303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:20.939505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 120/228] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:20.945320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.949731 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:21.016718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a892-1af0-40cc-9354-a3dc6bd3eb49 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:21.056017 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:21.058936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04e85-1031-4c80-98ff-f2a5a0be791d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:21.081713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:21.082762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:21.083245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:21.083810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] PATH_INFO: `/v3/users/5b7ad553ed424605b4c488319060ddb9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:21.090682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7ad553ed424605b4c488319060ddb9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:21.092555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:21.094836 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 109/229] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/users/5b7ad553ed424605b4c488319060ddb9 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:21.097444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:21.098457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:21.098959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:21.099430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] PATH_INFO: `/v3/users/5b7ad553ed424605b4c488319060ddb9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:21.100697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:21.101036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] RBAC: Authorizing `identity:get_user(user_id=5b7ad553ed424605b4c488319060ddb9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:21.102740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:21.104806 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 121/230] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/users/5b7ad553ed424605b4c488319060ddb9 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:21.111029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:21.193028 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:21.226986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8119-787f-4643-b855-0496517a0bcc None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:21.236803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e1a9d-0a72-4d80-b1e0-a11a6c0e2ab4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:21.265878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:21.266857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:21.267344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:21.267819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:21.269188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:21.270874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:21.273050 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 122/231] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:21 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:21.279331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:21.304387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:21.305402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:21.305927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:21.306485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:21.307838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:21.309482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:21.314257 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 110/232] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:21 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:21.320266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:21.438217 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:21.499760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aabd5-01a2-414f-a755-ee76fa50e73e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:21.502239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aaa8e-7091-4e09-93ac-4c947d67b6d2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:21.538674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78513a21-9874-4af5-8a43-c810a0d9966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:21.539500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78513a21-9874-4af5-8a43-c810a0d9966f None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:21.539878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78513a21-9874-4af5-8a43-c810a0d9966f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:21.540255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78513a21-9874-4af5-8a43-c810a0d9966f None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/5b7ad553ed424605b4c488319060ddb9/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:21.542557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78513a21-9874-4af5-8a43-c810a0d9966f None admin] RBAC: Authorizing `identity:create_grant(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c, user_id=5b7ad553ed424605b4c488319060ddb9, role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:21.544126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78513a21-9874-4af5-8a43-c810a0d9966f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:21.551984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38768b02-aa28-40a6-b26a-654d39bc411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:21.552660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38768b02-aa28-40a6-b26a-654d39bc411a None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:21.552943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38768b02-aa28-40a6-b26a-654d39bc411a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:21.553217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38768b02-aa28-40a6-b26a-654d39bc411a None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/5b7ad553ed424605b4c488319060ddb9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:21.555277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38768b02-aa28-40a6-b26a-654d39bc411a None admin] RBAC: Authorizing `identity:create_grant(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c, user_id=5b7ad553ed424605b4c488319060ddb9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:21.562573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38768b02-aa28-40a6-b26a-654d39bc411a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:21.638717 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:21.644176 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 123/233] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:21 2022] PUT /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/5b7ad553ed424605b4c488319060ddb9/roles/91d76748bf16477db62b3cd689f60fd2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:21.662661 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 111/234] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:21 2022] PUT /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/5b7ad553ed424605b4c488319060ddb9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:51:22.353137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67a5a-d706-43c1-9db2-83923d11c2cf None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:22.383335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67a5a-d706-43c1-9db2-83923d11c2cf None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:22.383335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c67a5a-d706-43c1-9db2-83923d11c2cf None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:22.383335 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 124/235] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:22.383603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c2847-cee4-4b19-97d5-eac774cd75c8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:22.383603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c2847-cee4-4b19-97d5-eac774cd75c8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:22.383603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c2847-cee4-4b19-97d5-eac774cd75c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:22.384146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e855f-f055-4445-8968-8a9176996604 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:22.384146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e855f-f055-4445-8968-8a9176996604 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:22.384146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e855f-f055-4445-8968-8a9176996604 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:22.385538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 125/236] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:22.392771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-679c2847-cee4-4b19-97d5-eac774cd75c8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:22.394018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-679c2847-cee4-4b19-97d5-eac774cd75c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:22.415118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dacf1-ad1a-45e8-8f86-7a9e451b853c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:22.415408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dacf1-ad1a-45e8-8f86-7a9e451b853c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:22.415692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dacf1-ad1a-45e8-8f86-7a9e451b853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:22.455062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e86dacf1-ad1a-45e8-8f86-7a9e451b853c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:22.456316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e86dacf1-ad1a-45e8-8f86-7a9e451b853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:22.529491 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 112/237] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:22.580151 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 126/238] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 00:51:22.812960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c2847-cee4-4b19-97d5-eac774cd75c8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:22.877496 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:22.947272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c2847-cee4-4b19-97d5-eac774cd75c8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:22.996536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:22.997189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:22.997474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:22.998331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:22.999819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:23.001334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:23.003018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 113/239] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:23.008826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dacf1-ad1a-45e8-8f86-7a9e451b853c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.026127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.136773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8b59-13fd-428c-8544-704a4d7bf72a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:23.154291 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:23.177302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:23.177978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.178263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.178540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.190469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:23.195072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dacf1-ad1a-45e8-8f86-7a9e451b853c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:23.195684 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:23.196590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:23.197426 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 114/240] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:23.204330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.251710 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:23.259796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa9317-20d2-4529-bbc6-3711e18934d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:23.260416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9317-20d2-4529-bbc6-3711e18934d7 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.260704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9317-20d2-4529-bbc6-3711e18934d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.260972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa9317-20d2-4529-bbc6-3711e18934d7 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.261628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa9317-20d2-4529-bbc6-3711e18934d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:23.263118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa9317-20d2-4529-bbc6-3711e18934d7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:23.317504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd44d8e-246a-4e57-8bce-ec948cbe75e2 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:23.354325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:23.355035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.355324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.355602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.356279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] RBAC: Adding query filter params (name=reader) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:23.356582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:23.358899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:23.367893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 115/241] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:23.374364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.385799 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 127/242] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:23 2022] POST /identity/v3/users => generated 293 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:23.395183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004080-e0fb-4195-b930-e84dab5c522f None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.395183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004080-e0fb-4195-b930-e84dab5c522f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.395183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21004080-e0fb-4195-b930-e84dab5c522f None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.395183 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 128/243] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:23.397495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775a08-f760-4f96-98e0-2b68d2d29ac1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.398070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775a08-f760-4f96-98e0-2b68d2d29ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.398552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775a08-f760-4f96-98e0-2b68d2d29ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.415173 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:23.423499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0a775a08-f760-4f96-98e0-2b68d2d29ac1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:23.426766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a775a08-f760-4f96-98e0-2b68d2d29ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:23.492022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d72e2e-fe6b-4961-981c-0685e8b61aac None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:23.533629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:23.534327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.534611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.534912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] PATH_INFO: `/v3/users/9fa6cfac18f64973977922904342195a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.548769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 129/244] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:23.552261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] RBAC: Authorizing `identity:get_user(user_id=9fa6cfac18f64973977922904342195a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:23.553850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:23.556017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 116/245] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:23 2022] GET /identity/v3/users/9fa6cfac18f64973977922904342195a => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:23.563030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775a08-f760-4f96-98e0-2b68d2d29ac1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.678320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775a08-f760-4f96-98e0-2b68d2d29ac1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:23.697251 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:23.720087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:23.720850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.721133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.721419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.805599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:23.807125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:23.850059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.948943 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 130/246] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:23.956266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.970071 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:23.975993 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:23.978051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234830b9-faca-484f-bc14-c6431126da92 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:24.015809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.016456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.016739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.017014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.028083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:24.033610 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:24.034756 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:24.035566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:24.040665 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 117/247] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:24.041171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:24.084717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812b7c-0c47-4ae8-bca7-5de7d0f7a373 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:24.124491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.125201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.125490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.125772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.126958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:24.128461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:24.130827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 131/248] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:23 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:24.137079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:24.165075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22e855-2108-46c8-baa3-349e2d566a1f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:24.211980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdf596-7deb-471e-b301-33dc3d83f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.212515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdf596-7deb-471e-b301-33dc3d83f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.212802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdf596-7deb-471e-b301-33dc3d83f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.213084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdf596-7deb-471e-b301-33dc3d83f2b8 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.213765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdf596-7deb-471e-b301-33dc3d83f2b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:24.214810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdf596-7deb-471e-b301-33dc3d83f2b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:24.216276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdf596-7deb-471e-b301-33dc3d83f2b8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:24.228425 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 118/249] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:24.229535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a34ed-0517-4b86-9232-f3a27dd48b1a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.229946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a34ed-0517-4b86-9232-f3a27dd48b1a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.230186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a34ed-0517-4b86-9232-f3a27dd48b1a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.231603 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 119/250] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:24.242826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a34ed-0517-4b86-9232-f3a27dd48b1a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:24.254008 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:24.268795 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:24.277285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e24dc1-0263-4fea-9039-2656211b05df None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:24.324696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f74f9b-1f4d-404e-8caa-c6c16d51fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.326340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74f9b-1f4d-404e-8caa-c6c16d51fb7d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.326340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74f9b-1f4d-404e-8caa-c6c16d51fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.326526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74f9b-1f4d-404e-8caa-c6c16d51fb7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.327223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f74f9b-1f4d-404e-8caa-c6c16d51fb7d None admin] RBAC: Adding query filter params (role.id=0c6e2ebeb67d499588437086fbe9fc5d, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=9fa6cfac18f64973977922904342195a) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:24.327531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f74f9b-1f4d-404e-8caa-c6c16d51fb7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:24.330170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f74f9b-1f4d-404e-8caa-c6c16d51fb7d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:24.346396 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 132/251] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:24 2022] GET /identity/v3/role_assignments?user.id=9fa6cfac18f64973977922904342195a&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=0c6e2ebeb67d499588437086fbe9fc5d => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:24.347975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae6cdd-8003-42b6-8995-6bcb9f892328 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.348264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae6cdd-8003-42b6-8995-6bcb9f892328 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.348540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae6cdd-8003-42b6-8995-6bcb9f892328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.370131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-42ae6cdd-8003-42b6-8995-6bcb9f892328 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:24.371487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-42ae6cdd-8003-42b6-8995-6bcb9f892328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:24.383568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a34ed-0517-4b86-9232-f3a27dd48b1a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:24.433425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f9f2f-e7a2-4b22-8bbe-ce36df6bd7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.434259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f9f2f-e7a2-4b22-8bbe-ce36df6bd7d1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.434838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f9f2f-e7a2-4b22-8bbe-ce36df6bd7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.435713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f9f2f-e7a2-4b22-8bbe-ce36df6bd7d1 None admin] PATH_INFO: `/v3/users/1ba78789dd7e408793f4059222e2e90a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.437549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f9f2f-e7a2-4b22-8bbe-ce36df6bd7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba78789dd7e408793f4059222e2e90a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:24.439467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f9f2f-e7a2-4b22-8bbe-ce36df6bd7d1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:24.441890 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 120/252] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:24 2022] GET /identity/v3/users/1ba78789dd7e408793f4059222e2e90a => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:24.443313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3765-ea84-49d0-8859-5b9309bc16ca None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.443688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3765-ea84-49d0-8859-5b9309bc16ca None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.444050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3765-ea84-49d0-8859-5b9309bc16ca None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.445598 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 121/253] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:24.451589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3765-ea84-49d0-8859-5b9309bc16ca None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:24.485166 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 133/254] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:24.486419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076143-9a48-49f1-ad3b-3cc6b9673e5b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.486705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076143-9a48-49f1-ad3b-3cc6b9673e5b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.486988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3076143-9a48-49f1-ad3b-3cc6b9673e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.521729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b3076143-9a48-49f1-ad3b-3cc6b9673e5b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:24.524353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b3076143-9a48-49f1-ad3b-3cc6b9673e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:24.622198 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:24.634323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3765-ea84-49d0-8859-5b9309bc16ca None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:24.672114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.672914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.673290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.673654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.674970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:24.675348 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 134/255] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:24.676687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:24.682816 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 122/256] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:24 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:24.688459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3076143-9a48-49f1-ad3b-3cc6b9673e5b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:24.708352 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:24.829535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3076143-9a48-49f1-ad3b-3cc6b9673e5b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:24.875561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.876223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.876501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.876785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/1ba78789dd7e408793f4059222e2e90a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.883071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c, user_id=1ba78789dd7e408793f4059222e2e90a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:24.884523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:24.944171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:25.004008 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 135/257] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:24 2022] PUT /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/1ba78789dd7e408793f4059222e2e90a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:25.077346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d20f-1946-425d-9a46-bdecf48844a8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:25.127703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:25.128281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:25.128560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:25.128833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:25.143449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:25.148570 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:25.149590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:25.150558 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 123/258] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:25.152654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:25.155964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:25.176170 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:25.311870 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:25.312246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2c3bb-f7d1-4563-b175-560e2e82d3e6 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:25.353722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf8ce7-72bb-43bb-92f8-f3770cb89979 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:25.363591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:25.364929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:25.365785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:25.366484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:25.367502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:25.368030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:25.370447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:25.389503 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 124/259] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:25.392390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:25.393027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:25.393308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:25.393576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:25.395008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:25.411132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:25.413274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:25.414252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:25.415064 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 136/260] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:25.425054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:25.546030 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:25.570093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740958-8038-48bb-9d62-cc3661726f6b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:25.607922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:25.608676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:25.608956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:25.609229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] PATH_INFO: `/v3/users/5b7ad553ed424605b4c488319060ddb9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:25.614784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7ad553ed424605b4c488319060ddb9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:25.616276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:25.618320 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 125/261] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:25 2022] GET /identity/v3/users/5b7ad553ed424605b4c488319060ddb9 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:25.623931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:25.687874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfc97-a06f-439c-b346-f5aa9660aebd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:25.760369 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:25.791125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:25.791750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:25.792035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:25.792308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:25.792983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:25.793284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:25.795431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:25.809801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d1f80-45af-4cfe-8b8d-17d053e649d4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:25.813452 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 137/262] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:25.823403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:25.880758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:25.881374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:25.881658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:25.881966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:25.907753 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.064486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:26.065982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:26.120857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dc798-fa3a-4906-8b19-3f3cc512e45b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:26.161479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:26.162164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.162506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.162895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] PATH_INFO: `/v3/users/5b7ad553ed424605b4c488319060ddb9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.164033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7ad553ed424605b4c488319060ddb9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:26.165653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:26.167334 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 138/263] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:25 2022] GET /identity/v3/users/5b7ad553ed424605b4c488319060ddb9 => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:26.173298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:26.244605 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.298939 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 126/264] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:51:26.304586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:26.314385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39f3f4-ccf5-4ff9-86b2-bb004e691746 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:26.364990 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.415563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab74e86-6564-4b12-bde6-817103e19bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:26.416194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74e86-6564-4b12-bde6-817103e19bf2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.416473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74e86-6564-4b12-bde6-817103e19bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.416745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74e86-6564-4b12-bde6-817103e19bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.478038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770eb0-0b2c-4de2-bdb7-1ae1fdf58849 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:26.524161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:26.524908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.525195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.525473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.526843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:26.528280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:26.536116 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 127/265] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:26 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:26.537605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:26.593148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab74e86-6564-4b12-bde6-817103e19bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:26.594838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab74e86-6564-4b12-bde6-817103e19bf2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:26.724412 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.760909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e7055-9bf6-4676-9f59-3162221fc509 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:26.773772 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.792352 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 139/266] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:26.793446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9850d-2749-4bd2-96ed-37061fcc2252 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.793730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9850d-2749-4bd2-96ed-37061fcc2252 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.794025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9850d-2749-4bd2-96ed-37061fcc2252 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.796120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 140/267] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:26.803765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c257a-cea6-4756-a76a-ebebcde3eb02 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.803765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c257a-cea6-4756-a76a-ebebcde3eb02 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.803765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c257a-cea6-4756-a76a-ebebcde3eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.820454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d16c257a-cea6-4756-a76a-ebebcde3eb02 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:26.821649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d16c257a-cea6-4756-a76a-ebebcde3eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:26.834732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:26.835761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.836346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.836814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.837878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=5b7ad553ed424605b4c488319060ddb9) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:26.838448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:26.840230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:26.854729 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 128/268] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:26 2022] GET /identity/v3/role_assignments?user.id=5b7ad553ed424605b4c488319060ddb9&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:26.855853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:26.895970 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 141/269] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:26.981601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2071-29f5-4036-88e3-c6d0585d3d23 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.981876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2071-29f5-4036-88e3-c6d0585d3d23 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.982141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2071-29f5-4036-88e3-c6d0585d3d23 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.983627 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 142/270] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:27.003156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3e1d-9765-433b-901b-89c07ca705fb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.003470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3e1d-9765-433b-901b-89c07ca705fb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.003700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a3e1d-9765-433b-901b-89c07ca705fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.041867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a53a3e1d-9765-433b-901b-89c07ca705fb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:27.043099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a53a3e1d-9765-433b-901b-89c07ca705fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:27.053369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5480-6d76-4664-b4f4-10928f907617 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:27.095020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:27.095665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.095946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.096218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.098260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:27.099716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:27.101615 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 129/271] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:26 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:27.110050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:27.177284 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:27.191137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 143/272] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:27.237237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6146a1-fa88-4c7c-bc52-820674642405 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:27.254434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b1877-3f11-4319-a4b4-f92a0fb98f73 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.254869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b1877-3f11-4319-a4b4-f92a0fb98f73 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.255152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b1877-3f11-4319-a4b4-f92a0fb98f73 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.256831 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 144/273] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:27.261626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf23a8-00dd-49da-9e3a-eee5407bc4da None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.262027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf23a8-00dd-49da-9e3a-eee5407bc4da None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.262309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf23a8-00dd-49da-9e3a-eee5407bc4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.277883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:27.278443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.279366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.279639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.280424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] RBAC: Adding query filter params (role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=5b7ad553ed424605b4c488319060ddb9) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:27.280727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:27.282740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:27.289867 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 130/274] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:27 2022] GET /identity/v3/role_assignments?user.id=5b7ad553ed424605b4c488319060ddb9&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:27.295386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7caf23a8-00dd-49da-9e3a-eee5407bc4da None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:27.296651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7caf23a8-00dd-49da-9e3a-eee5407bc4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:27.310838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:27.319975 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:27.441155 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 145/275] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:27.443209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c398f-f453-4509-a52f-bfb7cbcd6adf None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:27.451541 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:27.485830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:27.486514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.486803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.487075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.488295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:27.489708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:27.491876 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 131/276] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:27.497395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf23a8-00dd-49da-9e3a-eee5407bc4da None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:27.619356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf23a8-00dd-49da-9e3a-eee5407bc4da None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:27.628828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:27.666895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:27.667516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.667794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.668064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.668720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:27.670424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:27.752708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29644-ba2b-4a5f-93cf-822a3a092bfc None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:27.787474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:27.788235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.788467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.788650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.790289 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 146/277] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:27 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:27.795749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:27.806653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:27.806877 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:27.813353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:27.814381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:27.817740 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 132/278] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:27.823454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:27.864271 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:27.947295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18610174-ad1e-44e1-a0b9-514c80621087 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:27.993273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962be730-5dbb-4ef3-b2cd-89c3551575f8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.005510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc204450-b373-48a1-ae7f-baa5319e299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.006520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204450-b373-48a1-ae7f-baa5319e299e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.006800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204450-b373-48a1-ae7f-baa5319e299e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.007071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204450-b373-48a1-ae7f-baa5319e299e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.019598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc204450-b373-48a1-ae7f-baa5319e299e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-bc204450-b373-48a1-ae7f-baa5319e299e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:28.024904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:28.025985 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:28.026981 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 147/279] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:28.027731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869abafb-36dc-4817-ae8b-84c9ccf91791 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.028012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869abafb-36dc-4817-ae8b-84c9ccf91791 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.028290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869abafb-36dc-4817-ae8b-84c9ccf91791 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.030831 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 148/280] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:28.036243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869abafb-36dc-4817-ae8b-84c9ccf91791 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.049295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a92cf-e000-43f0-a543-de2e065f40b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.049961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a92cf-e000-43f0-a543-de2e065f40b0 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.050245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a92cf-e000-43f0-a543-de2e065f40b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.050516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a92cf-e000-43f0-a543-de2e065f40b0 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.051190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a92cf-e000-43f0-a543-de2e065f40b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:28.051574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a92cf-e000-43f0-a543-de2e065f40b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.053063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a92cf-e000-43f0-a543-de2e065f40b0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.063698 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 133/281] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:28.064882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854f50d-7853-4ce4-80e1-e4052d2a33a0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.065174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854f50d-7853-4ce4-80e1-e4052d2a33a0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.065453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854f50d-7853-4ce4-80e1-e4052d2a33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.086278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8854f50d-7853-4ce4-80e1-e4052d2a33a0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:28.087488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8854f50d-7853-4ce4-80e1-e4052d2a33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:28.118461 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.166701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869abafb-36dc-4817-ae8b-84c9ccf91791 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.173699 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 134/282] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:28.174411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854f50d-7853-4ce4-80e1-e4052d2a33a0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.206181 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.219149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.220772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.221278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.221744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.223033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] RBAC: Adding query filter params (name=reader) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:28.223911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.225869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.237316 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 149/283] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:28.243353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.295202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854f50d-7853-4ce4-80e1-e4052d2a33a0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.333661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.334335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.334616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.334890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] PATH_INFO: `/v3/users/7f72d2d6ee00449cb473ef310067233f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.352514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] RBAC: Authorizing `identity:get_user(user_id=7f72d2d6ee00449cb473ef310067233f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.354076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.356018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 135/284] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/users/7f72d2d6ee00449cb473ef310067233f => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:28.369614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.392199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc685d1-d98c-45fd-8adf-08b0e1c0e18b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.423060 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.458520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.459579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.460076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.460547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] PATH_INFO: `/v3/users/9fa6cfac18f64973977922904342195a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.463898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] RBAC: Authorizing `identity:get_user(user_id=9fa6cfac18f64973977922904342195a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.465670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.468291 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 150/285] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/users/9fa6cfac18f64973977922904342195a => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:28.474184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.500027 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.518726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f8432-809e-462b-8ab2-d32de524c43a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.558156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.558692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.559106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.559285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.560545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, user.id=7f72d2d6ee00449cb473ef310067233f, scope.system=all) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:28.561570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.563552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.571086 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 136/286] 10.222.0.59 () {56 vars in 1308 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/role_assignments?user.id=7f72d2d6ee00449cb473ef310067233f&scope.system=all&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:28.572351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.650771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5c96-17e4-473f-aaf1-e702d50ed48d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.691600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8e0b8-2a4d-4008-92a5-fae78493c995 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.696074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.696723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.696999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.697271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.703130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.704668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.711541 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 151/287] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:28.715233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.759029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.759683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.759963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.760232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.784049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:28.789237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:28.790562 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:28.791344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:28.792415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 137/288] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:28.798280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.810430 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.816783 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.866679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf256-1c1e-4f58-90c5-241ac6ef3d83 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.918417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.919108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.919381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.919656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/9fa6cfac18f64973977922904342195a/roles/0c6e2ebeb67d499588437086fbe9fc5d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.935149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c, user_id=9fa6cfac18f64973977922904342195a, role_id=0c6e2ebeb67d499588437086fbe9fc5d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.937016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.960484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d241e-a163-4df7-885d-33aa2ee252af None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.996915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.998244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.998526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.998794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.999463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:28.999763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:29.001184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:29.012613 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 152/289] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:51:28 2022] PUT /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/users/9fa6cfac18f64973977922904342195a/roles/0c6e2ebeb67d499588437086fbe9fc5d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:29.017693 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 138/290] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:29.024464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:29.236024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b97a76-616f-435b-bad7-3dfd017a2205 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:29.264268 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:29.287245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:29.287898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:29.293215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:29.293215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] PATH_INFO: `/v3/users/1ba78789dd7e408793f4059222e2e90a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:29.293215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba78789dd7e408793f4059222e2e90a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:29.293215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:29.293215 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 153/291] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:29 2022] GET /identity/v3/users/1ba78789dd7e408793f4059222e2e90a => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:29.300013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:29.384490 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:29.417837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd92f9-2700-4d1f-a9db-60ebabb187f1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:29.474299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:29.474939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:29.475222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:29.475498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:29.592824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:29.597847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:29.689519 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:29.725590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 139/292] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:29.735728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:29.847046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda99be8-3206-432f-8c08-60f08b34f880 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:29.895516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7512584-80f0-4c32-8672-cbd0e176c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:29.896157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512584-80f0-4c32-8672-cbd0e176c0ad None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:29.896435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512584-80f0-4c32-8672-cbd0e176c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:29.896712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512584-80f0-4c32-8672-cbd0e176c0ad None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:29.898799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7512584-80f0-4c32-8672-cbd0e176c0ad None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:29.900255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7512584-80f0-4c32-8672-cbd0e176c0ad None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:29.908458 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 154/293] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:29 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:29.913309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:30.051163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a69acf-470b-4b10-b597-ca4bb98e1d29 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:30.094100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744b0b3-a422-4098-a39d-8444456d81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:30.097890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b0b3-a422-4098-a39d-8444456d81fe None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:30.097890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b0b3-a422-4098-a39d-8444456d81fe None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:30.097890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744b0b3-a422-4098-a39d-8444456d81fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:30.097890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744b0b3-a422-4098-a39d-8444456d81fe None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=1ba78789dd7e408793f4059222e2e90a) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:30.097890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744b0b3-a422-4098-a39d-8444456d81fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:30.097890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744b0b3-a422-4098-a39d-8444456d81fe None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:30.110489 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 140/294] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:29 2022] GET /identity/v3/role_assignments?user.id=1ba78789dd7e408793f4059222e2e90a&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:30.428371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec0b5-76d3-4ccc-8d24-a41668d537d3 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:30.428730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec0b5-76d3-4ccc-8d24-a41668d537d3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:30.428968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec0b5-76d3-4ccc-8d24-a41668d537d3 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:30.430354 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 155/295] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:30.436306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14190bea-1ccf-466b-b592-f8e553078e44 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:30.436586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14190bea-1ccf-466b-b592-f8e553078e44 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:30.436857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14190bea-1ccf-466b-b592-f8e553078e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:30.455746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-14190bea-1ccf-466b-b592-f8e553078e44 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:30.456941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-14190bea-1ccf-466b-b592-f8e553078e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:30.486626 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:30.537110 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 141/296] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:30.674014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0092ee-701d-451f-aab4-1233c26ec381 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:30.674644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0092ee-701d-451f-aab4-1233c26ec381 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:30.675119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0092ee-701d-451f-aab4-1233c26ec381 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:30.676978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 156/297] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:30.682852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11bd3-17e8-409b-9aed-2da9add8bdc7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:30.683129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11bd3-17e8-409b-9aed-2da9add8bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:30.683402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11bd3-17e8-409b-9aed-2da9add8bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:30.704090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c9b11bd3-17e8-409b-9aed-2da9add8bdc7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:30.705272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c9b11bd3-17e8-409b-9aed-2da9add8bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:30.784086 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 142/298] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:30.836650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0092ee-701d-451f-aab4-1233c26ec381 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:30.900862 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:30.947820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0092ee-701d-451f-aab4-1233c26ec381 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:30.985107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41701c-46ff-45ee-b7cf-8ea1d2395e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:30.986152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41701c-46ff-45ee-b7cf-8ea1d2395e0e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:30.986624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41701c-46ff-45ee-b7cf-8ea1d2395e0e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:30.987089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41701c-46ff-45ee-b7cf-8ea1d2395e0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:30.998406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41701c-46ff-45ee-b7cf-8ea1d2395e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-8a41701c-46ff-45ee-b7cf-8ea1d2395e0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:31.004173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:31.005107 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:31.005963 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:31.007827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 157/299] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:31.014605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b11bd3-17e8-409b-9aed-2da9add8bdc7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.093593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698946b-90f8-4754-8a48-b7efec029093 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.094126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698946b-90f8-4754-8a48-b7efec029093 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.094575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698946b-90f8-4754-8a48-b7efec029093 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.096100 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 158/300] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:31.101185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7208938-0c63-4f82-b629-e94376bc10f0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.101465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7208938-0c63-4f82-b629-e94376bc10f0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.101736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7208938-0c63-4f82-b629-e94376bc10f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.123265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d7208938-0c63-4f82-b629-e94376bc10f0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:31.124468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d7208938-0c63-4f82-b629-e94376bc10f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:31.126099 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:31.133624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b11bd3-17e8-409b-9aed-2da9add8bdc7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.169262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:31.169915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.170200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.170477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.171169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:31.171458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:31.172820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:31.182174 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 143/301] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:31.183056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.205577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 159/302] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:31.206221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7208938-0c63-4f82-b629-e94376bc10f0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.266526 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:31.322016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7208938-0c63-4f82-b629-e94376bc10f0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.323053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ed6d6-af56-4eac-bf93-7134d1c5c4d1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.362950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5e617-a280-4dc1-8528-f6b0bfceafa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:31.363594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5e617-a280-4dc1-8528-f6b0bfceafa8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.363877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5e617-a280-4dc1-8528-f6b0bfceafa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.364151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5e617-a280-4dc1-8528-f6b0bfceafa8 None admin] PATH_INFO: `/v3/users/9f9327a6213648db9ac9a7e2fad79e8c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.370845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:31.371740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.373315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.373921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.375554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:31.377983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:31.379666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5e617-a280-4dc1-8528-f6b0bfceafa8 None admin] RBAC: Authorizing `identity:get_user(user_id=9f9327a6213648db9ac9a7e2fad79e8c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:31.381156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5e617-a280-4dc1-8528-f6b0bfceafa8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:31.382893 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 160/303] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/users/9f9327a6213648db9ac9a7e2fad79e8c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:31.384211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5b29-60a9-4fde-8d49-2c2208729ba6 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.384379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5b29-60a9-4fde-8d49-2c2208729ba6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.384477 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 144/304] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:31.384621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c5b29-60a9-4fde-8d49-2c2208729ba6 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.385196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.385973 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 161/305] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:31.391589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f412-5d0e-4e7f-8ed5-ab50d19002e5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.391876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f412-5d0e-4e7f-8ed5-ab50d19002e5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.392153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f412-5d0e-4e7f-8ed5-ab50d19002e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.413111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-33d3f412-5d0e-4e7f-8ed5-ab50d19002e5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:31.414476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33d3f412-5d0e-4e7f-8ed5-ab50d19002e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:31.416653 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:31.488572 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 162/306] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:31.489405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f412-5d0e-4e7f-8ed5-ab50d19002e5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.498212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba323420-9fb7-496d-b8c9-2a9e33b9193a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.530728 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:31.532001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:31.532616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.532893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.533174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.533833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:31.535277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:31.602512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f412-5d0e-4e7f-8ed5-ab50d19002e5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.613289 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 145/307] 10.222.0.59 () {60 vars in 1134 bytes} [Sun Aug 28 00:51:31 2022] POST /identity/v3/groups => generated 229 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:31.614864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.640975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:31.641768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.642147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.642517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.643404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] RBAC: Adding query filter params (role.id=0c6e2ebeb67d499588437086fbe9fc5d, user.id=9f9327a6213648db9ac9a7e2fad79e8c, scope.system=all) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:31.643785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:31.645497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:31.651397 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 163/308] 10.222.0.59 () {56 vars in 1308 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/role_assignments?user.id=9f9327a6213648db9ac9a7e2fad79e8c&scope.system=all&role.id=0c6e2ebeb67d499588437086fbe9fc5d => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:31.735781 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:31.754344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c74d9-bc22-439b-85cc-daae6f5cf0ba None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.771905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.811672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:31.812337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.812623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.813172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.830782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:31.836409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:31.837353 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:31.838380 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 146/309] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:31.844759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:31.909360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066b170-c66c-45da-a7b3-b255123476ae None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.919824 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:31.953944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:31.954623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:31.954905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:31.955184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:31.966576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:31.971662 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:31.972551 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:31.973355 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:31.974019 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 164/310] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:31.983646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0810c-b3d8-49f8-b84d-3466e5626905 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:31.984057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:32.027898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.030241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.030668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.031404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.032527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:32.032973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:32.035045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:32.051630 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 147/311] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:32.052756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:32.067070 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:32.103899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352817-41e0-4d4e-a196-c4708472ffe1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:32.143846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.144631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.144849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.145121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.145792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:32.146136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:32.147708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:32.161761 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 165/312] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:32.162804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:32.188978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb79ee5-a189-4a2f-b482-6a8d6fb86adb None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:32.196897 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:32.237991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.238970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.239630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.240075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] PATH_INFO: `/v3/users/7f72d2d6ee00449cb473ef310067233f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.242070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7f72d2d6ee00449cb473ef310067233f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:32.244284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:32.251277 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 148/313] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:32 2022] GET /identity/v3/users/7f72d2d6ee00449cb473ef310067233f => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:32.252850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:32.292254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f752-f81d-4fc2-b7a6-87c711ec7b06 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:32.334638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.335469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.335891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.336295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] PATH_INFO: `/v3/users/9fa6cfac18f64973977922904342195a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.337796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] RBAC: Authorizing `identity:get_user(user_id=9fa6cfac18f64973977922904342195a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:32.339375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:32.342114 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 166/314] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:32 2022] GET /identity/v3/users/9fa6cfac18f64973977922904342195a => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:32.347893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:32.353953 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:32.385234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affab0e-26cc-4708-b22e-787b8d99e4a4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:32.432631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.433290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.433567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.433870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] PATH_INFO: `/v3/system/users/7f72d2d6ee00449cb473ef310067233f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.436322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7f72d2d6ee00449cb473ef310067233f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:32.437820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:32.461636 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:32.475732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ffe3-39ba-4835-a68a-9c049dcf862e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:32.508372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.509291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.509578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.509855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.544543 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 149/315] 10.222.0.59 () {58 vars in 1334 bytes} [Sun Aug 28 00:51:32 2022] PUT /identity/v3/system/users/7f72d2d6ee00449cb473ef310067233f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:32.595796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:32.597312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:32.703657 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:32.714255 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 167/316] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:51:32.721701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:32.842588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b50e-4e22-43d2-b5f4-0633d7a1824e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:32.880539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a402e-f7fa-4a30-a089-98e1e9210a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.881167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a402e-f7fa-4a30-a089-98e1e9210a1b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.881445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a402e-f7fa-4a30-a089-98e1e9210a1b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.881765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a402e-f7fa-4a30-a089-98e1e9210a1b None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.882963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a402e-f7fa-4a30-a089-98e1e9210a1b None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:32.884392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a402e-f7fa-4a30-a089-98e1e9210a1b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:32.886492 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 150/317] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:32 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:32.893174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:33.003829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad79ed5-90ed-4dba-a895-4fbc9d7578ab None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:33.041985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea38bdc-5d13-4cb8-aea5-8c58c6be09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:33.042997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38bdc-5d13-4cb8-aea5-8c58c6be09cf None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:33.043481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38bdc-5d13-4cb8-aea5-8c58c6be09cf None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:33.045139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea38bdc-5d13-4cb8-aea5-8c58c6be09cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:33.046111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea38bdc-5d13-4cb8-aea5-8c58c6be09cf None admin] RBAC: Adding query filter params (role.id=0c6e2ebeb67d499588437086fbe9fc5d, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c, user.id=9fa6cfac18f64973977922904342195a) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:33.046645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea38bdc-5d13-4cb8-aea5-8c58c6be09cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:33.048310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea38bdc-5d13-4cb8-aea5-8c58c6be09cf None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:33.055315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 168/318] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:51:32 2022] GET /identity/v3/role_assignments?user.id=9fa6cfac18f64973977922904342195a&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=0c6e2ebeb67d499588437086fbe9fc5d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:33.619309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2637-c08b-47b4-a4c4-0f2bae607939 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:33.619859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2637-c08b-47b4-a4c4-0f2bae607939 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:33.619859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2637-c08b-47b4-a4c4-0f2bae607939 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:33.621398 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 151/319] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:33.627196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1bfae-9147-48be-b615-2e0ddb53de6a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:33.627873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1bfae-9147-48be-b615-2e0ddb53de6a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:33.628352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1bfae-9147-48be-b615-2e0ddb53de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:33.648884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a6d1bfae-9147-48be-b615-2e0ddb53de6a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:33.650443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a6d1bfae-9147-48be-b615-2e0ddb53de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:33.705587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6f9f-547e-4e83-83f5-089f9699bc0d None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:33.705925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6f9f-547e-4e83-83f5-089f9699bc0d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:33.706093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6f9f-547e-4e83-83f5-089f9699bc0d None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:33.707480 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 152/320] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:33.710224 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:33.712625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfa8c-f377-4339-9505-fc43a6be1f04 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:33.712912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfa8c-f377-4339-9505-fc43a6be1f04 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:33.713186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfa8c-f377-4339-9505-fc43a6be1f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:33.728457 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:33.733902 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 169/321] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:33.737921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2aedfa8c-f377-4339-9505-fc43a6be1f04 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:33.739136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2aedfa8c-f377-4339-9505-fc43a6be1f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:33.809027 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 153/322] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:34.002542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1bfae-9147-48be-b615-2e0ddb53de6a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:34.082753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfa8c-f377-4339-9505-fc43a6be1f04 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:34.108114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1bfae-9147-48be-b615-2e0ddb53de6a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:34.147203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:34.147852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.148117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.148385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.159423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:34.164170 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:34.165101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:34.165909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:34.170148 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 170/323] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:34.171481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:34.191955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfa8c-f377-4339-9505-fc43a6be1f04 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:34.221624 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:34.230637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:34.231822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.233632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.233632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.233788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:34.235317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:34.237100 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 154/324] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:34.242497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:34.248780 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:34.281558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd032c-f41f-43b5-b9bc-887507443b83 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:34.318772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:34.319409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.319653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.319923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.320573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:34.320869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:34.322260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:34.336775 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 171/325] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:34.337430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:34.354673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9aa36-6b55-4ec5-b6f4-77c7d1df5b67 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:34.393763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fd558-1f16-4866-be26-83225cc7214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:34.394402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd558-1f16-4866-be26-83225cc7214d None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.394684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd558-1f16-4866-be26-83225cc7214d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.394956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd558-1f16-4866-be26-83225cc7214d None admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.395591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fd558-1f16-4866-be26-83225cc7214d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:34.397132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fd558-1f16-4866-be26-83225cc7214d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:34.444808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a19f7-3096-45f8-9e0b-67846233db0d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:34.452861 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:34.479221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:34.479852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.480132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.480402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] PATH_INFO: `/v3/users/9f9327a6213648db9ac9a7e2fad79e8c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.481526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] RBAC: Authorizing `identity:get_user(user_id=9f9327a6213648db9ac9a7e2fad79e8c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:34.483119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:34.484708 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 172/326] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:34 2022] GET /identity/v3/users/9f9327a6213648db9ac9a7e2fad79e8c => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:34.490336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:34.534912 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 155/327] 10.222.0.59 () {60 vars in 1134 bytes} [Sun Aug 28 00:51:34 2022] POST /identity/v3/groups => generated 226 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:51:34.535124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de5c2-847c-4b00-9ec3-d12d86a9ca92 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.535265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de5c2-847c-4b00-9ec3-d12d86a9ca92 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.535544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de5c2-847c-4b00-9ec3-d12d86a9ca92 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.536869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 156/328] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:34.542735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37bd29-4c51-4eed-a11f-fc36c5a3487f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.542934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37bd29-4c51-4eed-a11f-fc36c5a3487f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.543247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37bd29-4c51-4eed-a11f-fc36c5a3487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.563677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ba37bd29-4c51-4eed-a11f-fc36c5a3487f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:34.565023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ba37bd29-4c51-4eed-a11f-fc36c5a3487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:34.609622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a6c2f-05c0-4155-b256-7b5034bceda6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:34.632792 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:34.642985 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 157/329] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:34.651265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:34.651937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:34.652211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:34.652481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] PATH_INFO: `/v3/system/users/9f9327a6213648db9ac9a7e2fad79e8c/roles/0c6e2ebeb67d499588437086fbe9fc5d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:34.654294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f9327a6213648db9ac9a7e2fad79e8c, role_id=0c6e2ebeb67d499588437086fbe9fc5d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:34.655695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:34.722800 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 173/330] 10.222.0.59 () {58 vars in 1334 bytes} [Sun Aug 28 00:51:34 2022] PUT /identity/v3/system/users/9f9327a6213648db9ac9a7e2fad79e8c/roles/0c6e2ebeb67d499588437086fbe9fc5d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:51:34.917682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37bd29-4c51-4eed-a11f-fc36c5a3487f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:35.030027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37bd29-4c51-4eed-a11f-fc36c5a3487f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:35.069903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:35.070935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:35.071412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:35.071885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:35.091255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:35.096156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:35.097039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:35.097883 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 158/331] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:35.103633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:35.162305 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:35.249667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966fa1f-15be-4f4c-ae79-49c784cb80e3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:35.300793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:35.301432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:35.301718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:35.302020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:35.302743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:35.303046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:35.304452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:35.320327 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 174/332] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:35.326268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:35.396517 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:35.458814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de9e0-f790-4b81-8947-0236db44b5f1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:35.506629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ab78-667c-4e3d-9427-b87a3036f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:35.507586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ab78-667c-4e3d-9427-b87a3036f3dd None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:35.508069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ab78-667c-4e3d-9427-b87a3036f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:35.508561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ab78-667c-4e3d-9427-b87a3036f3dd None admin] PATH_INFO: `/v3/users/7f72d2d6ee00449cb473ef310067233f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:35.511720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ab78-667c-4e3d-9427-b87a3036f3dd None admin] RBAC: Authorizing `identity:get_user(user_id=7f72d2d6ee00449cb473ef310067233f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:35.513474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ab78-667c-4e3d-9427-b87a3036f3dd None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:35.515758 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 159/333] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:35 2022] GET /identity/v3/users/7f72d2d6ee00449cb473ef310067233f => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:35.521383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:35.700724 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:35.704148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a9178-f1de-4822-8e2c-ac004c772faf None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:35.745856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcff3c-a9a6-4797-bfcf-f03b2e2a769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:35.746461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcff3c-a9a6-4797-bfcf-f03b2e2a769e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:35.747304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcff3c-a9a6-4797-bfcf-f03b2e2a769e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:35.747678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcff3c-a9a6-4797-bfcf-f03b2e2a769e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:35.748722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcff3c-a9a6-4797-bfcf-f03b2e2a769e None admin] RBAC: Adding query filter params (role.id=8af003ee18d04126ab4eb7661d7a6dd7, user.id=7f72d2d6ee00449cb473ef310067233f, scope.system=all) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:35.749038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcff3c-a9a6-4797-bfcf-f03b2e2a769e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:35.750515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcff3c-a9a6-4797-bfcf-f03b2e2a769e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:35.770454 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 175/334] 10.222.0.59 () {56 vars in 1308 bytes} [Sun Aug 28 00:51:35 2022] GET /identity/v3/role_assignments?user.id=7f72d2d6ee00449cb473ef310067233f&scope.system=all&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 510 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:37.038251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44de9-5e55-4224-87b5-8cabaab66019 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.038776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44de9-5e55-4224-87b5-8cabaab66019 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.038776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f44de9-5e55-4224-87b5-8cabaab66019 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.040516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 160/335] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:37.047425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec26-705c-456e-98e2-58dcaad1cf56 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.047898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec26-705c-456e-98e2-58dcaad1cf56 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.047973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec26-705c-456e-98e2-58dcaad1cf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.067953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0d8eec26-705c-456e-98e2-58dcaad1cf56 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:37.069153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0d8eec26-705c-456e-98e2-58dcaad1cf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:37.121739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13de339-c002-4c5f-86e3-66161932c3af None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.121739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13de339-c002-4c5f-86e3-66161932c3af None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.121739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13de339-c002-4c5f-86e3-66161932c3af None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.122412 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 161/336] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:37.127152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743086c-6df1-4ef8-886b-4be40b5c2a10 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.127642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743086c-6df1-4ef8-886b-4be40b5c2a10 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.128115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743086c-6df1-4ef8-886b-4be40b5c2a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.157964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4743086c-6df1-4ef8-886b-4be40b5c2a10 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:37.159441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4743086c-6df1-4ef8-886b-4be40b5c2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:37.170433 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 176/337] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:37.270784 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 162/338] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:37.630477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c6c6-b2f6-4690-a353-61b082f8106c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.630851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c6c6-b2f6-4690-a353-61b082f8106c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.631134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c6c6-b2f6-4690-a353-61b082f8106c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.632667 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 177/339] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:37.639024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0461d-2c51-4ad3-bf60-8e07ed869ab9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.639695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0461d-2c51-4ad3-bf60-8e07ed869ab9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.640281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0461d-2c51-4ad3-bf60-8e07ed869ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.644530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4b19-188c-487d-b282-c8710e0698af None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.645035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4b19-188c-487d-b282-c8710e0698af None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.645540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e4b19-188c-487d-b282-c8710e0698af None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.649529 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 178/340] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:37.656144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569d40-360a-4f60-84a9-958ef5f71383 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:37.656723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569d40-360a-4f60-84a9-958ef5f71383 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:37.657254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569d40-360a-4f60-84a9-958ef5f71383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:37.685432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8ba0461d-2c51-4ad3-bf60-8e07ed869ab9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:37.687096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8ba0461d-2c51-4ad3-bf60-8e07ed869ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:37.700966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-39569d40-360a-4f60-84a9-958ef5f71383 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:37.705112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-39569d40-360a-4f60-84a9-958ef5f71383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:37.801313 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 179/341] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:37.803183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569d40-360a-4f60-84a9-958ef5f71383 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:37.804376 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 163/342] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:37.805430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0461d-2c51-4ad3-bf60-8e07ed869ab9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:37.808037 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:37.843875 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:38.049546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0461d-2c51-4ad3-bf60-8e07ed869ab9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.103425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569d40-360a-4f60-84a9-958ef5f71383 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.105183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.105904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.109836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.109836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.124640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:38.133978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:38.134889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:38.135692 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 164/343] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:38.143647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.168508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.172453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.172453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.172453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.191703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:38.197742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:38.198681 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:38.199604 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:38.205329 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 180/344] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:38.207538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.222213 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:38.324276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d7cb6-596e-4ed4-8474-b593252ea982 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.367754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3030f-662c-4613-8b7c-96cd1118a47c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.370303 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:38.374577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.375206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.375498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.375774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.376461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] RBAC: Adding query filter params (name=reader) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:38.376765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:38.378315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:38.389232 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 165/345] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:38.390170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.414725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.415369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.416820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.417101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.436692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:38.444392 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:38.445417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:38.446286 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 181/346] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:38.446956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.534604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae9df1-ef8c-480e-ba19-90626cb9aedc None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.538909 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:38.573497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.574141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.575036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.575285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.575908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:38.576206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:38.577851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:38.579579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5603e-a62b-46d3-89f8-362ba8522f9d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.589952 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 166/347] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:38.591012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.622968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.623932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.624221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.624507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.634562 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:38.640618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:38.647128 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:38.648223 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:38.649219 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:38.651908 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 182/348] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:38.653621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.736099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376fc0-4362-4ffa-b09d-ae571c312bbc None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.785178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.786111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.786523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.786926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] PATH_INFO: `/v3/users/9f9327a6213648db9ac9a7e2fad79e8c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.788707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] RBAC: Authorizing `identity:get_user(user_id=9f9327a6213648db9ac9a7e2fad79e8c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:38.790638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:38.791610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856e868-a378-470b-9e12-d8ed26e7e5b9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.793049 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 167/349] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/users/9f9327a6213648db9ac9a7e2fad79e8c => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:38.794924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.838928 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:38.842880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.843513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.843798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.844076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:38.844755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:38.845114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:38.846574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:38.857888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 183/350] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:38.861475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:38.927347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6889-e135-40c3-96e8-2d64f5d393fe None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:38.943211 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:38.978688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5c8b1-a397-4e9b-bde5-de1423f36e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:38.979296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5c8b1-a397-4e9b-bde5-de1423f36e66 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:38.979572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5c8b1-a397-4e9b-bde5-de1423f36e66 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:38.979839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5c8b1-a397-4e9b-bde5-de1423f36e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.008191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1b0d2-6e07-4c7b-89d1-cae3cdb3ce4a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:39.068132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:39.068967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.069245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.069516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.070394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:39.071013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:39.072448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:39.081850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 184/351] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:39.082013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5c8b1-a397-4e9b-bde5-de1423f36e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:39.082667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:39.083895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5c8b1-a397-4e9b-bde5-de1423f36e66 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:39.135120 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:39.225055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626a9c-6427-4f7f-9bf0-b080595e7f9f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:39.229697 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 168/352] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:39.230899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719d63c-4042-4bf7-a18e-820eee516c86 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.231195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719d63c-4042-4bf7-a18e-820eee516c86 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.231487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719d63c-4042-4bf7-a18e-820eee516c86 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.233060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 169/353] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:39.233481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719d63c-4042-4bf7-a18e-820eee516c86 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:39.258039 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:39.276856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:39.277463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.277801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.278593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.279631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] RBAC: Adding query filter params (role.id=0c6e2ebeb67d499588437086fbe9fc5d, user.id=9f9327a6213648db9ac9a7e2fad79e8c, scope.system=all) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:39.279943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:39.281409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:39.300065 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 185/354] 10.222.0.59 () {56 vars in 1308 bytes} [Sun Aug 28 00:51:39 2022] GET /identity/v3/role_assignments?user.id=9f9327a6213648db9ac9a7e2fad79e8c&scope.system=all&role.id=0c6e2ebeb67d499588437086fbe9fc5d => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:39.300976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:39.388752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719d63c-4042-4bf7-a18e-820eee516c86 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:39.453494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:39.454218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.454533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.454785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.457735 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:39.457894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a06e2-5053-4df1-96aa-c611b2f1dfc4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:39.504785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bacfb-4e81-4027-a591-0020ca0dcbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:39.505512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bacfb-4e81-4027-a591-0020ca0dcbd1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.505793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bacfb-4e81-4027-a591-0020ca0dcbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.506760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bacfb-4e81-4027-a591-0020ca0dcbd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.547449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:39.549039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:39.565168 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:39.593748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bacfb-4e81-4027-a591-0020ca0dcbd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:39.593748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bacfb-4e81-4027-a591-0020ca0dcbd1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:39.674065 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 170/355] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:39.674968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:39.713349 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 186/356] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:39.715193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd777b8-7440-4228-8ee0-f6066f6adb8a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.715193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd777b8-7440-4228-8ee0-f6066f6adb8a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.715362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd777b8-7440-4228-8ee0-f6066f6adb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.718156 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:39.736656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2fd777b8-7440-4228-8ee0-f6066f6adb8a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:39.737911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2fd777b8-7440-4228-8ee0-f6066f6adb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:39.798505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f9257-73c8-46f3-b320-91254970d717 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:39.820636 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 187/357] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:39.822243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda85-e33b-45fa-bd26-3ebbc1c998f7 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.822775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda85-e33b-45fa-bd26-3ebbc1c998f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.823197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eda85-e33b-45fa-bd26-3ebbc1c998f7 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.825184 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 188/358] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:39.826112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eda85-e33b-45fa-bd26-3ebbc1c998f7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:39.844174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:39.844821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:39.845104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:39.845503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:39.846941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:39.848393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:39.848553 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:39.850122 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 171/359] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:39 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:39.850906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:39.961948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eda85-e33b-45fa-bd26-3ebbc1c998f7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:39.978724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874656-0973-490f-b969-fb23e5bd38b4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:39.980421 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:40.009324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7e78b-3a01-4946-89c4-12d83120387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.010997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e78b-3a01-4946-89c4-12d83120387c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.010997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e78b-3a01-4946-89c4-12d83120387c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.010997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7e78b-3a01-4946-89c4-12d83120387c None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.011625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e78b-3a01-4946-89c4-12d83120387c None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.013720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7e78b-3a01-4946-89c4-12d83120387c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.019326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 189/360] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:39 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.019326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deb84b-c6ac-4dea-83be-45d428b824c0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.019326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deb84b-c6ac-4dea-83be-45d428b824c0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.019326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deb84b-c6ac-4dea-83be-45d428b824c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.026654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.026972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.027193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.027462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.029130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.030515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.032372 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 172/361] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:39 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.033969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.038470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c5deb84b-c6ac-4dea-83be-45d428b824c0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:40.039673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c5deb84b-c6ac-4dea-83be-45d428b824c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:40.119491 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 190/362] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:40.120349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deb84b-c6ac-4dea-83be-45d428b824c0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.131065 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:40.164833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0278b-56c6-4954-8f4f-1b4e2f9b750c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.218445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.219401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.219853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.220309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.227824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.229268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.231586 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 173/363] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.232448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.260180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deb84b-c6ac-4dea-83be-45d428b824c0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.280659 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:40.313215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.314214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.314816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.315309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.317417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.319251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.321485 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 191/364] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.322580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.375784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12b4f-9b4c-4499-93da-5c634de2fb56 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.419325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.419325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.419325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.419325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.423786 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:40.423939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.425398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.427930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 174/365] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.427930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.455267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b70d-5f5d-4ffe-8d3d-23c6b14c5382 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.495601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.496843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.497287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.497765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.510392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:40.516052 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:40.516997 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:40.518030 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 192/366] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:40.522614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.553524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8100226-c8d0-44e9-b530-dc675ac5eaf5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.555301 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:40.593293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.593941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.594220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.594541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.595380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=ce2be326599045af941a207eb00a1476) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:40.597527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.597527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.603332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 175/367] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.604384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.666006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4c566-bf3b-4312-9b26-9cc1f24ac63b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.722351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.723336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.723614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.723887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.724650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=ce2be326599045af941a207eb00a1476) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:40.724958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.727726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.731531 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:40.736085 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 193/368] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.740000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.766813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b37dc-15e0-4129-9621-92a89d3a3536 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.818447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.819261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.819772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.820157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.833730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:40.839842 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:40.841460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:40.842297 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:40.842893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 176/369] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:40.843457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.871716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece2fa-7b80-46f3-b97c-2deaacae44ec None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:40.879338 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:40.922924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:40.923540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:40.923844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:40.924633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:40.924853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:40.926403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:40.927407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:40.935468 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 194/370] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:40.936203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:40.989204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28278f-2849-4cfc-844c-aabe37b30b82 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.022450 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:41.041929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.043936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.044488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.045431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:41.046760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:41.047278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:41.049700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:41.061911 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 177/371] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:41.070404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:41.076996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4976-e0db-499b-896a-60e9c63b38c2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.127392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.128016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.128768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.129117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:41.130229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:41.130551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:41.132291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:41.144708 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 195/372] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:41.150753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:41.217163 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:41.244359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cd8f6-0ac6-4d3c-9344-0a0d72243342 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.282922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83532aa-9bdd-48ba-b905-626be745a559 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.289420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.290095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.290527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.290812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:41.316891 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:41.329462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.333911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.333911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.333911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:41.375058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:41.376733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:41.422330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:41.423829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:41.489992 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:41.504916 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 178/373] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:51:41.512456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:41.553940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 196/374] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:51:41.559560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:41.595474 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:41.652411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48707a8-a19b-455c-b1b7-fe274377c6e1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.692887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe80a5-e5cb-4d37-b6a7-0ba9052e1923 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.697554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.698314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.698656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.699006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:41.700286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:41.702216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:41.708954 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 179/375] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:41 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:41.715605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:41.760879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.761861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.762298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.762707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] PATH_INFO: `/v3/projects/651780a5477f4d4a87199d4613e97281` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:41.764089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] RBAC: Authorizing `identity:get_project(project_id=651780a5477f4d4a87199d4613e97281)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:41.774632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:41.776969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 197/376] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:41 2022] GET /identity/v3/projects/651780a5477f4d4a87199d4613e97281 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:41.781297 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:41.784214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:41.832660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860f5a-6d24-4cd5-9de7-5e992eb76b65 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.878162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.878807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.879085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.879517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:41.882602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:41.884052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:41.885981 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 180/377] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:41 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:41.894839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:41.939198 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:41.946035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae916d1-0aab-4418-b383-14123da19ede None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:41.993441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:41.994213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:41.994557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:41.994893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] PATH_INFO: `/v3/groups/106cbf2edea74fdd84ed5220848f651d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:42.002197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] RBAC: Authorizing `identity:get_group(group_id=106cbf2edea74fdd84ed5220848f651d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:42.003742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:42.005413 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 198/378] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:41 2022] GET /identity/v3/groups/106cbf2edea74fdd84ed5220848f651d => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:42.011398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:42.098526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca30d-e873-4acb-a559-03dfc7c6767f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:42.167396 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:42.172761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06e66f-9712-41ad-b421-04d9e9cf94bf None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:42.201170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d11f3-df53-408b-aecb-63fe5dd21f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:42.202398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d11f3-df53-408b-aecb-63fe5dd21f48 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:42.203717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d11f3-df53-408b-aecb-63fe5dd21f48 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:42.204862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d11f3-df53-408b-aecb-63fe5dd21f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:42.205797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d11f3-df53-408b-aecb-63fe5dd21f48 None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:42.206480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d11f3-df53-408b-aecb-63fe5dd21f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:42.209180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d11f3-df53-408b-aecb-63fe5dd21f48 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:42.218942 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 181/379] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:41 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 260 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:42.230215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27e78b-ebb6-4098-8718-264ee87c48eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:42.231858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27e78b-ebb6-4098-8718-264ee87c48eb None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:42.232343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27e78b-ebb6-4098-8718-264ee87c48eb None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:42.232901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27e78b-ebb6-4098-8718-264ee87c48eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:42.233853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27e78b-ebb6-4098-8718-264ee87c48eb None admin] RBAC: Adding query filter params (group.id=106cbf2edea74fdd84ed5220848f651d, role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=651780a5477f4d4a87199d4613e97281) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:42.234370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27e78b-ebb6-4098-8718-264ee87c48eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:42.236007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27e78b-ebb6-4098-8718-264ee87c48eb None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:42.246275 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 199/380] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:42 2022] GET /identity/v3/role_assignments?group.id=106cbf2edea74fdd84ed5220848f651d&scope.project.id=651780a5477f4d4a87199d4613e97281&role.id=6ef968d350d64b4496757a252fa42707 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:43.072736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542d41c-d9fb-421d-9873-e56cbedf3ded None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.073139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542d41c-d9fb-421d-9873-e56cbedf3ded None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.073323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542d41c-d9fb-421d-9873-e56cbedf3ded None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.075530 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 182/381] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:43.077251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c05c1-5715-4904-a11d-078578c2a8dc None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.077693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c05c1-5715-4904-a11d-078578c2a8dc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.077781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c05c1-5715-4904-a11d-078578c2a8dc None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.079212 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 200/382] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:43.084382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125105-9e58-4930-863e-9d562858fcd7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.084667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125105-9e58-4930-863e-9d562858fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.084945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125105-9e58-4930-863e-9d562858fcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.090748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9360-8bca-47f9-a29c-4aa9b18b5a7e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.091026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9360-8bca-47f9-a29c-4aa9b18b5a7e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.091291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9360-8bca-47f9-a29c-4aa9b18b5a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.104423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7c125105-9e58-4930-863e-9d562858fcd7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:43.105711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7c125105-9e58-4930-863e-9d562858fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:43.122869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-544f9360-8bca-47f9-a29c-4aa9b18b5a7e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:43.124125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-544f9360-8bca-47f9-a29c-4aa9b18b5a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:43.166196 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:43.214396 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 183/383] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:43.244666 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 201/384] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:43.571233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c125105-9e58-4930-863e-9d562858fcd7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:43.641258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a314cf-a245-44d2-8112-7ec432793d46 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.641928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a314cf-a245-44d2-8112-7ec432793d46 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.642482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a314cf-a245-44d2-8112-7ec432793d46 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.644326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 202/385] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:43.647705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a314cf-a245-44d2-8112-7ec432793d46 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:43.714761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c125105-9e58-4930-863e-9d562858fcd7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:43.739584 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:43.771406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8c210-aa6a-4543-ae97-55b61d83581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:43.772543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c210-aa6a-4543-ae97-55b61d83581a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.772899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c210-aa6a-4543-ae97-55b61d83581a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.773254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c210-aa6a-4543-ae97-55b61d83581a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.788091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8c210-aa6a-4543-ae97-55b61d83581a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:43.790777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a314cf-a245-44d2-8112-7ec432793d46 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-0de8c210-aa6a-4543-ae97-55b61d83581a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:43.795524 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:43.796460 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:43.797409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 184/386] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:43.798700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86631f76-99eb-4de4-85bb-0eb95a8cea04 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.798802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86631f76-99eb-4de4-85bb-0eb95a8cea04 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.799086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86631f76-99eb-4de4-85bb-0eb95a8cea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.822658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-86631f76-99eb-4de4-85bb-0eb95a8cea04 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:43.823842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-86631f76-99eb-4de4-85bb-0eb95a8cea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:43.844097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:43.845041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:43.845539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:43.846099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:43.861563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:43.868369 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:43.869278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:43.870134 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:43.877957 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 203/387] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:43.878881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:43.897490 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:43.911225 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 185/388] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:43.912724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86631f76-99eb-4de4-85bb-0eb95a8cea04 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.030632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86631f76-99eb-4de4-85bb-0eb95a8cea04 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.040851 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:44.061143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8d42-4179-4527-a69c-21fa6a62f547 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.071934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.071934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.071934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.071934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.072268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:44.072268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.073793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.097268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.097994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.098470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.098923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.100060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] RBAC: Adding query filter params (name=member) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:44.108991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.108991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.109715 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 186/389] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:44.111047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.112401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 204/390] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:44.117985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.202785 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:44.224343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c144a-05f9-4828-927e-00d5d63e39ef None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.262634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.263269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.263547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.263817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.264951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.266488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.268557 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 205/391] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:44 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:44.273722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.282627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ba41b-b77e-4d41-a834-259390272d5b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.329760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.330418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.330753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.331048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.332731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.334639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.340889 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 187/392] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:44 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:44.340889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.391013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c810c62-f864-4c16-95ea-91bbd0401bd7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.396674 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:44.439556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.440570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.441066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.441417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.453740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:44.459526 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:44.460442 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:44.461273 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 206/393] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:44.466695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.470020 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:44.491329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159deb99-ee59-438f-ac21-34a7eaf16091 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.530090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.531106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.531640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.532178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.535167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.535771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.545546 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 188/394] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:44 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:44.546871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.598441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a97f0-67cc-4edb-b71a-4db0e9abb000 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.636420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.637197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.637483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.637756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.638912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.640359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.642042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 207/395] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:44 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:44.642787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.661293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ea76b-6521-4109-b125-ed58b64ec47c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.671127 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:44.698673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cb61d-1eab-4075-8bfe-48cac1b80e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.699513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cb61d-1eab-4075-8bfe-48cac1b80e51 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.699910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cb61d-1eab-4075-8bfe-48cac1b80e51 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.700211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cb61d-1eab-4075-8bfe-48cac1b80e51 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.700951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cb61d-1eab-4075-8bfe-48cac1b80e51 None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:44.701592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cb61d-1eab-4075-8bfe-48cac1b80e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.703079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cb61d-1eab-4075-8bfe-48cac1b80e51 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.717409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 189/396] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:44.717409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6261e8-77d8-484b-9156-2337568093ec None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.717409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6261e8-77d8-484b-9156-2337568093ec None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.717409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6261e8-77d8-484b-9156-2337568093ec None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.717409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 190/397] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:44.717943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6261e8-77d8-484b-9156-2337568093ec None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.724643 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:44.755978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e023e4-b4c4-45c8-9b7d-313826f0b567 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.790405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3be3d5-3a27-434b-83f9-2e1c902d481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.790984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3be3d5-3a27-434b-83f9-2e1c902d481d None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.791263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3be3d5-3a27-434b-83f9-2e1c902d481d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.791536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3be3d5-3a27-434b-83f9-2e1c902d481d None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.794196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3be3d5-3a27-434b-83f9-2e1c902d481d None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2be326599045af941a207eb00a1476, group_id=a41b8dee474e485bbdbfe9780a9f23ec, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.795642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3be3d5-3a27-434b-83f9-2e1c902d481d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.822952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6261e8-77d8-484b-9156-2337568093ec None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:44.856715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af5660-974e-478f-93ce-c3438f99a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:44.857376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5660-974e-478f-93ce-c3438f99a305 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.857654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5660-974e-478f-93ce-c3438f99a305 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.857960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5660-974e-478f-93ce-c3438f99a305 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.860108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af5660-974e-478f-93ce-c3438f99a305 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce2be326599045af941a207eb00a1476, group_id=a41b8dee474e485bbdbfe9780a9f23ec, role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:44.861526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af5660-974e-478f-93ce-c3438f99a305 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:44.863184 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 208/398] 10.222.0.59 () {58 vars in 1442 bytes} [Sun Aug 28 00:51:44 2022] PUT /identity/v3/projects/ce2be326599045af941a207eb00a1476/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:44.864502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e791d4-e83e-41ec-b7b4-579f0dbf3650 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.864792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e791d4-e83e-41ec-b7b4-579f0dbf3650 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.865068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e791d4-e83e-41ec-b7b4-579f0dbf3650 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.866393 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 209/399] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:44.867153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e791d4-e83e-41ec-b7b4-579f0dbf3650 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:44.944135 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 191/400] 10.222.0.59 () {58 vars in 1442 bytes} [Sun Aug 28 00:51:44 2022] PUT /identity/v3/projects/ce2be326599045af941a207eb00a1476/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/91d76748bf16477db62b3cd689f60fd2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:44.955351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c5c9-79a7-413e-97da-cf4e264bab63 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:44.955712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c5c9-79a7-413e-97da-cf4e264bab63 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:44.955908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c5c9-79a7-413e-97da-cf4e264bab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:44.985157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0f68c5c9-79a7-413e-97da-cf4e264bab63 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:44.987464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f68c5c9-79a7-413e-97da-cf4e264bab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:44.998241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e791d4-e83e-41ec-b7b4-579f0dbf3650 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:45.030923 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:45.042252 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:45.049345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f4102-0487-42d0-a3c4-e28690ac4ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:45.051538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f4102-0487-42d0-a3c4-e28690ac4ed2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:45.051538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f4102-0487-42d0-a3c4-e28690ac4ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:45.051538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f4102-0487-42d0-a3c4-e28690ac4ed2 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:45.051785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f4102-0487-42d0-a3c4-e28690ac4ed2 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:45.053202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f4102-0487-42d0-a3c4-e28690ac4ed2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:45.055046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 210/401] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:44 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:45.057853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9856c-53f9-453f-8c7b-1b37500190b6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:45.057853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9856c-53f9-453f-8c7b-1b37500190b6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:45.057853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9856c-53f9-453f-8c7b-1b37500190b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:45.088039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7bb9856c-53f9-453f-8c7b-1b37500190b6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:45.090985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7bb9856c-53f9-453f-8c7b-1b37500190b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:45.100247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 192/402] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:45.101451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68c5c9-79a7-413e-97da-cf4e264bab63 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:45.190484 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 211/403] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:45.225125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68c5c9-79a7-413e-97da-cf4e264bab63 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:45.268247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:45.268890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:45.269168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:45.269441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:45.270592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:45.272042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:45.274175 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 193/404] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:45 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:45.280468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9856c-53f9-453f-8c7b-1b37500190b6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:45.403207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9856c-53f9-453f-8c7b-1b37500190b6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:45.425853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:45.446683 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:45.454559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:45.459145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:45.459145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:45.459145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:45.459145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c, group_id=a41b8dee474e485bbdbfe9780a9f23ec, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:45.460130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:45.476792 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:45.557073 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 212/405] 10.222.0.59 () {58 vars in 1442 bytes} [Sun Aug 28 00:51:45 2022] PUT /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:45.563576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711c17-9f13-429b-9e4b-603f74d2bce4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:45.605416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:45.607019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:45.607585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:45.608097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:45.620679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:45.626134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:45.627039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:45.627889 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:45.630785 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 194/406] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:45.639001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:45.683760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:45.802856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4f9b9-4a70-4bbb-870e-d112a09ac3e9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:45.822592 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:45.843043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1af97-b0b8-4019-af67-a1d7285c652e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:45.857332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:45.857332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:45.857332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:45.857332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:45.857828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:45.857828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:45.857828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:45.873718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 213/407] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:45.879322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:45.895560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:45.896566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:45.896997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:45.897430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:45.924287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:45.929998 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:45.931072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:45.932093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:45.940404 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 195/408] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:45.947791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:46.001019 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:46.108929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f0e3-0d4d-407d-b12e-1b74b1b4ac98 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:46.161684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:46.164284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:46.164780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:46.165325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] PATH_INFO: `/v3/groups/106cbf2edea74fdd84ed5220848f651d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:46.166690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] RBAC: Authorizing `identity:get_group(group_id=106cbf2edea74fdd84ed5220848f651d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:46.168567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:46.170537 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 214/409] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:45 2022] GET /identity/v3/groups/106cbf2edea74fdd84ed5220848f651d => generated 229 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:46.178741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:46.191885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b8d5-18d9-4152-8d51-9d2958273bf1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:46.282115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:46.282937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:46.283338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:46.283715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:46.284495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:46.284902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:46.286406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:46.297008 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 196/410] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:46.303038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:46.320677 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:46.333306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b24d9-819b-4d49-afcc-55eb7667739d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:46.373611 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:46.405540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:46.406204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:46.407003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:46.407003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] PATH_INFO: `/v3/projects/651780a5477f4d4a87199d4613e97281` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:46.414746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] RBAC: Authorizing `identity:get_project(project_id=651780a5477f4d4a87199d4613e97281)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:46.416239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:46.420906 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 215/411] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:46 2022] GET /identity/v3/projects/651780a5477f4d4a87199d4613e97281 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:46.430789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:46.466131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657f0a-231e-474d-bddf-da53e406111c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:46.501281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:46.501949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:46.502232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:46.502585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:46.503663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:46.505146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:46.507077 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 197/412] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:46 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:46.514528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:46.644025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557b58-58d3-4569-89ff-1fb4218812b9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:46.674518 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:46.698209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4807e38-8e79-4b3b-b0cd-b5efb05ed157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:46.698883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4807e38-8e79-4b3b-b0cd-b5efb05ed157 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:46.699216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4807e38-8e79-4b3b-b0cd-b5efb05ed157 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:46.699609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4807e38-8e79-4b3b-b0cd-b5efb05ed157 None admin] PATH_INFO: `/v3/projects/651780a5477f4d4a87199d4613e97281/groups/106cbf2edea74fdd84ed5220848f651d/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:46.703109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4807e38-8e79-4b3b-b0cd-b5efb05ed157 None admin] RBAC: Authorizing `identity:create_grant(project_id=651780a5477f4d4a87199d4613e97281, group_id=106cbf2edea74fdd84ed5220848f651d, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:46.704564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4807e38-8e79-4b3b-b0cd-b5efb05ed157 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:46.715994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a34dc-6175-45a0-b9cd-bc561c2ef2c8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:46.753263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:46.753965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:46.754253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:46.754535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:46.755691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:46.757145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:46.759350 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 198/413] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:46 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:46.766790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:46.837874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 216/414] 10.222.0.59 () {58 vars in 1442 bytes} [Sun Aug 28 00:51:46 2022] PUT /identity/v3/projects/651780a5477f4d4a87199d4613e97281/groups/106cbf2edea74fdd84ed5220848f651d/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:46.880303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f6eff-52df-4cf1-ac38-722ab19c3e42 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:46.918621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09183de-85fc-4513-a260-dbc851e22bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:46.919501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09183de-85fc-4513-a260-dbc851e22bcf None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:46.919795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09183de-85fc-4513-a260-dbc851e22bcf None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:46.920181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09183de-85fc-4513-a260-dbc851e22bcf None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:46.922654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09183de-85fc-4513-a260-dbc851e22bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c, group_id=a41b8dee474e485bbdbfe9780a9f23ec, role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:46.924146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09183de-85fc-4513-a260-dbc851e22bcf None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:46.997275 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 199/415] 10.222.0.59 () {58 vars in 1442 bytes} [Sun Aug 28 00:51:46 2022] PUT /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c/groups/a41b8dee474e485bbdbfe9780a9f23ec/roles/91d76748bf16477db62b3cd689f60fd2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:51:47.036489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b3b9-7146-471a-9c2c-0257ae84e959 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:47.036776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b3b9-7146-471a-9c2c-0257ae84e959 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:47.036967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b3b9-7146-471a-9c2c-0257ae84e959 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:47.038757 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 217/416] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:47.044946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aab31-162d-44b1-92ae-a7c3daecd4a0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:47.045240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aab31-162d-44b1-92ae-a7c3daecd4a0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:47.045506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aab31-162d-44b1-92ae-a7c3daecd4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:47.053098 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:47.066251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5b4aab31-162d-44b1-92ae-a7c3daecd4a0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:47.067759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5b4aab31-162d-44b1-92ae-a7c3daecd4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:47.153906 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 200/417] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:47.285550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c4b6-8012-4a6c-9f6c-fe5bce7b635d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:47.285887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c4b6-8012-4a6c-9f6c-fe5bce7b635d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:47.286135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c4b6-8012-4a6c-9f6c-fe5bce7b635d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:47.287661 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 218/418] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:47.294075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1fae-ac0f-4a6b-8bca-6a99e0d46b30 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:47.294366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1fae-ac0f-4a6b-8bca-6a99e0d46b30 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:47.294638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1fae-ac0f-4a6b-8bca-6a99e0d46b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:47.313378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6e7b1fae-ac0f-4a6b-8bca-6a99e0d46b30 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:47.314613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6e7b1fae-ac0f-4a6b-8bca-6a99e0d46b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:47.410377 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 201/419] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:47.470943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217c4b6-8012-4a6c-9f6c-fe5bce7b635d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:47.536994 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:47.610997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217c4b6-8012-4a6c-9f6c-fe5bce7b635d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:47.655682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:47.656319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:47.656593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:47.656868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:47.674424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:47.679716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:47.680597 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:47.681412 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 219/420] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:47.689064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b1fae-ac0f-4a6b-8bca-6a99e0d46b30 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:47.793468 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:47.840142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b1fae-ac0f-4a6b-8bca-6a99e0d46b30 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:47.892524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:47.893497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:47.894002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:47.894500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:47.894671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:47.895593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:47.896133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:47.897755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:47.908263 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 202/421] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:47.914014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.023324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa16af-fed2-49dc-ba2b-8f5e76e72280 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.050354 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:48.059664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786dd94-e9a4-4a81-b99b-38eac9cd9b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.065251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786dd94-e9a4-4a81-b99b-38eac9cd9b03 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.065251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786dd94-e9a4-4a81-b99b-38eac9cd9b03 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.065251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786dd94-e9a4-4a81-b99b-38eac9cd9b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.066514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56478066-51e2-4f69-ac07-9cb2fc71f844 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.074494 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:48.103636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de95c70-8881-4fe2-ab8a-930e4ca50043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.104731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de95c70-8881-4fe2-ab8a-930e4ca50043 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.105752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de95c70-8881-4fe2-ab8a-930e4ca50043 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.106275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de95c70-8881-4fe2-ab8a-930e4ca50043 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.117608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de95c70-8881-4fe2-ab8a-930e4ca50043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-5de95c70-8881-4fe2-ab8a-930e4ca50043 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:48.123096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:48.124018 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:48.124938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:48.128140 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 220/422] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:48.129629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efa53-660b-4dee-8c6c-b1f8d77a543f None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.130160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efa53-660b-4dee-8c6c-b1f8d77a543f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.130640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efa53-660b-4dee-8c6c-b1f8d77a543f None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.136353 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 221/423] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:48.137437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786dd94-e9a4-4a81-b99b-38eac9cd9b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:48.138492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9efa53-660b-4dee-8c6c-b1f8d77a543f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.138939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786dd94-e9a4-4a81-b99b-38eac9cd9b03 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:48.249721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9efa53-660b-4dee-8c6c-b1f8d77a543f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.255747 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 203/424] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:48.257111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3f6a-1b73-4cad-842f-277cb53a4493 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.257395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3f6a-1b73-4cad-842f-277cb53a4493 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.257671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3f6a-1b73-4cad-842f-277cb53a4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.276078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3eab3f6a-1b73-4cad-842f-277cb53a4493 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:48.277338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3eab3f6a-1b73-4cad-842f-277cb53a4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:48.287696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.288636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.289163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.289650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.290679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:48.291183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:48.293553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:48.299087 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:48.305023 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 222/425] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:48.306282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.336581 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:48.358810 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 204/426] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:48.358810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3f6a-1b73-4cad-842f-277cb53a4493 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.470440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b594f-9a5f-4a3d-8fbb-8b8f56e8dfb6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.483464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3f6a-1b73-4cad-842f-277cb53a4493 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.542004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.542693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.543597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.543923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.545230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:48.546708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:48.548370 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 223/427] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:48.552350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.553716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.554450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.554726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.554994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.610218 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:48.689838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:48.692044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:48.739544 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:48.746561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f56d4-047b-4587-96a3-1f1584758ce5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.790940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.790940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.790940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.790940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.791363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:48.791363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:48.791363 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 224/428] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:48.791704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.811903 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 205/429] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:48.812822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.894325 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:48.900955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf625-e209-4b49-9f70-4995d3f4de2d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.919531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643dfbe-09dd-43da-b665-c4ade2e1d7b0 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:48.940145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.941006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.941440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.942004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.954821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:48.957073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:48.957836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:48.958212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:48.958561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:48.959364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=ce2be326599045af941a207eb00a1476) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:48.959744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:48.961204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:48.962118 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:51:48.962938 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:48.963571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:48.965927 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 225/430] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:48.966933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:48.973851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 206/431] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:48.973851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.028239 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:49.137567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b4a5f-1a41-48fd-8b1e-b8a6304218f9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:49.156042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bdaaf-2df9-4472-9f32-a26d232ed4c4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:49.164447 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:49.184852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecd01a-eccf-493d-918a-1917567857d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:49.185476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd01a-eccf-493d-918a-1917567857d8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.185758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd01a-eccf-493d-918a-1917567857d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.186060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecd01a-eccf-493d-918a-1917567857d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.186734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecd01a-eccf-493d-918a-1917567857d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:49.187039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecd01a-eccf-493d-918a-1917567857d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:49.189171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecd01a-eccf-493d-918a-1917567857d8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:49.200918 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 207/432] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:49.202628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08096-e2a9-4f49-b96c-131aff80db0c None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.202763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08096-e2a9-4f49-b96c-131aff80db0c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.204286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08096-e2a9-4f49-b96c-131aff80db0c None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.204506 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 208/433] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:49.208028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6814843-b4cd-45f4-ae37-cb228d8e1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:49.208787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6814843-b4cd-45f4-ae37-cb228d8e1932 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.209070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6814843-b4cd-45f4-ae37-cb228d8e1932 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.209345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6814843-b4cd-45f4-ae37-cb228d8e1932 None admin] PATH_INFO: `/v3/projects/ce2be326599045af941a207eb00a1476` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.210567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6814843-b4cd-45f4-ae37-cb228d8e1932 None admin] RBAC: Authorizing `identity:get_project(project_id=ce2be326599045af941a207eb00a1476)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:49.211146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08096-e2a9-4f49-b96c-131aff80db0c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.212026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6814843-b4cd-45f4-ae37-cb228d8e1932 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:49.213913 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 226/434] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:48 2022] GET /identity/v3/projects/ce2be326599045af941a207eb00a1476 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:49.215715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230fb95-e9e7-4513-a335-935ce81d0f7f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.216001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230fb95-e9e7-4513-a335-935ce81d0f7f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.216271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230fb95-e9e7-4513-a335-935ce81d0f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.238049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a230fb95-e9e7-4513-a335-935ce81d0f7f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:49.239425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a230fb95-e9e7-4513-a335-935ce81d0f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:49.328538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 227/435] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:49.329403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230fb95-e9e7-4513-a335-935ce81d0f7f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.336944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08096-e2a9-4f49-b96c-131aff80db0c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:49.358849 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:49.384226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612d4eb-16dd-4a5d-a8a6-f79c0560eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:49.384226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612d4eb-16dd-4a5d-a8a6-f79c0560eda7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.384226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612d4eb-16dd-4a5d-a8a6-f79c0560eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.384226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612d4eb-16dd-4a5d-a8a6-f79c0560eda7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.452741 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:49.477269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230fb95-e9e7-4513-a335-935ce81d0f7f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:49.479738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612d4eb-16dd-4a5d-a8a6-f79c0560eda7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:49.481301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612d4eb-16dd-4a5d-a8a6-f79c0560eda7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:49.519375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1395a-c130-4bd5-982b-364fb0f9a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:49.520290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1395a-c130-4bd5-982b-364fb0f9a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.520580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1395a-c130-4bd5-982b-364fb0f9a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.520856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1395a-c130-4bd5-982b-364fb0f9a8c4 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.522010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1395a-c130-4bd5-982b-364fb0f9a8c4 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:49.523757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1395a-c130-4bd5-982b-364fb0f9a8c4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:49.525616 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 228/436] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:49 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:49.526749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923b8d-2d12-4af4-8653-1a8c93b8be54 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.527094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923b8d-2d12-4af4-8653-1a8c93b8be54 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.527970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923b8d-2d12-4af4-8653-1a8c93b8be54 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.529971 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 229/437] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:49.531338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b923b8d-2d12-4af4-8653-1a8c93b8be54 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.598757 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 209/438] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:49.600346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b51e-1310-4317-b39b-29fa42fd31a6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.600832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b51e-1310-4317-b39b-29fa42fd31a6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.601323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6b51e-1310-4317-b39b-29fa42fd31a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.619991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-17e6b51e-1310-4317-b39b-29fa42fd31a6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:49.622218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-17e6b51e-1310-4317-b39b-29fa42fd31a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:49.640944 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:49.651823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b923b8d-2d12-4af4-8653-1a8c93b8be54 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:49.688452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:49.688963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.689243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.689585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.690308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=ce2be326599045af941a207eb00a1476) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:49.690657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:49.691754 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 210/439] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:49.692123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:49.692585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6b51e-1310-4317-b39b-29fa42fd31a6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.706125 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 230/440] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:49 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=ce2be326599045af941a207eb00a1476&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:49.706880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.707012 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:49.827274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6b51e-1310-4317-b39b-29fa42fd31a6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:49.847573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4406e-992c-47d9-864e-1cdeb76b7a97 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:49.878985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:49.879978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.880253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.880520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.881848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:49.883140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:49.884813 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 211/441] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:49 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:49.891867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.895294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:49.896161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:49.896436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:49.896703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:49.910198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:49.916608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:49.917613 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:49.918878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 231/442] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:49.926519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:49.954396 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.008134 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.028843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4789ba-387b-4dca-9777-0731524371ae None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.069946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.070592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.070902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.071176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.072306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.073740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.075634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d676ce-58cf-4e2e-b245-b204b1ddad60 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.077704 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 212/443] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:49 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:50.079452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.119032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.119688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.119962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.120227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.121477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:50.121790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.123243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.131587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 232/444] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:50.133481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.194059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fa87d-e8be-4122-9323-d44e0cda5b8d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.212410 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.229761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.230682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.231050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.231328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.235427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322931-cc01-433b-8309-78d9df73a29b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.241612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:50.246974 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:50.248070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 213/445] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:50.248907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.259749 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.277399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.278035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.278317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.278587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.279312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=8af003ee18d04126ab4eb7661d7a6dd7, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:50.279617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.281049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.286992 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 233/446] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=8af003ee18d04126ab4eb7661d7a6dd7 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:50.287777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.363075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9b9a-155e-4bb5-b797-91389d57f19c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.400733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acba481-1917-42aa-b980-3ac0740726c6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.410053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.410693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.410977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.411255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.445834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.446458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.446744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.447020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.447696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:50.448001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.450047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.463017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 234/447] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:50.469167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.472925 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.495477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.497716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.509499 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.583508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56d98f-af96-459d-a4cd-fd8d3864a55a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.623472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.624089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.624217 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 214/448] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:50.624363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.624641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.630822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.703217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.704711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.706585 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.735103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c4d1-6497-49df-a152-3d8acddd6a76 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.744434 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.771100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.772213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.772491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.772766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] PATH_INFO: `/v3/projects/651780a5477f4d4a87199d4613e97281` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.773954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] RBAC: Authorizing `identity:get_project(project_id=651780a5477f4d4a87199d4613e97281)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.775394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.777128 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 215/449] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/projects/651780a5477f4d4a87199d4613e97281 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:50.782722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.805475 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 235/450] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:51:50.812114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.881630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d976d9-fdb2-4d5f-b980-85e041bad76d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.915505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e2883-5256-4570-935a-4f223e53317c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:50.916368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.917005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.917123 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:50.917289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.918196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] PATH_INFO: `/v3/groups/106cbf2edea74fdd84ed5220848f651d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.919424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] RBAC: Authorizing `identity:get_group(group_id=106cbf2edea74fdd84ed5220848f651d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.920854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.922498 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 216/451] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/groups/106cbf2edea74fdd84ed5220848f651d => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:50.928295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.951135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:50.951778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:50.952058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:50.952333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] PATH_INFO: `/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:50.953470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1ed9bcbf4ddc41eaa5596f54dc46755c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:50.955516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:50.957645 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 236/452] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/projects/1ed9bcbf4ddc41eaa5596f54dc46755c => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:50.963190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:50.977690 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:51.033829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669871d-f933-4594-ad30-bc6980eae1b9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:51.064458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7feb97-61d4-4cdb-996d-7ac6ada055a0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:51.068717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:51.069324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:51.069602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:51.069903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:51.070635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] RBAC: Adding query filter params (group.id=106cbf2edea74fdd84ed5220848f651d, role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=651780a5477f4d4a87199d4613e97281) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:51.070938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:51.072361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:51.078818 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 217/453] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/role_assignments?group.id=106cbf2edea74fdd84ed5220848f651d&scope.project.id=651780a5477f4d4a87199d4613e97281&role.id=6ef968d350d64b4496757a252fa42707 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:51.100375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa45f3b-e1fc-49bc-9495-9cd9e9ac9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:51.101028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45f3b-e1fc-49bc-9495-9cd9e9ac9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:51.101306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45f3b-e1fc-49bc-9495-9cd9e9ac9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:51.101578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45f3b-e1fc-49bc-9495-9cd9e9ac9ee9 None admin] PATH_INFO: `/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:51.102794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa45f3b-e1fc-49bc-9495-9cd9e9ac9ee9 None admin] RBAC: Authorizing `identity:get_group(group_id=a41b8dee474e485bbdbfe9780a9f23ec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:51.104286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa45f3b-e1fc-49bc-9495-9cd9e9ac9ee9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:51.106838 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 237/454] 10.222.0.59 () {56 vars in 1180 bytes} [Sun Aug 28 00:51:50 2022] GET /identity/v3/groups/a41b8dee474e485bbdbfe9780a9f23ec => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:51:51.112935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:51.222311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eab4f-f52e-4ac3-accb-34b53d81ec0e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:51.231876 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:51.257316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed406e8-e987-476c-a56b-1aa1f47e2722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:51.257958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed406e8-e987-476c-a56b-1aa1f47e2722 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:51.258238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed406e8-e987-476c-a56b-1aa1f47e2722 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:51.258520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed406e8-e987-476c-a56b-1aa1f47e2722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:51.259242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed406e8-e987-476c-a56b-1aa1f47e2722 None admin] RBAC: Adding query filter params (group.id=a41b8dee474e485bbdbfe9780a9f23ec, role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:51.259547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed406e8-e987-476c-a56b-1aa1f47e2722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:51.260958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed406e8-e987-476c-a56b-1aa1f47e2722 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:51.267210 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 218/455] 10.222.0.59 () {56 vars in 1376 bytes} [Sun Aug 28 00:51:51 2022] GET /identity/v3/role_assignments?group.id=a41b8dee474e485bbdbfe9780a9f23ec&scope.project.id=1ed9bcbf4ddc41eaa5596f54dc46755c&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:53.715303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68171400-1510-47fb-a534-d9df823f607d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:53.715799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68171400-1510-47fb-a534-d9df823f607d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:53.715875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68171400-1510-47fb-a534-d9df823f607d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:53.717517 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 238/456] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:53.722669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8faddb-4f02-4fb4-8155-b1df81ab93da None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:53.723128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8faddb-4f02-4fb4-8155-b1df81ab93da None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:53.723205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8faddb-4f02-4fb4-8155-b1df81ab93da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:53.747635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5f8faddb-4f02-4fb4-8155-b1df81ab93da None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:53.748858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5f8faddb-4f02-4fb4-8155-b1df81ab93da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:53.850529 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 219/457] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:53.962836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962173e-22ed-4efb-8eb1-61695a4b2921 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:53.963481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962173e-22ed-4efb-8eb1-61695a4b2921 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:53.963995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962173e-22ed-4efb-8eb1-61695a4b2921 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:53.966331 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 239/458] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:53.971657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229105-d13f-456f-9138-e3c3251ddccf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:53.971948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229105-d13f-456f-9138-e3c3251ddccf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:53.972226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229105-d13f-456f-9138-e3c3251ddccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:53.998816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0d229105-d13f-456f-9138-e3c3251ddccf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:54.000029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0d229105-d13f-456f-9138-e3c3251ddccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:54.088454 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 220/459] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:54.185495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962173e-22ed-4efb-8eb1-61695a4b2921 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:54.186595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ce4a-6aee-4607-93da-af7ee87f7958 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.186889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ce4a-6aee-4607-93da-af7ee87f7958 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.187169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ce4a-6aee-4607-93da-af7ee87f7958 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.188831 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 221/460] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:54.194576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217ba10-2c7f-4fdf-bd87-abeae9fd8901 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.195369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217ba10-2c7f-4fdf-bd87-abeae9fd8901 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.195656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217ba10-2c7f-4fdf-bd87-abeae9fd8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.225772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9217ba10-2c7f-4fdf-bd87-abeae9fd8901 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:54.226919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9217ba10-2c7f-4fdf-bd87-abeae9fd8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:54.257524 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:54.284173 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:54.358215 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 222/461] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:54.368907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962173e-22ed-4efb-8eb1-61695a4b2921 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:54.420898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:54.420898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.420898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.420898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.437592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:54.439232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:54.466336 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:54.467327 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:54.468194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:54.468194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:54.468194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:54.468194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 240/462] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:54.473641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217ba10-2c7f-4fdf-bd87-abeae9fd8901 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:54.602792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:54.610704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217ba10-2c7f-4fdf-bd87-abeae9fd8901 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:54.686787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:54.687900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.688424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.688918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.689761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:54.690283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:54.692003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:54.706373 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 223/463] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:54.711888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:54.736838 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:54.742194 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:54.747508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64254c-8a18-449a-9bcf-721432444f89 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:54.784082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:54.784720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.784999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.785270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.796733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:54.799436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:54.815332 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:54.816343 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:54.817196 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:54.817196 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:54.817196 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:54.821390 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 241/464] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:54.822272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:54.828636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901fb16-7bea-4a5d-970d-a029447026ac None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:54.866515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:54.867466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.867922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.868405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.881069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:54.882937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:54.899657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:54.900585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:54.901452 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:54.901452 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:54.901452 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:54.902920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 224/465] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:54.903938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:54.943326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e5996-9dbb-4730-9025-980d4df69443 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:54.979516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:54.980320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.980724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.981289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.981977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:54.983440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:54.987399 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:55.013108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810c26-55ed-4363-8e38-c4c373676475 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:55.047585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472805d-973a-4d3b-95b7-1cd70aaa1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:55.048215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472805d-973a-4d3b-95b7-1cd70aaa1fcb None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.048489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472805d-973a-4d3b-95b7-1cd70aaa1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.048763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472805d-973a-4d3b-95b7-1cd70aaa1fcb None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.049405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472805d-973a-4d3b-95b7-1cd70aaa1fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:55.049902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472805d-973a-4d3b-95b7-1cd70aaa1fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:55.051281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472805d-973a-4d3b-95b7-1cd70aaa1fcb None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:55.068358 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 225/466] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:55.068358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac948-c6d6-4db5-8733-79ef324a1dde None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.068358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac948-c6d6-4db5-8733-79ef324a1dde None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.068358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac948-c6d6-4db5-8733-79ef324a1dde None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.068358 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 226/467] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:55.068358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac948-c6d6-4db5-8733-79ef324a1dde None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:55.132024 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:55.138364 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 242/468] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:54 2022] POST /identity/v3/users => generated 246 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:55.139553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:55.212456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac948-c6d6-4db5-8733-79ef324a1dde None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:55.258230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f22f09-0083-466e-87d4-b26dd42adc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:55.259565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22f09-0083-466e-87d4-b26dd42adc05 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.259565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22f09-0083-466e-87d4-b26dd42adc05 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.259771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22f09-0083-466e-87d4-b26dd42adc05 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.260459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f22f09-0083-466e-87d4-b26dd42adc05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:55.260853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f22f09-0083-466e-87d4-b26dd42adc05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:55.262563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f22f09-0083-466e-87d4-b26dd42adc05 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:55.264697 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:55.275750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83111d0-38cf-495c-b32f-f7f95c389857 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:55.281864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 227/469] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:55.281864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f377-9087-4bce-9aa1-b47baef5a463 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.281864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f377-9087-4bce-9aa1-b47baef5a463 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.281864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12f377-9087-4bce-9aa1-b47baef5a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.299201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3e12f377-9087-4bce-9aa1-b47baef5a463 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:55.300395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3e12f377-9087-4bce-9aa1-b47baef5a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:55.321182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fe29c-aa43-4535-bff1-4357057aeff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:55.321938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe29c-aa43-4535-bff1-4357057aeff7 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.322227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe29c-aa43-4535-bff1-4357057aeff7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.322503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe29c-aa43-4535-bff1-4357057aeff7 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.323671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fe29c-aa43-4535-bff1-4357057aeff7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:55.325889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fe29c-aa43-4535-bff1-4357057aeff7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:55.377884 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 228/470] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:55.379222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014154d3-508e-4c47-a7e0-0b2c262fbe9a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.379513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014154d3-508e-4c47-a7e0-0b2c262fbe9a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.379788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014154d3-508e-4c47-a7e0-0b2c262fbe9a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.385314 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 229/471] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:55.385314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014154d3-508e-4c47-a7e0-0b2c262fbe9a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:55.451248 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 243/472] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:55 2022] POST /identity/v3/users => generated 248 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:55.458493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46eab-6775-4cdc-ada8-ce6bf8118f5c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.458783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46eab-6775-4cdc-ada8-ce6bf8118f5c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.459051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46eab-6775-4cdc-ada8-ce6bf8118f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.495426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-62e46eab-6775-4cdc-ada8-ce6bf8118f5c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:55.496768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-62e46eab-6775-4cdc-ada8-ce6bf8118f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:55.517595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014154d3-508e-4c47-a7e0-0b2c262fbe9a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:55.551888 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:55.566486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:55.568005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.568512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.568977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.569917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:55.572006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:55.602395 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:55.624384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 244/473] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:55.657774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e46eab-6775-4cdc-ada8-ce6bf8118f5c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:55.670772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 230/474] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:55 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:51:55.780550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e46eab-6775-4cdc-ada8-ce6bf8118f5c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:55.819845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:55.820927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.821440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.822017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.834808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:55.836580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:55.853116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:55.854119 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:55.855533 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:55.855533 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:55.855533 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:55.856765 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 245/475] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:55.862338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:55.917549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:55.966774 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:56.008645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e507-1127-4c0d-8845-4f8244938215 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:56.049205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:56.049838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.050130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.050405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.051049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:56.051349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:56.051685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572f5e6-879c-43de-add2-cf26ff0921d5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:56.052722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:56.066753 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 231/476] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:56.072056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:56.088519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:56.089130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.089436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.089707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.090411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:56.091789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:56.138002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.sql.core [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:51:56.138002 n-d-master-1 devstack@keystone.service[82007]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:51:56.138002 n-d-master-1 devstack@keystone.service[82007]: [parameters: {'id': '8e603e63bd6b414db8da153b6e5c8824', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:51:56.138002 n-d-master-1 devstack@keystone.service[82007]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82007) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:51:56.138844 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result.read() Aug 28 00:51:56.178631 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:51:56.179531 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application yield resource Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise self.value Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application session.commit() Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:51:56.180437 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:51:56.181958 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:51:56.187862 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result.read() Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:51:56.188765 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [parameters: {'id': '8e603e63bd6b414db8da153b6e5c8824', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:56.189565 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:51:56.191740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:56.193665 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 246/477] 10.222.0.59 () {60 vars in 1131 bytes} [Sun Aug 28 00:51:55 2022] POST /identity/v3/roles => generated 144 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:51:56.197585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:56.209730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956438d-6b89-4342-8c13-c313013e4118 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:56.307129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f6ddf-f864-4ba7-ba91-21baa1b55171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:56.307882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6ddf-f864-4ba7-ba91-21baa1b55171 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.308289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6ddf-f864-4ba7-ba91-21baa1b55171 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.308744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f6ddf-f864-4ba7-ba91-21baa1b55171 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.309642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f6ddf-f864-4ba7-ba91-21baa1b55171 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:56.311115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f6ddf-f864-4ba7-ba91-21baa1b55171 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:56.338644 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:56.342699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54afc59-9497-4146-a5e6-bd1155ad184f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:56.382870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:56.383464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.383748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.384083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.395812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:56.400830 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:56.402978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:56.404947 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 247/478] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:51:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:56.411705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:56.497736 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 232/479] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:51:56 2022] POST /identity/v3/users => generated 249 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:51:56.526707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af364b83-38aa-4082-acea-4e081f5ee63c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:56.566825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656d7a-571f-4647-ba4d-a22113076e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:56.567436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656d7a-571f-4647-ba4d-a22113076e5a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.567713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656d7a-571f-4647-ba4d-a22113076e5a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.568078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656d7a-571f-4647-ba4d-a22113076e5a None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.568750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656d7a-571f-4647-ba4d-a22113076e5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:56.569052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656d7a-571f-4647-ba4d-a22113076e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:56.570577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656d7a-571f-4647-ba4d-a22113076e5a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:56.581290 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 248/480] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:51:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:57.295164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e3fb-7f42-4eaa-9d22-d5a47a9be661 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:57.295884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e3fb-7f42-4eaa-9d22-d5a47a9be661 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:57.295884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e3fb-7f42-4eaa-9d22-d5a47a9be661 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:57.297423 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 233/481] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:57.315623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f613b-8a64-4f9f-915d-417576f8cdd6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:57.316230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f613b-8a64-4f9f-915d-417576f8cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:57.316230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f613b-8a64-4f9f-915d-417576f8cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:57.342888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f94f613b-8a64-4f9f-915d-417576f8cdd6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:57.344100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f94f613b-8a64-4f9f-915d-417576f8cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:57.368046 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:57.454363 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 249/482] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:57.756078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888e3fb-7f42-4eaa-9d22-d5a47a9be661 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:57.888199 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:57.900475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888e3fb-7f42-4eaa-9d22-d5a47a9be661 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:57.946214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb599b2-de65-46a3-8ce3-c52f9786cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:57.947205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb599b2-de65-46a3-8ce3-c52f9786cb19 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:57.947699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb599b2-de65-46a3-8ce3-c52f9786cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:57.948129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb599b2-de65-46a3-8ce3-c52f9786cb19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:57.966717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb599b2-de65-46a3-8ce3-c52f9786cb19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-9cb599b2-de65-46a3-8ce3-c52f9786cb19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:57.971824 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:57.972736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:51:57.973532 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:57.975480 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 234/483] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:57.986939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f613b-8a64-4f9f-915d-417576f8cdd6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.062985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c137-a61a-42ba-8aa7-df552bcdd6ae None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.063617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c137-a61a-42ba-8aa7-df552bcdd6ae None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.064120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c137-a61a-42ba-8aa7-df552bcdd6ae None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.065976 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 235/484] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:58.072750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4902-96a5-4642-bcc9-ed4b34845c9e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.073353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4902-96a5-4642-bcc9-ed4b34845c9e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.074484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4902-96a5-4642-bcc9-ed4b34845c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.107264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f38b4902-96a5-4642-bcc9-ed4b34845c9e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:58.108781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f38b4902-96a5-4642-bcc9-ed4b34845c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:58.152503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f613b-8a64-4f9f-915d-417576f8cdd6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.190239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498452b7-979d-47e9-a917-01f69eff8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:58.190849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498452b7-979d-47e9-a917-01f69eff8f79 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.191125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498452b7-979d-47e9-a917-01f69eff8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.191392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498452b7-979d-47e9-a917-01f69eff8f79 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.192060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498452b7-979d-47e9-a917-01f69eff8f79 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:58.192357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498452b7-979d-47e9-a917-01f69eff8f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:58.193866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498452b7-979d-47e9-a917-01f69eff8f79 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:58.204245 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 250/485] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:58.205379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49aa06-e48f-449c-89d0-7088f73b3a78 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.205660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49aa06-e48f-449c-89d0-7088f73b3a78 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.205963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49aa06-e48f-449c-89d0-7088f73b3a78 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.211432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 251/486] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:58.211432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49aa06-e48f-449c-89d0-7088f73b3a78 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.229020 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:58.234205 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 236/487] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:51:58.236645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103ea85-64d7-4969-b6ac-1b31e167cbc8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.237770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103ea85-64d7-4969-b6ac-1b31e167cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.238537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103ea85-64d7-4969-b6ac-1b31e167cbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.265172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e103ea85-64d7-4969-b6ac-1b31e167cbc8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:58.267004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e103ea85-64d7-4969-b6ac-1b31e167cbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:58.333262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49aa06-e48f-449c-89d0-7088f73b3a78 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.343324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 237/488] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:58.367543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:58.368160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.368437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.368705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.380006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:58.381452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:58.395614 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:58.396627 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:58.397487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:58.397487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:58.397487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:58.397487 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 252/489] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:58.402901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103ea85-64d7-4969-b6ac-1b31e167cbc8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.444809 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:58.545759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103ea85-64d7-4969-b6ac-1b31e167cbc8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.582079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:58.582761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.583048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.583378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.583978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:58.584284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:58.585659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:58.598125 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 238/490] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:58.603163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.610704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.678798 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:58.716258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1750b7f-7bec-4193-86b8-7a20c1e2233a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.754688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:58.755682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.755966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.756238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] PATH_INFO: `/v3/users/nova` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.763233 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:58.764651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:58.766174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:51:58.779371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:58.780341 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 253/491] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:58.781626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.796491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25400f93-4a1d-4331-a063-560e3e5df8a9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.839687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:58.840229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.840679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.840954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.854691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:58.862505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:58.863790 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:58.864688 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 239/492] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:58.866767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.911491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb3d4-f0bf-40c7-9113-0cee3d7b338d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.940918 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:58.950760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:58.951603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.952128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.952580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.964608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:51:58.970866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:58.971962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:51:58.972885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:58.975056 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 254/493] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:58.975728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff95ed-5985-4b78-a439-914ff41a0074 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.976100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.016612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.017227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.017559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.017856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.018650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:59.018955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.020424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.033318 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.065005 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 240/494] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:59.066011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.092662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9485cd-b3cb-4a6b-a594-094d42311975 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.130632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.131509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.131979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.132485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.133297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:59.133739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.135386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.151442 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 255/495] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:59.153138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.174221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e68b-d9bc-4005-9ffb-fac6d2dcbeb5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.209080 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.211326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.211935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.212214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.212486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.213142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:59.213710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.215363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.225056 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 241/496] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:59.226004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.264923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b9f2-9bb5-441f-bda1-23e78cdac2a3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.287876 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.298418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb82ad5-48f6-4d85-b2ce-836a4accb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.299014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82ad5-48f6-4d85-b2ce-836a4accb659 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.301582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82ad5-48f6-4d85-b2ce-836a4accb659 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.301582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb82ad5-48f6-4d85-b2ce-836a4accb659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.334116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf521b2-820a-4e3b-9dc3-96b761bae044 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.367204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02768b2d-6a74-4ad7-9a2c-df40e8bb96f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.367886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768b2d-6a74-4ad7-9a2c-df40e8bb96f0 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.368016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768b2d-6a74-4ad7-9a2c-df40e8bb96f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.368256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768b2d-6a74-4ad7-9a2c-df40e8bb96f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.368763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb82ad5-48f6-4d85-b2ce-836a4accb659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.370232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb82ad5-48f6-4d85-b2ce-836a4accb659 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.379375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02768b2d-6a74-4ad7-9a2c-df40e8bb96f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.380868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02768b2d-6a74-4ad7-9a2c-df40e8bb96f0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-02768b2d-6a74-4ad7-9a2c-df40e8bb96f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:59.395146 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:59.396164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:59.397054 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:59.397054 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:59.397054 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:59.397054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 242/497] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:59.397503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c36d5-30f1-4cdd-ab13-17f60288e5ab None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.397725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c36d5-30f1-4cdd-ab13-17f60288e5ab None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.398025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c36d5-30f1-4cdd-ab13-17f60288e5ab None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.399283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 243/498] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:59.399973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c36d5-30f1-4cdd-ab13-17f60288e5ab None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.425623 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.477027 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 256/499] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:51:59.478378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c62e4-985e-451e-b1ab-4934d5deecfa None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.478659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c62e4-985e-451e-b1ab-4934d5deecfa None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.478937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c62e4-985e-451e-b1ab-4934d5deecfa None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.480866 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 257/500] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:59.481662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c62e4-985e-451e-b1ab-4934d5deecfa None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.510683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c36d5-30f1-4cdd-ab13-17f60288e5ab None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.519947 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.544755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30d5b7-9251-413f-aa3b-ff4cf96cbd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.545378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d5b7-9251-413f-aa3b-ff4cf96cbd85 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.545656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d5b7-9251-413f-aa3b-ff4cf96cbd85 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.545959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d5b7-9251-413f-aa3b-ff4cf96cbd85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.556442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30d5b7-9251-413f-aa3b-ff4cf96cbd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.558567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30d5b7-9251-413f-aa3b-ff4cf96cbd85 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-3f30d5b7-9251-413f-aa3b-ff4cf96cbd85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:59.572727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:59.575036 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:59.576388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:59.576388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:59.576388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:51:59.576388 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 244/501] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:59.576388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a191c2-c554-4078-91aa-408a6b9f262a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.576388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a191c2-c554-4078-91aa-408a6b9f262a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.576388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a191c2-c554-4078-91aa-408a6b9f262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.588565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c62e4-985e-451e-b1ab-4934d5deecfa None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.595743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a1a191c2-c554-4078-91aa-408a6b9f262a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:59.596936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a1a191c2-c554-4078-91aa-408a6b9f262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:59.624434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.624927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.625205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.625484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.626156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:59.626461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.627832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.640013 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 258/502] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:59.640813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.656623 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.664738 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 245/503] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:59.666014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2528-f127-4745-9e46-638a56910dd3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.668393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2528-f127-4745-9e46-638a56910dd3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.668393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce2528-f127-4745-9e46-638a56910dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.687956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-77ce2528-f127-4745-9e46-638a56910dd3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:59.690089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77ce2528-f127-4745-9e46-638a56910dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:59.763549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62c8f-a36d-47ff-ab67-964cde99357f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.791206 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 246/504] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:51:59.792274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2528-f127-4745-9e46-638a56910dd3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.812765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.813688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.814104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.814470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.819708 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.831551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.833781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:51:59.853957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:51:59.855374 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:51:59.856626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:51:59.856626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:51:59.856626 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:51:59.857835 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 259/505] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:51:59.864066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.917069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce2528-f127-4745-9e46-638a56910dd3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:59.944532 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.960512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:59.961353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.961884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.962324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.963130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:51:59.963617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:59.965179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:59.978686 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 247/506] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:51:59.979729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:59.993615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e88636-addb-4ab2-8a7c-ac6160ae10a0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.030888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.031541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.031820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.032100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.040082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.041954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:00.053834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:00.054835 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 260/507] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:00.056518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.075037 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.097353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8568db-f06c-4b77-aa32-8d46fe9e6154 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.132605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.133284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.133569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.133934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.134618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:00.134886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.136276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.148217 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 248/508] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:00.149027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.170997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242393-e3f8-43d5-bd7f-6e3f6e956d74 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.191623 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.205982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.206610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.206892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.207182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.218044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:00.223152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:00.224252 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:00.225199 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 261/509] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:00.229414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.264125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e53c-85d8-4e54-90c5-1ed2cc49c388 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.299430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.300183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.300461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.300732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.308571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.310030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.312726 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:00.323783 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:00.327165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 249/510] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:00.328103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.334536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48047746-ba5d-45cb-b1f8-278dc93195c7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.368793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365070-050e-4475-878c-53938ba65cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.369434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365070-050e-4475-878c-53938ba65cef None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.369652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365070-050e-4475-878c-53938ba65cef None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.369958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f365070-050e-4475-878c-53938ba65cef None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.371506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f365070-050e-4475-878c-53938ba65cef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:00.371805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f365070-050e-4475-878c-53938ba65cef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.373239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f365070-050e-4475-878c-53938ba65cef None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.412467 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 262/511] 10.222.0.59 () {56 vars in 1137 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:00.413152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365070-050e-4475-878c-53938ba65cef None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.436946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadc73a-81d4-4874-9103-ad2e548bb0a2 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.453100 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.472545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.473176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.473449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.473719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.484661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.486133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:00.499957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:00.501078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:00.502133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:00.502133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:00.502133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:00.505770 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 250/512] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:00.506606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.513504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f365070-050e-4475-878c-53938ba65cef None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.548551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.549175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.549455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.549727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.556515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.558456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.558613 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:00.570539 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:00.573111 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 263/513] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:00.574564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.610946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ccaa4-687b-4559-9011-25e95c00f294 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.645112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.645709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.646024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.646304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.646975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:00.647277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.648675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.658172 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 251/514] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:00.659036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.676591 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.680338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3192c-3fc3-4eb3-bc80-b54f2c5bd26b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.715073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.715681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.715959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.716232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.716994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:00.717308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.718771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.736450 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 264/515] 10.222.0.59 () {56 vars in 1137 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:00.737259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.762668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb31e3-df30-46ef-b419-3a9d1ba7170d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.778053 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.797206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.797861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.798150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.798475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.836194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1ed76-09cb-4745-becd-0761fb9d918e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.868433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.870016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.871234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.871882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.872156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.872427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.873061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:00.873354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.874729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.886540 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 265/516] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:00.887507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.906184 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.970980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 252/517] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:00.972094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.987705 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.992669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9a3e-3bec-4348-91e5-cafc5a03083e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.027083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.027786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.028060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.028333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.029035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:01.029341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.030800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.048252 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 266/518] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:01.048252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.081843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc6db-544a-4885-b4d9-124ffa3ca2a8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.116919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.117552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.117878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.118234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.128796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.128943 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.130377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:01.145136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:01.150499 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:01.152018 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:01.152018 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:01.152018 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:01.152018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 253/519] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:01.152018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.157397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309035-099f-49cb-b4d9-e0eaa169ecc0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.191915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.192510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.192789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.193057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.213712 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.251824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2c9f-7dc3-4f37-be55-06357f9af3f5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.262600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.264075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.285698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.286364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.286646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.286916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.287560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.288975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.340411 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.363382 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 267/520] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:01.364189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.388440 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 254/521] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:52:01 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:01.389283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.493595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8619a-2ab0-4e8f-a299-824f5056acdd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.512129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc89ee-a61d-4929-983f-153b53ba45e7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.536524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.537160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.537440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.537714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.538754 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.550139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.551012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.551618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.553746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.553746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.553746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.553746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=0ef7d679c29544eeb884f2172e643a59) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:01.553746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.554630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.561010 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 255/522] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/role_assignments?user.id=0ef7d679c29544eeb884f2172e643a59&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:01.561782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:01.568876 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:01.569984 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:01.571017 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:01.571017 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:01.571017 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:01.571017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 268/523] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:01.571345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.613006 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.703546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9d7d-9601-4744-98f2-37a78b4ca9c1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.707471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b514d9-04b0-463c-b136-addf8d1ac958 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.750018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.750710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.751001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.751277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.752261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:01.752571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.754475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.757319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.758237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.758741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.759228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.771148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.775706 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 256/524] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:01.775706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.778493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:01.794965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:01.795952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:01.796819 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:01.796819 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:01.796819 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:01.803305 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 269/525] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:01.804477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.838204 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.904539 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.908544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8ec9-63f9-4112-9e63-0d4f69a3bbf7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.924865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84bb54-4d9d-4431-958e-a75af85f1cd8 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:01.953028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.953984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.954526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.954797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.955446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:01.955892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.957876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:01.965105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:01.966415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.966808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.967189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.971590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 257/526] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:01.972578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.982152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:01.984130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:02.000912 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:02.001890 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:52:02.002791 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:02.005982 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 270/527] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:02.006834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.091714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb31871-f0b8-4918-b54a-36ffc49470b4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.099225 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.127403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.128153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.128503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.128879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.129603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:02.130016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.131602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.143663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7b73-b240-494c-96d5-9f2ed3e0cbda None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.146315 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 258/528] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:02.147398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.193389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.194052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.194609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.194888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.205261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.207313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.211524 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:02.225574 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:02.227605 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 271/529] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:02.233544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.260250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b704e7-e5ca-4eba-89b3-f1d396291721 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.300443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.301068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.301348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.301614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.302374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:02.302678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.304096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.322859 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 259/530] 10.222.0.59 () {56 vars in 1139 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:02.324341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.352030 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.390091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b7f1-c07e-4216-aa62-a6e3bad7b9d6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.439672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5280d-1cb7-446c-983f-7b221acf947e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.444326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.445220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.445716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.446242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.457204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.459716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.476762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.477367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.477645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.477965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:02.478544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:02.479399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:02.480986 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:02.481426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:02.481426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.481426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.483742 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 272/531] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:02.484971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.506172 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 260/532] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:02.507107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.556732 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.601218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd53b5-7cc9-4d22-b133-12e2d0043ccc None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.606891 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.624639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a0fe3-7ee9-4ecd-a86a-bdafb0af5eac None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.641578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.642262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.642541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.642812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.670893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.671502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.671779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.672043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.672736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:02.673090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.674777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.689546 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 261/533] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:02.690294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.730441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.732137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.797564 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.816285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e3dee-d26b-4f26-8283-0953cc9b5c3c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.844578 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 273/534] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:02.845792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.861063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.861601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.861931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.862211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.863112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=55ea28229f144d47826791bcade28b24) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:02.863425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.865522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.874036 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 262/535] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/role_assignments?user.id=55ea28229f144d47826791bcade28b24&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:02.875106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:02.891322 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.981282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23141-8084-416f-8ad7-c40343a9a98a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.991913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831a832-b3c4-45b5-aa1f-f8598d0540b7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:03.038299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:03.039509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.039628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:03.040130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.040235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.040497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.040775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.041115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.041539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=10fe5abbf8c24c3882d8ad3addd241b5) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:03.041871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:03.043939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:03.055590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:03.057470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:03.061150 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 274/536] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/role_assignments?user.id=10fe5abbf8c24c3882d8ad3addd241b5&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:03.086239 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:03.087285 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:03.088138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:03.088138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:03.088138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:03.090818 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 263/537] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:03.096150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:03.132919 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:03.226719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050f6e-4b04-4671-a1df-c655025763f4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:03.269184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:03.269840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.270123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.270393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.271050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:03.271350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:03.272743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:03.286091 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 275/538] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:03.291663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:03.364084 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:03.410159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48d30-d2a5-4ef8-8218-e4e4dea62f53 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:03.446280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7023918-7744-48c4-8db7-a385c1026829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:03.447038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023918-7744-48c4-8db7-a385c1026829 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.447317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023918-7744-48c4-8db7-a385c1026829 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.447627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7023918-7744-48c4-8db7-a385c1026829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.455809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7023918-7744-48c4-8db7-a385c1026829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:03.457262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7023918-7744-48c4-8db7-a385c1026829 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f7023918-7744-48c4-8db7-a385c1026829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:03.470751 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:03.471745 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:03.473030 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 264/539] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:03.478036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:03.597745 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:03.620017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf8aa-38d9-493f-a520-0435d76b59f6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:03.654383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405228fa-c71a-4ed5-b4ce-8b2b560b19c6 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.654939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405228fa-c71a-4ed5-b4ce-8b2b560b19c6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.654939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405228fa-c71a-4ed5-b4ce-8b2b560b19c6 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.656294 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 265/540] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:03.662308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3f442-bba1-41cb-a6c4-1fee78e24304 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.662519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3f442-bba1-41cb-a6c4-1fee78e24304 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.662798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3f442-bba1-41cb-a6c4-1fee78e24304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.669654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:03.670600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.671103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.671572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.672469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:03.672972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:03.674716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:03.684612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d0e3f442-bba1-41cb-a6c4-1fee78e24304 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:03.689844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d0e3f442-bba1-41cb-a6c4-1fee78e24304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:03.696340 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 276/541] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:03.703680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:03.794503 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 266/542] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:52:03.795772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6653-9933-42cf-a0ed-91a7371e5e2a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.796053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6653-9933-42cf-a0ed-91a7371e5e2a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.796320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6653-9933-42cf-a0ed-91a7371e5e2a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.797582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 267/543] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:03.811340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967ba4-fe80-4d77-90ea-1c92ffa83c14 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.811663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967ba4-fe80-4d77-90ea-1c92ffa83c14 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.811874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a967ba4-fe80-4d77-90ea-1c92ffa83c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.846025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8a967ba4-fe80-4d77-90ea-1c92ffa83c14 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:03.847229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8a967ba4-fe80-4d77-90ea-1c92ffa83c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:03.890261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5f51e-0486-44f2-9080-8faf63170fc0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:03.928502 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:03.952470 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 268/544] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 00:52:03.970676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:03.971280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.971586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.971829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.972610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=9db493faf16349169f9199f922ff3646) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:03.972920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:03.974390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:03.981030 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 277/545] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:03 2022] GET /identity/v3/role_assignments?user.id=9db493faf16349169f9199f922ff3646&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:04.090694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a967ba4-fe80-4d77-90ea-1c92ffa83c14 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.227898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a967ba4-fe80-4d77-90ea-1c92ffa83c14 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:04.262556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:04.263194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.263467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.263734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.268009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.274856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:04.281192 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:04.282249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:04.283606 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 269/546] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:04.288260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.300777 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:04.339873 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:04.460040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c84dd6-5e39-4c32-92f9-9dbd9370599d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:04.483890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f47e77-622f-4aab-b018-ef5add6a0739 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:04.497887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:04.498629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.498912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.499179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.510253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:04.517538 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:04.518572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:04.519376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:04.520478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 278/547] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:04.526857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.533679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:04.534340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.534620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.534893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.535572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:04.536030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:04.537520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:04.554919 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 270/548] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:04.562339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.612459 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:04.677363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdbefe-47e9-4c1e-8e82-cc8664bd6ce3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:04.721597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ea1e6-abdd-439a-8f7c-5022c4f650b5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:04.723110 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:04.756101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:04.756740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.757016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.757286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.770062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:04.771387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:04.771612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:04.772439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.772932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.773409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.774351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:04.774881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:04.777011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:04.786733 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:04.787696 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:04.788576 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:04.788576 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:04.788576 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:04.788576 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 271/549] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:04.798764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.801640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 279/550] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:04.815429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.904878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237d833-58a6-4bba-8ab1-304f083d3bd1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:04.940507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:04.941112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.941387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.941656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.942327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:04.942628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:04.943979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:04.957707 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 272/551] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:04.963402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.981020 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.058007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856b652-39d1-4eac-9c41-72ca0b1cf6f6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.081675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13683610-b44e-4484-b925-f21ef1b63acc None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.119704 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.122711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.123354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.123629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.123908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] PATH_INFO: `/v3/users/swift` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.132378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.134122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.139355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.139355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.139355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.139355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:05.147892 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:05.148823 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:05.149869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 273/552] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:05.154898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:05.170885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.172720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:05.193750 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:05.194760 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:05.195615 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:05.195615 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:05.195615 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:05.195615 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 280/553] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:05.205030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:05.258368 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.297679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f1c1-32b6-4303-bc03-dd44a04842df None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.343784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f17852-4ad1-440d-8308-9cee7ca83d37 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.368810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f609d-9abb-4367-81de-3396104a2106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.369615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f609d-9abb-4367-81de-3396104a2106 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.370028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f609d-9abb-4367-81de-3396104a2106 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.370955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f609d-9abb-4367-81de-3396104a2106 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.371880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f609d-9abb-4367-81de-3396104a2106 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:05.372193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f609d-9abb-4367-81de-3396104a2106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.373640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f609d-9abb-4367-81de-3396104a2106 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.381801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0387f3-a2a8-40c1-9182-cb4a7b33ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.382441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0387f3-a2a8-40c1-9182-cb4a7b33ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.382745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0387f3-a2a8-40c1-9182-cb4a7b33ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.383090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0387f3-a2a8-40c1-9182-cb4a7b33ecc1 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.383850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0387f3-a2a8-40c1-9182-cb4a7b33ecc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:05.384159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0387f3-a2a8-40c1-9182-cb4a7b33ecc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.386241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0387f3-a2a8-40c1-9182-cb4a7b33ecc1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.394403 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 274/554] 10.222.0.59 () {56 vars in 1135 bytes} [Sun Aug 28 00:52:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:05.395732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4979b2-a1d5-4706-bfe1-290ee0a51383 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.396021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4979b2-a1d5-4706-bfe1-290ee0a51383 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.396299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4979b2-a1d5-4706-bfe1-290ee0a51383 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.397826 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 275/555] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:05.403373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4979b2-a1d5-4706-bfe1-290ee0a51383 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:05.406835 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 281/556] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:05.407873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cac80-f5df-4b54-a367-79700af900b5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.408163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cac80-f5df-4b54-a367-79700af900b5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.408435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cac80-f5df-4b54-a367-79700af900b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.429835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-652cac80-f5df-4b54-a367-79700af900b5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:05.429835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-652cac80-f5df-4b54-a367-79700af900b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:05.470078 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.504209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 282/557] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:05.505109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cac80-f5df-4b54-a367-79700af900b5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:05.535593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4979b2-a1d5-4706-bfe1-290ee0a51383 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.593610 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.613370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530305-ca3b-4ba7-bbb6-f4d717ad1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.613370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530305-ca3b-4ba7-bbb6-f4d717ad1331 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.613370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530305-ca3b-4ba7-bbb6-f4d717ad1331 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.613370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530305-ca3b-4ba7-bbb6-f4d717ad1331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.616488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cac80-f5df-4b54-a367-79700af900b5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.654866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e2783-d81e-4c85-8d31-f1698cf85976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.655818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2783-d81e-4c85-8d31-f1698cf85976 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.656279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2783-d81e-4c85-8d31-f1698cf85976 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.656684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e2783-d81e-4c85-8d31-f1698cf85976 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.665915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e2783-d81e-4c85-8d31-f1698cf85976 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.667856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e2783-d81e-4c85-8d31-f1698cf85976 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-4e5e2783-d81e-4c85-8d31-f1698cf85976 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:05.680872 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:05.682077 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:05.683810 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:05.686104 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 283/558] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:52:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:05.687525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aab89-1cfd-4373-9f1d-b3bca7ab4367 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.688063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aab89-1cfd-4373-9f1d-b3bca7ab4367 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.688476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aab89-1cfd-4373-9f1d-b3bca7ab4367 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.689891 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 284/559] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:05.691548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aab89-1cfd-4373-9f1d-b3bca7ab4367 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:05.704354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530305-ca3b-4ba7-bbb6-f4d717ad1331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.706123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530305-ca3b-4ba7-bbb6-f4d717ad1331 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.727995 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.806549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aab89-1cfd-4373-9f1d-b3bca7ab4367 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.825844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 276/560] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:05.825844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699691-b6a7-4bcd-9098-d2be1b8b1e69 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.825844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699691-b6a7-4bcd-9098-d2be1b8b1e69 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.825844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9699691-b6a7-4bcd-9098-d2be1b8b1e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.845974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b9699691-b6a7-4bcd-9098-d2be1b8b1e69 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:05.847244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b9699691-b6a7-4bcd-9098-d2be1b8b1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:05.851496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.852321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.852763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.853203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.854165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:05.854851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.856715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.875595 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.879561 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 285/561] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:52:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:05.880556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:05.923099 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 277/562] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:05.923910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699691-b6a7-4bcd-9098-d2be1b8b1e69 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.003151 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.013882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be15db3-563f-4a9c-80c5-e0b167ff7e87 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.043624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9699691-b6a7-4bcd-9098-d2be1b8b1e69 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.051341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.051975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.052255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.052528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.064234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.065696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.083933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.084896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.085376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.085897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:06.089461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:06.090399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:06.091380 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:06.091380 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:06.091380 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:06.097498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 286/563] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:06.098491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.101100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:06.106490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:06.107406 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:06.108237 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:06.111025 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 278/564] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:06.112489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.140524 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.225913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7da26-0e0c-4494-baf8-df34774c2ce5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.227211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479674-b197-43ae-a1f0-ba298d8d1dc2 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.269612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.270261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.270535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.270802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.272874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.273479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.273755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.274063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.274707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:06.275008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.276944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.282046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.283470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.285216 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.289186 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 279/565] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:06.290079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:06.298159 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:06.303006 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:06.303896 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:06.303896 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:06.303896 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:06.303896 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 287/566] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:06.303896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.381198 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.399740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e7254-6e9d-48b5-9777-9db446e65202 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.403269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec08a8-f842-4701-b3c7-7968197228f1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.436655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964be4be-cd64-4995-964f-e7e2746a66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.437265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be4be-cd64-4995-964f-e7e2746a66d0 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.437551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be4be-cd64-4995-964f-e7e2746a66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.437832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be4be-cd64-4995-964f-e7e2746a66d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.437953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.438527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964be4be-cd64-4995-964f-e7e2746a66d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:06.438618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.438821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.438927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964be4be-cd64-4995-964f-e7e2746a66d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.439095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.440170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964be4be-cd64-4995-964f-e7e2746a66d0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.448695 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 280/567] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:06.450398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91b27-0eed-4112-8fd5-ae6039ce8b9d None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.450677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91b27-0eed-4112-8fd5-ae6039ce8b9d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.450955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91b27-0eed-4112-8fd5-ae6039ce8b9d None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.452190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 281/568] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:06.452878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be91b27-0eed-4112-8fd5-ae6039ce8b9d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.454438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:06.459776 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:06.460800 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 288/569] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:06.461646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.519582 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.558479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be91b27-0eed-4112-8fd5-ae6039ce8b9d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.565669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153582af-aea6-463e-b65c-b95d1b48085f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.592084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.592930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.593212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.593487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.599489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99686fa4-1ffa-4e94-a2a9-63785c8a7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.600085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686fa4-1ffa-4e94-a2a9-63785c8a7fc4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.600200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.600367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686fa4-1ffa-4e94-a2a9-63785c8a7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.600642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686fa4-1ffa-4e94-a2a9-63785c8a7fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.601283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99686fa4-1ffa-4e94-a2a9-63785c8a7fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:06.601527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.601616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99686fa4-1ffa-4e94-a2a9-63785c8a7fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.602997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99686fa4-1ffa-4e94-a2a9-63785c8a7fc4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:06.614496 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:06.615501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 282/570] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:06.616399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.617605 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 289/571] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:06.618052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552b59-5ea8-49ad-869c-16fec9f3e88e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.618230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552b59-5ea8-49ad-869c-16fec9f3e88e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.618461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552b59-5ea8-49ad-869c-16fec9f3e88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.623821 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.636085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f5552b59-5ea8-49ad-869c-16fec9f3e88e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:06.637279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5552b59-5ea8-49ad-869c-16fec9f3e88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:06.705158 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 290/572] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:06.706107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552b59-5ea8-49ad-869c-16fec9f3e88e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.728110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dfdd7-751f-4a53-b55f-9cdab225f9b5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.756669 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.765773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.766442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.766728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.769955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.781661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.784070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:06.801480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:06.802491 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:06.803378 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:06.803378 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:06.803378 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:06.804254 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 283/573] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:06.805103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.820116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552b59-5ea8-49ad-869c-16fec9f3e88e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.860506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.861085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.861358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.861623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.862308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:06.862656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.863957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.868291 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.872868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 291/574] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:06.873659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.924673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b24e4-50ad-420d-9d5d-f2adf57bde8b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.964521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:06.965282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.965570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.965881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.966758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:06.967070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:06.968911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:06.983816 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 284/575] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:06.984645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.987011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83c3eb-6723-453f-b2d6-32d40a2975b5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:06.994176 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.021123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.021747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.022058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.022334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.029935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.031692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:07.043136 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:07.044203 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 292/576] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:07.045126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.091344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faf07e-c9e4-48eb-ae4f-e329afe7134a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.108148 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.125676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.126347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.126629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.126906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.127550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:07.127857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.129280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.141037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 285/577] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:07.141854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.148561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763f632-faf0-4817-b3a1-fe07682b6904 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.183826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.184453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.184732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.185014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.196154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.197595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:07.212502 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:07.213576 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:07.215113 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:07.215113 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:07.215113 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:07.215113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 293/578] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:07.215113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.234083 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.249914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359e405-8458-47d3-b5c6-2dbcaead9e8e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.285145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.285869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.286156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.286436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.297317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:07.302765 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:07.303896 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 286/579] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:07.305263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.319383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31887e9b-8cdd-41d4-b6ad-7f8a24abf7a0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.344386 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.355043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.355649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.357508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.357508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.357508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=33919497efcb42f49a4b9034352f3045) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:07.357508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.358718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.364189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 294/580] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/role_assignments?user.id=33919497efcb42f49a4b9034352f3045&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:07.364972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.427104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9737ee-4173-46eb-a71c-b56e8975465a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.470098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.470636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.470913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.471177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.471884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:07.472186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.473221 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.473634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.487093 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 287/581] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:07.487903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.499952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272f654-e6cb-4d0a-b302-145d691dd742 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.540175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.540807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.541083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.541355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] PATH_INFO: `/v3/users/glance` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.550536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.552019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:07.565148 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:07.566153 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 295/582] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:07.567173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.610062 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.616333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05479599-5a12-4bab-b253-33bd04688a4b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.660143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.660739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.661016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.661291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.661992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:07.662287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.663660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.680695 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 288/583] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:07.680885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82398a0-1f9d-4c17-a565-01e2a500bf6b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.681330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.718553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.719307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.719769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.719975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.720817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:07.721132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.722595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.737299 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 296/584] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:07.738125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.742525 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.796310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ca418-d169-4c78-9237-e0c5a989cc81 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.832937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.833605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.833920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.834213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/0ef7d679c29544eeb884f2172e643a59/roles/4605266f425143d29e63e37830ba3ad7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.846219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94501-89f5-45e0-9f29-0db3b7324b77 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.850356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=0ef7d679c29544eeb884f2172e643a59, role_id=4605266f425143d29e63e37830ba3ad7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.851808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.880527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.881136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.881414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.881684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.882448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:07.882754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.884196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.902502 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 297/585] 10.222.0.59 () {56 vars in 1137 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:07.903329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.987609 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 289/586] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:07 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/0ef7d679c29544eeb884f2172e643a59/roles/4605266f425143d29e63e37830ba3ad7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:52:07.989201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:07.999871 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.040986 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.088278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1be7f-935d-45de-bff4-42a378f26b2e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.116607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c2f7-9866-4623-a9cd-99c22e29ad4b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.128285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.128922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.129268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.129544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.139788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.141251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:08.153691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:08.154693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:08.155630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:08.156210 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 298/587] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:08.156821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.169874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.170875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.171167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.171461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.183945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.185451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:08.202147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:08.203123 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:08.204012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:08.204012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:08.204012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:08.204012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 290/588] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:08.204463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.280161 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.281601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352a2d1-770f-4462-86ea-6d17283c7c4e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.312093 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.329357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.330835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.331393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.331827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.336996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec73f34-42e0-4c43-811c-56690c811f8a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.346313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.348541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:08.370290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:08.371579 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:08.372742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:08.372742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:08.372742 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:08.374980 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 299/589] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:08.375963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.387804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.389149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.389529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.389949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.390825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:08.391230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.393690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.417496 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 291/590] 10.222.0.59 () {56 vars in 1137 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:08.418670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.502130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb411829-289f-4a85-80b0-0e2f6d47c0d0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.542977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e1a17-ff5b-46bd-a4a4-7f4007a98c8f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.544009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.544953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.545494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.546025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.546896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:08.547403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.548974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.561553 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.564255 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 300/591] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:08.565376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.586669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.587334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.587653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.588082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.589987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:08.590302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.592050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.607582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 292/592] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:08.608489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.611180 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.689539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349190d-6521-4f0d-9b82-5b9b19c319af None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.726909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8348be-edf9-4c04-a737-76cd2c16c517 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.729139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.730588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.731049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.731515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.743034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.745537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:08.763057 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:08.764240 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:08.765338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:08.765338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:08.765338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:08.767232 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 301/593] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:08.767704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.768398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.768512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.768806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.769163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.778609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.780302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:08.794124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:08.795291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:52:08.796466 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:08.797132 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 293/594] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:08.797782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.836521 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.868209 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.885095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124f1fb-5295-48d7-94d3-c6f5bf8e8627 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.910761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2fc2b-354c-4616-a242-ec5453d6cd7e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.923687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.924585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.925007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.925422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.933658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.935469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:08.949280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:08.950693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:08.951783 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:08.952308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.952308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.952714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.953052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.953771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:08.954162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.954572 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 302/595] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:08.955628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.960428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.974016 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 294/596] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:08.975065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.067195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e49ac-5587-4f59-85ee-027be261dba9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.079132 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:09.085494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83772a0e-acce-4ccd-8d9d-11afb3aef036 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.105726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.106604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.107030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.107444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.108371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:09.108865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.110453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.125384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.126129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.126483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.126832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.127605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:09.128459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.129604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.132743 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 303/597] 10.222.0.59 () {56 vars in 1139 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:09.133927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.139040 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:09.150046 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 295/598] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:09.152126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.246221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce52d-385e-494c-a64f-4199012652b7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.268797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b556e-267a-477a-bc0f-ecc2051472bc None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.284945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.285736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.286063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.286453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.294395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.295914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:09.308636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:09.309577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:09.310514 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 304/599] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:09.311013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.312524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.313387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.313913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.314421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.327072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.328486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:09.342996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:09.343959 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:09.344864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:09.344864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:09.344864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:09.344864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 296/600] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:09.345528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.359342 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:09.379673 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:09.422645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb55e72-6e7d-47d0-9d5e-486b378c5421 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.458432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672674-db25-46bd-90e1-3a2a269479b1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.461707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.462416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.462694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.462963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/55ea28229f144d47826791bcade28b24/roles/4605266f425143d29e63e37830ba3ad7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.478168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=55ea28229f144d47826791bcade28b24, role_id=4605266f425143d29e63e37830ba3ad7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.479970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.494076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202d08b-d61b-4d5f-89ed-dea80322ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.495263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202d08b-d61b-4d5f-89ed-dea80322ac68 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.495620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202d08b-d61b-4d5f-89ed-dea80322ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.495895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202d08b-d61b-4d5f-89ed-dea80322ac68 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.496588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202d08b-d61b-4d5f-89ed-dea80322ac68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:09.496900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202d08b-d61b-4d5f-89ed-dea80322ac68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.498396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202d08b-d61b-4d5f-89ed-dea80322ac68 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.511065 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 297/601] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:09.512346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f6950-43ea-4bdd-9c00-01ed919dec1a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.512635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f6950-43ea-4bdd-9c00-01ed919dec1a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.512906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f6950-43ea-4bdd-9c00-01ed919dec1a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.514342 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 298/602] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:09.514863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f6950-43ea-4bdd-9c00-01ed919dec1a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.552586 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 305/603] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:09 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/55ea28229f144d47826791bcade28b24/roles/4605266f425143d29e63e37830ba3ad7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:52:09.553405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.600552 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:09.644982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f6950-43ea-4bdd-9c00-01ed919dec1a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.688301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82461c7a-c37e-4c80-92da-a0172d1db070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.689382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461c7a-c37e-4c80-92da-a0172d1db070 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.689900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461c7a-c37e-4c80-92da-a0172d1db070 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.690402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461c7a-c37e-4c80-92da-a0172d1db070 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.691264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82461c7a-c37e-4c80-92da-a0172d1db070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:09.691781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82461c7a-c37e-4c80-92da-a0172d1db070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.693469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82461c7a-c37e-4c80-92da-a0172d1db070 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.707772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 299/604] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:09.709420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0a63-27e4-4e5d-a996-ea69357d5b13 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.712892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0a63-27e4-4e5d-a996-ea69357d5b13 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.713495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0a63-27e4-4e5d-a996-ea69357d5b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.716716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd586c13-9d3d-40a6-bcb4-95198ba3f08f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.733015 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:09.735303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9fdf0a63-27e4-4e5d-a996-ea69357d5b13 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:09.736481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9fdf0a63-27e4-4e5d-a996-ea69357d5b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:09.764224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.764500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.764771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.765031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/10fe5abbf8c24c3882d8ad3addd241b5/roles/4605266f425143d29e63e37830ba3ad7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.788535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=10fe5abbf8c24c3882d8ad3addd241b5, role_id=4605266f425143d29e63e37830ba3ad7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.790026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:09.822807 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 300/605] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:09.823943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf0a63-27e4-4e5d-a996-ea69357d5b13 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:09.877738 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 306/606] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:09 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/10fe5abbf8c24c3882d8ad3addd241b5/roles/4605266f425143d29e63e37830ba3ad7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:52:09.894577 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:09.942177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf0a63-27e4-4e5d-a996-ea69357d5b13 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:09.982500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:09.983469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:09.983964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:09.984421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:09.992397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:09.994110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:10.008009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:10.008969 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:10.009888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:10.012611 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 301/607] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:10.018944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:10.156946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:10.167150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0861ee-6328-4597-b870-a487bc9094be None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:10.219565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23697f99-971b-4c7d-a1a0-fc5472ccdf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:10.220220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23697f99-971b-4c7d-a1a0-fc5472ccdf05 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.220607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23697f99-971b-4c7d-a1a0-fc5472ccdf05 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.220878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23697f99-971b-4c7d-a1a0-fc5472ccdf05 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.221677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23697f99-971b-4c7d-a1a0-fc5472ccdf05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:10.222011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23697f99-971b-4c7d-a1a0-fc5472ccdf05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:10.223509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23697f99-971b-4c7d-a1a0-fc5472ccdf05 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:10.236588 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 307/608] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:10.238173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1645d0-5a4f-4923-98b8-4780836a9ad8 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.238173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1645d0-5a4f-4923-98b8-4780836a9ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.238467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1645d0-5a4f-4923-98b8-4780836a9ad8 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.240043 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 308/609] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:10.246292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1645d0-5a4f-4923-98b8-4780836a9ad8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:10.272466 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:10.318931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d800-b8d0-41a0-a97b-7b19d2f0ee7b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:10.343298 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:10.366236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1645d0-5a4f-4923-98b8-4780836a9ad8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:10.366727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d2aa0-096a-46f2-a808-fa5e4712c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:10.367863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2aa0-096a-46f2-a808-fa5e4712c50b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.368349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2aa0-096a-46f2-a808-fa5e4712c50b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.370295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d2aa0-096a-46f2-a808-fa5e4712c50b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.384465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d2aa0-096a-46f2-a808-fa5e4712c50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-817d2aa0-096a-46f2-a808-fa5e4712c50b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:10.389501 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:10.390707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:10.391620 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 302/610] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:10.392889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de675f-64bb-4b51-aaa0-605a57565f6d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.392889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de675f-64bb-4b51-aaa0-605a57565f6d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.393168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de675f-64bb-4b51-aaa0-605a57565f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.413046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:10.414074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.414623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.415096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/9db493faf16349169f9199f922ff3646/roles/4605266f425143d29e63e37830ba3ad7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.416191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-30de675f-64bb-4b51-aaa0-605a57565f6d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:10.418103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-30de675f-64bb-4b51-aaa0-605a57565f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:10.434865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=9db493faf16349169f9199f922ff3646, role_id=4605266f425143d29e63e37830ba3ad7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:10.437408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:10.497235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 303/611] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:10.498169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de675f-64bb-4b51-aaa0-605a57565f6d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:10.538762 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 309/612] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:10 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/9db493faf16349169f9199f922ff3646/roles/4605266f425143d29e63e37830ba3ad7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:52:10.632036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de675f-64bb-4b51-aaa0-605a57565f6d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:10.641552 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:10.670205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:10.670832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.671146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.671444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.672386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:10.672734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:10.674495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:10.685739 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 304/613] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:10.691157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:10.790527 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:10.816762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db27136-4745-4371-ad9e-30a3b787e2ad None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:10.830133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:10.859047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:10.859736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.860014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.860285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.871478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:10.872899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:10.889048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:10.890091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:10.891020 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:10.891020 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:10.891020 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:10.891020 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 310/614] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:10.896036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:10.951443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8bffd-74f6-4b7e-96c8-7713e5aa494b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:10.989014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:10.990055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.990546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.991063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.003166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:11.008449 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:11.009397 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:11.010426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:11.013039 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 305/615] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:11.018904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.022186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a50ef-63b3-4da3-8337-8bb889ce2130 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.074214 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:11.076006 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:11.092448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.093122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.096702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.096702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.096702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:11.096702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.096702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.122306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 311/616] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:11.127555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.199961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793688c-1081-41ee-a6b5-3a1ae5eb62fe None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.273707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.274352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.274630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.274902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.275570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:11.275919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.277304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.299788 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 306/617] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:11.301988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.333651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705ec2b-5b8a-4997-a880-57efe2c136cd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.406001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.406644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.407373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.407373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] PATH_INFO: `/v3/users/swift` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.415312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.417307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:11.430873 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:11.431943 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:11.433797 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:11.437690 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 312/618] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:11.439562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.512030 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:11.531892 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:11.540874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247992a-bc30-4077-a3d3-a22a43c132c4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.587425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0072d7b-0d54-4689-9f3f-3d9c111fb51d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.619011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.619801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.620083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.620349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.636810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.638290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:11.654167 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:11.655368 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:11.656784 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:11.656784 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:11.656784 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:11.656784 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 307/619] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:11.658072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.658758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.659104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.659444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.661068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.662090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:11.662406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.663860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.702985 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 313/620] 10.222.0.59 () {56 vars in 1135 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:11.708376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.847606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8dc72-ca8c-42a1-a8f0-0fa305665726 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.893888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846295b-0500-447f-98f1-ab01dd76dfd5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.974326 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:11.974530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3ab5-887a-4055-b113-2cd996816bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.974530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3ab5-887a-4055-b113-2cd996816bd8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.974530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3ab5-887a-4055-b113-2cd996816bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.974530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3ab5-887a-4055-b113-2cd996816bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.974828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3ab5-887a-4055-b113-2cd996816bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:11.974828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3ab5-887a-4055-b113-2cd996816bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.974828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3ab5-887a-4055-b113-2cd996816bd8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.974828 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 308/621] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:11.975089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103328-fc5c-4684-8409-2cabaa7f2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.975089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103328-fc5c-4684-8409-2cabaa7f2832 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.975236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97e04-0527-41bd-993c-27f7def005f8 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.975307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103328-fc5c-4684-8409-2cabaa7f2832 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.975307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103328-fc5c-4684-8409-2cabaa7f2832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.975430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97e04-0527-41bd-993c-27f7def005f8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.975430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97e04-0527-41bd-993c-27f7def005f8 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.975430 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 309/622] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:11.975430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97e04-0527-41bd-993c-27f7def005f8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.975430 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:11.975767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103328-fc5c-4684-8409-2cabaa7f2832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.975767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103328-fc5c-4684-8409-2cabaa7f2832 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-af103328-fc5c-4684-8409-2cabaa7f2832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:11.985606 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:11.986802 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:11.987697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:11.987697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:11.987697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:11.995373 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 314/623] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:11.995373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62726c65-bba4-4b6b-8cf9-80c2538e7992 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.995373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62726c65-bba4-4b6b-8cf9-80c2538e7992 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.995373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62726c65-bba4-4b6b-8cf9-80c2538e7992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.021332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-62726c65-bba4-4b6b-8cf9-80c2538e7992 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:12.023005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-62726c65-bba4-4b6b-8cf9-80c2538e7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:12.079381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97e04-0527-41bd-993c-27f7def005f8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:12.105907 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 315/624] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:12.105907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62726c65-bba4-4b6b-8cf9-80c2538e7992 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:12.138899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce8423-fee1-4b18-bdf8-075977623ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:12.139553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce8423-fee1-4b18-bdf8-075977623ad0 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.140081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce8423-fee1-4b18-bdf8-075977623ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.140686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce8423-fee1-4b18-bdf8-075977623ad0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.150056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce8423-fee1-4b18-bdf8-075977623ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:12.151664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce8423-fee1-4b18-bdf8-075977623ad0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-5cce8423-fee1-4b18-bdf8-075977623ad0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:12.167994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:12.169888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 310/625] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55fb33-6203-4026-a011-b64063dd12b3 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.171758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55fb33-6203-4026-a011-b64063dd12b3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.172473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55fb33-6203-4026-a011-b64063dd12b3 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.174136 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 311/626] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:12.175712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55fb33-6203-4026-a011-b64063dd12b3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:12.221689 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:12.240823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62726c65-bba4-4b6b-8cf9-80c2538e7992 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:12.253349 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:12.285376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a8a4-cace-4e39-95b8-5ff8e31a2431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:12.286017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a8a4-cace-4e39-95b8-5ff8e31a2431 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.286298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a8a4-cace-4e39-95b8-5ff8e31a2431 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.286574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a8a4-cace-4e39-95b8-5ff8e31a2431 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.287231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a8a4-cace-4e39-95b8-5ff8e31a2431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:12.287537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a8a4-cace-4e39-95b8-5ff8e31a2431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:12.289426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a8a4-cace-4e39-95b8-5ff8e31a2431 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:12.304930 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 316/627] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:12.305716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55fb33-6203-4026-a011-b64063dd12b3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:12.306289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e563c-4f35-438a-a7a8-2250243790f6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.306584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e563c-4f35-438a-a7a8-2250243790f6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.307012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e563c-4f35-438a-a7a8-2250243790f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.332691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c78e563c-4f35-438a-a7a8-2250243790f6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:12.334623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c78e563c-4f35-438a-a7a8-2250243790f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:12.345558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:12.346306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.346591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.346907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.347745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:12.348104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:12.349683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:12.372236 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 312/628] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:12.373143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:12.437967 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 317/629] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:12.438867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e563c-4f35-438a-a7a8-2250243790f6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:12.508553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5dc4d-eff8-458a-8376-f46f61953f08 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:12.533789 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:12.545704 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:12.560842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e563c-4f35-438a-a7a8-2250243790f6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:12.562831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:12.563681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.563965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.564237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.576823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:12.581654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:12.596938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:12.598107 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 313/630] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:12.603977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:12.619980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:12.620730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.621124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.621328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.723764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:12.726410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:12.735522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0119-7787-461e-b189-356f6297a2ac None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:12.777748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:12.778488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.778768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.779039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.796697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:12.804903 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:12.805953 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:12.807654 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:12.811982 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 314/631] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:12.811982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:12.838724 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:12.872846 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:12.873726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 318/632] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:12.874385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:12.938778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26194f2-50a2-49b6-ac39-e89451937099 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:12.977100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:12.977689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:12.977925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:12.978192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:12.979496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:12.980213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:12.981475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.001075 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 315/633] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:13.001283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa407cb-f04c-4269-88dd-8d8e4a6ba3d4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.001718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.033912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b3bc8-f2dc-4c2f-9a38-ff7d2a46e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.034539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3bc8-f2dc-4c2f-9a38-ff7d2a46e2df None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.034814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3bc8-f2dc-4c2f-9a38-ff7d2a46e2df None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.035081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b3bc8-f2dc-4c2f-9a38-ff7d2a46e2df None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.046373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b3bc8-f2dc-4c2f-9a38-ff7d2a46e2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6a5b3bc8-f2dc-4c2f-9a38-ff7d2a46e2df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:13.051130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:13.052419 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:13.053364 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 319/634] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:13.054420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0245-ee5a-429e-864d-8158e48580ed None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.054420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0245-ee5a-429e-864d-8158e48580ed None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.054670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da0245-ee5a-429e-864d-8158e48580ed None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.060396 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 320/635] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:13.061237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0245-ee5a-429e-864d-8158e48580ed None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.106337 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:13.112382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e2fcb-eaaa-4e81-acf9-c0fb60955b1e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.149879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.150498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.151507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.152015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.152766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:13.153082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.154499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.164977 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:13.165167 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 316/636] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:13.166323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.199294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da0245-ee5a-429e-864d-8158e48580ed None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.245990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.246638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.246914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.247185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.260763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.262687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:13.279840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:13.280967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:13.281945 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:13.281945 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:13.281945 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:13.281945 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 321/637] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:13.281945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.305043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386c40-a9c2-4514-aa1b-66547ef0ee55 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.343531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed4eb3-6cd2-4269-a239-869b111e499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.344200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed4eb3-6cd2-4269-a239-869b111e499a None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.344483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed4eb3-6cd2-4269-a239-869b111e499a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.344763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed4eb3-6cd2-4269-a239-869b111e499a None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/33919497efcb42f49a4b9034352f3045/roles/4605266f425143d29e63e37830ba3ad7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.361955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed4eb3-6cd2-4269-a239-869b111e499a None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=33919497efcb42f49a4b9034352f3045, role_id=4605266f425143d29e63e37830ba3ad7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.363411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed4eb3-6cd2-4269-a239-869b111e499a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.398115 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:13.411175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bc5a3-fa07-4580-b4d3-c51f10d770c5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.444285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.444882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.445158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.445424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.446111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:13.446406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.448482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.454590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 317/638] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:13 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/33919497efcb42f49a4b9034352f3045/roles/4605266f425143d29e63e37830ba3ad7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:52:13.456094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc0c7-f152-4f14-b4a4-6b45a385839d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.456383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc0c7-f152-4f14-b4a4-6b45a385839d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.456658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc0c7-f152-4f14-b4a4-6b45a385839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.462237 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 322/639] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:13.462237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.482717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-457dc0c7-f152-4f14-b4a4-6b45a385839d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:13.483965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-457dc0c7-f152-4f14-b4a4-6b45a385839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:13.496417 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:13.561304 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 318/640] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:13.570074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dc0c7-f152-4f14-b4a4-6b45a385839d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.615860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807ea1-2646-43d8-96ab-c79bee672559 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.659241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.659884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.660276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.660555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.677177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.678672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:13.701303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:13.702373 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:13.703281 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:13.703281 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:13.703281 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:13.703281 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 323/641] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:13.703938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.708031 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:13.721229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dc0c7-f152-4f14-b4a4-6b45a385839d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.767262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.767831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.768555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.768835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.770135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:13.770596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.772352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.788934 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 319/642] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:13.790629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.799822 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:13.849348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65176c-a52b-42e4-8236-eb0b69973f20 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.890762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.892331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.892615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.892901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.904848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.905377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13370c94-482f-43d1-8aa0-acd7e993a654 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:13.906521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:13.921769 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:13.925583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:13.926616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:13.926616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:13.926616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:13.926616 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 324/643] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:13.926868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:13.945401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:13.946044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.946322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.946593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.947232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:13.948293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:13.950211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:13.962299 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 320/644] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:13.963788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.003542 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.031818 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.049728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b8c16-ec1a-427f-97a2-b5ab28a3e995 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.072541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea95cc0-6279-4774-b8a5-2f8b116aa5ef None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.084593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.085222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.085501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.085773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.093636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.095595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:14.109295 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:14.110344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 325/645] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:14.111666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.116113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.116759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.117088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.117563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.131751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:14.136807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:14.137736 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:14.138607 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 321/646] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:14.139357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.238188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb363-2140-4d44-bf3b-abebfdc2482c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.246329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0483da-336a-4ae5-b46c-24deb82bb963 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.255338 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.272754 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.277303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.277965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.278318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.278506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.279175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:14.279429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.280789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.283817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.284388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.284667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.284939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] PATH_INFO: `/v3/users/glance` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.293036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.294481 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 326/647] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:14.295165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.298884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:14.310542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:14.312248 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:52:14.313665 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:14.316473 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 322/648] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:14.317376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.415632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74cbd1-50ec-4ab7-a2df-84f32787e3fa None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.438462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a712140-e9dd-4c29-8924-27d6bb0eedfb None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.456365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.457123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.457499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.457912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.458714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:14.459113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.460807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.477938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 327/649] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:14.477938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.481617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.482372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.482703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.483045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.483830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:14.484198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.485653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.496958 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 323/650] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:14.497851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.518931 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.546041 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.592534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46145bc2-6189-4925-bed6-160e2ec67606 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.603094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa23ad-3acb-47dd-a39b-9c693fb9f841 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.628700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.629440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.629791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.630160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.638705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.638862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.639372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.639647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.639943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.640616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.640722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:14.640956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.642379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:14.653658 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:14.654915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:14.656091 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:14.662318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 328/651] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:14.662318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.675619 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 324/652] 10.222.0.59 () {56 vars in 1137 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:14.675619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.767604 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.774267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8d5ba-d61f-487c-8fc9-da7648f693d9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.776284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec78407-52fc-42cc-9ac3-34df7c04ed6f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.779508 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.810992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.811621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.811956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.812071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.812364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.812757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.813105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.813293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=0ef7d679c29544eeb884f2172e643a59) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:14.813487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.813734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.815318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.829840 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 329/653] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/role_assignments?user.id=0ef7d679c29544eeb884f2172e643a59&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:14.829840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.839650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.841453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:14.860639 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:14.861888 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:14.863114 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:14.863114 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:14.863114 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:14.867129 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 325/654] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:14.868162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.960516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc27db-9baf-435a-aac6-17db6742b887 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.988172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6761d-9302-41ab-9146-990fe7514f4d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.012967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.014095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.014376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.014650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.015679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:15.015985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.017571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.037680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.038409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.038694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.038971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.040978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 330/655] 10.222.0.59 () {56 vars in 1137 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:15.045236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.062972 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.072918 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.127435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.129003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.188976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a443712-84e0-4a92-bb3c-c291f0b6b9be None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.237677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.238334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.238618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.238891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.239145 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 326/656] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:15.239544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:15.239848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.239997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.241224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.258086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 331/657] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:15.258860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.323241 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.352699 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.379475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5068768-fd46-4cf5-80ac-d11e38d236e0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.382991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d7a78-6365-4d8a-b872-7c02038cb7f8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.429246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.429916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.430196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.430471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.436834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459ec6e-c27c-4e37-8e58-0c7b899f5b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.437887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459ec6e-c27c-4e37-8e58-0c7b899f5b88 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.438383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459ec6e-c27c-4e37-8e58-0c7b899f5b88 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.438868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459ec6e-c27c-4e37-8e58-0c7b899f5b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.443344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.444498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:15.459680 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:15.460719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:15.462278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:15.462278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:15.462278 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:15.462278 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 332/658] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:15.462278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.516162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459ec6e-c27c-4e37-8e58-0c7b899f5b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.517719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459ec6e-c27c-4e37-8e58-0c7b899f5b88 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.573803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6abf09-efb2-4f4c-a00e-375caa839a0b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.577256 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.602609 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.610403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.611042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.611308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.611585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.619903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.624099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.626378 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 327/659] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:15.631934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679a0d-d1c4-4eaa-8ebe-e6549a85e11a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.632212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679a0d-d1c4-4eaa-8ebe-e6549a85e11a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.632490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679a0d-d1c4-4eaa-8ebe-e6549a85e11a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:15.633165 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:15.634124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:52:15.635370 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:15.638468 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 328/660] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:15.639023 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 333/661] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:15.639294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb679a0d-d1c4-4eaa-8ebe-e6549a85e11a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.639848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.752475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb679a0d-d1c4-4eaa-8ebe-e6549a85e11a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.758314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373bfe-329e-459a-afce-0d912ea165ef None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.788486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34a37e-e16e-4ec5-84fb-51f756d90261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.789095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34a37e-e16e-4ec5-84fb-51f756d90261 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.789382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34a37e-e16e-4ec5-84fb-51f756d90261 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.789657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34a37e-e16e-4ec5-84fb-51f756d90261 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.790390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34a37e-e16e-4ec5-84fb-51f756d90261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:15.790695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34a37e-e16e-4ec5-84fb-51f756d90261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.792741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34a37e-e16e-4ec5-84fb-51f756d90261 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.802591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.803456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.803947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.804416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.804903 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 329/662] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:15.806394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3095ba3-c368-4a61-9fd9-240708cb773d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.807444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3095ba3-c368-4a61-9fd9-240708cb773d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.808007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3095ba3-c368-4a61-9fd9-240708cb773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.821047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:15.823697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:15.827480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b3095ba3-c368-4a61-9fd9-240708cb773d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:15.828613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b3095ba3-c368-4a61-9fd9-240708cb773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:15.839983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:15.840988 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:15.841949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:15.841949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:15.841949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:15.841949 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 334/663] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:15.842595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.843425 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.891435 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:15.905861 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 330/664] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:15.906888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3095ba3-c368-4a61-9fd9-240708cb773d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:15.959825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a37c0-bfbe-4239-874d-d8888d321d01 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:15.996825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:15.997942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:15.998450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:15.998896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:15.999874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:16.000395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.002080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.033191 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 335/665] 10.222.0.59 () {56 vars in 1139 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:16.033191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.049548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3095ba3-c368-4a61-9fd9-240708cb773d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.096046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.096604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.096885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.097208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.106573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.108708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:16.122241 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:16.123158 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:16.124095 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:16.131154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 331/666] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:16.132241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.142385 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.154688 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.159074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e284-295e-4986-9e6b-40250231bce6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.196407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.197412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.197951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.198371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.199535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:16.200069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.201600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.214482 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 336/667] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:16.215528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.246123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538253-4051-4edb-adac-2cdbd4836503 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.280742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.281353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.281632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.281932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.334961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b250d-33ef-45f8-b94e-c65b0a35aaf4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.359130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.360726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.370576 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.374553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.375170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.375465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.375726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.376422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:16.376730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.378185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.391681 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 337/668] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:16.392781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.420441 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.480904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 332/669] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:16.481756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.514230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8661-76b4-44ab-be22-4d85f36f0882 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.554127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.554756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.555035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.555311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.566776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:16.572096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:16.573836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 338/670] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:16.580086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.591843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c78319-a455-4b93-8323-a06a836c788e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.599601 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.627182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909114c7-6578-414b-bece-52133d425bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.627736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909114c7-6578-414b-bece-52133d425bce None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.628022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909114c7-6578-414b-bece-52133d425bce None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.628297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909114c7-6578-414b-bece-52133d425bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.635784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909114c7-6578-414b-bece-52133d425bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.637539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909114c7-6578-414b-bece-52133d425bce None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-909114c7-6578-414b-bece-52133d425bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:16.651072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:16.652291 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:16.653280 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 333/671] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:16.653883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909114c7-6578-414b-bece-52133d425bce None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.677196 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.700152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67dd6-ff06-4d43-90a4-6f559de770c2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.742051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.743034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.743318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.743898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.745342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=55ea28229f144d47826791bcade28b24) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:16.745790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.747257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.763265 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 339/672] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/role_assignments?user.id=55ea28229f144d47826791bcade28b24&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:16.763265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.767646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909114c7-6578-414b-bece-52133d425bce None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.808772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.809423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.809762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.810077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.826164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.827640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:16.846208 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:16.847422 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:16.848588 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:16.848588 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:16.848588 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:16.852334 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 334/673] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:16.853294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.881166 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.903454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795591d-7663-499a-bf15-896ff379fe9d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:16.944605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:16.945319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.945611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.945931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.946606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:16.946913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:16.948628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:16.957937 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 340/674] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:16.958552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:16.963599 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.985056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a774664-bd80-45c9-b7ce-1cae51284bde None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.024252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7d568-96e7-41b3-9d0c-9ba0f7c94fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.025108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7d568-96e7-41b3-9d0c-9ba0f7c94fb4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.026154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7d568-96e7-41b3-9d0c-9ba0f7c94fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.026632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7d568-96e7-41b3-9d0c-9ba0f7c94fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.027608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7d568-96e7-41b3-9d0c-9ba0f7c94fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:17.027920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7d568-96e7-41b3-9d0c-9ba0f7c94fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.029446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7d568-96e7-41b3-9d0c-9ba0f7c94fb4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.043857 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 335/675] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:17.045207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908fdd-844b-4648-a565-61e05b143c54 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.045495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908fdd-844b-4648-a565-61e05b143c54 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.045770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908fdd-844b-4648-a565-61e05b143c54 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.049968 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 336/676] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:17.049968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e908fdd-844b-4648-a565-61e05b143c54 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.078154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d4811-b721-4de4-a624-e873b86f9d9b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.114652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.115262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.115543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.115820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.116465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:17.116770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.118389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.136362 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 341/677] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:17.136362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.157397 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:17.187229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e908fdd-844b-4648-a565-61e05b143c54 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.206220 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:17.230664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436df0c-3108-412b-b484-03443b71c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.231332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436df0c-3108-412b-b484-03443b71c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.231614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436df0c-3108-412b-b484-03443b71c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.231891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436df0c-3108-412b-b484-03443b71c2c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.243441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436df0c-3108-412b-b484-03443b71c2c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.245923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436df0c-3108-412b-b484-03443b71c2c3 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.249183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be6bb2-ecc0-4cac-9cef-d12cd2692d7c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-8436df0c-3108-412b-b484-03443b71c2c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:17.262164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:17.263164 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:17.264074 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:17.264074 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:17.264074 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:17.264074 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 337/678] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:17.264650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c59d8-03b2-4562-a58c-5787a84b3843 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.264731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c59d8-03b2-4562-a58c-5787a84b3843 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.265062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c59d8-03b2-4562-a58c-5787a84b3843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.284541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aa0c59d8-03b2-4562-a58c-5787a84b3843 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:17.285748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aa0c59d8-03b2-4562-a58c-5787a84b3843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:17.293372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f999a-a843-48ac-a121-de01db570244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.294274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f999a-a843-48ac-a121-de01db570244 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.294865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f999a-a843-48ac-a121-de01db570244 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.295143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f999a-a843-48ac-a121-de01db570244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.295878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f999a-a843-48ac-a121-de01db570244 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=10fe5abbf8c24c3882d8ad3addd241b5) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:17.296184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f999a-a843-48ac-a121-de01db570244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.297734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f999a-a843-48ac-a121-de01db570244 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.313867 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 342/679] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/role_assignments?user.id=10fe5abbf8c24c3882d8ad3addd241b5&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:17.313867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f999a-a843-48ac-a121-de01db570244 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.390103 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 338/680] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:17.391070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c59d8-03b2-4562-a58c-5787a84b3843 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.489092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f999a-a843-48ac-a121-de01db570244 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.523276 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:17.546227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.546889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.547176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.547454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.555755 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:17.557590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.559834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:17.577779 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:17.578803 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:17.579794 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:17.583588 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 343/681] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:17.585010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.588842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c59d8-03b2-4562-a58c-5787a84b3843 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.644573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.645116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.645393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.645665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.646345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:17.646650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.648033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.661680 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 339/682] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:17.667235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.720424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f81a-918d-42f2-bced-5e19f806b180 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.757432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.758166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.758589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.758985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.760503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:17.760819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.762439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.774113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16945d-f9f9-4eaa-9015-5d63c1c4dbd9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.776536 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 344/683] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:17.777391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.799946 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:17.814756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.815395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.815675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.816051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.825074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.826558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.834202 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:17.840138 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:17.841321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:17.842446 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:17.848841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 340/684] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:17.849925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.891983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59e42-1ac8-4b83-9924-42a9c6cd21a2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.930035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.930584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.930863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.931135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.943847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:17.950063 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:17.951234 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:17.952352 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:17.956137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 345/685] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:17.957150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.961385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158ae59-b60a-4277-aec5-7fcd276c4355 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.999592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.000479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.000929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.001343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.002241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=9db493faf16349169f9199f922ff3646) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:18.002694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.004269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.011800 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 341/686] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/role_assignments?user.id=9db493faf16349169f9199f922ff3646&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:18.012952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.075145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49688-3c51-4ea8-a13e-515b521d1f9f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.076162 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:18.100245 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:18.151767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79c3a4-a7ff-4869-ba2c-f4448bb1bac1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.167720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.168499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.168877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.169245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.170172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:18.170572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.172088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.204368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.205279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.205706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.206160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.207027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:18.207477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.209122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.209715 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 346/687] 10.222.0.59 () {56 vars in 1135 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:18.214914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.220798 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 342/688] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:18.226651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.332616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6e068-2171-4414-b541-a60de0c37289 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.339079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f892401-1cfb-4f1f-81a9-2dd9d83920ab None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.346540 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:18.372925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.373917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.374661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.375153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.380202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.380456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.380741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.381014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.395139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.396576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:18.412763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:18.413698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:18.414614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:18.414614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:18.414614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:18.417851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 343/689] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:18.422455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.430200 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:18.457596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.459246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.574529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8937d-7f8e-48b9-b412-b70e872a57a6 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.576046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 347/690] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:52:18.577798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.646549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.647531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.648029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.648529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.649246 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:18.649959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:18.651420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.653013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.677075 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 344/691] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:18.682928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.687456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14b33-0f46-4b62-87e2-bd68812dc34c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.727012 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:18.728185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.729936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.730402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.730836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.742316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.744594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:18.762886 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:18.764202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:18.765443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:18.765443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:18.765443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:18.771757 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 348/692] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:18.773262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.889980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc477d3-8fbb-4df7-a568-60787e30beb7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.913634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778bfae-075b-4b06-93e5-6bda1d5cc6ef None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:18.915052 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:18.949838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.949838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.949838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.949838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:18.950308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:18.950308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:18.950904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:18.973039 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 349/693] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:18.980267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:18.981080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:18.981728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:18.983920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:18.984199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.000511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:19.001974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:19.023439 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:19.024628 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:19.026879 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 345/694] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:19.034757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:19.114481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48a3b-927b-415e-b25f-a2c6be81b75d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:19.146709 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:19.153137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89873d32-f0a0-4a25-ae03-283c60d7cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:19.153972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873d32-f0a0-4a25-ae03-283c60d7cf29 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.154363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873d32-f0a0-4a25-ae03-283c60d7cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.154766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873d32-f0a0-4a25-ae03-283c60d7cf29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.162488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89873d32-f0a0-4a25-ae03-283c60d7cf29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:19.164076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89873d32-f0a0-4a25-ae03-283c60d7cf29 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:19.173143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6d483-ae6e-4807-b331-8832dab4cc8c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-89873d32-f0a0-4a25-ae03-283c60d7cf29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:19.176944 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:19.178083 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:19.179155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:19.180873 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 350/695] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:19.182897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b627f-c2f8-42cc-9099-ef588ce09ae8 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.183288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b627f-c2f8-42cc-9099-ef588ce09ae8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.183721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b627f-c2f8-42cc-9099-ef588ce09ae8 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.189616 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 351/696] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:19.190897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b627f-c2f8-42cc-9099-ef588ce09ae8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:19.219084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b65ec0-0f8d-4968-b2a8-1a57a54be5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:19.220302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65ec0-0f8d-4968-b2a8-1a57a54be5ec None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.220994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65ec0-0f8d-4968-b2a8-1a57a54be5ec None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.221412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b65ec0-0f8d-4968-b2a8-1a57a54be5ec None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.222452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b65ec0-0f8d-4968-b2a8-1a57a54be5ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:19.222922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b65ec0-0f8d-4968-b2a8-1a57a54be5ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:19.225078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b65ec0-0f8d-4968-b2a8-1a57a54be5ec None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:19.238479 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:19.248379 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 346/697] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:52:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:19.254046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd533069-efd3-485f-9aed-91e6c95687ec None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.254334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd533069-efd3-485f-9aed-91e6c95687ec None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.254619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd533069-efd3-485f-9aed-91e6c95687ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.277258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cd533069-efd3-485f-9aed-91e6c95687ec None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:19.278464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cd533069-efd3-485f-9aed-91e6c95687ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:19.317237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b627f-c2f8-42cc-9099-ef588ce09ae8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:19.356510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:19.357486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.358015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.358501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.359467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:19.360063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:19.361787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:19.369836 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 347/698] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:19.369836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd533069-efd3-485f-9aed-91e6c95687ec None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:19.387601 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 352/699] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:19.393061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:19.448879 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:19.489482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd533069-efd3-485f-9aed-91e6c95687ec None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:19.569782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362fc56-d97d-4575-b381-74d59f1a24e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:19.570432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fc56-d97d-4575-b381-74d59f1a24e8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.570717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fc56-d97d-4575-b381-74d59f1a24e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.570987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362fc56-d97d-4575-b381-74d59f1a24e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.595834 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:19.601518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef42e0-df0a-42be-95cf-4d36a795f876 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:19.672922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:19.673728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.674030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.675203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.675938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=33919497efcb42f49a4b9034352f3045) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:19.676248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:19.678524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:19.694323 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 353/700] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:19 2022] GET /identity/v3/role_assignments?user.id=33919497efcb42f49a4b9034352f3045&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:19.719140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362fc56-d97d-4575-b381-74d59f1a24e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:19.720758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362fc56-d97d-4575-b381-74d59f1a24e8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:19.731634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:19.846331 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:19.894048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0021b96-4420-4c1c-a8c9-56e15cde2dc6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:19.898109 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 348/701] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:19.899518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05612-1b09-4c73-b74f-c043272710eb None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.899800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05612-1b09-4c73-b74f-c043272710eb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.900862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05612-1b09-4c73-b74f-c043272710eb None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.902687 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 349/702] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:19.904541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05612-1b09-4c73-b74f-c043272710eb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:19.944385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650dd5-7daf-4b59-91db-0eb5972dbe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:19.945028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650dd5-7daf-4b59-91db-0eb5972dbe5b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.945312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650dd5-7daf-4b59-91db-0eb5972dbe5b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.945593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650dd5-7daf-4b59-91db-0eb5972dbe5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.960149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650dd5-7daf-4b59-91db-0eb5972dbe5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:19.962085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650dd5-7daf-4b59-91db-0eb5972dbe5b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f0650dd5-7daf-4b59-91db-0eb5972dbe5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:19.983376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:19.984461 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:19.985500 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:19.985500 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:19.985500 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:19.985677 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 354/703] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:19.987481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9506e-a542-4b79-abdf-e3800629536a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.987910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9506e-a542-4b79-abdf-e3800629536a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.988259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9506e-a542-4b79-abdf-e3800629536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.013269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a7f9506e-a542-4b79-abdf-e3800629536a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:20.015026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a7f9506e-a542-4b79-abdf-e3800629536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:20.028148 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:20.031730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05612-1b09-4c73-b74f-c043272710eb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.074355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.075751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.076486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.076937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.091256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.093591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.106644 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 355/704] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:20.111958 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:20.112910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:20.113882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:20.113882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:20.113882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:20.114745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9506e-a542-4b79-abdf-e3800629536a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.121268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 350/705] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:20.123636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.146232 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:20.253592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b31d91-9eac-4c6b-a097-b02466e90efd None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.293385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9506e-a542-4b79-abdf-e3800629536a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.334420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.335281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.335730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.336142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.336966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:20.337427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.339936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.352805 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 356/706] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:20.357094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.357902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.359375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.359893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.360641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.362711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:20.362915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.363968 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:20.364293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.393363 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 351/707] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:20.399157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.478894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2dc7-dd21-4d40-9f93-8bddfdbf2b67 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.514224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.515072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.515500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.515913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.516695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.518377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.526251 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:20.548109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8cef5-2e77-42f3-aa01-313b8170fb37 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.582398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ecb36-f183-4367-b486-befd564b9244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.583020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecb36-f183-4367-b486-befd564b9244 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.583382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecb36-f183-4367-b486-befd564b9244 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.583651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecb36-f183-4367-b486-befd564b9244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.590899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ecb36-f183-4367-b486-befd564b9244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.592328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ecb36-f183-4367-b486-befd564b9244 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.605682 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 357/708] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:52:20 2022] POST /identity/v3/users => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:52:20.605682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2a7ecb36-f183-4367-b486-befd564b9244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:20.606461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:20.607359 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 352/709] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e984f-482b-4fe1-9562-c06f287a6cff None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.608394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e984f-482b-4fe1-9562-c06f287a6cff None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.609020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e984f-482b-4fe1-9562-c06f287a6cff None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.613054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 353/710] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:20.614931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e984f-482b-4fe1-9562-c06f287a6cff None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.697689 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:20.738945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e984f-482b-4fe1-9562-c06f287a6cff None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.766165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e181e-cdeb-4d29-9afa-9b007da1cefd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.780960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0856467-493f-4ea3-8f9a-6e81175b3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.781638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856467-493f-4ea3-8f9a-6e81175b3c87 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.781961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856467-493f-4ea3-8f9a-6e81175b3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.782235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0856467-493f-4ea3-8f9a-6e81175b3c87 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.782924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0856467-493f-4ea3-8f9a-6e81175b3c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:20.783230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0856467-493f-4ea3-8f9a-6e81175b3c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.784648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0856467-493f-4ea3-8f9a-6e81175b3c87 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.792314 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:20.798327 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 354/711] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:20.799629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14b9d-f6f2-41ce-ab68-1cd4463b5161 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.799996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14b9d-f6f2-41ce-ab68-1cd4463b5161 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.805442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14b9d-f6f2-41ce-ab68-1cd4463b5161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.814707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.815389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.816212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.816212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.816481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.817825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.820951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8de14b9d-f6f2-41ce-ab68-1cd4463b5161 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:20.823599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8de14b9d-f6f2-41ce-ab68-1cd4463b5161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:20.840344 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:20.841625 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:20.844510 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 358/712] 10.222.0.59 () {56 vars in 1129 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:20.845406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.904796 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 355/713] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:20.905429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14b9d-f6f2-41ce-ab68-1cd4463b5161 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.996509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aa686-cbd5-44aa-aa11-f062176f4282 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:21.030205 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:21.034190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:21.034900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.035188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.035461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.036191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=0ef7d679c29544eeb884f2172e643a59) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:21.036501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:21.037975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:21.044887 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 359/714] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/role_assignments?user.id=0ef7d679c29544eeb884f2172e643a59&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:21.069126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14b9d-f6f2-41ce-ab68-1cd4463b5161 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:21.099311 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:21.107970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:21.108609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.108890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.114494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.114494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:21.114494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:21.114494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:21.117272 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 356/715] 10.222.0.59 () {56 vars in 1124 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:21.123486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:21.240235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:21.257234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24ce67-32c4-4e1e-9930-0fb4e240cd9f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:21.297400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:21.298037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.298318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.298587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.299215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:21.299513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:21.300871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:21.307774 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 360/716] 10.222.0.59 () {56 vars in 1124 bytes} [Sun Aug 28 00:52:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:21.375708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d567ea-6b1c-4f14-9862-7a2e1df1cf7f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:21.440144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:21.440924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.441381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.441875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] PATH_INFO: `/v3/services/network` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.442828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:21.444455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:21.464275 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:21.465388 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:21.466284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 357/717] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:21 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:21.473548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:21.545610 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:21.615640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb171dc2-e4ba-4417-bd04-d0121da57fe9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:21.676745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56300d-afb2-4dd5-ab6f-6e0ccb7f650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:21.677356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56300d-afb2-4dd5-ab6f-6e0ccb7f650a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.677635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56300d-afb2-4dd5-ab6f-6e0ccb7f650a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.677936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56300d-afb2-4dd5-ab6f-6e0ccb7f650a None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.678571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56300d-afb2-4dd5-ab6f-6e0ccb7f650a None admin] RBAC: Adding query filter params (name=network) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:21.678872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56300d-afb2-4dd5-ab6f-6e0ccb7f650a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:21.680240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56300d-afb2-4dd5-ab6f-6e0ccb7f650a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:21.689798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 361/718] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:21.696613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:21.779228 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:21.827969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4057d-23cb-4a6f-8647-2328796f7e30 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:21.878548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b214b-5c66-4943-ac1d-b408d9b6a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:21.879182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b214b-5c66-4943-ac1d-b408d9b6a48a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.879466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b214b-5c66-4943-ac1d-b408d9b6a48a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.879741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b214b-5c66-4943-ac1d-b408d9b6a48a None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.880386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b214b-5c66-4943-ac1d-b408d9b6a48a None admin] RBAC: Adding query filter params (type=network) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:21.880689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b214b-5c66-4943-ac1d-b408d9b6a48a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:21.882094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b214b-5c66-4943-ac1d-b408d9b6a48a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:21.889319 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 358/719] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:21.966445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1df1-ac43-41b8-aa41-6dc4c202bb93 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.966748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1df1-ac43-41b8-aa41-6dc4c202bb93 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.966996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1df1-ac43-41b8-aa41-6dc4c202bb93 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.968703 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 362/720] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:21.974607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914af3-bf1d-4a63-9d08-d6986ecabe9b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:21.974893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914af3-bf1d-4a63-9d08-d6986ecabe9b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:21.975172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914af3-bf1d-4a63-9d08-d6986ecabe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:21.998452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-db914af3-bf1d-4a63-9d08-d6986ecabe9b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:21.999680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-db914af3-bf1d-4a63-9d08-d6986ecabe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:22.078976 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 359/721] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:22.383631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1df1-ac43-41b8-aa41-6dc4c202bb93 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:22.547501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1df1-ac43-41b8-aa41-6dc4c202bb93 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:22.569613 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:22.591158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:22.591791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:22.592074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:22.592346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:22.611459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:22.616570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:22.617724 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:22.619311 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:22.622260 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 363/722] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:22.627981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914af3-bf1d-4a63-9d08-d6986ecabe9b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:22.704186 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:22.772584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914af3-bf1d-4a63-9d08-d6986ecabe9b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:22.818275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:22.818904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:22.819185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:22.819456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:22.820133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:22.820434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:22.824423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:22.838490 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 360/723] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:22.844401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:22.978691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0869cb-688e-422f-9e61-61cfc8a21f3a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:23.020552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:23.021189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.021472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.021744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.033236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:23.034721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:23.049202 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:23.050217 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:23.051208 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:23.051208 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:23.051208 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:23.051208 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 364/724] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:23.058942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:23.183713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9196da-d145-4cfb-91da-dfcad342f1c6 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:23.196996 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:23.219505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26ab5e-b8aa-41ee-8168-a613988732d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:23.220126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ab5e-b8aa-41ee-8168-a613988732d8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.220404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ab5e-b8aa-41ee-8168-a613988732d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.220678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ab5e-b8aa-41ee-8168-a613988732d8 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.221324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ab5e-b8aa-41ee-8168-a613988732d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:23.221627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ab5e-b8aa-41ee-8168-a613988732d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:23.223125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ab5e-b8aa-41ee-8168-a613988732d8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:23.237305 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 361/725] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:23.242558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:23.273080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b006c6-eac0-40bf-bc98-74cf79d3216b None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.273390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b006c6-eac0-40bf-bc98-74cf79d3216b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.273634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b006c6-eac0-40bf-bc98-74cf79d3216b None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.275099 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 362/726] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:23.277691 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:23.283660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42964cd7-e78c-4c75-ba22-653220960efd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.283934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42964cd7-e78c-4c75-ba22-653220960efd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.284214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42964cd7-e78c-4c75-ba22-653220960efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.314437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-42964cd7-e78c-4c75-ba22-653220960efd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:23.315733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-42964cd7-e78c-4c75-ba22-653220960efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:23.421175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c674f-f8e8-49ab-a967-d3e78697edd7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:23.443111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 363/727] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:52:23.444793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45921-ecce-460a-abe8-91d6c1612111 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.445229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45921-ecce-460a-abe8-91d6c1612111 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.445696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45921-ecce-460a-abe8-91d6c1612111 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.447524 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 364/728] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:23.465656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:23.466584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.467018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.467443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.473045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b872ed-3689-4bcf-b6e2-951566eb13b6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.473511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b872ed-3689-4bcf-b6e2-951566eb13b6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.473974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b872ed-3689-4bcf-b6e2-951566eb13b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.490867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:23.492606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:23.505786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f5b872ed-3689-4bcf-b6e2-951566eb13b6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:23.507532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f5b872ed-3689-4bcf-b6e2-951566eb13b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:23.515852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:23.517125 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:23.518292 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:23.519438 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 365/729] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:23.524840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:23.602621 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 365/730] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:52:23.684775 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:23.701852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa861b58-96f7-48ef-b29e-c59c49c704d9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:23.745550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcef631-c313-452a-968c-4fd1f65395d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:23.746111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef631-c313-452a-968c-4fd1f65395d7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.746391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef631-c313-452a-968c-4fd1f65395d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.746664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef631-c313-452a-968c-4fd1f65395d7 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.747393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcef631-c313-452a-968c-4fd1f65395d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:23.747700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcef631-c313-452a-968c-4fd1f65395d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:23.749121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcef631-c313-452a-968c-4fd1f65395d7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:23.777296 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 366/731] 10.222.0.59 () {56 vars in 1135 bytes} [Sun Aug 28 00:52:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:23.782632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b872ed-3689-4bcf-b6e2-951566eb13b6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:23.837176 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:23.845160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80cc7-5def-4327-ad30-8e3a38b3b8d7 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.845470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80cc7-5def-4327-ad30-8e3a38b3b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.845739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80cc7-5def-4327-ad30-8e3a38b3b8d7 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.847195 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 367/732] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:23.852152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96408-6e56-4a68-8e58-6afb2e3ef9a2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.852439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96408-6e56-4a68-8e58-6afb2e3ef9a2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.858902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96408-6e56-4a68-8e58-6afb2e3ef9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.876478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f3c96408-6e56-4a68-8e58-6afb2e3ef9a2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:23.878068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f3c96408-6e56-4a68-8e58-6afb2e3ef9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:23.928717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b872ed-3689-4bcf-b6e2-951566eb13b6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:23.959527 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 368/733] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:52:23.961638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c96408-6e56-4a68-8e58-6afb2e3ef9a2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:23.977108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:23.977726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.978084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.978353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.054901 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:24.065538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:24.068195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:24.081264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c96408-6e56-4a68-8e58-6afb2e3ef9a2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.108887 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:24.124330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.124968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.125250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.125526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.141786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:24.148940 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:24.149992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:24.150915 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 369/734] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:24.152206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.209154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 366/735] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:52:24.210348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.273181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f304a0-0e73-49f6-8569-024af44e5f49 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.311780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.312327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.312608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.312881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.315978 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:24.323600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeffbea-cef0-485d-be8e-7b3a37e62670 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.328834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:24.330099 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:24.331036 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:24.331928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:24.336088 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 370/736] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:24.336956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.357883 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:24.365875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.366492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.366772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.370828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.370828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:24.370828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:24.370828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:24.383268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 367/737] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:24.383268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.455580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcd642-8803-4d6e-a78c-fd516ada33e3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.492904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.494180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.494455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.494739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.505126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c335c-aa4a-45e7-a14d-04382b5fe60e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.505620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:24.507367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:24.523547 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:24.524566 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:24.525949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:24.525949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:24.525949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:24.527702 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 371/738] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:24.528654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.546555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.547168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.547446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.547720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.548368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:24.549728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:24.585049 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:24.636548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b696e-2f22-47e1-a29a-299475bbc2b7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.656773 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 368/739] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:24 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:24.657888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.680194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.680894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.681770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.682023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.682765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:24.683067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:24.684628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:24.694289 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 372/740] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:24.695146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.732507 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:24.783934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0bfce-5cb7-424b-9fee-ce4678f9fca2 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.824540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fc7e6-c5f3-4d53-963e-6f77dc727553 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.830791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2035f-09ec-4e9f-84fd-14ef32cf0884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.833215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2035f-09ec-4e9f-84fd-14ef32cf0884 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.833215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2035f-09ec-4e9f-84fd-14ef32cf0884 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.833215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2035f-09ec-4e9f-84fd-14ef32cf0884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.833448 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:24.847193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2035f-09ec-4e9f-84fd-14ef32cf0884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:24.847193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2035f-09ec-4e9f-84fd-14ef32cf0884 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:24.862627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb450a-9e03-47cd-a878-a89fefeb933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:24.863232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb450a-9e03-47cd-a878-a89fefeb933a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.863506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb450a-9e03-47cd-a878-a89fefeb933a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.863775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb450a-9e03-47cd-a878-a89fefeb933a None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.864423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb450a-9e03-47cd-a878-a89fefeb933a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:24.864720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb450a-9e03-47cd-a878-a89fefeb933a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-21d2035f-09ec-4e9f-84fd-14ef32cf0884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:24.865076 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:24.870180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 369/741] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b7edf-589f-4ff4-91e1-87fc82ec7d46 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b7edf-589f-4ff4-91e1-87fc82ec7d46 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b7edf-589f-4ff4-91e1-87fc82ec7d46 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 370/742] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:24.871109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b7edf-589f-4ff4-91e1-87fc82ec7d46 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:24.872964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb450a-9e03-47cd-a878-a89fefeb933a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:24.886994 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 373/743] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:24.888450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969914-e8b9-4775-b09b-d7b8c818b516 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:24.888881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969914-e8b9-4775-b09b-d7b8c818b516 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:24.889295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969914-e8b9-4775-b09b-d7b8c818b516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:24.968218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-19969914-e8b9-4775-b09b-d7b8c818b516 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:24.969440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-19969914-e8b9-4775-b09b-d7b8c818b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:24.980262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b7edf-589f-4ff4-91e1-87fc82ec7d46 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:24.988178 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.017405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.018066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.018343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.018612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.031530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.033266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.045858 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 374/744] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:52:25.045858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969914-e8b9-4775-b09b-d7b8c818b516 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:25.053003 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:25.054236 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:25.055412 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:25.055412 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:25.055412 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:25.059178 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 371/745] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:25.060060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.157611 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.164294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969914-e8b9-4775-b09b-d7b8c818b516 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.186642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f04ee-9f9b-4a70-a582-c80979aeac0e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.203356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.204397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.204896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.205375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.206275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:25.206821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.208434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.221593 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 375/746] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:25.222573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.224560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.225492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.225961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.226410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.234317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.236147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:25.249525 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:25.250579 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:25.251486 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:25.254174 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 372/747] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:25.255282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.276771 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.331061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843b5e-fb39-4c89-a233-502c3b64f9c0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.366459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2ac9-6fc7-447c-b002-7de6edeb3f6d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.366803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.367497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.367748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.368024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.369335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:25.370284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.371107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.385863 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 376/748] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:25.385863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.406890 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.410208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.410800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.411081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.411348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.420244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.421779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:25.434344 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:25.435310 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 373/749] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:25.436683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.506410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360be021-4628-4b06-9de2-81439d965be9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.526321 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.544482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.545097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.545378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.545651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.546382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:25.546681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.548185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.549858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45024832-954a-426f-860c-c22ace7c9173 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.567171 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 377/750] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:25.568062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.586196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.586813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.587127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.587596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.588273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.589647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.656794 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.661407 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 374/751] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:25 2022] POST /identity/v3/services => generated 240 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:25.662562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.696827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff31670-d7fe-4090-b9d8-360567ff57b3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.758474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.759463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.759924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.760447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] PATH_INFO: `/v3/users/nova` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.773014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.775037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.791626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fc8e4-c2da-4880-8e30-4b70c240012f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:25.793443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:25.794666 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:25.795848 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:25.805263 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 378/752] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:25.806777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.840814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.841539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.841847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.842131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.842873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:25.843187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.844581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:25.855607 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.866763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 375/753] 10.222.0.59 () {56 vars in 1149 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:25.867923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.940143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485ee0-6e0f-4bc8-b0d2-a9d497b2753e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.982194 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.984392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9efea-9111-4def-8302-d8e7e5ebf404 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.988280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.989147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.989639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.990261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.991245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=33919497efcb42f49a4b9034352f3045) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:25.991714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:25.995236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.002065 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 379/754] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/role_assignments?user.id=33919497efcb42f49a4b9034352f3045&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:26.003675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:26.104006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:26.104636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.104914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.105183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.106075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:26.106381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.107814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.132439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c379e-dc55-4391-8428-c60bc36f4ea0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:26.148568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 376/755] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:26.154684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:26.173754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:26.174805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.175348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.175820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.246313 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:26.262209 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:26.271325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.273410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.293391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e7101-6d35-42b1-89e1-8a1323f4714c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:26.335183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:26.335889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.336175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.336432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.367505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.369626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.396560 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 380/756] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:26.401337 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:26.402542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:26.403456 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:26.403456 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:26.403456 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:26.404877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:26.408864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 377/757] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:26.414178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:26.514464 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:26.521465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a776b-f6d2-4505-a86c-a66bf3ef25f4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:26.559452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:26.560790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.561292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.561822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.575204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.576994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:26.594721 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:26.595716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:26.596617 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:26.596617 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:26.596617 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:26.599727 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 381/758] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:26.607305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:26.655436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d6a8b-d5f6-4c1c-8aec-9680634759a0 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:26.674199 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:26.704894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61e267-a8a7-42b8-87f3-d987ff00ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:26.706471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61e267-a8a7-42b8-87f3-d987ff00ad88 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.706958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61e267-a8a7-42b8-87f3-d987ff00ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.707695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61e267-a8a7-42b8-87f3-d987ff00ad88 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.708788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61e267-a8a7-42b8-87f3-d987ff00ad88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:26.709734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61e267-a8a7-42b8-87f3-d987ff00ad88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.711586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61e267-a8a7-42b8-87f3-d987ff00ad88 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.728955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 378/759] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:26.730652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4fa3e-aad8-4670-a13b-9e3eb111e71a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.731102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4fa3e-aad8-4670-a13b-9e3eb111e71a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.731554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4fa3e-aad8-4670-a13b-9e3eb111e71a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.737933 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 379/760] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:26.739059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4fa3e-aad8-4670-a13b-9e3eb111e71a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:26.766525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dcaf7-1161-4045-875c-a71337d715f8 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:26.804676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2cd87-d9fd-44bc-ae0c-20ca513aa490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:26.805275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cd87-d9fd-44bc-ae0c-20ca513aa490 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.805561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cd87-d9fd-44bc-ae0c-20ca513aa490 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.805979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cd87-d9fd-44bc-ae0c-20ca513aa490 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.806842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cd87-d9fd-44bc-ae0c-20ca513aa490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:26.806952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cd87-d9fd-44bc-ae0c-20ca513aa490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.808461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cd87-d9fd-44bc-ae0c-20ca513aa490 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.822251 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 382/761] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:26.828243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bba41-fb15-4020-95e3-b3435877aa8c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.828591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bba41-fb15-4020-95e3-b3435877aa8c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.828879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bba41-fb15-4020-95e3-b3435877aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.851476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ff5bba41-fb15-4020-95e3-b3435877aa8c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:26.855201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ff5bba41-fb15-4020-95e3-b3435877aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:26.856002 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:26.877045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4fa3e-aad8-4670-a13b-9e3eb111e71a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:26.969891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:26.970854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:26.971412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:26.971868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:26.974110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 383/762] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:26.979835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bba41-fb15-4020-95e3-b3435877aa8c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:26.985654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.987513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:27.008975 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:27.010702 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:27.011619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:27.018059 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 380/763] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:27.019083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:27.064555 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:27.084713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bba41-fb15-4020-95e3-b3435877aa8c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:27.129701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:27.130874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.134770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.135271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.153098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:27.154922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:27.174727 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:27.175849 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:27.176980 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:27.181498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 384/764] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:27.181973 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:27.187534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:27.221964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973cfad-275e-4ac7-afd9-7d9dfe480f8d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:27.314794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:27.315914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.316383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.316839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.317778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:27.318382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:27.320141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.345642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 381/765] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:27.350982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:27.356253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f145451-8c44-4b18-ae98-1ea09ec1634c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:27.395498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:27.396183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.396473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.396782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.397498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:27.397824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:27.399391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.418601 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 385/766] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:27.419595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:27.465065 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:27.482234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e333cfa-5060-4082-b607-e8e5cc0c248c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:27.506292 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:27.520878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:27.522055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.522542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.523016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/0ef7d679c29544eeb884f2172e643a59/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.525592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=0ef7d679c29544eeb884f2172e643a59, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:27.527276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.544434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e110-5864-4b33-a39c-39fea8b0b62d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:27.583274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:27.583827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.584108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.584378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.584953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:27.586359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:27.595431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:27.596518 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:27.597417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 386/767] 10.222.0.59 () {56 vars in 1129 bytes} [Sun Aug 28 00:52:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:27.598317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:27.614243 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 382/768] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:27 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/0ef7d679c29544eeb884f2172e643a59/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:52:27.614925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:27.740217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823ee6b-fd1a-4f3e-9b78-91c9a19eeb57 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:27.770340 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:27.798152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb734a-4d0a-490b-a81b-9a81eb3ccbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:27.800143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb734a-4d0a-490b-a81b-9a81eb3ccbf9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.800660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb734a-4d0a-490b-a81b-9a81eb3ccbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.801139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb734a-4d0a-490b-a81b-9a81eb3ccbf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.802324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb734a-4d0a-490b-a81b-9a81eb3ccbf9 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=7c105d176ec44ab890a6ce4c0f50b2a5) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:27.802855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb734a-4d0a-490b-a81b-9a81eb3ccbf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:27.805081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb734a-4d0a-490b-a81b-9a81eb3ccbf9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.813362 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 387/769] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:27 2022] GET /identity/v3/role_assignments?user.id=7c105d176ec44ab890a6ce4c0f50b2a5&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:27.814620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b8d8-86f5-4c43-ad96-b4830b8b1d03 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.814902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b8d8-86f5-4c43-ad96-b4830b8b1d03 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.815118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b8d8-86f5-4c43-ad96-b4830b8b1d03 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.816951 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 388/770] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:27.823117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f794-831d-4dd6-90fd-dc7f4b94978a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.823812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f794-831d-4dd6-90fd-dc7f4b94978a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.824209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f794-831d-4dd6-90fd-dc7f4b94978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.834715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eb501-39a2-4b07-891b-fd98cf204850 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:27.849608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fb76f794-831d-4dd6-90fd-dc7f4b94978a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:27.850898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fb76f794-831d-4dd6-90fd-dc7f4b94978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:27.890300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:27.891611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:27.892106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:27.892562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:27.893679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:27.894178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:27.896701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:27.903411 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 383/771] 10.222.0.59 () {56 vars in 1124 bytes} [Sun Aug 28 00:52:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:27.915600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:27.942309 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 389/772] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:27.945839 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:28.056345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e4593-b781-43bf-9dd8-b86c35d56031 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:28.100236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:28.100777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.101071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.101347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.102008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:28.102318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:28.104835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:28.113635 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 384/773] 10.222.0.59 () {56 vars in 1124 bytes} [Sun Aug 28 00:52:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:28.119515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f794-831d-4dd6-90fd-dc7f4b94978a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:28.261417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f794-831d-4dd6-90fd-dc7f4b94978a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:28.289979 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:28.313212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:28.313835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.314130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.314398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.315100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] RBAC: Adding query filter params (interface=public, service_id=a6882c44382a4414a6c9087fc35537fb, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:28.315404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:28.316769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:28.325714 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 390/774] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:52:28 2022] GET /identity/v3/endpoints?service_id=a6882c44382a4414a6c9087fc35537fb&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:28.331492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:28.354742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:28.462745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2987-6ceb-4dd9-8ab3-7aa9c3fdf785 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:28.471396 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:28.499502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770632-de20-4298-9fcb-ae1cfe916eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:28.500233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770632-de20-4298-9fcb-ae1cfe916eb4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.500583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770632-de20-4298-9fcb-ae1cfe916eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.500918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770632-de20-4298-9fcb-ae1cfe916eb4 None admin] PATH_INFO: `/v3/services/network` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.501655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3770632-de20-4298-9fcb-ae1cfe916eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:28.503121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3770632-de20-4298-9fcb-ae1cfe916eb4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:28.509540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c743-e428-4d26-94ab-246ddafe0a5b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-b3770632-de20-4298-9fcb-ae1cfe916eb4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:28.513581 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:28.514840 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:28.515930 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:28.521906 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 391/775] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:28 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:28.523362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd437b6-7ef6-46e5-b956-46090ec57e8c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.523647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd437b6-7ef6-46e5-b956-46090ec57e8c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.523916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd437b6-7ef6-46e5-b956-46090ec57e8c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.525531 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 392/776] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:28.526276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd437b6-7ef6-46e5-b956-46090ec57e8c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:28.560547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6e8e-5185-4c6b-b122-61dd32126427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:28.561925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6e8e-5185-4c6b-b122-61dd32126427 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.562954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6e8e-5185-4c6b-b122-61dd32126427 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.563718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6e8e-5185-4c6b-b122-61dd32126427 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.564609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6e8e-5185-4c6b-b122-61dd32126427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:28.566395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6e8e-5185-4c6b-b122-61dd32126427 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:28.575226 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 385/777] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:52:28 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:28.577196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bee86-019f-4d1d-9e06-84e0bbba72c8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.577999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bee86-019f-4d1d-9e06-84e0bbba72c8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.578521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bee86-019f-4d1d-9e06-84e0bbba72c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.579803 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:28.607079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d63bee86-019f-4d1d-9e06-84e0bbba72c8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:28.608822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d63bee86-019f-4d1d-9e06-84e0bbba72c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:28.683116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd437b6-7ef6-46e5-b956-46090ec57e8c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:28.754980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 386/778] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:28.756535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:28.757155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.757433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.757703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.758393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] RBAC: Adding query filter params (name=network) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:28.759242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:28.760789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:28.766256 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 393/779] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:28.771850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bee86-019f-4d1d-9e06-84e0bbba72c8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:28.847145 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:28.887467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bee86-019f-4d1d-9e06-84e0bbba72c8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:28.941605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:28.942267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.942641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.942811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.943464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] RBAC: Adding query filter params (type=network) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:28.943769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:28.945193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:28.954290 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 387/780] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:28.959695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:29.080968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:29.186133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd19f8a-3aca-4abc-83e7-c9f28e6ec724 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:29.200088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17dde-f097-4955-951e-80f6231cc502 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:29.210174 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:29.218443 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:29.222418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:29.223203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:29.223490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:29.223762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:29.251480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:29.256560 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:29.257600 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:29.258533 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:29.261758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:29.262250 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 388/781] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:29.263039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:29.263661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:29.264080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:29.264931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:29.266332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] RBAC: Adding query filter params (interface=public, service_id=2c899dc9d12743c9af46f296a28495ca, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:29.266843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:29.268398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:29.277152 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 394/782] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:52:28 2022] GET /identity/v3/endpoints?service_id=2c899dc9d12743c9af46f296a28495ca&interface=public®ion_id=RegionOne => generated 194 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:29.286164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:29.387234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cecbc-2d41-4e1b-b34e-a213a4112663 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:29.464630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:29.465508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:29.465974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:29.466393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:29.467409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:29.467898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:29.469413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:29.485172 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 389/783] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:29.491653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b192b-ac97-4967-b62e-1a4084d6d6d9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:29.494712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:29.566178 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:29.577620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:29.578301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:29.578590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:29.578868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:29.579484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:29.580861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:29.594534 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 395/784] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:52:29 2022] GET /identity/v3/services => generated 772 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:29.614248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72e291-cf67-4011-95ec-5a7d141692d7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:29.653950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:29.655001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:29.655486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:29.655995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:29.668699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:29.670550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:29.686941 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:29.687951 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:29.688860 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:29.688860 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:29.688860 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:29.690985 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 390/785] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:29.703016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:29.759457 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:29.850400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0018b9e-6da3-4776-b2fb-0e2a89518dd6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:29.901789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555d30d-3463-4077-9f54-cec58b2d3453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:29.902456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d30d-3463-4077-9f54-cec58b2d3453 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:29.902733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d30d-3463-4077-9f54-cec58b2d3453 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:29.903009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555d30d-3463-4077-9f54-cec58b2d3453 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:29.903666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d30d-3463-4077-9f54-cec58b2d3453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:29.903971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d30d-3463-4077-9f54-cec58b2d3453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:29.905388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555d30d-3463-4077-9f54-cec58b2d3453 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:29.918829 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 396/786] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:29.931342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:30.068298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752a89b-b496-4940-a148-2a7764e7ca59 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:30.076376 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:30.109394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:30.110065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.110344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.110619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.112935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3c22-1cf8-4752-a1c1-f025c652fbf9 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.113230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3c22-1cf8-4752-a1c1-f025c652fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.113974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca3c22-1cf8-4752-a1c1-f025c652fbf9 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.115133 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 397/787] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:30.120655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:30.120890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d512-c9ec-4d97-a5cf-a8a0b007da18 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.121157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d512-c9ec-4d97-a5cf-a8a0b007da18 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.121444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303d512-c9ec-4d97-a5cf-a8a0b007da18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.123429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:30.136619 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:30.137614 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:30.138692 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:30.141283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 391/788] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:30.147592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:30.156924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5303d512-c9ec-4d97-a5cf-a8a0b007da18 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:30.159083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5303d512-c9ec-4d97-a5cf-a8a0b007da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:30.318236 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 398/789] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:30.349279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa92f-65d4-4546-b865-7aae64d0d59d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.349612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa92f-65d4-4546-b865-7aae64d0d59d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.349912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa92f-65d4-4546-b865-7aae64d0d59d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.357979 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 399/790] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:30.367271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8920c2d-0e0d-4ad0-aed9-b4d98828d3de None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.367558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8920c2d-0e0d-4ad0-aed9-b4d98828d3de None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.367838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8920c2d-0e0d-4ad0-aed9-b4d98828d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.378921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a0628-c77e-49eb-af55-053e1b682c50 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:30.426958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e8920c2d-0e0d-4ad0-aed9-b4d98828d3de None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:30.428848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e8920c2d-0e0d-4ad0-aed9-b4d98828d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:30.473398 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:30.522551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:30.523194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.523477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.523752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.524549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:30.524859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:30.526319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:30.576181 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 392/791] 10.222.0.59 () {56 vars in 1135 bytes} [Sun Aug 28 00:52:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:30.577606 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 400/792] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:30.587002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:30.647466 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:30.668440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8920c2d-0e0d-4ad0-aed9-b4d98828d3de None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:30.799157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8920c2d-0e0d-4ad0-aed9-b4d98828d3de None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:30.862482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:30.863327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.863607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.880780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.882589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:30.889443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:30.890637 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:30.891693 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:30.892488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73b4d2-6f40-419f-9c93-a904e83e8751 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:30.898845 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 401/793] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:30.900772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:30.931559 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.020234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.021147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.021577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.022061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.031792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5de96-c873-451a-9378-2dd38d8dd252 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.038005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.039651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:31.055194 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:31.056814 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:31.057774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:31.057774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:31.057774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:31.057774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 393/794] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:31.057774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.077406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8ed2-f4e5-4b23-a70e-014924b93820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.078051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8ed2-f4e5-4b23-a70e-014924b93820 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.078336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8ed2-f4e5-4b23-a70e-014924b93820 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.078606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8ed2-f4e5-4b23-a70e-014924b93820 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.079275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8ed2-f4e5-4b23-a70e-014924b93820 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:31.079575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8ed2-f4e5-4b23-a70e-014924b93820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.080962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8ed2-f4e5-4b23-a70e-014924b93820 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.091368 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 402/795] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:31.092699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb3c3-ecfd-4587-8bea-2c08a6fb43d8 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.092991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb3c3-ecfd-4587-8bea-2c08a6fb43d8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.093262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb3c3-ecfd-4587-8bea-2c08a6fb43d8 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.098450 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 403/796] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:31.098450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb3c3-ecfd-4587-8bea-2c08a6fb43d8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.160621 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.184541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f7272-5fbe-44a7-8436-4cd1801953cf None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.190600 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.219609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb3c3-ecfd-4587-8bea-2c08a6fb43d8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.226790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.227513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.227799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.227988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.239376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:31.246133 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:31.247105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:31.247981 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 394/797] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:31.248700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.265248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3b5f1-d5c5-4f87-80ae-7ee39895834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.265882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3b5f1-d5c5-4f87-80ae-7ee39895834a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.266164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3b5f1-d5c5-4f87-80ae-7ee39895834a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.266436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3b5f1-d5c5-4f87-80ae-7ee39895834a None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.267073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3b5f1-d5c5-4f87-80ae-7ee39895834a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:31.267370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3b5f1-d5c5-4f87-80ae-7ee39895834a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.268734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3b5f1-d5c5-4f87-80ae-7ee39895834a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.281562 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 404/798] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:31.282991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5263-a3e9-4e73-a274-282c73ca7065 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.283348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5263-a3e9-4e73-a274-282c73ca7065 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.283696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5263-a3e9-4e73-a274-282c73ca7065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.302848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c73d5263-a3e9-4e73-a274-282c73ca7065 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:31.304302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c73d5263-a3e9-4e73-a274-282c73ca7065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:31.365517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4cf61-432d-49e2-bd93-83bc28c29c78 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.380008 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 405/799] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:31.381098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5263-a3e9-4e73-a274-282c73ca7065 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.410452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.411772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.412451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.412877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.416775 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.434216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.435681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:31.451251 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:31.452370 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:31.453321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:31.453321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:31.453321 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:31.457308 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 395/800] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:31.458242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.462958 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.498932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5263-a3e9-4e73-a274-282c73ca7065 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.548106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.548728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.549055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.549334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.550036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:31.550341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.552316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.569946 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 406/801] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:31.570914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.583982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876130cb-0b05-414f-8f85-5dcfc70da6bb None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.623308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.624337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.624822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.625326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.632745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.634812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:31.647606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:31.648593 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:31.649647 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:31.651807 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 396/802] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:31.652805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.701930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3d4d1-db0a-4e46-a5dc-671bef4110d7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.710692 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.740196 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.747927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.748538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.748823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.749137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.749767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:31.750101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.751481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.764837 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 407/803] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:31.769621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.778343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed84e75-b45f-440f-8196-34416bc3b766 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.815390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.816046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.816323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.816593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.829451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.830964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:31.846566 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:31.847606 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:31.848541 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:31.848541 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:31.848541 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:31.850136 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 397/804] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:31.851414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.967513 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.970446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc963860-d129-474c-8f69-e775948f6d53 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.006076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.006712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.007030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.007306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.007970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.009348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.012285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da1409-a8e0-4364-92fd-80acf00226b4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:32.018683 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:32.019949 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:52:32.021014 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:32.025543 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 398/805] 10.222.0.59 () {56 vars in 1129 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:32.026442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.058476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.059081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.059359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.059628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.060323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:32.060622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.062080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.075837 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 408/806] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:32.076683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.126516 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:32.143701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a9b4e-5fd9-4e6e-9886-0595536f4ce9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.176508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5b6f0-eee7-46c7-ab69-c1e2925b50f8 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.179199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.179827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.180108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.180919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.188964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.190519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:32.202681 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:32.203754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 399/807] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:32.204698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.217698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e7e89-6c2f-4ea6-ae7b-824fc2c41e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.218273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e7e89-6c2f-4ea6-ae7b-824fc2c41e65 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.218557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e7e89-6c2f-4ea6-ae7b-824fc2c41e65 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.218838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e7e89-6c2f-4ea6-ae7b-824fc2c41e65 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.219490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e7e89-6c2f-4ea6-ae7b-824fc2c41e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:32.219796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e7e89-6c2f-4ea6-ae7b-824fc2c41e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.221285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e7e89-6c2f-4ea6-ae7b-824fc2c41e65 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.231610 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:32.234342 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 409/808] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:32.235561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b6c43-759e-43a6-8571-63da67139a9c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.235852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b6c43-759e-43a6-8571-63da67139a9c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.236130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b6c43-759e-43a6-8571-63da67139a9c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.240504 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 410/809] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:32.240504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b6c43-759e-43a6-8571-63da67139a9c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.317239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fa2c-06ce-416f-a5cd-7d56e8f97c77 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.347176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b6c43-759e-43a6-8571-63da67139a9c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.358929 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:32.359588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.360267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.360547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.360820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.361506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:32.361830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.363202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.367708 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 400/810] 10.222.0.59 () {56 vars in 1124 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:32.370449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.383012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.383685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.384038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.384340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/33919497efcb42f49a4b9034352f3045/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.386339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=33919497efcb42f49a4b9034352f3045, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.387767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.454470 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 411/811] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:32 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/33919497efcb42f49a4b9034352f3045/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:52:32.455056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.467674 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:32.483187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05445-e8f4-4548-87b0-6334069be0f4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.526323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b14a4-b447-465b-b4f6-85a45f9c84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.527983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b14a4-b447-465b-b4f6-85a45f9c84cf None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.528705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b14a4-b447-465b-b4f6-85a45f9c84cf None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.529285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b14a4-b447-465b-b4f6-85a45f9c84cf None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.530468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b14a4-b447-465b-b4f6-85a45f9c84cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:32.530786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b14a4-b447-465b-b4f6-85a45f9c84cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.532309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b14a4-b447-465b-b4f6-85a45f9c84cf None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.554585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 401/812] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:32.556601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79719a-cf45-42c2-969d-fc09921d2f9f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.556885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79719a-cf45-42c2-969d-fc09921d2f9f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.557159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79719a-cf45-42c2-969d-fc09921d2f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.581896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cb79719a-cf45-42c2-969d-fc09921d2f9f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:32.582106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55717680-6be6-4f40-a896-a97cad098475 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.583247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cb79719a-cf45-42c2-969d-fc09921d2f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:32.624238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.624874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.625150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.625412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.633090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.634743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:32.646856 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:32.647942 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 412/813] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:32.648962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.672397 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 402/814] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:32.673383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79719a-cf45-42c2-969d-fc09921d2f9f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.694261 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:32.775961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5a69-eeb5-43ab-9e2f-e9be1766dd6a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.778184 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:32.812775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79719a-cf45-42c2-969d-fc09921d2f9f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.819056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.819907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.820332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.821707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.822547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:32.822997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.824944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.830893 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 413/815] 10.222.0.59 () {56 vars in 1124 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:32.831838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:32.856556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.857185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.857462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.857796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.934966 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:32.937460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.938948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:32.942488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea1ea1-5900-4663-a984-b5f5923884f6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:32.979800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:32.980416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:32.980693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:32.980965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:32.982300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:32.982608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:32.984089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.002771 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 414/816] 10.222.0.59 () {56 vars in 1149 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:33.003845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.026841 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:33.052278 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 403/817] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:52:33.053386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.121590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca62d-d056-454e-97fa-e620e94effb7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.158356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.159075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.159424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.159773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.160490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.161458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcdf7a-da5e-4330-a765-61cee8397777 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.162032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.301931 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 415/818] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:52:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:33.301931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.315039 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:33.345163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.345834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.346121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.346419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] PATH_INFO: `/v3/services/network` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.347043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.348503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:33.359240 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:33.360376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:52:33.361276 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:33.365537 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 404/819] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/services/network => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:33.366517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.413993 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:33.446549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc492a7-0d54-46f6-896c-5d92b8c0b7b3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.500817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.501849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.502255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54706-e993-49d0-a473-44b6b7021cf7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.502546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.503016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.521875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.524283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:33.546904 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:33.548053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:33.548953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:33.548953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:33.548953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:33.548953 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 416/820] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:33.549192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.555922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.558431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.560712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.561104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.579448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.581323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:33.599376 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:33.600634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:33.601763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:33.601763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:33.601763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:33.603824 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 405/821] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:33.609131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.627557 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:33.671142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860b3c9-ab82-4dd9-82da-80d1c710fadf None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.708875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.709768 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:33.710636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.711208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.712213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.713347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:33.713896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.715492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.720891 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 417/822] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:33.722018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.729847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093a7b-a135-4269-bb11-f12ee567fd63 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.767940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.768558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.768839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.769110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.769763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:33.770115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.771493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.789315 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 406/823] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:33.790929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.841409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c198afd-6a5c-4499-b7cd-cc78e7bd14c8 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.874228 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:33.882429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.883981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.884564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.885119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.886020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:33.886524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.888294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.901366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c105a-db8d-4457-a25e-90d394f5fd50 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:33.903214 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 418/824] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:33.910802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.951323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:33.952423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.953634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.954130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.954931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] RBAC: Adding query filter params (type=network) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:33.955460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:33.957004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:33.964771 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 407/825] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:33.965889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:33.987605 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:34.046597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1396c-fdb3-44bd-b94e-e6ecc79fb738 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.091637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.092653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.093115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.093591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.097587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe540f-99d5-4af8-91d0-187bd76d4483 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.101745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.103579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:34.115624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:34.116559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:34.117448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:34.120037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 419/826] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:34.121135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:34.145541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.146313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.146661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.147055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.157225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.159476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.174944 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:34.176072 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:34.176965 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:34.177910 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:34.181955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 408/827] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:34.182987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:34.242562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307323-47e1-4d17-8d6a-89c59e5a4a97 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.281304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.282304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.282791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.282898 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:34.283715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.284583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.286207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.317124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9b4cf-e53d-4a16-a28e-103598ae2274 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.357582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.358241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.358526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.358693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.364535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:34.364859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.366334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.382507 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 409/828] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:34.384001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:34.418052 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 420/829] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:52:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:34.418052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:34.557181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704cf64-6078-4235-aaf9-5f2ad5efe987 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.571579 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:34.582146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fb7ae-6f91-488a-9b18-0e5c224cd8e4 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.606250 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:34.611959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95241fea-f6b3-40c1-a837-a24fb2bc023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.612629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95241fea-f6b3-40c1-a837-a24fb2bc023b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.612913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95241fea-f6b3-40c1-a837-a24fb2bc023b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.613196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95241fea-f6b3-40c1-a837-a24fb2bc023b None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.614575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95241fea-f6b3-40c1-a837-a24fb2bc023b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:34.614890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95241fea-f6b3-40c1-a837-a24fb2bc023b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.616325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95241fea-f6b3-40c1-a837-a24fb2bc023b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.631090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9481b-9356-461f-8ae2-1af334710949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.631090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9481b-9356-461f-8ae2-1af334710949 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.631090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9481b-9356-461f-8ae2-1af334710949 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.632672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9481b-9356-461f-8ae2-1af334710949 None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/7c105d176ec44ab890a6ce4c0f50b2a5/roles/4605266f425143d29e63e37830ba3ad7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.632750 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 410/830] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:34.634510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f506-1ef1-46f8-8e16-5dc308e119be None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.634798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f506-1ef1-46f8-8e16-5dc308e119be None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.635068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f506-1ef1-46f8-8e16-5dc308e119be None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.636718 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 411/831] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:34.642362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932f506-1ef1-46f8-8e16-5dc308e119be None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:34.656862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9481b-9356-461f-8ae2-1af334710949 None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=7c105d176ec44ab890a6ce4c0f50b2a5, role_id=4605266f425143d29e63e37830ba3ad7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.659749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9481b-9356-461f-8ae2-1af334710949 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.756725 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 421/832] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:34 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/7c105d176ec44ab890a6ce4c0f50b2a5/roles/4605266f425143d29e63e37830ba3ad7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:52:34.765652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25f907-dc41-4a7c-9fed-9a43d3fc4318 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.765652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25f907-dc41-4a7c-9fed-9a43d3fc4318 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.765652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25f907-dc41-4a7c-9fed-9a43d3fc4318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.765953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932f506-1ef1-46f8-8e16-5dc308e119be None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.780544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3a25f907-dc41-4a7c-9fed-9a43d3fc4318 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:34.781805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3a25f907-dc41-4a7c-9fed-9a43d3fc4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:34.811656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.812447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.812734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.813009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.814466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=0ef7d679c29544eeb884f2172e643a59) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:34.814789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.816849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.826489 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 412/833] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:34 2022] GET /identity/v3/role_assignments?user.id=0ef7d679c29544eeb884f2172e643a59&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:34.867486 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 422/834] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:35.139924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:35.202162 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:35.249764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71934dd-f1da-43c5-a91f-72585c65248c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:35.284634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed4e3-62e5-4519-b0a3-24c6f65fa37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:35.285280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed4e3-62e5-4519-b0a3-24c6f65fa37d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:35.285558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed4e3-62e5-4519-b0a3-24c6f65fa37d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:35.285866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed4e3-62e5-4519-b0a3-24c6f65fa37d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:35.297531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed4e3-62e5-4519-b0a3-24c6f65fa37d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-4abed4e3-62e5-4519-b0a3-24c6f65fa37d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:35.303720 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:35.304650 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:52:35.305935 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:35.309987 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 413/835] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:35.311369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25f907-dc41-4a7c-9fed-9a43d3fc4318 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:35.318509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348929e8-82c6-4d61-899f-52c47b8300df None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:35.318840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348929e8-82c6-4d61-899f-52c47b8300df None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:35.319048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348929e8-82c6-4d61-899f-52c47b8300df None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:35.320651 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 414/836] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:35.326689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b6597-a517-4e9f-bca7-7313d02bdffa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:35.326964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b6597-a517-4e9f-bca7-7313d02bdffa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:35.327236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b6597-a517-4e9f-bca7-7313d02bdffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:35.352578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c14b6597-a517-4e9f-bca7-7313d02bdffa None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:35.353967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c14b6597-a517-4e9f-bca7-7313d02bdffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:35.399283 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:35.418945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25f907-dc41-4a7c-9fed-9a43d3fc4318 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:35.433856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 415/837] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:35.464376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:35.465048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:35.465328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:35.465601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:35.466296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:35.466595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:35.468009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:35.482676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 423/838] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:35.484049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b6597-a517-4e9f-bca7-7313d02bdffa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:35.534179 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:35.589762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b6597-a517-4e9f-bca7-7313d02bdffa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:35.624741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:35.625383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:35.625663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:35.625969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:35.636999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:35.638484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:35.654461 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:35.655476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:35.656390 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:35.656390 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:35.656390 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:35.660415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 416/839] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:35.661776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:35.725626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:35.789498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbcb4b-3c89-4ae6-8b2a-9f700060c4ac None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:35.826905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:35.827944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:35.828420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:35.828882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:35.829734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:35.830285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:35.831905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:35.840525 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:35.845199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8374d0e-9f27-462d-ae2f-e17fa57bb625 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:35.850689 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 424/840] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:35.851054 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:35.853432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:35.890875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:35.891518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:35.891796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:35.892066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:35.893024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:35.894448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:35.904731 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:35.905747 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:35.906657 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:35.911103 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 417/841] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:35.912061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:35.999374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46acecc-a81e-419c-aa77-62fb17fdae11 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.037080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfcbcf-4a8f-47c8-be94-39746965a705 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.047329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:36.048266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.048741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.049208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.058130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:36.059929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:36.073229 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:36.074406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:52:36.075548 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:36.077660 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 425/842] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:52:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:36.083417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:36.083765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:36.084642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.085096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.085577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.086740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:36.087244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:36.088916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:36.094589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 418/843] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:36.099714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:36.131264 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:36.156499 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:36.211350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813cc93-f15a-4594-9a0f-f2f9ca342031 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.212913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8bb72-da6d-4b66-9202-17c5c03df88e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.253577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:36.254417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.254851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.255193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.255987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:36.256365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:36.257461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:36.258121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:36.259139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.259592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.260034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.260934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:36.261423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:36.263128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:36.268731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 419/844] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:36.285984 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 426/845] 10.222.0.59 () {56 vars in 1135 bytes} [Sun Aug 28 00:52:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:36.288453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:36.399868 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:36.410307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2ac0-03e5-47e1-a198-1b1db383e419 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.447287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97be968-16a6-4957-b48f-00d3fc5dd233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:36.448192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be968-16a6-4957-b48f-00d3fc5dd233 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.448458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be968-16a6-4957-b48f-00d3fc5dd233 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.448733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be968-16a6-4957-b48f-00d3fc5dd233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.521274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97be968-16a6-4957-b48f-00d3fc5dd233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:36.522762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97be968-16a6-4957-b48f-00d3fc5dd233 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:36.617525 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:36.632706 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 420/846] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:52:36.634510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:36.741341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b72bf-8343-4b75-a140-a402cbdcd184 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.759958 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:36.778084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:36.778718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.778997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.779268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.790837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:36.792529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:36.792974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9a1db-d8b8-4ce8-951a-0722d75a3908 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.793281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9a1db-d8b8-4ce8-951a-0722d75a3908 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.793522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9a1db-d8b8-4ce8-951a-0722d75a3908 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.795274 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 421/847] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:36.803398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d530e2-6a03-445d-9c56-0a79d650a671 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.803553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d530e2-6a03-445d-9c56-0a79d650a671 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.803878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d530e2-6a03-445d-9c56-0a79d650a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:36.811222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:36.812200 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:36.813116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:36.813116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:36.813116 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:36.819604 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 427/848] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:36.822775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:36.828811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b0d530e2-6a03-445d-9c56-0a79d650a671 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:36.830047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b0d530e2-6a03-445d-9c56-0a79d650a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:36.900516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 422/849] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:36.947369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad72bf3-b1ed-4a42-919a-28fbedbd4367 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.984506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050739-f5f6-4f5b-a472-cfff2a7d2f1c None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.984815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050739-f5f6-4f5b-a472-cfff2a7d2f1c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.985058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050739-f5f6-4f5b-a472-cfff2a7d2f1c None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.986686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:36.986817 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 423/850] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:36.987627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.987627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.990166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.990166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:36.990166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:36.990714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:36.991681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2a0e0-97d3-480e-a17c-082a5b61912e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.991910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2a0e0-97d3-480e-a17c-082a5b61912e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.992180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2a0e0-97d3-480e-a17c-082a5b61912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.005467 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 428/851] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:37.011161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.015983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1bb2a0e0-97d3-480e-a17c-082a5b61912e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:37.017481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1bb2a0e0-97d3-480e-a17c-082a5b61912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:37.043006 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.110245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 424/852] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:37.122518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a056-bb37-454b-858b-57252bcfbd5f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.158911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.159916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.160399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.160869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.168194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.169968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:37.182390 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:37.183313 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:37.184290 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:37.186692 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 429/853] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:37.194926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2a0e0-97d3-480e-a17c-082a5b61912e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.201722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.294293 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.314735 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.322030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2a0e0-97d3-480e-a17c-082a5b61912e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.327715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90812171-dbeb-48ac-96cc-661cc7c4ed83 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.362604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.363014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.363229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.363506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.363776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.364486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.364912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.365325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.366207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:37.366795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.369090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.378836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:37.383556 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:37.384808 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:52:37.385852 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:37.387986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 425/855] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:37.392451 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 430/855] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:37.393488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.395373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.500930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01396888-f9d3-43af-8d31-8a31f50bf117 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.505917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee98f1-f407-4f83-a2e7-d9607ea5ea9c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.511454 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.534222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.534830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.535106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.554138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.554138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=33919497efcb42f49a4b9034352f3045) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:37.554138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.554138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.554520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.554520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.554520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.554520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.554841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:37.554841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.554999 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 426/856] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/role_assignments?user.id=33919497efcb42f49a4b9034352f3045&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:37.554999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.555839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.565587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 431/857] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:37.572774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.588248 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.693662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22f075-3726-453d-b797-860e81558c7f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.707406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadbc73-be8e-4bf8-8353-34654841f5c9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.741189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.741852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.742139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.742442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.743972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.744648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.748991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.749621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.749936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.750210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:37.754418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:37.755354 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:37.756243 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 427/858] 10.222.0.59 () {56 vars in 1132 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:37.762223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.766237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.767704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:37.783962 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:37.784952 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:37.785914 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:37.785914 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:37.785914 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:37.785914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 432/859] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:37.792130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.819183 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.862109 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.903817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078be8e-fad5-4b9e-82e3-4f2ad087f4b4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.904864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fcf8a-255e-4376-ac7b-a43aee9c4061 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:37.945182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.946170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.946546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.947061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.948069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:37.948466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.950026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.952237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.953568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.954023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.954443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.955240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:37.955699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.957187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.972727 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 433/860] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:37.972919 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 428/861] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:37.973028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:37.974627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:38.096924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651eb5c-d92d-4a83-8960-78908d05ec7d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:38.098433 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:38.099031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845aebc-b8d6-4c69-8d07-d438463b0bc9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:38.136587 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:38.136906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:38.137711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.137711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.139007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.151368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:38.152809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:38.157575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ddcbd-ee26-4b8b-8412-7efd0e2dc616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:38.158468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ddcbd-ee26-4b8b-8412-7efd0e2dc616 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.158952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ddcbd-ee26-4b8b-8412-7efd0e2dc616 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.159442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ddcbd-ee26-4b8b-8412-7efd0e2dc616 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.160649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ddcbd-ee26-4b8b-8412-7efd0e2dc616 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:38.161162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ddcbd-ee26-4b8b-8412-7efd0e2dc616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:38.162755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ddcbd-ee26-4b8b-8412-7efd0e2dc616 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:38.165839 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:38.167473 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:38.168698 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:38.171635 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 429/862] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:38.172573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:38.178106 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 434/863] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:38.240776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56d79-d0b6-44c5-a2b2-faa2a46b0134 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.241063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56d79-d0b6-44c5-a2b2-faa2a46b0134 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.241340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56d79-d0b6-44c5-a2b2-faa2a46b0134 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.243639 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 435/864] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:38.250091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335162-68d5-481d-8e5f-36f8fb08c817 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.250577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335162-68d5-481d-8e5f-36f8fb08c817 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.250684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335162-68d5-481d-8e5f-36f8fb08c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.270619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ea335162-68d5-481d-8e5f-36f8fb08c817 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:38.271858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ea335162-68d5-481d-8e5f-36f8fb08c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:38.299367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8dc23-96c0-4a73-b69d-c2b6576aa200 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:38.339249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:38.339872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.340215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.340602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.341497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:38.341803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:38.343273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:38.366985 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 436/865] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:38.369097 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 430/866] 10.222.0.59 () {56 vars in 1149 bytes} [Sun Aug 28 00:52:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:38.375462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335162-68d5-481d-8e5f-36f8fb08c817 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:38.482968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335162-68d5-481d-8e5f-36f8fb08c817 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:38.500284 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:38.519558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:38.520204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.520476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.520795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.594671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:38.596170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:38.649144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:38.677950 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:38.710673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 437/867] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:52:38.716689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:38.740204 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:38.788779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f1b79-0d19-4c74-958b-16387b22ce89 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:38.839548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:38.841001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.841398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.842041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.842822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:38.845212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:38.853988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce58791-ba45-43d6-85c8-0d3f8c4769d8 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:38.891360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:38.891990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:38.892268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:38.892539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:38.903180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:38.904563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:38.919622 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:38.920616 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:38.921608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:38.921608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:38.921608 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:38.925403 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 438/868] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:38.926255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:38.976747 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 431/869] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:38 2022] POST /identity/v3/services => generated 251 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:52:39.000880 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:39.042995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c54b5-acfe-4c16-958d-d8b7eae5cff6 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:39.090516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:39.091147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:39.091423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:39.091692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:39.092406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:39.092712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:39.094192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:39.109044 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 439/870] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:39.114720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:39.208455 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:39.229434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07bd7-bb09-4cd8-afe2-08d377fceb52 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:39.264619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:39.265591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:39.270987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:39.270987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:39.274665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:39.276388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:39.288559 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:39.289663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:39.290705 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:39.293141 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 432/871] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:39.298728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:39.414752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ccc8-30b9-414f-b1b0-2f4afc0ca51a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:39.449397 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:39.454676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad335d-0330-41ed-b1ea-80c8779138eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:39.455289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad335d-0330-41ed-b1ea-80c8779138eb None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:39.455567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad335d-0330-41ed-b1ea-80c8779138eb None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:39.455839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad335d-0330-41ed-b1ea-80c8779138eb None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:39.456540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad335d-0330-41ed-b1ea-80c8779138eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:39.456845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad335d-0330-41ed-b1ea-80c8779138eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:39.458373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad335d-0330-41ed-b1ea-80c8779138eb None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:39.471295 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 440/872] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:39.477679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:39.585232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1b47-c23d-471c-83b2-d8703787d0ac None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:39.618481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25f589-3b05-43f3-a427-b99ede2acb38 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:39.618831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25f589-3b05-43f3-a427-b99ede2acb38 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:39.619029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25f589-3b05-43f3-a427-b99ede2acb38 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:39.620680 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 441/873] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:39.622019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:39.622799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:39.623221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:39.623591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:39.624426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=7c105d176ec44ab890a6ce4c0f50b2a5) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:39.624836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:39.626474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:39.627839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6719-d4bc-4899-993e-85e9394b0ad8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:39.628290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6719-d4bc-4899-993e-85e9394b0ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:39.628721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6719-d4bc-4899-993e-85e9394b0ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:39.634285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 433/874] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:39 2022] GET /identity/v3/role_assignments?user.id=7c105d176ec44ab890a6ce4c0f50b2a5&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:39.651938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-321a6719-d4bc-4899-993e-85e9394b0ad8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:39.653441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-321a6719-d4bc-4899-993e-85e9394b0ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:39.742080 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 442/875] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:40.015022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:40.019685 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:40.128881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de069-69a0-4bd8-9c6e-6c89ce25b779 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:40.163883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7d3bf-1d5f-4162-b854-52e504838378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:40.165091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d3bf-1d5f-4162-b854-52e504838378 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:40.165362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d3bf-1d5f-4162-b854-52e504838378 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:40.165630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d3bf-1d5f-4162-b854-52e504838378 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:40.166249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7d3bf-1d5f-4162-b854-52e504838378 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:40.167613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7d3bf-1d5f-4162-b854-52e504838378 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-02e7d3bf-1d5f-4162-b854-52e504838378 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:40.176990 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:40.178165 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:40.179400 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 434/876] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:40.186770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6719-d4bc-4899-993e-85e9394b0ad8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:40.247857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579157c9-3c65-48b6-9cf3-4b582d7e1877 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:40.248211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579157c9-3c65-48b6-9cf3-4b582d7e1877 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:40.248408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579157c9-3c65-48b6-9cf3-4b582d7e1877 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:40.249920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 435/877] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:40.257381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15760bd-6c24-41c3-8d1b-3667c71faf9a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:40.259008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15760bd-6c24-41c3-8d1b-3667c71faf9a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:40.259710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15760bd-6c24-41c3-8d1b-3667c71faf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:40.281835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d15760bd-6c24-41c3-8d1b-3667c71faf9a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:40.283535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d15760bd-6c24-41c3-8d1b-3667c71faf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:40.300074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6719-d4bc-4899-993e-85e9394b0ad8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:40.317549 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:40.341122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:40.341957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:40.342334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:40.342696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:40.343673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:40.344068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:40.345688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:40.356804 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 443/878] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:40.358425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:40.368700 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:40.376716 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 436/879] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:40.487573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8025-4a6b-43d0-b9f8-f7d2da0171e5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:40.525713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccff538-3d53-495d-baa3-a878106bdd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:40.526349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccff538-3d53-495d-baa3-a878106bdd91 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:40.526631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccff538-3d53-495d-baa3-a878106bdd91 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:40.527048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccff538-3d53-495d-baa3-a878106bdd91 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:40.527688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccff538-3d53-495d-baa3-a878106bdd91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:40.527992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccff538-3d53-495d-baa3-a878106bdd91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:40.529357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccff538-3d53-495d-baa3-a878106bdd91 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:40.534641 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 444/880] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:40.647662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15760bd-6c24-41c3-8d1b-3667c71faf9a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:40.761258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15760bd-6c24-41c3-8d1b-3667c71faf9a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:40.815536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ea034-2a25-4de1-9f6c-bc2a8fc60cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:40.816526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea034-2a25-4de1-9f6c-bc2a8fc60cf1 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:40.817090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea034-2a25-4de1-9f6c-bc2a8fc60cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:40.817648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea034-2a25-4de1-9f6c-bc2a8fc60cf1 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:40.818927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ea034-2a25-4de1-9f6c-bc2a8fc60cf1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:40.823017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ea034-2a25-4de1-9f6c-bc2a8fc60cf1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:40.931375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 437/881] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:40 2022] POST /identity/v3/services => generated 269 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:41.055676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95a48-ab21-4442-b173-dadc274ad1fe None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:41.056130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95a48-ab21-4442-b173-dadc274ad1fe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:41.056316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b95a48-ab21-4442-b173-dadc274ad1fe None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:41.058146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 445/882] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:41.063776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f83b4-7010-4163-8cb8-a1194a70fd08 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:41.064395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f83b4-7010-4163-8cb8-a1194a70fd08 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:41.064395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f83b4-7010-4163-8cb8-a1194a70fd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:41.083068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a70f83b4-7010-4163-8cb8-a1194a70fd08 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:41.084165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a70f83b4-7010-4163-8cb8-a1194a70fd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:41.140834 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:41.160494 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 438/883] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:41.429402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b95a48-ab21-4442-b173-dadc274ad1fe None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:41.477309 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:41.536439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b95a48-ab21-4442-b173-dadc274ad1fe None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:41.573961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:41.574592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:41.574866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:41.575178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:41.575809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:41.577176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:41.586386 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:41.589043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:41.591096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 446/884] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:41.598590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f83b4-7010-4163-8cb8-a1194a70fd08 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:41.699438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f83b4-7010-4163-8cb8-a1194a70fd08 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:41.735303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9b4f-a05f-46e0-96a0-b4cb6d4fc641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:41.735921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9b4f-a05f-46e0-96a0-b4cb6d4fc641 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:41.736202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9b4f-a05f-46e0-96a0-b4cb6d4fc641 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:41.736473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9b4f-a05f-46e0-96a0-b4cb6d4fc641 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:41.737108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec9b4f-a05f-46e0-96a0-b4cb6d4fc641 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:41.737410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec9b4f-a05f-46e0-96a0-b4cb6d4fc641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:41.738802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec9b4f-a05f-46e0-96a0-b4cb6d4fc641 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:41.744754 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 439/885] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:41.750074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:41.782598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479821-ae2f-4b7c-b957-26e1af76a743 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:41.782906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479821-ae2f-4b7c-b957-26e1af76a743 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:41.783160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479821-ae2f-4b7c-b957-26e1af76a743 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:41.785524 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 440/886] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:41.791322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2df9f-0e68-405f-8545-c35f49064c0f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:41.791603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2df9f-0e68-405f-8545-c35f49064c0f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:41.791882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2df9f-0e68-405f-8545-c35f49064c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:41.813414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4bc2df9f-0e68-405f-8545-c35f49064c0f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:41.815322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4bc2df9f-0e68-405f-8545-c35f49064c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:41.859252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d51334-514e-4849-964e-fcead4c2a1a3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:41.869117 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:41.881434 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:41.896804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:41.897651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:41.897774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:41.898009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:41.898704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:41.898962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:41.900321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:41.914572 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 447/888] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:41.914572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:41.915164 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 441/888] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:42.031685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24ada6-fc63-4f7e-9071-365fa19a02d7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:42.068791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:42.069682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.070140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.071143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.072069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] RBAC: Adding query filter params (interface=public, service_id=fa3f9ca3293b4e6ebe84582810535062, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:42.072794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:42.074353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:42.080544 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 448/889] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:52:41 2022] GET /identity/v3/endpoints?service_id=fa3f9ca3293b4e6ebe84582810535062&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:42.088564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2df9f-0e68-405f-8545-c35f49064c0f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:42.202054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2df9f-0e68-405f-8545-c35f49064c0f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:42.211885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:42.239699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:42.240317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.240643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.240917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.241530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:42.243977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:42.250589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 442/890] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:52:42 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:52:42.264856 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:42.332120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706abad-ad55-476f-93a4-98346b793c34 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:42.374035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020892db-e6af-4e96-afda-dbc50c8fc7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:42.374688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020892db-e6af-4e96-afda-dbc50c8fc7c5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.374970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020892db-e6af-4e96-afda-dbc50c8fc7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.375245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020892db-e6af-4e96-afda-dbc50c8fc7c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.388024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020892db-e6af-4e96-afda-dbc50c8fc7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-020892db-e6af-4e96-afda-dbc50c8fc7c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:42.393338 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:42.394321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:42.395460 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 449/891] 10.222.0.59 () {56 vars in 1120 bytes} [Sun Aug 28 00:52:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:42.402086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:42.458795 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:42.519970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c719-922f-4255-9380-2556877f0d3e None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.520557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d5bc-c785-424a-9a0d-13c8ab9acebc None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:42.520650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c719-922f-4255-9380-2556877f0d3e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.520650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c719-922f-4255-9380-2556877f0d3e None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.522168 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 450/892] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:42.528332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fd1c2-0397-4572-813f-700cb8838940 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.528640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fd1c2-0397-4572-813f-700cb8838940 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.528936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fd1c2-0397-4572-813f-700cb8838940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.551237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-745fd1c2-0397-4572-813f-700cb8838940 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:42.552429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-745fd1c2-0397-4572-813f-700cb8838940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:42.567118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:42.568210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.568773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.569271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.570292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:42.571436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:42.573275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:42.583514 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 443/893] 10.222.0.59 () {56 vars in 1115 bytes} [Sun Aug 28 00:52:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:42.589685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:42.646095 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 451/894] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:42.709258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9c8cd-97af-45e8-808e-45ec6cc8dd7c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:42.711642 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:42.744430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:42.745069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.745345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.745612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.757045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:42.759087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:42.773450 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:42.774471 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:42.775445 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:42.775445 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:42.775445 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:42.775445 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 444/895] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:42.780349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fd1c2-0397-4572-813f-700cb8838940 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:42.807998 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:42.890010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fd1c2-0397-4572-813f-700cb8838940 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:42.926151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:42.926761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:42.927034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:42.927301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:42.927948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:42.928244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:42.930250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:42.935610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:42.944799 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 452/896] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:42.953846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:43.053204 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:43.070709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a480de-ee03-476f-ad9d-da0240dd4087 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:43.071327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b500930-1e8e-4858-910e-601b74ae352d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:43.106919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583cea4-7d96-41f1-87b5-3fb5e1107e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:43.107552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583cea4-7d96-41f1-87b5-3fb5e1107e0e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.107826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583cea4-7d96-41f1-87b5-3fb5e1107e0e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.108096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583cea4-7d96-41f1-87b5-3fb5e1107e0e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.113836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b3b0f-47fd-4e16-84b8-67d086591bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:43.114449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3b0f-47fd-4e16-84b8-67d086591bbc None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.114727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3b0f-47fd-4e16-84b8-67d086591bbc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.114999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3b0f-47fd-4e16-84b8-67d086591bbc None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.115642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b3b0f-47fd-4e16-84b8-67d086591bbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:43.116181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583cea4-7d96-41f1-87b5-3fb5e1107e0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:43.117010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b3b0f-47fd-4e16-84b8-67d086591bbc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:43.118672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583cea4-7d96-41f1-87b5-3fb5e1107e0e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-a583cea4-7d96-41f1-87b5-3fb5e1107e0e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:43.130544 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:43.134406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 453/897] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:52:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c773680-93d2-4c17-bd3c-b309932f78d0 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.135717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c773680-93d2-4c17-bd3c-b309932f78d0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.136682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c773680-93d2-4c17-bd3c-b309932f78d0 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.136682 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 454/898] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:43.137513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c773680-93d2-4c17-bd3c-b309932f78d0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:43.205963 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 445/899] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:42 2022] POST /identity/v3/services => generated 241 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:52:43.205963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87e387-2aeb-4bb9-9c58-9d8d419701ad None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.205963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87e387-2aeb-4bb9-9c58-9d8d419701ad None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.205963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87e387-2aeb-4bb9-9c58-9d8d419701ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.232011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ca87e387-2aeb-4bb9-9c58-9d8d419701ad None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:43.234150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ca87e387-2aeb-4bb9-9c58-9d8d419701ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:43.250765 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:43.280774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c773680-93d2-4c17-bd3c-b309932f78d0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:43.337507 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 446/900] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:43.346134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:43.346894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.347180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.347457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.349046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:43.349046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:43.350808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:43.362727 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:43.371694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 455/901] 10.222.0.59 () {56 vars in 1149 bytes} [Sun Aug 28 00:52:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:43.377099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87e387-2aeb-4bb9-9c58-9d8d419701ad None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:43.489269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87e387-2aeb-4bb9-9c58-9d8d419701ad None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:43.525469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:43.526111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.526443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.526723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.543126 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:43.605250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:43.607493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:43.620421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:43.723938 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 447/902] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:52:43.729956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:43.741340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00389f6-a9ea-450f-ae81-ffd0b01ad5ff None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:43.779596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:43.780368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.780791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.781156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.781896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:43.784297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:43.794192 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:43.794701 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:43.795916 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:43.797129 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:43.803696 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 456/903] 10.222.0.59 () {56 vars in 1132 bytes} [Sun Aug 28 00:52:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:43.805335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:43.868501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13684d85-78c2-4ace-9985-94a9c9c07228 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:43.874538 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:43.915395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37053517-c725-4e6e-8fca-cec9c85471bf None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:43.917209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:43.918882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.919353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.919781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.934992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:43.937268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:43.955083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:43.955880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:43.956250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:43.956652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:43.957376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:43.957827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:43.957954 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:43.959068 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:43.960070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:43.960070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:43.960070 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:43.961493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:43.962947 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 448/904] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:43.968648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:43.971440 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 457/905] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:43.977954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.091919 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:44.096196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc97ea-8665-440f-b7e8-1c147c0acb37 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.098152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73b36-043b-4ad7-8e69-b42814948012 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.131195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.132619 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:44.134032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.134350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.134628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.135441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:44.135567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.136955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.144474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.148398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.148398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.148398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.148398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:44.148398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.150255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.154208 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 449/906] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:44.156262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.156891 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 458/907] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:44.163029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.269228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9154f4-7e09-47b0-90b8-f47cbd3ec8a9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.279069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc02c-994e-4210-a739-e1d45418ba29 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.306788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.307425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.307704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.307976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.314884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.316360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.317892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f6e52-55da-4b69-8671-8e7987d692c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.318611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6e52-55da-4b69-8671-8e7987d692c4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.318809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6e52-55da-4b69-8671-8e7987d692c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.319102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6e52-55da-4b69-8671-8e7987d692c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.319799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f6e52-55da-4b69-8671-8e7987d692c4 None admin] RBAC: Adding query filter params (interface=public, service_id=7eba66ac88fb4951bdf33d05d27fbf3b, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:44.320722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f6e52-55da-4b69-8671-8e7987d692c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.322251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f6e52-55da-4b69-8671-8e7987d692c4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.332519 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 459/908] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:52:44 2022] GET /identity/v3/endpoints?service_id=7eba66ac88fb4951bdf33d05d27fbf3b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:44.332706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:44.333575 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:44.334864 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:44.335360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c4a4-ffbc-49d8-86f0-f134d555312b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.335360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c4a4-ffbc-49d8-86f0-f134d555312b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.335360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c4a4-ffbc-49d8-86f0-f134d555312b None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.335556 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 450/909] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:44.335556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.337045 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 460/910] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:44.337835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88c4a4-ffbc-49d8-86f0-f134d555312b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.358808 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:44.398215 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:44.451109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55f60-a78f-41f4-9ecb-6db75c5c74d4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.460953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88c4a4-ffbc-49d8-86f0-f134d555312b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.495794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522f30e-e842-4845-bcf1-51b575a9d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.496483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522f30e-e842-4845-bcf1-51b575a9d11a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.496761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522f30e-e842-4845-bcf1-51b575a9d11a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.497034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522f30e-e842-4845-bcf1-51b575a9d11a None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.497698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522f30e-e842-4845-bcf1-51b575a9d11a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.499101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522f30e-e842-4845-bcf1-51b575a9d11a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.500926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.501424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.501706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.502008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.502698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:44.503003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.504472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.513608 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 451/911] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:52:44 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:52:44.513608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120d7b-f24c-4a4f-a620-d5cfb00ba29b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.513608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120d7b-f24c-4a4f-a620-d5cfb00ba29b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.513608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120d7b-f24c-4a4f-a620-d5cfb00ba29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.527493 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 461/912] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:44.531322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a0120d7b-f24c-4a4f-a620-d5cfb00ba29b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:44.532573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a0120d7b-f24c-4a4f-a620-d5cfb00ba29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:44.534910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.618300 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 452/913] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:44.650235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d5cf0-ae87-427c-b83b-c1ed131e3f49 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:44.667540 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:44.690236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:44.690839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:44.691114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:44.691384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:44.692203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] RBAC: Adding query filter params (role.id=4ad5bb16232d466dbfc628e9136ecde4, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=7c105d176ec44ab890a6ce4c0f50b2a5) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:44.692533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:44.694068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:44.701917 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 462/914] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:44 2022] GET /identity/v3/role_assignments?user.id=7c105d176ec44ab890a6ce4c0f50b2a5&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4ad5bb16232d466dbfc628e9136ecde4 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:44.897582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120d7b-f24c-4a4f-a620-d5cfb00ba29b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:44.913091 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:45.006683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120d7b-f24c-4a4f-a620-d5cfb00ba29b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:45.045352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:45.046423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.046929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.047420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.048225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:45.049796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:45.059955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:45.061004 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:52:45.061878 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:45.064677 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 453/915] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:45.070936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:45.182404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3962ef9-e358-43ca-b859-73447955b1e1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:45.222344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3da42-2725-477d-a4d3-86eeacfe6659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:45.222955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3da42-2725-477d-a4d3-86eeacfe6659 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.223284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3da42-2725-477d-a4d3-86eeacfe6659 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.223555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3da42-2725-477d-a4d3-86eeacfe6659 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.224184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3da42-2725-477d-a4d3-86eeacfe6659 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:45.224488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3da42-2725-477d-a4d3-86eeacfe6659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:45.225886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3da42-2725-477d-a4d3-86eeacfe6659 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:45.231716 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 463/916] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:45.237361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:45.269231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfb25-87f9-4dc2-82cb-c75367070cb7 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.269561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfb25-87f9-4dc2-82cb-c75367070cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.269786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfb25-87f9-4dc2-82cb-c75367070cb7 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.271337 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 464/917] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:45.277104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925eb1-a73b-490a-b509-10a638673262 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.277393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925eb1-a73b-490a-b509-10a638673262 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.277676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925eb1-a73b-490a-b509-10a638673262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.301732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d9925eb1-a73b-490a-b509-10a638673262 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:45.303344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d9925eb1-a73b-490a-b509-10a638673262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:45.340217 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:45.355993 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:45.364854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342bfbd-9754-4bcf-9026-18a57eedd735 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:45.401004 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 465/918] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:45.410081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:45.410969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.411450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.411982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.412892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:45.413428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:45.415188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:45.421608 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 454/919] 10.222.0.59 () {56 vars in 1114 bytes} [Sun Aug 28 00:52:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:45.433959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925eb1-a73b-490a-b509-10a638673262 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:45.539949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925eb1-a73b-490a-b509-10a638673262 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:45.576580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:45.577202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.577484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.577758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.578463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:45.579851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:45.684703 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 466/920] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:52:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:45.698879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:45.823188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884991f-7978-4f46-8821-d785a7157db3 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:45.866972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:45.867722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:45.868009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:45.868278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:45.868859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:45.870257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:45.873397 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:45.880261 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:45.881303 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:45.883442 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 455/921] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:45.888343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:45.923749 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:45.999939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe92a6-36d9-42ac-b5fa-4cb16496169b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:46.038252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:46.039428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.039800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.040294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.040932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:46.041231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:46.042615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:46.047956 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 467/922] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:46.053355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:46.162815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5314960-f078-4358-b399-344dd0eb85e6 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:46.200605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:46.201283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.201570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.201862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.202508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:46.202813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:46.204188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:46.209914 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 456/923] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:46.216159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:46.323866 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:46.333557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c77bfb-84f8-4a3a-ab21-a40002105ba9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:46.372063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0697-94ec-49ad-9643-5345b7772c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:46.372688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0697-94ec-49ad-9643-5345b7772c2b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.372975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0697-94ec-49ad-9643-5345b7772c2b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.373247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0697-94ec-49ad-9643-5345b7772c2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.373993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0697-94ec-49ad-9643-5345b7772c2b None admin] RBAC: Adding query filter params (interface=public, service_id=85a73ba4bf1346019a07312003e62849, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:46.374303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0697-94ec-49ad-9643-5345b7772c2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:46.375676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0697-94ec-49ad-9643-5345b7772c2b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:46.381747 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 468/924] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:52:46 2022] GET /identity/v3/endpoints?service_id=85a73ba4bf1346019a07312003e62849&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:46.388046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:46.465880 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:46.504459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf559-c114-4d9d-bacc-7c9c4d4f176c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:46.532402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9699fd8-e0c4-4a33-aabd-c9222b806881 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.532739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9699fd8-e0c4-4a33-aabd-c9222b806881 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.532966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9699fd8-e0c4-4a33-aabd-c9222b806881 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.534686 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 469/925] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:46.540184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb69925-257d-467f-ba98-efaccdb4a1c4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.540465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb69925-257d-467f-ba98-efaccdb4a1c4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.540716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb69925-257d-467f-ba98-efaccdb4a1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.540824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a67cd1-98e6-4c72-995d-18074922d9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:46.541325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a67cd1-98e6-4c72-995d-18074922d9fc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.541608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a67cd1-98e6-4c72-995d-18074922d9fc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.541900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a67cd1-98e6-4c72-995d-18074922d9fc None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.542510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a67cd1-98e6-4c72-995d-18074922d9fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:46.544052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a67cd1-98e6-4c72-995d-18074922d9fc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:46.551840 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 457/926] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:52:46 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:52:46.560499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bbb69925-257d-467f-ba98-efaccdb4a1c4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:46.561744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bbb69925-257d-467f-ba98-efaccdb4a1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:46.639915 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 470/927] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:46.772546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0d3b-1e99-432c-978e-ecbc2100527b None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.772891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0d3b-1e99-432c-978e-ecbc2100527b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.773177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0d3b-1e99-432c-978e-ecbc2100527b None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.774844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 458/928] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:46.780426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b20250-415e-4d3c-9d78-ec64818f079d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:46.780895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b20250-415e-4d3c-9d78-ec64818f079d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:46.780992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b20250-415e-4d3c-9d78-ec64818f079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:46.799723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-73b20250-415e-4d3c-9d78-ec64818f079d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:46.800905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-73b20250-415e-4d3c-9d78-ec64818f079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:46.876655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 471/929] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:46.926001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0d3b-1e99-432c-978e-ecbc2100527b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.035469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be0d3b-1e99-432c-978e-ecbc2100527b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.064839 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:47.073448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.086380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.086380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.086380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.086380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:47.086380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:47.086380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:47.086380 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:47.086877 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:47.087789 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:47.088706 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 459/930] 10.222.0.59 () {56 vars in 1132 bytes} [Sun Aug 28 00:52:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:47.093053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b20250-415e-4d3c-9d78-ec64818f079d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.128589 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:47.152064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.208058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b20250-415e-4d3c-9d78-ec64818f079d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.258902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.259539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.259821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.260095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.260732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:47.261191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:47.262641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:47.274037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 472/931] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:47.276022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.290708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc965b7d-7753-490a-b8ad-3dc914a88049 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.337429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.338403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.338691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.338970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.355344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:47.361055 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:47.362075 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:52:47.362957 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:47.367747 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 460/932] 10.222.0.59 () {56 vars in 1120 bytes} [Sun Aug 28 00:52:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:47.368978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.392166 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:47.416879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b01d8-49eb-4a08-b1d7-23c78e4228c3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.429137 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:47.463360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.464317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.464815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.465291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.466171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:47.466690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:47.468268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:47.478933 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 473/933] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:47.480076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.482364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672f31-40d1-4d44-8ff2-a1b9be5500d8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.519192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.519439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.519670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.519900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.520570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:47.520873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:47.522379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:47.537032 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 461/934] 10.222.0.59 () {56 vars in 1115 bytes} [Sun Aug 28 00:52:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:47.538421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.592153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783c6ab-f95c-44e3-9757-fd66300e2edf None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.633358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac06ea-f4cc-4322-acdc-4c2fe1f3a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.634788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac06ea-f4cc-4322-acdc-4c2fe1f3a4e6 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.635498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac06ea-f4cc-4322-acdc-4c2fe1f3a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.636197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac06ea-f4cc-4322-acdc-4c2fe1f3a4e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.637624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac06ea-f4cc-4322-acdc-4c2fe1f3a4e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:47.639271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac06ea-f4cc-4322-acdc-4c2fe1f3a4e6 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:47.651375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17770-6453-4278-b5d5-25ba5bfd27e7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.666703 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:47.689568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.690312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.690630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.690981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.704972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:47.706468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:47.721590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:47.722811 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:47.723740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:47.723740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:47.723740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:47.723740 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 462/935] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:47.728672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.751847 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:47.760029 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 474/936] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:52:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:47.852909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0f542-b553-42d3-8bcb-d699c6a5b547 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:47.893557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2025-588d-4f80-aa2f-6dbbe2ae0bb3 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.894953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2025-588d-4f80-aa2f-6dbbe2ae0bb3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.896021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db2025-588d-4f80-aa2f-6dbbe2ae0bb3 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.899013 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 475/937] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:47.904182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:47.904812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.905094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.905370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.907769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:47.907769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:47.907941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:47.909975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622dac-5240-4cc2-96dc-d7aa7a4b9450 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:47.911607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622dac-5240-4cc2-96dc-d7aa7a4b9450 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:47.912083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622dac-5240-4cc2-96dc-d7aa7a4b9450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:47.923146 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 463/938] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:47.928401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:47.937485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-df622dac-5240-4cc2-96dc-d7aa7a4b9450 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:47.938796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df622dac-5240-4cc2-96dc-d7aa7a4b9450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:47.961562 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:48.049687 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 476/939] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:48.060467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314a861-c22e-44c9-88df-786071ba6cab None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:48.097211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:48.098215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.098681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.099173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.107711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:48.109479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:48.122042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:48.123060 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:48.124039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:48.129932 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 464/940] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:52:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:48.132908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622dac-5240-4cc2-96dc-d7aa7a4b9450 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.241112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622dac-5240-4cc2-96dc-d7aa7a4b9450 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:48.271848 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:48.278362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:48.278973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.286708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.286708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.286708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:48.286708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:48.286708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:48.302224 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 477/941] 10.222.0.59 () {56 vars in 1149 bytes} [Sun Aug 28 00:52:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:48.308397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.344463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.402846 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:48.437624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ee1d0-e966-465a-bdff-3899605a60db None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:48.462256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539e2f-f8f4-4906-b853-a6267ed37979 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:48.480440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664609-452f-4cb4-9e46-8021a299bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:48.481086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664609-452f-4cb4-9e46-8021a299bad1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.481415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664609-452f-4cb4-9e46-8021a299bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.481697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664609-452f-4cb4-9e46-8021a299bad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.493171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664609-452f-4cb4-9e46-8021a299bad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:48.494655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664609-452f-4cb4-9e46-8021a299bad1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:48.507183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:48.509949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.510237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.510521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.511189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:48.512644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-22664609-452f-4cb4-9e46-8021a299bad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:48.514128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:48.515219 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:48.516116 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:48.516116 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:48.516116 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:48.516297 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.server.flask.common [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 00:52:48.518282 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 465/942] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:48.522524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579cd1-72c3-4cbb-9c1c-b019849090d8 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.523335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579cd1-72c3-4cbb-9c1c-b019849090d8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.524175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579cd1-72c3-4cbb-9c1c-b019849090d8 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.526306 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 466/943] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:48.527900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579cd1-72c3-4cbb-9c1c-b019849090d8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.584085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.sql.core [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:52:48.584085 n-d-master-1 devstack@keystone.service[82007]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:52:48.584085 n-d-master-1 devstack@keystone.service[82007]: [parameters: {'id': '54b9ce5fbe5c4cccbc4cd215ffe5ddc9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:52:48.584085 n-d-master-1 devstack@keystone.service[82007]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82007) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f17e7233-9394-455a-acf9-0641d5e842d8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 54b9ce5fbe5c4cccbc4cd215ffe5ddc9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 54b9ce5fbe5c4cccbc4cd215ffe5ddc9. Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:52:48.591843 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result.read() Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 00:52:48.592728 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application yield resource Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise self.value Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application session.commit() Aug 28 00:52:48.593740 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:52:48.595131 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:52:48.596130 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result.read() Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:52:48.596953 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [parameters: {'id': '54b9ce5fbe5c4cccbc4cd215ffe5ddc9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.598772 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:48.601939 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 54b9ce5fbe5c4cccbc4cd215ffe5ddc9. Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 478/944] 10.222.0.59 () {60 vars in 1140 bytes} [Sun Aug 28 00:52:48 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a24df-3c71-4d1d-af58-b96ebd4d7289 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.605431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a24df-3c71-4d1d-af58-b96ebd4d7289 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.608318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a24df-3c71-4d1d-af58-b96ebd4d7289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.617008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-449a24df-3c71-4d1d-af58-b96ebd4d7289 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:48.618567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-449a24df-3c71-4d1d-af58-b96ebd4d7289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:48.651639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579cd1-72c3-4cbb-9c1c-b019849090d8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:48.665039 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:48.689918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:48.690524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.690834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.691067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.691701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:48.691998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:48.692448 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 479/945] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:48.693359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a24df-3c71-4d1d-af58-b96ebd4d7289 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.703194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:48.705233 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:48.719472 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 467/946] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:48.727017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.817145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a24df-3c71-4d1d-af58-b96ebd4d7289 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:48.859329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ab339-a2e3-4854-bd51-00bc79b6d289 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:48.863350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:48.864181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.864608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.865401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.875135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:48.877024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:48.892985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:48.895689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:48.895689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:48.895893 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:48.897233 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:48.898436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:48.898949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:48.902597 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 480/947] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:48.902597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.906729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:48.908309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:48.922135 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:48.923209 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:48.924293 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:48.925847 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 468/948] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:48.934541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:48.949646 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:49.010201 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:49.024492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f4a5c-e5a3-42f4-a7c8-566537ae6653 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:49.057546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942c41-1935-49da-89bf-899a484cd104 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:49.065023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:49.065720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.066092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.066439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.067528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:49.067905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:49.070160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:49.091510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:49.092199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.092540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.092876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.093648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:49.094054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:49.095565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:49.106048 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 481/949] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:49.106048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:49.112701 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 469/950] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:49.121346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:49.214943 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:49.223307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d366e95-e9f6-4f63-82bf-16ae3414a936 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:49.268273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:49.269017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.269361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.269698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.270348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77477a2b-c9ef-42cb-8425-e058b793395c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:49.270596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:49.271734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:49.283072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:49.285801 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:49.286775 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 482/951] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:49.291342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:49.293320 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:49.324159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:49.325098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.325373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.325702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/7c105d176ec44ab890a6ce4c0f50b2a5/roles/4ad5bb16232d466dbfc628e9136ecde4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.327889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=7c105d176ec44ab890a6ce4c0f50b2a5, role_id=4ad5bb16232d466dbfc628e9136ecde4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:49.329342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:49.405577 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 470/952] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:52:49 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/7c105d176ec44ab890a6ce4c0f50b2a5/roles/4ad5bb16232d466dbfc628e9136ecde4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:52:49.413548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5854b-9b2b-403b-9cf2-c465bc097299 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:49.457280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:49.458188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.458625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.458996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.459771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:49.460181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:49.462662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:49.469073 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 483/953] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:49.474511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:49.586723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844a64-fb4e-4f0c-a019-b046888bedb2 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:49.624088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc52a5-0b00-4b5b-a4b6-a05ecb3ec1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:49.624849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc52a5-0b00-4b5b-a4b6-a05ecb3ec1d7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.625220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc52a5-0b00-4b5b-a4b6-a05ecb3ec1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.625589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc52a5-0b00-4b5b-a4b6-a05ecb3ec1d7 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.626344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc52a5-0b00-4b5b-a4b6-a05ecb3ec1d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:49.626759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc52a5-0b00-4b5b-a4b6-a05ecb3ec1d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:49.628198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc52a5-0b00-4b5b-a4b6-a05ecb3ec1d7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:49.634498 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 471/954] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:49.640328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:49.671515 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:49.760114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d6e56-e163-48d2-8f73-2432af6a8dc5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:49.796983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:49.797904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.798336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.798775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.799590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:49.801179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:49.825802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5561-04a4-4334-936d-7f0de6466342 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.826116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5561-04a4-4334-936d-7f0de6466342 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.826385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5561-04a4-4334-936d-7f0de6466342 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.827774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 472/955] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:49.833711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ac50-7cc2-4f43-94a9-ef6689d867e0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:49.834269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ac50-7cc2-4f43-94a9-ef6689d867e0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:49.834700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4ac50-7cc2-4f43-94a9-ef6689d867e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:49.853780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3bd4ac50-7cc2-4f43-94a9-ef6689d867e0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:49.855003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3bd4ac50-7cc2-4f43-94a9-ef6689d867e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:49.880098 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 484/956] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:52:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:49.893198 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:49.972636 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 473/957] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:50.241402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:50.328395 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:50.351570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2492-a0eb-4dd2-bc1d-bc365108d4dd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:50.387988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:50.388621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:50.388924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:50.389181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:50.389755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:50.395870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:50.401138 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:50.402189 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:50.403094 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 485/958] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:50.410734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ac50-7cc2-4f43-94a9-ef6689d867e0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:50.525777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4ac50-7cc2-4f43-94a9-ef6689d867e0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:50.562044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abef532-b373-4b6b-8ceb-99908282d389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:50.562664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abef532-b373-4b6b-8ceb-99908282d389 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:50.562945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abef532-b373-4b6b-8ceb-99908282d389 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:50.563211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abef532-b373-4b6b-8ceb-99908282d389 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:50.563847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abef532-b373-4b6b-8ceb-99908282d389 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:50.564147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abef532-b373-4b6b-8ceb-99908282d389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:50.565502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abef532-b373-4b6b-8ceb-99908282d389 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:50.571069 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 474/959] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:50.576930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:50.689306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8495a-08fe-47bf-8023-15d00b9432e5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:50.725131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5d2bf-ec7c-4e30-a68b-83521f881312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:50.725749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d2bf-ec7c-4e30-a68b-83521f881312 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:50.726806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d2bf-ec7c-4e30-a68b-83521f881312 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:50.727084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d2bf-ec7c-4e30-a68b-83521f881312 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:50.727730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5d2bf-ec7c-4e30-a68b-83521f881312 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:50.728032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5d2bf-ec7c-4e30-a68b-83521f881312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:50.729476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5d2bf-ec7c-4e30-a68b-83521f881312 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:50.734938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 486/960] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:51.177209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35a12-d3e7-4a42-9d1c-a17e04424c74 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.177627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35a12-d3e7-4a42-9d1c-a17e04424c74 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.177832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35a12-d3e7-4a42-9d1c-a17e04424c74 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.180030 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 475/961] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:51.185329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69416710-74a1-4d2a-b377-47463f04fde1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.185624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69416710-74a1-4d2a-b377-47463f04fde1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.185929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69416710-74a1-4d2a-b377-47463f04fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.199542 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:51.205760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-69416710-74a1-4d2a-b377-47463f04fde1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:51.206974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-69416710-74a1-4d2a-b377-47463f04fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:51.276629 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 487/962] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:51.534876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397390bb-102a-444d-894d-8d299326f813 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.535616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397390bb-102a-444d-894d-8d299326f813 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.535616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397390bb-102a-444d-894d-8d299326f813 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.537028 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 476/963] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:51.543181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1dc6b-c280-4320-9965-9f70a108ec4a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.543462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1dc6b-c280-4320-9965-9f70a108ec4a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.543731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1dc6b-c280-4320-9965-9f70a108ec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.555639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397390bb-102a-444d-894d-8d299326f813 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:51.564299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-69f1dc6b-c280-4320-9965-9f70a108ec4a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:51.565478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-69f1dc6b-c280-4320-9965-9f70a108ec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:51.587045 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:51.645903 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 488/964] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:51.678796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397390bb-102a-444d-894d-8d299326f813 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:51.715984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:51.716944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.717464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.718039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.719065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:51.720954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:51.723792 n-d-master-1 devstack@keystone.service[82006]: WARNING keystone.server.flask.common [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 00:52:51.784281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.sql.core [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:52:51.784281 n-d-master-1 devstack@keystone.service[82006]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:52:51.784281 n-d-master-1 devstack@keystone.service[82006]: [parameters: {'user_id': '6ff32fe6f1e04763a297dbb0c5e4e229', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:52:51.784281 n-d-master-1 devstack@keystone.service[82006]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82006) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-047d43c9-4949-40a7-968b-3ce3e7aaa195 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result.read() Aug 28 00:52:51.803136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:52:51.804734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application yield resource Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise self.value Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application session.commit() Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:52:51.805754 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:52:51.806882 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:52:51.807989 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result.read() Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:52:51.809050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [parameters: {'user_id': '6ff32fe6f1e04763a297dbb0c5e4e229', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:51.810147 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 00:52:51.811216 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 00:52:51.813734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 00:52:51.813734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 00:52:51.813734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:52:51.813734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:52:51.813734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:52:51.813734 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:51.818626 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 477/965] 10.222.0.59 () {60 vars in 1131 bytes} [Sun Aug 28 00:52:51 2022] POST /identity/v3/users => generated 160 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:51.821408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1dc6b-c280-4320-9965-9f70a108ec4a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:51.892876 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:51.930048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1dc6b-c280-4320-9965-9f70a108ec4a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:51.941380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c562d-a5ed-48ce-b25d-1d89bd74d244 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.941664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c562d-a5ed-48ce-b25d-1d89bd74d244 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.941981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c562d-a5ed-48ce-b25d-1d89bd74d244 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.951939 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 478/966] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:51.953155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac15145-f496-473c-827d-d56f6d08917c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.953448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac15145-f496-473c-827d-d56f6d08917c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.953725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac15145-f496-473c-827d-d56f6d08917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.968887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:51.969536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:51.969841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:51.970114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:51.974313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bac15145-f496-473c-827d-d56f6d08917c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:51.975868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bac15145-f496-473c-827d-d56f6d08917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:51.977724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:51.979330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:51.991405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:51.992573 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 489/967] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:52:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:51.993553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.059681 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 479/968] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:52.062716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac15145-f496-473c-827d-d56f6d08917c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.090900 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:52.120907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5fa6-3f76-4256-9284-973257522400 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.157866 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:52.169593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.170496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.170919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.171346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.183216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:52:52.188194 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:52.189399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:52:52.190506 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:52.192073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac15145-f496-473c-827d-d56f6d08917c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.193022 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 490/969] 10.222.0.59 () {56 vars in 1120 bytes} [Sun Aug 28 00:52:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:52.201305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.239459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.240107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.240431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.240707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.242247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:52.242556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:52.244808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:52.289980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 480/970] 10.222.0.59 () {56 vars in 1101 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:52.339666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4082cf-2b41-4127-80e4-aa58cdb815a0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.346450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.392479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.393487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.393997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.394486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.396165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:52.396714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:52.400262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:52.423477 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 491/971] 10.222.0.59 () {56 vars in 1115 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:52.426558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.448311 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:52.474051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783901e6-c89c-4c88-a9d7-9625ca2dddb1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.498969 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:52.518946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.520215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.520501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.520766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.521351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:52.522866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:52.539663 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:52.541403 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:52.542381 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:52.545959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 481/972] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:52.549186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.568336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa5276-d6ec-41f2-a85c-87a0446c8a2e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.614389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.614942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.615219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.615485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.628744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:52.631830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:52.646770 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:52.647909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:52.649225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:52.649225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:52.649225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:52.649225 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 492/973] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:52.653888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.685260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404419-8271-4fd2-a5b1-aad747c9bba8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.722666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd08cd-06f3-4c0b-b397-1f563f1c3575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.723274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd08cd-06f3-4c0b-b397-1f563f1c3575 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.723569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd08cd-06f3-4c0b-b397-1f563f1c3575 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.723819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd08cd-06f3-4c0b-b397-1f563f1c3575 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.724447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd08cd-06f3-4c0b-b397-1f563f1c3575 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:52.724744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd08cd-06f3-4c0b-b397-1f563f1c3575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:52.726869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd08cd-06f3-4c0b-b397-1f563f1c3575 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:52.737079 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 482/974] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:52.738520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7ca5-97c3-4019-a40c-6bb50354f096 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.738829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7ca5-97c3-4019-a40c-6bb50354f096 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.739103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c7ca5-97c3-4019-a40c-6bb50354f096 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.741012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 483/975] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:52.742395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7ca5-97c3-4019-a40c-6bb50354f096 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.753564 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:52.764229 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:52.767338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad809-6c2b-4324-88ed-56d1308e4686 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.800176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7dfa7-3f7d-40e9-a094-f5330fa6eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.800781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dfa7-3f7d-40e9-a094-f5330fa6eb98 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.801053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dfa7-3f7d-40e9-a094-f5330fa6eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.801321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7dfa7-3f7d-40e9-a094-f5330fa6eb98 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.801996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dfa7-3f7d-40e9-a094-f5330fa6eb98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:52.802299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dfa7-3f7d-40e9-a094-f5330fa6eb98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:52.803651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7dfa7-3f7d-40e9-a094-f5330fa6eb98 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:52.815714 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 493/976] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:52.819178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f055b-fb34-4a21-815c-d2c9d87de715 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.819779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f055b-fb34-4a21-815c-d2c9d87de715 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.820055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f055b-fb34-4a21-815c-d2c9d87de715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.837277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1d5f055b-fb34-4a21-815c-d2c9d87de715 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:52.838486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d5f055b-fb34-4a21-815c-d2c9d87de715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:52.846953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c7ca5-97c3-4019-a40c-6bb50354f096 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:52.882758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:52.883298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:52.883568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:52.883833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:52.884454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:52.884758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:52.886187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:52.896732 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 484/977] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:52.896732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.910416 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 494/978] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:52.911259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f055b-fb34-4a21-815c-d2c9d87de715 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:52.968078 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:53.000426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4fa69-d9a8-4a3a-94c0-3e6cac46ae91 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.002450 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:53.012842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f055b-fb34-4a21-815c-d2c9d87de715 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.036560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.037332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.037612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.037921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.046386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.047828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.048306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.048921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.049229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.049474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.050219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] RBAC: Adding query filter params (interface=admin, service_id=85a73ba4bf1346019a07312003e62849, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:53.050524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.051881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.057877 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 495/979] 10.222.0.59 () {56 vars in 1249 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/endpoints?service_id=85a73ba4bf1346019a07312003e62849&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:52:53.060620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:53.061535 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:52:53.062798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:53.063356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:53.066588 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 485/980] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:52:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:53.067365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:53.169137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efeb0-dd95-4175-8933-3f5bf0257d45 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.169496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aae3d6-b804-49df-b854-5a4e5c5cd8fa None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.197945 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:53.203507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.204118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.204398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.204668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.204909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.205392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:53.205565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.205692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.205868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.206145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.206745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.207138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.208092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.215187 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 496/981] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:52:53 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:52:53.216843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:53.225888 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 486/982] 10.222.0.59 () {56 vars in 1149 bytes} [Sun Aug 28 00:52:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:53.232089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:53.239694 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:53.342979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecf034-dfe2-4ced-8691-7b74cd58569f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.354445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2709bc1-7447-452a-96f0-23701b3ce264 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.386711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.387585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.387867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.388138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.388793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.390211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.394179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.394799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.395082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.395353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.456400 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:53.465948 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 497/983] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:53 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:52:53.473652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.475326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.588928 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 487/984] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:52:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:52:53.595109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:53.685222 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:53.715823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4fb8b-927e-4a2c-ac79-b536629197af None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.754474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.755285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.755578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.756307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.767346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.768845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:52:53.784179 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:53.785187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:52:53.786149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:52:53.786149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:52:53.786149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:53.786149 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 498/985] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:53.792749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:53.884626 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:53.897330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3982f-bd9a-4baa-b33c-5f22df25939f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:53.932299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:53.932932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:53.933176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:53.933447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:53.934113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:53.934417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:53.935771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:53.949262 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 488/986] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:53.955098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:54.057766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cc84c-5b35-4f72-a2bc-cfa8099cdd8f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:54.083449 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:54.092734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:54.093360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:54.099672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:54.099672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:54.101698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:54.103165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:52:54.115061 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:54.116022 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:52:54.118055 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:54.118805 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 499/987] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:54.122286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:54.226311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3ec5e-bce8-4b7a-a0b9-874ebc34ff1a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:54.260770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4d26-f6b1-4095-8217-84c1b260a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:54.261378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4d26-f6b1-4095-8217-84c1b260a3b3 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:54.261654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4d26-f6b1-4095-8217-84c1b260a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:54.261949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4d26-f6b1-4095-8217-84c1b260a3b3 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:54.262637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4d26-f6b1-4095-8217-84c1b260a3b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:54.262939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4d26-f6b1-4095-8217-84c1b260a3b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:54.264341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a4d26-f6b1-4095-8217-84c1b260a3b3 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:54.277499 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 489/988] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:54.283290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:54.389547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c8a37-ea68-457f-8bba-28f168952b20 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:54.432879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42185d2d-1e5d-4ffa-8050-0f3dcf7dbc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:54.433472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42185d2d-1e5d-4ffa-8050-0f3dcf7dbc89 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:54.433750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42185d2d-1e5d-4ffa-8050-0f3dcf7dbc89 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:54.434044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42185d2d-1e5d-4ffa-8050-0f3dcf7dbc89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:54.434765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42185d2d-1e5d-4ffa-8050-0f3dcf7dbc89 None admin] RBAC: Adding query filter params (role.id=4ad5bb16232d466dbfc628e9136ecde4, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=7c105d176ec44ab890a6ce4c0f50b2a5) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:54.435067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42185d2d-1e5d-4ffa-8050-0f3dcf7dbc89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:54.436487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42185d2d-1e5d-4ffa-8050-0f3dcf7dbc89 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:54.442614 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 500/989] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:52:54 2022] GET /identity/v3/role_assignments?user.id=7c105d176ec44ab890a6ce4c0f50b2a5&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4ad5bb16232d466dbfc628e9136ecde4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:55.187423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd3e0-a451-4513-9453-a3e4735f0262 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:55.188000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd3e0-a451-4513-9453-a3e4735f0262 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:55.188000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd3e0-a451-4513-9453-a3e4735f0262 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:55.189496 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 490/990] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:55.195083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa5e8-6010-434d-9a1b-06d192738e3f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:55.195431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa5e8-6010-434d-9a1b-06d192738e3f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:55.195641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa5e8-6010-434d-9a1b-06d192738e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:55.215406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-957aa5e8-6010-434d-9a1b-06d192738e3f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:55.216601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-957aa5e8-6010-434d-9a1b-06d192738e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:55.264098 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:55.285694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 501/991] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:55.448433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74bba3-3071-48ac-8b80-8c20da142862 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:55.448628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74bba3-3071-48ac-8b80-8c20da142862 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:55.448890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74bba3-3071-48ac-8b80-8c20da142862 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:55.450464 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 491/992] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:55.455505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78cea-556b-4815-9ce3-ec58350be15d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:55.455998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78cea-556b-4815-9ce3-ec58350be15d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:55.456091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a78cea-556b-4815-9ce3-ec58350be15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:55.474942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a9a78cea-556b-4815-9ce3-ec58350be15d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:55.477135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a9a78cea-556b-4815-9ce3-ec58350be15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:55.551275 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 502/993] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:55.562750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74bba3-3071-48ac-8b80-8c20da142862 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:55.573968 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:55.668119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74bba3-3071-48ac-8b80-8c20da142862 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:55.702673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:55.703158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:55.703438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:55.703709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:55.704290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:55.705639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:55.714707 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:55.715714 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:52:55.716578 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:55.721851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 492/994] 10.222.0.59 () {56 vars in 1126 bytes} [Sun Aug 28 00:52:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:55.722042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78cea-556b-4815-9ce3-ec58350be15d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:55.825905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:55.828240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a78cea-556b-4815-9ce3-ec58350be15d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:55.841962 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:55.868405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:55.869020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:55.869301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:55.869574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:55.870236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:55.870542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:55.871915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:55.876978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 503/995] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:55.882622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:55.908971 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:55.940320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d91df-da89-456a-96d6-af616816c335 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:55.976717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:55.977267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:55.977548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:55.977837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] PATH_INFO: `/v3/services/compute` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:55.978430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:55.979803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:55.989426 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:55.990488 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:52:55.991833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 493/996] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:52:55.997358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfd9fe-0cf3-4cc3-a381-264c61b5ae8d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:55.998789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:56.039553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:56.040127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.040412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.040714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.041339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:56.041644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:56.043650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:56.050129 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 504/997] 10.222.0.59 () {56 vars in 1122 bytes} [Sun Aug 28 00:52:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:56.056132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:56.098707 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:56.114659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee30c15-c448-48ec-9ba9-61ca3cdc839a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:56.155106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:56.155731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.156036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.156275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.156914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:56.157217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:56.158602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:56.160648 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:56.164025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbc257-a849-445d-9cac-45f3d045c034 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:56.169381 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 494/998] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:56.170267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:56.202604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:56.203210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.203490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.203766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.204429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:56.205860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:56.273494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e1869-1b71-4742-838c-767d8c8bfcd2 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:56.305042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 505/999] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:52:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:52:56.316610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559449-5b52-41d3-9cea-7bf2f4469288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:56.317242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559449-5b52-41d3-9cea-7bf2f4469288 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.317520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559449-5b52-41d3-9cea-7bf2f4469288 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.317789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559449-5b52-41d3-9cea-7bf2f4469288 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.318466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559449-5b52-41d3-9cea-7bf2f4469288 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:56.318770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559449-5b52-41d3-9cea-7bf2f4469288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:56.320888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559449-5b52-41d3-9cea-7bf2f4469288 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:56.327296 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 495/1000] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:56.333337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:56.376762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814691a-b50e-477a-a8d0-482359432a5c None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.377122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814691a-b50e-477a-a8d0-482359432a5c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.377326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814691a-b50e-477a-a8d0-482359432a5c None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.378999 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 496/1001] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:56.385358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694dca8-6633-4dc8-807a-550345661828 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.385698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694dca8-6633-4dc8-807a-550345661828 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.385958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694dca8-6633-4dc8-807a-550345661828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.405975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8694dca8-6633-4dc8-807a-550345661828 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:56.407261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8694dca8-6633-4dc8-807a-550345661828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:56.459055 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:56.463734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134821f4-47ff-4d3e-9e97-026783a06129 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:56.477542 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:56.489446 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 497/1002] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:56.501788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:56.502450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.502734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.503008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.503717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] RBAC: Adding query filter params (interface=public, service_id=6a0c0817e950498fbd08ed5de59e5bb8, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:56.504026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:56.505402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:56.513197 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 506/1003] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:52:56 2022] GET /identity/v3/endpoints?service_id=6a0c0817e950498fbd08ed5de59e5bb8&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:56.519219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694dca8-6633-4dc8-807a-550345661828 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:56.633484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694dca8-6633-4dc8-807a-550345661828 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:56.670153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:56.670768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.671051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.671330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.671941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:56.673309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:56.685904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 498/1004] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:52:56 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:52:56.765329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:56.879890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2eaac-d155-4157-93e5-772f77f166df None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:56.918077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:56.918626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.918901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.919199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] PATH_INFO: `/v3/services/image` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.919805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:56.921160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:56.929955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:56.931178 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:56.932142 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 507/1005] 10.222.0.59 () {56 vars in 1105 bytes} [Sun Aug 28 00:52:56 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:56.939380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:56.999489 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:57.046030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745d2cf-b8f1-4c7f-a753-5af5ac3c8e74 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:57.081683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592ce05-450f-4f36-8c7d-d43cdb05c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:57.082404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592ce05-450f-4f36-8c7d-d43cdb05c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:57.082691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592ce05-450f-4f36-8c7d-d43cdb05c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:57.082967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592ce05-450f-4f36-8c7d-d43cdb05c2e8 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:57.083589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592ce05-450f-4f36-8c7d-d43cdb05c2e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:57.083893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592ce05-450f-4f36-8c7d-d43cdb05c2e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:57.085380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592ce05-450f-4f36-8c7d-d43cdb05c2e8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:57.094944 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 499/1006] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:57.096190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:57.126748 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:57.203521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06f24-3f20-4cbc-9e5c-8f79461c1bc1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:57.238518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69813d-f1f1-4d3a-9f99-6dbc381e84c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:57.239126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69813d-f1f1-4d3a-9f99-6dbc381e84c9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:57.239405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69813d-f1f1-4d3a-9f99-6dbc381e84c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:57.239677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69813d-f1f1-4d3a-9f99-6dbc381e84c9 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:57.240308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69813d-f1f1-4d3a-9f99-6dbc381e84c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:57.240617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69813d-f1f1-4d3a-9f99-6dbc381e84c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:57.242758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69813d-f1f1-4d3a-9f99-6dbc381e84c9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:57.247701 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 508/1007] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:58.249453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa753-13c4-46f3-8c86-db200c4a28d5 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.250060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa753-13c4-46f3-8c86-db200c4a28d5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.250060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa753-13c4-46f3-8c86-db200c4a28d5 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.251590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 500/1008] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:58.256623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41a7f-2878-4cfe-b9f4-6e27f83e71c1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.257535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41a7f-2878-4cfe-b9f4-6e27f83e71c1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.257776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d41a7f-2878-4cfe-b9f4-6e27f83e71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.275670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a6d41a7f-2878-4cfe-b9f4-6e27f83e71c1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:58.276832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a6d41a7f-2878-4cfe-b9f4-6e27f83e71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:58.353977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 509/1009] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:52:58.627270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa753-13c4-46f3-8c86-db200c4a28d5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:58.692699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a69ab3-b7e8-4838-af76-8493239eccb1 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.693392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a69ab3-b7e8-4838-af76-8493239eccb1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.693679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a69ab3-b7e8-4838-af76-8493239eccb1 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.695745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 510/1010] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:58.700919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d60e7-726b-45f1-ad7e-353856fac282 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.701252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d60e7-726b-45f1-ad7e-353856fac282 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.702000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d60e7-726b-45f1-ad7e-353856fac282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.720237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-da1d60e7-726b-45f1-ad7e-353856fac282 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:58.721643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-da1d60e7-726b-45f1-ad7e-353856fac282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:58.741509 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:58.747678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa753-13c4-46f3-8c86-db200c4a28d5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:58.768245 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:58.786412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:58.787041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.787321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.787587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.789433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:58.790880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:58.792676 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 501/1011] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:52:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:58.798165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:58.805843 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 511/1012] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:58.904260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f922e91-4f28-4da5-ae12-f54fa8fbf10f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:58.943035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423d23d-8218-4f50-8437-f358d6a3aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:58.943650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d23d-8218-4f50-8437-f358d6a3aff9 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:58.943950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d23d-8218-4f50-8437-f358d6a3aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:58.944382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d23d-8218-4f50-8437-f358d6a3aff9 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:58.945263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423d23d-8218-4f50-8437-f358d6a3aff9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:58.946984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423d23d-8218-4f50-8437-f358d6a3aff9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:59.041839 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 502/1013] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:58 2022] POST /identity/v3/projects => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:52:59.070639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d60e7-726b-45f1-ad7e-353856fac282 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:59.167414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db507-6a6f-42f2-a3c4-38d7461ae4ca None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.167729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db507-6a6f-42f2-a3c4-38d7461ae4ca None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.167902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999db507-6a6f-42f2-a3c4-38d7461ae4ca None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.169323 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 503/1014] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:52:59.175216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de82d1-49e7-48c0-92b7-94d29e8a7fcc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.175538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de82d1-49e7-48c0-92b7-94d29e8a7fcc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.175771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de82d1-49e7-48c0-92b7-94d29e8a7fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.183568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d60e7-726b-45f1-ad7e-353856fac282 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:59.196740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-33de82d1-49e7-48c0-92b7-94d29e8a7fcc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:59.197981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-33de82d1-49e7-48c0-92b7-94d29e8a7fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:59.228220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:59.229131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.229415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.229885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] PATH_INFO: `/v3/services/compute` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.231498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:59.232214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:59.234202 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:52:59.242124 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:52:59.243230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:52:59.244155 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 512/1015] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:52:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:52:59.249563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:59.268237 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:59.280123 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 504/1016] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:52:59.358670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea68539-0781-4d33-9f55-b7788ee4396d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:59.394348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:59.394952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.395234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.395509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.396134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:59.396439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:59.398513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:59.412420 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 513/1017] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:52:59.413714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de82d1-49e7-48c0-92b7-94d29e8a7fcc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:59.518462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de82d1-49e7-48c0-92b7-94d29e8a7fcc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:59.553999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:59.554632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.554986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.555271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.556428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:59.557201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:52:59.557498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:59.558911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:59.564666 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 505/1018] 10.222.0.59 () {56 vars in 1112 bytes} [Sun Aug 28 00:52:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:52:59.570853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:59.606503 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:59.648098 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:59.672100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34294-02d6-4750-b835-893d3325ae80 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:59.684057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee04a1-b2b8-46ed-b8a4-32f642ec6f28 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:59.711273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc027b-a75c-4999-a3c3-ccd85a83ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:59.712139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc027b-a75c-4999-a3c3-ccd85a83ed13 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.712417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc027b-a75c-4999-a3c3-ccd85a83ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.712707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc027b-a75c-4999-a3c3-ccd85a83ed13 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.713375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc027b-a75c-4999-a3c3-ccd85a83ed13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:59.714791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc027b-a75c-4999-a3c3-ccd85a83ed13 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:59.719275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4330f9-4187-422e-a7ad-c32e28c05388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:59.719884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4330f9-4187-422e-a7ad-c32e28c05388 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.720160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4330f9-4187-422e-a7ad-c32e28c05388 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.720432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4330f9-4187-422e-a7ad-c32e28c05388 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.721096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4330f9-4187-422e-a7ad-c32e28c05388 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:59.722477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4330f9-4187-422e-a7ad-c32e28c05388 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:59.824465 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 514/1019] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:52:59 2022] POST /identity/v3/services => generated 242 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:52:59.861854 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 506/1020] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:52:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:53:01.083253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b928d-6c00-4d8c-8f86-272e991a5249 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.083801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b928d-6c00-4d8c-8f86-272e991a5249 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.083801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b928d-6c00-4d8c-8f86-272e991a5249 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.086267 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 515/1021] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:01.092037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12e749-1c0b-4230-87d4-986daa68e157 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.092538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12e749-1c0b-4230-87d4-986daa68e157 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.092617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12e749-1c0b-4230-87d4-986daa68e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.110837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9f12e749-1c0b-4230-87d4-986daa68e157 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:01.112006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f12e749-1c0b-4230-87d4-986daa68e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:01.196546 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 507/1022] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:01.466929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b928d-6c00-4d8c-8f86-272e991a5249 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:01.574892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b928d-6c00-4d8c-8f86-272e991a5249 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:01.610726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0a0f-a8bf-49f0-bc2b-0336b3fbc608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:01.611376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0a0f-a8bf-49f0-bc2b-0336b3fbc608 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.611657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0a0f-a8bf-49f0-bc2b-0336b3fbc608 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.611931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0a0f-a8bf-49f0-bc2b-0336b3fbc608 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.613083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd0a0f-a8bf-49f0-bc2b-0336b3fbc608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:01.614560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd0a0f-a8bf-49f0-bc2b-0336b3fbc608 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:01.617263 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 516/1023] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:01.622765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12e749-1c0b-4230-87d4-986daa68e157 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:01.640322 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:01.732535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12e749-1c0b-4230-87d4-986daa68e157 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:01.766037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa222-fce1-4c84-9bde-ed7f83a2484b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.766408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa222-fce1-4c84-9bde-ed7f83a2484b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.766633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aa222-fce1-4c84-9bde-ed7f83a2484b None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.767972 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 517/1024] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:53:01.769484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82578450-b8a7-4734-819f-3de5641df843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:01.770138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82578450-b8a7-4734-819f-3de5641df843 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.770418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82578450-b8a7-4734-819f-3de5641df843 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.770695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82578450-b8a7-4734-819f-3de5641df843 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.771360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82578450-b8a7-4734-819f-3de5641df843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:01.773912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82578450-b8a7-4734-819f-3de5641df843 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:01.774634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793494a-d55f-4516-826e-72ae65bcc94f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.775088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793494a-d55f-4516-826e-72ae65bcc94f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.775520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793494a-d55f-4516-826e-72ae65bcc94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.788335 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:01.794287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3793494a-d55f-4516-826e-72ae65bcc94f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:01.795473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3793494a-d55f-4516-826e-72ae65bcc94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:01.864297 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 518/1025] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:01.870231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 508/1026] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:53:01 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:01.949240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d69a7-e9a7-4f8e-b514-01b44290cc4c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.949580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d69a7-e9a7-4f8e-b514-01b44290cc4c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.949794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d69a7-e9a7-4f8e-b514-01b44290cc4c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.951459 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 519/1027] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:01.956963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02fe7-c530-4f7f-ab6f-63718daabc44 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:01.957246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02fe7-c530-4f7f-ab6f-63718daabc44 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:01.957617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02fe7-c530-4f7f-ab6f-63718daabc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:01.976790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-19c02fe7-c530-4f7f-ab6f-63718daabc44 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:01.978049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-19c02fe7-c530-4f7f-ab6f-63718daabc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:02.054521 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:02.059395 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 509/1028] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:02.138657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d69a7-e9a7-4f8e-b514-01b44290cc4c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.248082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d69a7-e9a7-4f8e-b514-01b44290cc4c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.285289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.286183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.286646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.287083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] PATH_INFO: `/v3/services/image` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.288909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.290476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.293482 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:02.300651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:02.301713 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:02.307038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 520/1029] 10.222.0.59 () {56 vars in 1105 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:02.308035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02fe7-c530-4f7f-ab6f-63718daabc44 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.327529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.424916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02fe7-c530-4f7f-ab6f-63718daabc44 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.443122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc036e6-a10f-4e29-a95e-328c959b6df7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.466764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.467376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.467654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.467929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.468571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] RBAC: Adding query filter params (name=image) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:02.468876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.470288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.475870 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 510/1030] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:02.481106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.485193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.485437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.485716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.486069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.497770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:02.502948 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:02.504009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:02.504992 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 521/1031] 10.222.0.59 () {56 vars in 1120 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:02.510527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.551238 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:02.581988 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:02.597186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb1fd1-d691-4f45-b0b2-e26517efd2d9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.624272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f64ca-452b-485a-ba92-4395ae197243 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.633659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.634308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.634593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.634867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.635582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] RBAC: Adding query filter params (type=image) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:02.635889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.637247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.647878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 511/1032] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:02.649553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.664273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.664885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.665166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.665430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.666126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:02.666425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.667790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.676099 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 522/1033] 10.222.0.59 () {56 vars in 1115 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:02.682402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.764825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f212b-67aa-4023-b14f-a7a9d284aa9c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.793186 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:02.802474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aac8b0-dfb5-4619-93c1-b4e3f6ae4ea1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.806010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.806010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.806010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.806010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.806348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] RBAC: Adding query filter params (interface=public, service_id=85e9988b1aa748658927c37af761049c, region_id=RegionOne) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:02.806348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.807013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.820910 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 512/1034] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/endpoints?service_id=85e9988b1aa748658927c37af761049c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:02.822643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.828755 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:02.842649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.843210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.843490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.843756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.854369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.855811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:02.871207 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:02.872228 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:53:02.873231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:02.873231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:02.873231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:02.873231 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 523/1035] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:02.878510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.935725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd935501-9b66-4e7d-81c7-1031623a056d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.975741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:02.976497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.976780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.977170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.977775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:02.979390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:02.982819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8202-3c9e-43bc-8f0d-bcdc1e221722 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:02.997881 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 513/1036] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:53:03.031405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:03.032018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.032363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.032637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.033330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:03.033638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:03.035097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:03.055086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 524/1037] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:03.056878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:03.123196 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:03.169950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d7a64-a9ce-455d-9bdc-30ef55d61cfa None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:03.206013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:03.206657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.206933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.207204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.215685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:03.217154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:53:03.229234 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:03.230298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:03.235952 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 514/1038] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:03.238121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:03.275775 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:03.343403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02900ce8-bc79-4524-b7ba-5e8c16e80752 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:03.377952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:03.378477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.378753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.379019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.379739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:03.380038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:03.382070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:03.404687 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 525/1039] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:53:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:03.407462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:03.516500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7a069-5629-41e2-8b62-525bdfc3bf74 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:03.533307 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:03.551689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:03.552443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.552541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.552812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.623161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:03.624602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:03.729414 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 515/1040] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:03.730787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:03.827008 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:03.836268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321b87e-49e4-4135-88db-a6c2e6a816db None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:03.872818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c4954-0aef-4eed-a8f3-140dffee70ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:03.873475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c4954-0aef-4eed-a8f3-140dffee70ce None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.873752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c4954-0aef-4eed-a8f3-140dffee70ce None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.874054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c4954-0aef-4eed-a8f3-140dffee70ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.885132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c4954-0aef-4eed-a8f3-140dffee70ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:03.886595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c4954-0aef-4eed-a8f3-140dffee70ce None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-158c4954-0aef-4eed-a8f3-140dffee70ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:03.901557 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:03.907507 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:53:03.908458 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:03.908458 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:03.908458 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:03.908458 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 526/1041] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:03.908909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:03.927572 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:03.957246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb838-20fa-4f06-b56c-52334b91c559 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.957524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb838-20fa-4f06-b56c-52334b91c559 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.957796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb838-20fa-4f06-b56c-52334b91c559 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.959435 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 527/1042] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:03.964955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7702b-3782-43ca-9c00-8be8cd55b5cb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.965241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7702b-3782-43ca-9c00-8be8cd55b5cb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.965517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7702b-3782-43ca-9c00-8be8cd55b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.984657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e3f7702b-3782-43ca-9c00-8be8cd55b5cb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:03.985768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e3f7702b-3782-43ca-9c00-8be8cd55b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:04.016647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e71b-46f8-4735-873a-531e15676f23 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.055549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.056160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.056438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.056709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.057417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:04.057650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:04.059031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:04.070231 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 528/1043] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:04.077907 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 516/1044] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:04.080302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7702b-3782-43ca-9c00-8be8cd55b5cb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.161250 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:04.185769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7702b-3782-43ca-9c00-8be8cd55b5cb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.219796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.220424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.220707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.220981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.229243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:04.230740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:53:04.242145 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:04.243552 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:53:04.244868 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:04.246167 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 529/1045] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:04.248972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.330560 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:04.347601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.357024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a9439-cdbf-4124-af3f-647c6c4ca3e3 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.394049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.395000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.395575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.396238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.397647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:04.398125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:04.400849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:04.430770 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 517/1046] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:04.431840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.457930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8084b-5f22-4c0b-b664-b95c6acdee82 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.494783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.495340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.495619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.495894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.497793 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:04.507132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:04.512270 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:04.513471 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:04.518967 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 530/1047] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:04.520575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.551766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee676cd-3a8b-435c-9385-ab158a3f2237 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.588122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.588840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.589137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.589407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.590223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] RBAC: Adding query filter params (role.id=4ad5bb16232d466dbfc628e9136ecde4, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=0ef7d679c29544eeb884f2172e643a59) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:04.590628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:04.592068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:04.595277 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:04.609844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 518/1048] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/role_assignments?user.id=0ef7d679c29544eeb884f2172e643a59&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4ad5bb16232d466dbfc628e9136ecde4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:04.646722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ce03f-0f69-4e0b-91c0-0ef43b086dee None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.689109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.689727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.690033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.690426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.691028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:04.691330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:04.692751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:04.708183 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 531/1049] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:04.711428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.825107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2a8a-36b4-445f-bbd6-d37378401dae None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:04.860207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a72aee-ed63-4113-9b0c-e63eaf38be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:04.860836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72aee-ed63-4113-9b0c-e63eaf38be3f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.876291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72aee-ed63-4113-9b0c-e63eaf38be3f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.876291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72aee-ed63-4113-9b0c-e63eaf38be3f None admin] PATH_INFO: `/v3/users/7a18cc7b3326481288f73142c2834575` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.876291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a72aee-ed63-4113-9b0c-e63eaf38be3f None admin] RBAC: Authorizing `identity:get_user(user_id=7a18cc7b3326481288f73142c2834575)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:04.876542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a72aee-ed63-4113-9b0c-e63eaf38be3f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:04.878425 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 519/1050] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/users/7a18cc7b3326481288f73142c2834575 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:04.885270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:04.925941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e92e9f-703b-4aea-bd0f-79fd59d00ff5 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.926325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e92e9f-703b-4aea-bd0f-79fd59d00ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.926501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e92e9f-703b-4aea-bd0f-79fd59d00ff5 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.928410 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 520/1051] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:04.933905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b69-1618-4017-bd08-c81bd351d90f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:04.934371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b69-1618-4017-bd08-c81bd351d90f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:04.934643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b69-1618-4017-bd08-c81bd351d90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:04.951766 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:04.953506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7fcd8b69-1618-4017-bd08-c81bd351d90f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:04.954731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7fcd8b69-1618-4017-bd08-c81bd351d90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:05.005866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40acb01-4ba4-4a25-8c0d-a3535d8a4c19 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:05.016257 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:05.030332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 521/1052] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:05.043030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:05.043639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.043918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.044288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.115102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:05.117171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:05.173551 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:05.224537 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 532/1053] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:05.225911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8b69-1618-4017-bd08-c81bd351d90f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:05.300600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:05.330357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8b69-1618-4017-bd08-c81bd351d90f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:05.368262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:05.368944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.369199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.369470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.370699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] RBAC: Authorizing `identity:get_project(project_id=54e07cf3cd40414c9acabbfe297aa47d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:05.372116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:05.378871 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 522/1054] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:05 2022] GET /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:05.379795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:05.417996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669a6fb-948b-4673-aef6-6a71e9d2aca2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:05.448393 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:05.457791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:05.462132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.462132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.462132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] PATH_INFO: `/v3/services/image` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.462132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:05.462132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:05.469874 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:05.470884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:05.471753 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 533/1055] 10.222.0.59 () {56 vars in 1105 bytes} [Sun Aug 28 00:53:05 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:05.477543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:05.499344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13b980-8c73-4427-9e5b-d53a2749ab4f None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:05.504104 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:05.534968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:05.535608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.535891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.536166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.536885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=54e07cf3cd40414c9acabbfe297aa47d, user.id=7a18cc7b3326481288f73142c2834575) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:05.537780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:05.539487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:05.545022 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 523/1056] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:05 2022] GET /identity/v3/role_assignments?user.id=7a18cc7b3326481288f73142c2834575&scope.project.id=54e07cf3cd40414c9acabbfe297aa47d&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:05.603842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04244a48-4f6c-4237-857a-b7973f30513a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:05.643318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:05.643858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.644155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.644425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.645078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] RBAC: Adding query filter params (name=image) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:05.645383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:05.648297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:05.654549 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 534/1057] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:05.660500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:05.776140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7848c1-898a-4f7f-b57d-5ab0f0248f78 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:05.797518 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:05.812505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd0a1d-7cb7-42a4-be68-651dc36a930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:05.813117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0a1d-7cb7-42a4-be68-651dc36a930e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.813399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0a1d-7cb7-42a4-be68-651dc36a930e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.816707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0a1d-7cb7-42a4-be68-651dc36a930e None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.816707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd0a1d-7cb7-42a4-be68-651dc36a930e None admin] RBAC: Adding query filter params (type=image) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:05.816707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd0a1d-7cb7-42a4-be68-651dc36a930e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:05.816707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd0a1d-7cb7-42a4-be68-651dc36a930e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:05.827012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 524/1058] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:05.828782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:05.920857 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:05.937915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb36fb2-7fee-4197-aa5d-f4c82df22e47 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:05.974814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98d5e0-b181-4367-ae01-f1ffa97ff6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:05.976117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98d5e0-b181-4367-ae01-f1ffa97ff6f8 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.976403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98d5e0-b181-4367-ae01-f1ffa97ff6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.976680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98d5e0-b181-4367-ae01-f1ffa97ff6f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.977364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98d5e0-b181-4367-ae01-f1ffa97ff6f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:05.978768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98d5e0-b181-4367-ae01-f1ffa97ff6f8 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:06.100900 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 535/1059] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:53:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:06.543033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb400e46-b28d-4b3b-91d0-6c3700280699 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:06.543572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb400e46-b28d-4b3b-91d0-6c3700280699 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:06.543572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb400e46-b28d-4b3b-91d0-6c3700280699 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:06.545108 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 525/1060] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:06.550162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca097cc-bca4-4fc2-9da3-28c1a0f3f632 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:06.550621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca097cc-bca4-4fc2-9da3-28c1a0f3f632 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:06.550710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca097cc-bca4-4fc2-9da3-28c1a0f3f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:06.570347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2ca097cc-bca4-4fc2-9da3-28c1a0f3f632 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:06.571784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2ca097cc-bca4-4fc2-9da3-28c1a0f3f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:06.652895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 536/1061] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:06.921152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb400e46-b28d-4b3b-91d0-6c3700280699 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:07.026604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb400e46-b28d-4b3b-91d0-6c3700280699 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:07.061049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:07.061686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.061995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.062268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.074943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:07.079757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:07.080740 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:53:07.081624 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:07.086439 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 526/1062] 10.222.0.59 () {56 vars in 1120 bytes} [Sun Aug 28 00:53:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:07.087796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca097cc-bca4-4fc2-9da3-28c1a0f3f632 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:07.157231 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:07.197277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca097cc-bca4-4fc2-9da3-28c1a0f3f632 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:07.235325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:07.235937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.236218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.236492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.237159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:07.237461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:07.238863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:07.253149 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 537/1063] 10.222.0.59 () {56 vars in 1115 bytes} [Sun Aug 28 00:53:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:07.255006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:07.309989 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:07.365699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72787a-4825-4ff7-91cf-8f9729604bca None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:07.401783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8122e23-775a-4e63-a04c-fc14901f8ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:07.405153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8122e23-775a-4e63-a04c-fc14901f8ffc None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.405153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8122e23-775a-4e63-a04c-fc14901f8ffc None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.405153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8122e23-775a-4e63-a04c-fc14901f8ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.417312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8122e23-775a-4e63-a04c-fc14901f8ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:07.421255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8122e23-775a-4e63-a04c-fc14901f8ffc None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f8122e23-775a-4e63-a04c-fc14901f8ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:07.437510 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:07.438634 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:53:07.445118 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:07.445118 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:07.445118 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:07.445118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 527/1064] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:07.447377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:07.458273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab69f6-1a19-417c-a876-449620f163e5 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.458556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab69f6-1a19-417c-a876-449620f163e5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.458835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab69f6-1a19-417c-a876-449620f163e5 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.460945 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 528/1065] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:53:07.466109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa17604-f1c4-4c8d-8d0e-f79de193c434 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.466395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa17604-f1c4-4c8d-8d0e-f79de193c434 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.466676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa17604-f1c4-4c8d-8d0e-f79de193c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.485582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3fa17604-f1c4-4c8d-8d0e-f79de193c434 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:07.486799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3fa17604-f1c4-4c8d-8d0e-f79de193c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:07.559641 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 529/1066] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:07.560857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cfe0d-b32f-454d-a364-7fb04e7c6c69 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:07.593541 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:07.601693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:07.602340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.602620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.602891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.603535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:07.603838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:07.605259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:07.617695 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 538/1067] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:07.623800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa17604-f1c4-4c8d-8d0e-f79de193c434 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:07.652943 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:07.729188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa17604-f1c4-4c8d-8d0e-f79de193c434 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:07.763723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:07.764348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.764625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.764892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.772425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:07.773863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:53:07.785218 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:07.786280 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:07.787995 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 530/1068] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:53:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:07.792228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:07.851659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:07.901666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e6940-5fa3-476e-bcde-aa69ab0d665f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:07.942857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:07.944679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:07.945212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:07.945945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:07.946878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:07.947379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:07.947986 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:07.949007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:07.962807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5173-72de-4c8f-8749-0b0e65342d50 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:07.974053 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 539/1069] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:53:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:07.976592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.001824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.002495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.002748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.003002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.014825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:08.020057 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:08.021005 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:08.022336 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 531/1070] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:08.027349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.029134 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.083153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e959d7d-32bd-430d-8a4e-0b87d5300094 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.118984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fff35-ddc1-4652-929c-1de445629750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.119619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fff35-ddc1-4652-929c-1de445629750 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.121267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fff35-ddc1-4652-929c-1de445629750 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.121267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fff35-ddc1-4652-929c-1de445629750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.130862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054ae53-db78-4ccd-a522-10bad94f0c38 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.131847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fff35-ddc1-4652-929c-1de445629750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.133378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fff35-ddc1-4652-929c-1de445629750 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-b10fff35-ddc1-4652-929c-1de445629750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:08.148994 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:08.150098 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:53:08.151011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:08.151011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:08.151011 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:08.151011 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 540/1071] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:08.151376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704845ad-6a02-4db2-9579-f5fb9d3347ae None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.151662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704845ad-6a02-4db2-9579-f5fb9d3347ae None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.151917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704845ad-6a02-4db2-9579-f5fb9d3347ae None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.153193 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 541/1072] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:08.156235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704845ad-6a02-4db2-9579-f5fb9d3347ae None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.173892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dba012-4474-4c3f-a5c0-c28364bfcaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.174515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba012-4474-4c3f-a5c0-c28364bfcaed None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.174791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba012-4474-4c3f-a5c0-c28364bfcaed None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.175063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba012-4474-4c3f-a5c0-c28364bfcaed None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.175728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dba012-4474-4c3f-a5c0-c28364bfcaed None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:08.176071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dba012-4474-4c3f-a5c0-c28364bfcaed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.177440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dba012-4474-4c3f-a5c0-c28364bfcaed None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.186780 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 532/1073] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:08.188119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0536f6-c058-44a3-913d-fab2b43d9303 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.188485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0536f6-c058-44a3-913d-fab2b43d9303 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.188833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0536f6-c058-44a3-913d-fab2b43d9303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.206582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0a0536f6-c058-44a3-913d-fab2b43d9303 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:08.207776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0a0536f6-c058-44a3-913d-fab2b43d9303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:08.211163 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.257651 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.262221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704845ad-6a02-4db2-9579-f5fb9d3347ae None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.275744 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 533/1074] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:08.276639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0536f6-c058-44a3-913d-fab2b43d9303 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.299369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.300114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.300490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.300914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.301654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:08.301994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.303385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.317857 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 542/1075] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:08.321555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.388117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0536f6-c058-44a3-913d-fab2b43d9303 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.432463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee10936-eb20-45d7-b7cd-59e8a5e6c915 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.433142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.434085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.434513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.434995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] PATH_INFO: `/v3/users/7a18cc7b3326481288f73142c2834575` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.436166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] RBAC: Authorizing `identity:get_user(user_id=7a18cc7b3326481288f73142c2834575)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.437606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.444915 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 534/1076] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/users/7a18cc7b3326481288f73142c2834575 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:08.445563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.454954 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.475032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.475661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.475968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.476214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.483003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.484432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:53:08.495834 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:08.496987 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:53:08.498152 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:08.501843 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 543/1077] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:08.502642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.523603 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.557233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea47137-3843-47e1-8530-c0a52e51ca44 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.591147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.591799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.592072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.592351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.593457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] RBAC: Authorizing `identity:get_project(project_id=54e07cf3cd40414c9acabbfe297aa47d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.594912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.596585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 535/1078] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:08.597401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.608688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb016-b5ec-4ab8-bda1-f37e264d4357 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.644559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.645171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.645453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.645725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.647196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:08.647732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.649231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.662606 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 544/1079] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:08.663949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.677887 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.702261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc18d2-d9df-448b-9d8a-73016a2491de None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.736650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.737256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.737537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.737829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.745578 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.766277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23fc8-978c-4992-a612-37a3113405c0 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.807691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.808273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.808449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.808551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.808815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d/users/7a18cc7b3326481288f73142c2834575/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.809952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.810840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] RBAC: Authorizing `identity:create_grant(project_id=54e07cf3cd40414c9acabbfe297aa47d, user_id=7a18cc7b3326481288f73142c2834575, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:08.812265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:08.884784 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.904425 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 545/1080] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:53:08 2022] PUT /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d/users/7a18cc7b3326481288f73142c2834575/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:53:08.905473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.911494 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 536/1081] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:08.918163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:09.027701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c21d2-03a5-47e1-83ab-bb0b4624dbca None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:09.044015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57700f0-7880-4c6c-a100-1ad1ca5f0ff1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:09.071956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db40f0-b907-4c79-98d3-18d29a0817f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:09.072909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db40f0-b907-4c79-98d3-18d29a0817f4 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:09.073195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db40f0-b907-4c79-98d3-18d29a0817f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:09.073471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db40f0-b907-4c79-98d3-18d29a0817f4 None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/0ef7d679c29544eeb884f2172e643a59/roles/4ad5bb16232d466dbfc628e9136ecde4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:09.075891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db40f0-b907-4c79-98d3-18d29a0817f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=0ef7d679c29544eeb884f2172e643a59, role_id=4ad5bb16232d466dbfc628e9136ecde4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:09.077280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db40f0-b907-4c79-98d3-18d29a0817f4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:09.084009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:09.084649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:09.084929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:09.085200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:09.096938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:09.101307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:09.114290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:09.116126 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:53:09.117190 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:09.117190 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:09.117190 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:09.117190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 537/1082] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:09.122275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:09.149496 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:09.150753 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:09.156244 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 546/1083] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:53:08 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/0ef7d679c29544eeb884f2172e643a59/roles/4ad5bb16232d466dbfc628e9136ecde4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:53:09.251868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00e931-3161-4a61-ad6e-2995e9b88beb None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:09.293478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4358c1-42ab-44df-9e53-f06dffa6fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:09.294171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4358c1-42ab-44df-9e53-f06dffa6fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:09.294457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4358c1-42ab-44df-9e53-f06dffa6fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:09.294731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4358c1-42ab-44df-9e53-f06dffa6fcd5 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:09.295390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4358c1-42ab-44df-9e53-f06dffa6fcd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:09.295741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4358c1-42ab-44df-9e53-f06dffa6fcd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:09.297922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4358c1-42ab-44df-9e53-f06dffa6fcd5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:09.314093 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 538/1084] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:10.850751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53e974-ca05-48af-bf0c-4d802a0cd1a4 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:10.851320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53e974-ca05-48af-bf0c-4d802a0cd1a4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:10.851320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53e974-ca05-48af-bf0c-4d802a0cd1a4 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:10.852640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 547/1085] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:10.857884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4917-c454-407e-b0ac-19405ccf18e6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:10.858319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4917-c454-407e-b0ac-19405ccf18e6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:10.858444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4917-c454-407e-b0ac-19405ccf18e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:10.877527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e7cd4917-c454-407e-b0ac-19405ccf18e6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:10.878831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e7cd4917-c454-407e-b0ac-19405ccf18e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:10.947434 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 539/1086] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:11.059031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da6b84-c867-4d9f-b129-e4f88e709f5c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.059310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da6b84-c867-4d9f-b129-e4f88e709f5c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.059579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da6b84-c867-4d9f-b129-e4f88e709f5c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.061040 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 548/1087] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:11.066334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e54d1-bff3-4720-8d14-9696d840086d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.066630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e54d1-bff3-4720-8d14-9696d840086d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.066911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e54d1-bff3-4720-8d14-9696d840086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.086443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a05e54d1-bff3-4720-8d14-9696d840086d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:11.087637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a05e54d1-bff3-4720-8d14-9696d840086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:11.098516 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.156538 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 540/1088] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:11.225367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da6b84-c867-4d9f-b129-e4f88e709f5c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.327255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da6b84-c867-4d9f-b129-e4f88e709f5c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.360405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.361027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.361308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.361582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.372415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:11.377101 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:11.381908 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:11.383072 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 549/1089] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:11.384769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e54d1-bff3-4720-8d14-9696d840086d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.432425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.489983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e54d1-bff3-4720-8d14-9696d840086d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.492063 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.525772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.526406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.526686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.526958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.527663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:11.527968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:11.529420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:11.533641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cbe69-5458-4619-bdec-940bd6dcb42e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.542895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 541/1090] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:11.544017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.555359 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.570285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.573672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.573672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.573672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.581539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:11.586299 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:11.587453 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:11.588646 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 550/1091] 10.222.0.59 () {56 vars in 1120 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:11.593470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.648299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37fbbe-2c3c-4658-9fab-92fd559f0828 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.687312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.687853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.688186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.688460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] PATH_INFO: `/v3/users/7a18cc7b3326481288f73142c2834575` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.689603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] RBAC: Authorizing `identity:get_user(user_id=7a18cc7b3326481288f73142c2834575)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:11.691051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:11.692663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 542/1092] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/users/7a18cc7b3326481288f73142c2834575 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:11.698686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.701122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408406b-d65b-40f0-861b-5354e3f44fe8 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.721772 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.740221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.740821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.741098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.741366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.742057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:11.742353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:11.743707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:11.751830 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 551/1093] 10.222.0.59 () {56 vars in 1115 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:11.757481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.777537 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.800268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f01e-6299-45e2-92c4-8cdb0f276b35 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.836074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.836685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.836964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.837342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.858995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dd980-2807-4ae0-a731-873c006c0e39 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.893653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.894340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.894624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.894898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.905857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:11.906013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:11.907365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:11.907479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:11.922968 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:11.923973 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:53:11.924901 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:11.924901 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:11.924901 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:11.924901 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 552/1094] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:11.931424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.965653 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.983750 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:12.012321 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 543/1095] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:53:12.013511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:12.044209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f558ae-e89e-4f59-8602-8d5a031c3ac2 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:12.078877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:12.079704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:12.079981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:12.080257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:12.080882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:12.081179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:12.082558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:12.095060 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 553/1096] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:12.101051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:12.115281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffc56d-9205-49a1-93a9-2fc5210de56e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:12.150959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:12.151600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:12.151881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:12.152155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:12.153334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] RBAC: Authorizing `identity:get_project(project_id=54e07cf3cd40414c9acabbfe297aa47d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:12.154813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:12.156511 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 544/1097] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:12 2022] GET /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:12.162811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:12.191325 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:12.201170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f6687-beff-4e98-bc69-f690fb20b097 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:12.210805 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:12.235259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:12.235811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:12.236088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:12.236358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:12.243490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:12.244966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:53:12.256928 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:12.258284 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:53:12.259499 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:12.262190 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 554/1098] 10.222.0.59 () {56 vars in 1093 bytes} [Sun Aug 28 00:53:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:12.264141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:12.267384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d0dd3-9d96-44fc-8481-a4ec33a650d8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:12.304163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:12.304760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:12.305042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:12.305314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:12.306068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=54e07cf3cd40414c9acabbfe297aa47d, user.id=7a18cc7b3326481288f73142c2834575) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:12.306424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:12.307894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:12.313836 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 545/1099] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:12 2022] GET /identity/v3/role_assignments?user.id=7a18cc7b3326481288f73142c2834575&scope.project.id=54e07cf3cd40414c9acabbfe297aa47d&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:12.377454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce66203-4ee2-40d0-804b-d2b053569fd7 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:12.417120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:12.417743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:12.418057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:12.418388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:12.419074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:12.419383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:12.420851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:12.442171 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 555/1100] 10.222.0.59 () {56 vars in 1133 bytes} [Sun Aug 28 00:53:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:12.449133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:12.549456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2e687-9eb3-46b0-a298-e444f6d930cd None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:12.559834 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:12.584617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:12.585271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:12.585546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:12.585834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:12.658907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:12.660341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:12.757774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 546/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:12.763663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:12.776993 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:12.867042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ab542-dcf4-444f-a6c0-a69e94adb03a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:12.903309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:12.903939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:12.904218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:12.904489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:12.914593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:12.916026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:12.930504 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:12.931636 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:53:12.932559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:12.932559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:53:12.932559 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:12.932559 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 556/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:53:12.937300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:12.948115 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:13.035689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b49b22-e0f5-46e2-9c4b-f8ea095b9b3a None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:13.068402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:13.069005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:13.069277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:13.069544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:13.070199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:13.070754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:13.072086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:13.082965 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 547/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:13.089407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:13.152751 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:13.191477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50fe59-36b2-442d-b08e-08cdb70cf723 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:13.225479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:13.226188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:13.226467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:13.226739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:13.233275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:13.234847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:53:13.247053 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:13.248406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:13.249353 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 557/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:13.253935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:13.321094 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:13.354491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09033fa-ead3-46ff-87cc-64ee04873c57 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:13.393109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a825d-c960-4e7f-9d8e-a4299bb20f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:13.393784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a825d-c960-4e7f-9d8e-a4299bb20f11 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:13.394140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a825d-c960-4e7f-9d8e-a4299bb20f11 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:13.394411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a825d-c960-4e7f-9d8e-a4299bb20f11 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:13.395396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a825d-c960-4e7f-9d8e-a4299bb20f11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:13.395704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a825d-c960-4e7f-9d8e-a4299bb20f11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:13.397520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a825d-c960-4e7f-9d8e-a4299bb20f11 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:13.417343 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 548/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:13.418912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:13.525277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed5ef-cc14-4332-9e6d-ac5769ada69c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:13.549922 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:13.563144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db4d07-b5a4-4555-a582-01d4eca9912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:13.563803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4d07-b5a4-4555-a582-01d4eca9912f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:13.564081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4d07-b5a4-4555-a582-01d4eca9912f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:13.564348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4d07-b5a4-4555-a582-01d4eca9912f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:13.565108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db4d07-b5a4-4555-a582-01d4eca9912f None admin] RBAC: Adding query filter params (role.id=4ad5bb16232d466dbfc628e9136ecde4, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=0ef7d679c29544eeb884f2172e643a59) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:13.565412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db4d07-b5a4-4555-a582-01d4eca9912f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:13.566847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db4d07-b5a4-4555-a582-01d4eca9912f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:13.573471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 558/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:13 2022] GET /identity/v3/role_assignments?user.id=0ef7d679c29544eeb884f2172e643a59&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4ad5bb16232d466dbfc628e9136ecde4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:14.491554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9abd-790b-412a-a44d-e420971f4c7c None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:14.492131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9abd-790b-412a-a44d-e420971f4c7c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:14.492131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9abd-790b-412a-a44d-e420971f4c7c None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:14.493464 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 549/1107] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:14.498639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320387d2-13ac-47d2-8581-831b596b72f9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:14.499073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320387d2-13ac-47d2-8581-831b596b72f9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:14.499172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320387d2-13ac-47d2-8581-831b596b72f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:14.517195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-320387d2-13ac-47d2-8581-831b596b72f9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:14.518392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-320387d2-13ac-47d2-8581-831b596b72f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:14.584405 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 559/1108] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:14.854634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa9abd-790b-412a-a44d-e420971f4c7c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:14.956706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa9abd-790b-412a-a44d-e420971f4c7c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:14.984250 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:14.992490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d4c65-2338-45dc-9176-08ad7c8c000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:15.000599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4c65-2338-45dc-9176-08ad7c8c000e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:15.000599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4c65-2338-45dc-9176-08ad7c8c000e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:15.000599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d4c65-2338-45dc-9176-08ad7c8c000e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:15.000599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d4c65-2338-45dc-9176-08ad7c8c000e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:15.000599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d4c65-2338-45dc-9176-08ad7c8c000e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:15.000599 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 550/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:15.003429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320387d2-13ac-47d2-8581-831b596b72f9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:15.102233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320387d2-13ac-47d2-8581-831b596b72f9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:15.118796 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:15.135526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccef85-5c55-45bd-b2d7-2b241f1ce3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:15.137905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccef85-5c55-45bd-b2d7-2b241f1ce3fa None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:15.137905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccef85-5c55-45bd-b2d7-2b241f1ce3fa None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:15.137905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccef85-5c55-45bd-b2d7-2b241f1ce3fa None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:15.137905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccef85-5c55-45bd-b2d7-2b241f1ce3fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:15.138763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccef85-5c55-45bd-b2d7-2b241f1ce3fa None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:15.256989 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 560/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:53:15 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:17.203920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf970bf-6a03-47e6-9708-15f76d31f2a1 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:17.204496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf970bf-6a03-47e6-9708-15f76d31f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:17.204496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf970bf-6a03-47e6-9708-15f76d31f2a1 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:17.206031 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 551/1111] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:17.211882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e5790-93df-48eb-8c72-98ab794532cf None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:17.212312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e5790-93df-48eb-8c72-98ab794532cf None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:17.212415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e5790-93df-48eb-8c72-98ab794532cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:17.230877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-874e5790-93df-48eb-8c72-98ab794532cf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:17.232065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-874e5790-93df-48eb-8c72-98ab794532cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:17.298850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 561/1112] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:17.580582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf970bf-6a03-47e6-9708-15f76d31f2a1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:17.681263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf970bf-6a03-47e6-9708-15f76d31f2a1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:17.715345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:17.715972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:17.716250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:17.716519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] PATH_INFO: `/v3/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:17.717915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] RBAC: Authorizing `identity:get_role(role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:17.719260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:17.720606 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 552/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:17 2022] GET /identity/v3/roles/91d76748bf16477db62b3cd689f60fd2 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:17.727206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e5790-93df-48eb-8c72-98ab794532cf None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:17.824082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e5790-93df-48eb-8c72-98ab794532cf None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:17.825608 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:17.859628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:17.860200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:17.860500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:17.860770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] PATH_INFO: `/v3/users/00faee3bd8f54f3aa4ef3d9a812543a4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:17.874172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] RBAC: Authorizing `identity:get_user(user_id=00faee3bd8f54f3aa4ef3d9a812543a4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:17.875600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:17.877209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 562/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:17 2022] GET /identity/v3/users/00faee3bd8f54f3aa4ef3d9a812543a4 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:17.883450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:17.946151 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:17.983349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733bfc4-e639-4b5b-84e6-867b93e561ab None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:18.017603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:18.018230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:18.018514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:18.018789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:18.085832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:18.087276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:18.146910 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:18.183607 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 553/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:18.189599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:18.287342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66c650-4102-428a-9a2b-9fa8517b9db9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:18.320787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab6d3e-5b4e-44fb-90bb-532b4e07688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:18.321435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab6d3e-5b4e-44fb-90bb-532b4e07688e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:18.321712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab6d3e-5b4e-44fb-90bb-532b4e07688e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:18.322012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab6d3e-5b4e-44fb-90bb-532b4e07688e None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:18.323102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab6d3e-5b4e-44fb-90bb-532b4e07688e None admin] RBAC: Authorizing `identity:get_project(project_id=54e07cf3cd40414c9acabbfe297aa47d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:18.324575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab6d3e-5b4e-44fb-90bb-532b4e07688e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:18.326254 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 563/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:18 2022] GET /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:18.332520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:18.430902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a6f09-2164-4bd6-b0fb-18cbc3ef5537 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:18.464513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7be9-fac3-4d1d-ab0c-fcab034bce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:18.465101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7be9-fac3-4d1d-ab0c-fcab034bce0f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:18.465379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7be9-fac3-4d1d-ab0c-fcab034bce0f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:18.465649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7be9-fac3-4d1d-ab0c-fcab034bce0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:18.466391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7be9-fac3-4d1d-ab0c-fcab034bce0f None admin] RBAC: Adding query filter params (role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=54e07cf3cd40414c9acabbfe297aa47d, user.id=00faee3bd8f54f3aa4ef3d9a812543a4) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:18.466691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7be9-fac3-4d1d-ab0c-fcab034bce0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:18.468088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7be9-fac3-4d1d-ab0c-fcab034bce0f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:18.473341 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 554/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:18 2022] GET /identity/v3/role_assignments?user.id=00faee3bd8f54f3aa4ef3d9a812543a4&scope.project.id=54e07cf3cd40414c9acabbfe297aa47d&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:20.385378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e271782-4d21-4732-abe9-3cc05fe9810a None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:20.385977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e271782-4d21-4732-abe9-3cc05fe9810a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:20.385977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e271782-4d21-4732-abe9-3cc05fe9810a None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:20.387322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 564/1118] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:20.392545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12a12-6584-42ce-a6f1-ff6e2e1736b4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:20.392989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12a12-6584-42ce-a6f1-ff6e2e1736b4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:20.393092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12a12-6584-42ce-a6f1-ff6e2e1736b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:20.412028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4de12a12-6584-42ce-a6f1-ff6e2e1736b4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:20.413253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4de12a12-6584-42ce-a6f1-ff6e2e1736b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:20.435903 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:20.480683 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 555/1119] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:20.763885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e271782-4d21-4732-abe9-3cc05fe9810a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:20.791568 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:20.863766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e271782-4d21-4732-abe9-3cc05fe9810a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:20.898257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:20.898866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:20.899142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:20.899411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] PATH_INFO: `/v3/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:20.900772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] RBAC: Authorizing `identity:get_role(role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:20.902151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:20.903511 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 565/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:20 2022] GET /identity/v3/roles/91d76748bf16477db62b3cd689f60fd2 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:20.909483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de12a12-6584-42ce-a6f1-ff6e2e1736b4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:21.008388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de12a12-6584-42ce-a6f1-ff6e2e1736b4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:21.041832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:21.042403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:21.042680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:21.042951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] PATH_INFO: `/v3/users/00faee3bd8f54f3aa4ef3d9a812543a4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:21.044056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] RBAC: Authorizing `identity:get_user(user_id=00faee3bd8f54f3aa4ef3d9a812543a4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:21.045471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:21.047105 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 556/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:20 2022] GET /identity/v3/users/00faee3bd8f54f3aa4ef3d9a812543a4 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:21.053590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:21.148725 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:21.154554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cb028-e528-410c-bee4-de5a386410df None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:21.189450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1397f-ee57-4b0c-8280-71afb97b5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:21.190081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1397f-ee57-4b0c-8280-71afb97b5058 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:21.190357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1397f-ee57-4b0c-8280-71afb97b5058 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:21.190624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1397f-ee57-4b0c-8280-71afb97b5058 None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:21.191709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1397f-ee57-4b0c-8280-71afb97b5058 None admin] RBAC: Authorizing `identity:get_project(project_id=54e07cf3cd40414c9acabbfe297aa47d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:21.193679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1397f-ee57-4b0c-8280-71afb97b5058 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:21.195598 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 566/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:21 2022] GET /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:21.201625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:21.230133 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:21.300776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9e285-7fc7-458f-beee-b5f560d867c1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:21.334117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a67b62-4266-41a7-b94f-bfd837ee2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:21.334763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a67b62-4266-41a7-b94f-bfd837ee2a5f None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:21.335038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a67b62-4266-41a7-b94f-bfd837ee2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:21.335306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a67b62-4266-41a7-b94f-bfd837ee2a5f None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d/users/00faee3bd8f54f3aa4ef3d9a812543a4/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:21.337388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a67b62-4266-41a7-b94f-bfd837ee2a5f None admin] RBAC: Authorizing `identity:create_grant(project_id=54e07cf3cd40414c9acabbfe297aa47d, user_id=00faee3bd8f54f3aa4ef3d9a812543a4, role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:21.338810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a67b62-4266-41a7-b94f-bfd837ee2a5f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:21.416256 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 557/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:53:21 2022] PUT /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d/users/00faee3bd8f54f3aa4ef3d9a812543a4/roles/91d76748bf16477db62b3cd689f60fd2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:53:23.307433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e9aec-e3aa-4a65-840b-be2829d52f4e None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:23.307996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e9aec-e3aa-4a65-840b-be2829d52f4e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:23.307996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e9aec-e3aa-4a65-840b-be2829d52f4e None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:23.309384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 567/1124] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:23.314499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05250318-2f47-4dd6-8d08-cff3758d46d5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:23.314907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05250318-2f47-4dd6-8d08-cff3758d46d5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:23.315041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05250318-2f47-4dd6-8d08-cff3758d46d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:23.332986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-05250318-2f47-4dd6-8d08-cff3758d46d5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:23.334285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-05250318-2f47-4dd6-8d08-cff3758d46d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:23.399765 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 558/1125] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:23.669247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e9aec-e3aa-4a65-840b-be2829d52f4e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:23.770367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e9aec-e3aa-4a65-840b-be2829d52f4e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:23.804334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:23.804962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:23.805241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:23.805517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] PATH_INFO: `/v3/roles/91d76748bf16477db62b3cd689f60fd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:23.806920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] RBAC: Authorizing `identity:get_role(role_id=91d76748bf16477db62b3cd689f60fd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:23.808290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:23.809655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 568/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:23 2022] GET /identity/v3/roles/91d76748bf16477db62b3cd689f60fd2 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:23.815551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05250318-2f47-4dd6-8d08-cff3758d46d5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:23.834133 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:23.917082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05250318-2f47-4dd6-8d08-cff3758d46d5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:23.951730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:23.952282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:23.952565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:23.952843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] PATH_INFO: `/v3/users/00faee3bd8f54f3aa4ef3d9a812543a4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:23.953984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] RBAC: Authorizing `identity:get_user(user_id=00faee3bd8f54f3aa4ef3d9a812543a4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:23.955414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:23.957035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 559/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:23 2022] GET /identity/v3/users/00faee3bd8f54f3aa4ef3d9a812543a4 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:23.963429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:23.995095 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:24.067786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48325b4-6979-4c56-b1c2-796e773657dd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:24.102347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:24.102949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:24.103229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:24.103499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:24.171366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:24.172827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:24.203159 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:24.272229 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 569/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:24.278542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:24.359305 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:24.374853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4c33a-8cd2-4dda-90ec-90d81da80977 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:24.409167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999cbb3-6581-4ce2-b75c-2c78e8023f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:24.409797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999cbb3-6581-4ce2-b75c-2c78e8023f03 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:24.410098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999cbb3-6581-4ce2-b75c-2c78e8023f03 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:24.410374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999cbb3-6581-4ce2-b75c-2c78e8023f03 None admin] PATH_INFO: `/v3/projects/54e07cf3cd40414c9acabbfe297aa47d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:24.412224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999cbb3-6581-4ce2-b75c-2c78e8023f03 None admin] RBAC: Authorizing `identity:get_project(project_id=54e07cf3cd40414c9acabbfe297aa47d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:24.413635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999cbb3-6581-4ce2-b75c-2c78e8023f03 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:24.415351 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 560/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:24 2022] GET /identity/v3/projects/54e07cf3cd40414c9acabbfe297aa47d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:24.421629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:24.522527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64d854-6220-489b-a143-e3de503ad084 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:24.553186 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:24.558088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce1088-5f2a-47a3-9d10-5acd8614e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:24.558685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce1088-5f2a-47a3-9d10-5acd8614e60d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:24.558968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce1088-5f2a-47a3-9d10-5acd8614e60d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:24.559241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce1088-5f2a-47a3-9d10-5acd8614e60d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:24.559992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce1088-5f2a-47a3-9d10-5acd8614e60d None admin] RBAC: Adding query filter params (role.id=91d76748bf16477db62b3cd689f60fd2, scope.project.id=54e07cf3cd40414c9acabbfe297aa47d, user.id=00faee3bd8f54f3aa4ef3d9a812543a4) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:24.560304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce1088-5f2a-47a3-9d10-5acd8614e60d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:24.561745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce1088-5f2a-47a3-9d10-5acd8614e60d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:24.567729 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 570/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:24 2022] GET /identity/v3/role_assignments?user.id=00faee3bd8f54f3aa4ef3d9a812543a4&scope.project.id=54e07cf3cd40414c9acabbfe297aa47d&role.id=91d76748bf16477db62b3cd689f60fd2 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:26.514082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b5c3-27d1-4103-b742-9c68196eb13e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:26.514631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b5c3-27d1-4103-b742-9c68196eb13e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:26.514631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610b5c3-27d1-4103-b742-9c68196eb13e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:26.515987 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 561/1131] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:26.522224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d872-365b-484d-beba-b127599c3eb6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:26.522661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d872-365b-484d-beba-b127599c3eb6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:26.522764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d872-365b-484d-beba-b127599c3eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:26.540541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-13e1d872-365b-484d-beba-b127599c3eb6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:26.541720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13e1d872-365b-484d-beba-b127599c3eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:26.608738 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 571/1132] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:26.890049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b5c3-27d1-4103-b742-9c68196eb13e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:26.992992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610b5c3-27d1-4103-b742-9c68196eb13e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:27.027343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f914c35-610b-4c9a-a749-8407696a74e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:27.027967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914c35-610b-4c9a-a749-8407696a74e2 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:27.028255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914c35-610b-4c9a-a749-8407696a74e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:27.028530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914c35-610b-4c9a-a749-8407696a74e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:27.029634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914c35-610b-4c9a-a749-8407696a74e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:27.031424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914c35-610b-4c9a-a749-8407696a74e2 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:27.033223 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 562/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:27.039576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d872-365b-484d-beba-b127599c3eb6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:27.137371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d872-365b-484d-beba-b127599c3eb6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:27.164049 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:27.172301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60170a-841d-4abb-aa83-682eb3bf0038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:27.178906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60170a-841d-4abb-aa83-682eb3bf0038 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:27.178906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60170a-841d-4abb-aa83-682eb3bf0038 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:27.178906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60170a-841d-4abb-aa83-682eb3bf0038 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:27.178906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60170a-841d-4abb-aa83-682eb3bf0038 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:27.178906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60170a-841d-4abb-aa83-682eb3bf0038 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:27.268124 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 572/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:53:27 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:29.227774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4030c3-c543-415a-be93-e8d294761bfb None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:29.228342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4030c3-c543-415a-be93-e8d294761bfb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:29.228342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4030c3-c543-415a-be93-e8d294761bfb None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:29.229712 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 563/1135] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:29.236148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbb81f-8c5f-4be9-bd08-f94e3dc938cc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:29.236575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbb81f-8c5f-4be9-bd08-f94e3dc938cc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:29.236692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbb81f-8c5f-4be9-bd08-f94e3dc938cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:29.255855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-44fbb81f-8c5f-4be9-bd08-f94e3dc938cc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:29.257032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-44fbb81f-8c5f-4be9-bd08-f94e3dc938cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:29.323732 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 573/1136] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:29.597941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4030c3-c543-415a-be93-e8d294761bfb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:29.619804 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:29.702614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4030c3-c543-415a-be93-e8d294761bfb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:29.735175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98383a3-31a5-42b1-b696-fe575391afd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:29.735799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98383a3-31a5-42b1-b696-fe575391afd3 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:29.736079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98383a3-31a5-42b1-b696-fe575391afd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:29.736351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98383a3-31a5-42b1-b696-fe575391afd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:29.737453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98383a3-31a5-42b1-b696-fe575391afd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:29.739618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98383a3-31a5-42b1-b696-fe575391afd3 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:29.741315 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 564/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:53:29.747463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbb81f-8c5f-4be9-bd08-f94e3dc938cc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:29.849480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbb81f-8c5f-4be9-bd08-f94e3dc938cc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:29.858692 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:29.884224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9c888-308d-4f1b-ad09-90c22e2f8e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:29.884822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c888-308d-4f1b-ad09-90c22e2f8e29 None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:29.885106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c888-308d-4f1b-ad09-90c22e2f8e29 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:29.885382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c888-308d-4f1b-ad09-90c22e2f8e29 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:29.886057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9c888-308d-4f1b-ad09-90c22e2f8e29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:29.887506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9c888-308d-4f1b-ad09-90c22e2f8e29 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:29.993296 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 574/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:53:29 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:31.983236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ecb3-9973-4de8-bc39-cda9ac6c3666 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:31.983804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ecb3-9973-4de8-bc39-cda9ac6c3666 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:31.983804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7ecb3-9973-4de8-bc39-cda9ac6c3666 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:31.985167 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 565/1139] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:31.991274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ed5cd-f361-4829-b949-f8b503d850d3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:31.991733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ed5cd-f361-4829-b949-f8b503d850d3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:31.991832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ed5cd-f361-4829-b949-f8b503d850d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:32.012148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c58ed5cd-f361-4829-b949-f8b503d850d3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:32.013360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c58ed5cd-f361-4829-b949-f8b503d850d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:32.080202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 575/1140] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:32.353704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ecb3-9973-4de8-bc39-cda9ac6c3666 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:32.441409 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:32.454954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7ecb3-9973-4de8-bc39-cda9ac6c3666 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:32.487924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:32.488567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:32.488840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:32.489106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:32.498836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:32.503538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:32.505249 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:32.506494 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 566/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:32.511559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ed5cd-f361-4829-b949-f8b503d850d3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:32.604022 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:32.610502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ed5cd-f361-4829-b949-f8b503d850d3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:32.644536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:32.645702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:32.646122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:32.646397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:32.647060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:32.647360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:32.648820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:32.657067 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 576/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:32.663933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:32.764622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567eb3-d6ae-4f64-9289-655c8b3a0fbb None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:32.798054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:32.798682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:32.798963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:32.799241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] PATH_INFO: `/v3/users/05355ff7a31b49b2bf245c8b9bd70e34` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:32.812787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] RBAC: Authorizing `identity:get_user(user_id=05355ff7a31b49b2bf245c8b9bd70e34)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:32.814246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:32.815961 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 567/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:32 2022] GET /identity/v3/users/05355ff7a31b49b2bf245c8b9bd70e34 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:32.823034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:32.926340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978b22-05d9-4833-8f23-6cf9d5e72b34 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:32.961063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:32.961661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:32.961976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:32.962260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:32.986646 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:33.028800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:33.030270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:33.126438 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 577/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:53:33.133297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:33.142044 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:33.232357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf7d89-98e1-4729-bcd0-81cdccd228f6 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:33.265633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9cc9-07ae-4c33-ade8-d1f887c45e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:33.266297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9cc9-07ae-4c33-ade8-d1f887c45e32 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:33.266578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9cc9-07ae-4c33-ade8-d1f887c45e32 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:33.266853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9cc9-07ae-4c33-ade8-d1f887c45e32 None admin] PATH_INFO: `/v3/projects/d41ed207fb8f4139836b7299d148e338` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:33.267963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9cc9-07ae-4c33-ade8-d1f887c45e32 None admin] RBAC: Authorizing `identity:get_project(project_id=d41ed207fb8f4139836b7299d148e338)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:33.269375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9cc9-07ae-4c33-ade8-d1f887c45e32 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:33.271622 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 568/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:33 2022] GET /identity/v3/projects/d41ed207fb8f4139836b7299d148e338 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:33.278017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:33.332365 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:33.375277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739e315-96a2-4e39-b66a-1a2c8f30b1e1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:33.410267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6eda-8cab-4356-b719-3392f3617fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:33.410872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6eda-8cab-4356-b719-3392f3617fc0 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:33.411156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6eda-8cab-4356-b719-3392f3617fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:33.411429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6eda-8cab-4356-b719-3392f3617fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:33.412149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6eda-8cab-4356-b719-3392f3617fc0 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=d41ed207fb8f4139836b7299d148e338, user.id=05355ff7a31b49b2bf245c8b9bd70e34) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:33.412459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6eda-8cab-4356-b719-3392f3617fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:33.414051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6eda-8cab-4356-b719-3392f3617fc0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:33.419724 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 578/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:33 2022] GET /identity/v3/role_assignments?user.id=05355ff7a31b49b2bf245c8b9bd70e34&scope.project.id=d41ed207fb8f4139836b7299d148e338&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:35.280809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aaeca-72e4-4c21-aea9-6314582507ba None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:35.281480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aaeca-72e4-4c21-aea9-6314582507ba None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:35.281480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61aaeca-72e4-4c21-aea9-6314582507ba None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:35.282741 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 569/1147] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:35.288345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3060a62-5003-4d04-8992-f293c51c7bcb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:35.288773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3060a62-5003-4d04-8992-f293c51c7bcb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:35.288892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3060a62-5003-4d04-8992-f293c51c7bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:35.307171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c3060a62-5003-4d04-8992-f293c51c7bcb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:35.308340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3060a62-5003-4d04-8992-f293c51c7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:35.374081 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 579/1148] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:35.648075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61aaeca-72e4-4c21-aea9-6314582507ba None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:35.723807 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:35.749828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61aaeca-72e4-4c21-aea9-6314582507ba None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:35.785826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:35.786511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:35.786863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:35.787142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:35.797475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:35.802978 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:35.804182 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:35.805134 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 570/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:35.810344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3060a62-5003-4d04-8992-f293c51c7bcb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:35.858418 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:35.908252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3060a62-5003-4d04-8992-f293c51c7bcb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:35.941478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:35.942115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:35.942399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:35.943281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:35.944175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:35.944472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:35.945851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:35.953921 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 580/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:35.959961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:36.062632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96789c-eff7-4b89-8de4-12f6ea4e7718 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:36.096778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:36.097397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:36.097677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:36.097980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] PATH_INFO: `/v3/users/05355ff7a31b49b2bf245c8b9bd70e34` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:36.099336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=05355ff7a31b49b2bf245c8b9bd70e34)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:36.100860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:36.102490 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 571/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:35 2022] GET /identity/v3/users/05355ff7a31b49b2bf245c8b9bd70e34 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:36.108415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:36.207197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59093056-c6c4-4100-a6eb-449e32bdbc77 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:36.220410 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:36.240803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3548dae-da54-4e31-9b2c-b23b40cbfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:36.241420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3548dae-da54-4e31-9b2c-b23b40cbfbb2 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:36.241738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3548dae-da54-4e31-9b2c-b23b40cbfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:36.242058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3548dae-da54-4e31-9b2c-b23b40cbfbb2 None admin] PATH_INFO: `/v3/projects/d41ed207fb8f4139836b7299d148e338` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:36.243164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3548dae-da54-4e31-9b2c-b23b40cbfbb2 None admin] RBAC: Authorizing `identity:get_project(project_id=d41ed207fb8f4139836b7299d148e338)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:36.244581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3548dae-da54-4e31-9b2c-b23b40cbfbb2 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:36.246272 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 581/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:36 2022] GET /identity/v3/projects/d41ed207fb8f4139836b7299d148e338 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:36.252266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:36.255641 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:36.354539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2858fcf-aaf2-43b1-a8f7-0a27d4474ce3 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:36.388291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5a8c5-75c3-47d5-b20f-9e632ceb0f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:36.389004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a8c5-75c3-47d5-b20f-9e632ceb0f98 None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:36.389324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a8c5-75c3-47d5-b20f-9e632ceb0f98 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:36.389610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a8c5-75c3-47d5-b20f-9e632ceb0f98 None admin] PATH_INFO: `/v3/projects/d41ed207fb8f4139836b7299d148e338/users/05355ff7a31b49b2bf245c8b9bd70e34/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:36.391775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5a8c5-75c3-47d5-b20f-9e632ceb0f98 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41ed207fb8f4139836b7299d148e338, user_id=05355ff7a31b49b2bf245c8b9bd70e34, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:36.393201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5a8c5-75c3-47d5-b20f-9e632ceb0f98 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:36.472713 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 572/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:53:36 2022] PUT /identity/v3/projects/d41ed207fb8f4139836b7299d148e338/users/05355ff7a31b49b2bf245c8b9bd70e34/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:53:38.393500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fb0f-5760-4278-ac0a-30cec2311a58 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:38.394191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fb0f-5760-4278-ac0a-30cec2311a58 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:38.394191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fb0f-5760-4278-ac0a-30cec2311a58 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:38.395459 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 582/1154] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:38.401563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c75dd-1a54-422c-88d6-ce2a971efa2e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:38.402026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c75dd-1a54-422c-88d6-ce2a971efa2e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:38.402117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c75dd-1a54-422c-88d6-ce2a971efa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:38.419647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3d0c75dd-1a54-422c-88d6-ce2a971efa2e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:38.420847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d0c75dd-1a54-422c-88d6-ce2a971efa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:38.476089 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:38.485945 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 573/1155] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:38.753061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6fb0f-5760-4278-ac0a-30cec2311a58 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:38.859558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6fb0f-5760-4278-ac0a-30cec2311a58 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:38.893083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:38.893700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:38.894010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:38.894320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:38.904962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:38.909691 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:38.910833 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:38.912140 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 583/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:38.917067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c75dd-1a54-422c-88d6-ce2a971efa2e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:39.014224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c75dd-1a54-422c-88d6-ce2a971efa2e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:39.047156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:39.047755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:39.048030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:39.048298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:39.048951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:39.049250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:39.050614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:39.058998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 574/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:39.064788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:39.107231 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:39.166639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1febeb0-34f2-4d89-8fcf-474d7d229b6b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:39.200355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:39.201001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:39.201342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:39.201621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] PATH_INFO: `/v3/users/05355ff7a31b49b2bf245c8b9bd70e34` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:39.202760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] RBAC: Authorizing `identity:get_user(user_id=05355ff7a31b49b2bf245c8b9bd70e34)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:39.204186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:39.205782 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 584/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:39 2022] GET /identity/v3/users/05355ff7a31b49b2bf245c8b9bd70e34 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:39.211886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:39.266151 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:39.309440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217ece1-d760-49c7-be26-6f7233823fb5 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:39.341888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:39.342515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:39.342791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:39.343059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:39.408158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:39.409598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:39.464635 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:39.509517 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 575/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:39.515433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:39.617101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6ae64-ff64-4e2b-9c1f-d8f05016ddc5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:39.625938 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:39.650147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fc26e-49cc-4888-b958-2e158c2b33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:39.650761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc26e-49cc-4888-b958-2e158c2b33fe None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:39.651040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc26e-49cc-4888-b958-2e158c2b33fe None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:39.651309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc26e-49cc-4888-b958-2e158c2b33fe None admin] PATH_INFO: `/v3/projects/d41ed207fb8f4139836b7299d148e338` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:39.652402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fc26e-49cc-4888-b958-2e158c2b33fe None admin] RBAC: Authorizing `identity:get_project(project_id=d41ed207fb8f4139836b7299d148e338)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:39.653833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fc26e-49cc-4888-b958-2e158c2b33fe None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:39.655496 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 585/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:39 2022] GET /identity/v3/projects/d41ed207fb8f4139836b7299d148e338 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:39.661749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:39.760608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aace8-d918-4e60-ab51-f497c5a91770 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:39.796769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721826a-498b-4fca-acd6-c3eaaa95d21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:39.797370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721826a-498b-4fca-acd6-c3eaaa95d21e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:39.797660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721826a-498b-4fca-acd6-c3eaaa95d21e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:39.797942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721826a-498b-4fca-acd6-c3eaaa95d21e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:39.798662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721826a-498b-4fca-acd6-c3eaaa95d21e None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=d41ed207fb8f4139836b7299d148e338, user.id=05355ff7a31b49b2bf245c8b9bd70e34) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:39.798969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721826a-498b-4fca-acd6-c3eaaa95d21e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:39.800394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721826a-498b-4fca-acd6-c3eaaa95d21e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:39.806257 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 576/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:39 2022] GET /identity/v3/role_assignments?user.id=05355ff7a31b49b2bf245c8b9bd70e34&scope.project.id=d41ed207fb8f4139836b7299d148e338&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:41.762010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b9eb-7d74-4f94-a3fa-5e46bb86bf84 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:41.762574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b9eb-7d74-4f94-a3fa-5e46bb86bf84 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:41.762574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b9eb-7d74-4f94-a3fa-5e46bb86bf84 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:41.763947 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 586/1162] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:41.769107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695310-5fd9-4c77-afe4-7903a979eec1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:41.769546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695310-5fd9-4c77-afe4-7903a979eec1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:41.769650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695310-5fd9-4c77-afe4-7903a979eec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:41.788381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-93695310-5fd9-4c77-afe4-7903a979eec1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:41.789579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-93695310-5fd9-4c77-afe4-7903a979eec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:41.802400 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:41.856070 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 577/1163] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:42.131628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b9eb-7d74-4f94-a3fa-5e46bb86bf84 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:42.232724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b9eb-7d74-4f94-a3fa-5e46bb86bf84 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:42.266244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:42.266841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:42.267122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:42.267397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:42.312241 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:42.334977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:42.336421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:42.433684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 587/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:42.439576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695310-5fd9-4c77-afe4-7903a979eec1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:42.536107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695310-5fd9-4c77-afe4-7903a979eec1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:42.569006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c118edd-dad6-4cef-ac49-7ca12fa055b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:42.569622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118edd-dad6-4cef-ac49-7ca12fa055b3 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:42.569931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118edd-dad6-4cef-ac49-7ca12fa055b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:42.570203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c118edd-dad6-4cef-ac49-7ca12fa055b3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:42.576684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c118edd-dad6-4cef-ac49-7ca12fa055b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:42.578131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c118edd-dad6-4cef-ac49-7ca12fa055b3 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-7c118edd-dad6-4cef-ac49-7ca12fa055b3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:42.589798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:42.591030 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:42.592255 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 578/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:53:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:42.597011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:42.676202 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:42.700136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d0a3d-3403-4152-8eb9-f648b2ee6d52 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:42.734035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906d018-9d36-48c1-ae59-65263929f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:42.734633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d018-9d36-48c1-ae59-65263929f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:42.734913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d018-9d36-48c1-ae59-65263929f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:42.735185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d018-9d36-48c1-ae59-65263929f8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:42.735889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906d018-9d36-48c1-ae59-65263929f8c4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:42.736187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906d018-9d36-48c1-ae59-65263929f8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:42.737547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906d018-9d36-48c1-ae59-65263929f8c4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:42.744700 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 588/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Sun Aug 28 00:53:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:44.620634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c233-f999-48d4-9239-fb03fd0735c2 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:44.621166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c233-f999-48d4-9239-fb03fd0735c2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:44.621166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c233-f999-48d4-9239-fb03fd0735c2 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:44.622685 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 579/1167] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:44.627984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ecb83-2521-49fb-b506-371278a1f98c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:44.628475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ecb83-2521-49fb-b506-371278a1f98c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:44.628571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ecb83-2521-49fb-b506-371278a1f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:44.646397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a48ecb83-2521-49fb-b506-371278a1f98c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:44.648149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a48ecb83-2521-49fb-b506-371278a1f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:44.713401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 589/1168] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:44.981290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066c233-f999-48d4-9239-fb03fd0735c2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:44.993188 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:45.083744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066c233-f999-48d4-9239-fb03fd0735c2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:45.117826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec9b9a-80ad-4898-a9bc-251da3beb2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:45.118445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9b9a-80ad-4898-a9bc-251da3beb2b7 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:45.118722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9b9a-80ad-4898-a9bc-251da3beb2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:45.119100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9b9a-80ad-4898-a9bc-251da3beb2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:45.119776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec9b9a-80ad-4898-a9bc-251da3beb2b7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:45.121127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec9b9a-80ad-4898-a9bc-251da3beb2b7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:45.221027 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 580/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Sun Aug 28 00:53:44 2022] POST /identity/v3/domains => generated 267 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:47.133130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9020e63-991c-47ce-af04-77195efe82e3 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:47.133712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9020e63-991c-47ce-af04-77195efe82e3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:47.133712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9020e63-991c-47ce-af04-77195efe82e3 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:47.135064 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 590/1170] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:47.140390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846827d-6fff-488e-8c41-6371146dd6d0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:47.140784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846827d-6fff-488e-8c41-6371146dd6d0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:47.140955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846827d-6fff-488e-8c41-6371146dd6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:47.159455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9846827d-6fff-488e-8c41-6371146dd6d0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:47.160643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9846827d-6fff-488e-8c41-6371146dd6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:47.222920 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:47.229017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 581/1171] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:47.502358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9020e63-991c-47ce-af04-77195efe82e3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:47.575876 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:47.608023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9020e63-991c-47ce-af04-77195efe82e3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:47.642525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75dc2a-3259-4859-9faf-9f44439cdb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:47.643147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75dc2a-3259-4859-9faf-9f44439cdb7f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:47.643425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75dc2a-3259-4859-9faf-9f44439cdb7f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:47.643696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75dc2a-3259-4859-9faf-9f44439cdb7f None admin] PATH_INFO: `/v3/domains/a6e08c6a59d347b7ba5b79c09956a0d9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:47.654756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75dc2a-3259-4859-9faf-9f44439cdb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=a6e08c6a59d347b7ba5b79c09956a0d9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:47.656203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75dc2a-3259-4859-9faf-9f44439cdb7f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:47.658034 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 591/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Sun Aug 28 00:53:47 2022] GET /identity/v3/domains/a6e08c6a59d347b7ba5b79c09956a0d9 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:47.664836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846827d-6fff-488e-8c41-6371146dd6d0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:47.761750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846827d-6fff-488e-8c41-6371146dd6d0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:47.795322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b028b-b83d-4338-a2ef-3030537c73d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:47.795915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b028b-b83d-4338-a2ef-3030537c73d2 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:47.796194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b028b-b83d-4338-a2ef-3030537c73d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:47.796465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b028b-b83d-4338-a2ef-3030537c73d2 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:47.797105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b028b-b83d-4338-a2ef-3030537c73d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:47.798555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b028b-b83d-4338-a2ef-3030537c73d2 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:47.895027 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 582/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:53:47 2022] POST /identity/v3/projects => generated 361 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:49.810461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8feae6-6ff5-40ef-9c7f-a4773940f3b8 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:49.811023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8feae6-6ff5-40ef-9c7f-a4773940f3b8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:49.811023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8feae6-6ff5-40ef-9c7f-a4773940f3b8 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:49.812439 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 592/1174] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:49.818138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9105-a96c-4859-84de-b3fb1c867a56 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:49.818612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9105-a96c-4859-84de-b3fb1c867a56 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:49.818718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9105-a96c-4859-84de-b3fb1c867a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:49.837111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-81cb9105-a96c-4859-84de-b3fb1c867a56 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:49.838317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-81cb9105-a96c-4859-84de-b3fb1c867a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:49.883354 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:49.903720 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 583/1175] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:50.185853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8feae6-6ff5-40ef-9c7f-a4773940f3b8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:50.290363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8feae6-6ff5-40ef-9c7f-a4773940f3b8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:50.318983 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:50.324361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aff34-9585-446e-97ee-147fb477dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:50.324977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aff34-9585-446e-97ee-147fb477dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:50.325253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aff34-9585-446e-97ee-147fb477dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:50.325522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aff34-9585-446e-97ee-147fb477dbb5 None admin] PATH_INFO: `/v3/domains/a6e08c6a59d347b7ba5b79c09956a0d9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:50.326682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aff34-9585-446e-97ee-147fb477dbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a6e08c6a59d347b7ba5b79c09956a0d9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:50.338211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aff34-9585-446e-97ee-147fb477dbb5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:50.338211 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 593/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Sun Aug 28 00:53:50 2022] GET /identity/v3/domains/a6e08c6a59d347b7ba5b79c09956a0d9 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:50.338463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9105-a96c-4859-84de-b3fb1c867a56 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:50.434144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9105-a96c-4859-84de-b3fb1c867a56 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:50.466977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cc98c-bad0-4389-aecd-ab3d27a3762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:50.467515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cc98c-bad0-4389-aecd-ab3d27a3762b None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:50.467794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cc98c-bad0-4389-aecd-ab3d27a3762b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:50.468066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cc98c-bad0-4389-aecd-ab3d27a3762b None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:50.468704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cc98c-bad0-4389-aecd-ab3d27a3762b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:50.470162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cc98c-bad0-4389-aecd-ab3d27a3762b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:50.574065 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 584/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:53:50 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:53:52.503200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf41fa-1739-4220-84cc-0ef7c5355004 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:52.503763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf41fa-1739-4220-84cc-0ef7c5355004 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:52.503763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf41fa-1739-4220-84cc-0ef7c5355004 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:52.505131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 594/1178] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:52.510825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7442a-61ca-4532-85ad-f53d397770c9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:52.511219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7442a-61ca-4532-85ad-f53d397770c9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:52.511380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7442a-61ca-4532-85ad-f53d397770c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:52.529268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-05a7442a-61ca-4532-85ad-f53d397770c9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:52.530495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-05a7442a-61ca-4532-85ad-f53d397770c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:52.561195 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:52.598481 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 585/1179] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:53:52.876684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf41fa-1739-4220-84cc-0ef7c5355004 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:52.980613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf41fa-1739-4220-84cc-0ef7c5355004 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:53.015262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:53.015886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:53.016167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:53.016441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:53.027418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:53.032162 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:53.035238 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:53.036346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 595/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:53.039707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7442a-61ca-4532-85ad-f53d397770c9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:53.139351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7442a-61ca-4532-85ad-f53d397770c9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:53.173218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:53.173890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:53.174173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:53.174447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:53.175110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:53.175415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:53.176776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:53.185668 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 586/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:53.191532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:53.252983 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:53.294526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1bd42-91a8-479d-a6ac-d826a91d463c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:53.329904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:53.330527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:53.330814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:53.331096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] PATH_INFO: `/v3/users/938da91b6d3040819d7c12581743f301` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:53.344907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] RBAC: Authorizing `identity:get_user(user_id=938da91b6d3040819d7c12581743f301)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:53.346379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:53.348007 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 596/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:53 2022] GET /identity/v3/users/938da91b6d3040819d7c12581743f301 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:53.354368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:53.384009 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:53.455525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4b4c-82b6-4fd4-965f-3bc5691a4623 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:53.488257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:53.488865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:53.489146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:53.489419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:53.556761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:53.558250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:53.585161 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:53.655984 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 587/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:53:53.662207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:53.769461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7008b-4e31-4ebf-a8a6-c8ebdf85880a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:53.787233 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:53.806588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dad638-e138-46d9-8ce1-a5731a60f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:53.807243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dad638-e138-46d9-8ce1-a5731a60f08d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:53.807523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dad638-e138-46d9-8ce1-a5731a60f08d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:53.807795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dad638-e138-46d9-8ce1-a5731a60f08d None admin] PATH_INFO: `/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:53.809800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dad638-e138-46d9-8ce1-a5731a60f08d None admin] RBAC: Authorizing `identity:get_project(project_id=45d2a5e83dbd46c0850f0fdfa1739192)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:53.810524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dad638-e138-46d9-8ce1-a5731a60f08d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:53.812318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 597/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:53 2022] GET /identity/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:53.819614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:53.922307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852dc0c5-40b4-4d07-aa2f-373db171a24c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:53.952751 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:53.960900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9196-6a07-4037-82b0-135979a56736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:53.961529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9196-6a07-4037-82b0-135979a56736 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:53.961797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9196-6a07-4037-82b0-135979a56736 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:53.962102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9196-6a07-4037-82b0-135979a56736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:53.962860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9196-6a07-4037-82b0-135979a56736 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=45d2a5e83dbd46c0850f0fdfa1739192, user.id=938da91b6d3040819d7c12581743f301) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:53.963167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9196-6a07-4037-82b0-135979a56736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:53.964596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9196-6a07-4037-82b0-135979a56736 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:53.970650 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 588/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:53:53 2022] GET /identity/v3/role_assignments?user.id=938da91b6d3040819d7c12581743f301&scope.project.id=45d2a5e83dbd46c0850f0fdfa1739192&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:55.900612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690188-d726-4137-a85f-1854db09c1d4 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:55.901184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690188-d726-4137-a85f-1854db09c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:55.901184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87690188-d726-4137-a85f-1854db09c1d4 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:55.902586 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 598/1186] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:55.908132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60a7b-cc20-429d-85a8-67c87b639a49 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:55.908603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60a7b-cc20-429d-85a8-67c87b639a49 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:55.908742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60a7b-cc20-429d-85a8-67c87b639a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:55.928008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3fe60a7b-cc20-429d-85a8-67c87b639a49 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:55.929239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3fe60a7b-cc20-429d-85a8-67c87b639a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:55.995895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 589/1187] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:56.269391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690188-d726-4137-a85f-1854db09c1d4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:56.382641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87690188-d726-4137-a85f-1854db09c1d4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:56.425230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:56.425918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:56.426203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:56.426474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:56.438085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:56.443949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:56.445236 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:53:56.446214 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 599/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:56.451214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe60a7b-cc20-429d-85a8-67c87b639a49 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:56.554620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe60a7b-cc20-429d-85a8-67c87b639a49 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:56.579158 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:56.591000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:56.591621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:56.591905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:56.592182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:56.596103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:56.596103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:56.596103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:56.603918 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 590/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:56.610146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:56.657840 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:56.713915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ab2b4-a357-444e-b2da-8cde06e7a8b1 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:56.748453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:56.749082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:56.749355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:56.749623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] PATH_INFO: `/v3/users/938da91b6d3040819d7c12581743f301` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:56.750758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] RBAC: Authorizing `identity:get_user(user_id=938da91b6d3040819d7c12581743f301)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:56.752181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:56.753772 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 600/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:56 2022] GET /identity/v3/users/938da91b6d3040819d7c12581743f301 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:56.760333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:56.860657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f45e4-6243-4ab3-82be-de784eb70c1d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:56.896687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef039fb5-5d17-4dd2-945e-247fdf1fc6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:56.897325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef039fb5-5d17-4dd2-945e-247fdf1fc6d1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:56.897607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef039fb5-5d17-4dd2-945e-247fdf1fc6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:56.897907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef039fb5-5d17-4dd2-945e-247fdf1fc6d1 None admin] PATH_INFO: `/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:56.899029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef039fb5-5d17-4dd2-945e-247fdf1fc6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=45d2a5e83dbd46c0850f0fdfa1739192)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:56.900452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef039fb5-5d17-4dd2-945e-247fdf1fc6d1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:56.902151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 591/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:53:56 2022] GET /identity/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:56.908715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:57.013016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5f478-7f02-423d-9266-26b60506c436 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:57.026608 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:57.047544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b7c86-2691-4aab-bfac-6e8283a6461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:57.057063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7c86-2691-4aab-bfac-6e8283a6461b None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:57.057063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7c86-2691-4aab-bfac-6e8283a6461b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:57.057063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7c86-2691-4aab-bfac-6e8283a6461b None admin] PATH_INFO: `/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192/users/938da91b6d3040819d7c12581743f301/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:57.057063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b7c86-2691-4aab-bfac-6e8283a6461b None admin] RBAC: Authorizing `identity:create_grant(project_id=45d2a5e83dbd46c0850f0fdfa1739192, user_id=938da91b6d3040819d7c12581743f301, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:57.057063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b7c86-2691-4aab-bfac-6e8283a6461b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:57.145095 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 601/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:53:56 2022] PUT /identity/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192/users/938da91b6d3040819d7c12581743f301/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:53:59.140987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585135b-e7e8-4ba4-ae07-4392c9a673e4 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:59.141623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585135b-e7e8-4ba4-ae07-4392c9a673e4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:59.141623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585135b-e7e8-4ba4-ae07-4392c9a673e4 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:59.143084 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 592/1193] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:59.150371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10865db2-c344-4223-80ee-60f21eaf4b70 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:59.150985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10865db2-c344-4223-80ee-60f21eaf4b70 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:59.150985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10865db2-c344-4223-80ee-60f21eaf4b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:59.172168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-10865db2-c344-4223-80ee-60f21eaf4b70 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:59.173423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-10865db2-c344-4223-80ee-60f21eaf4b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:59.248213 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 602/1194] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:53:59.525783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585135b-e7e8-4ba4-ae07-4392c9a673e4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:59.584132 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:59.636121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585135b-e7e8-4ba4-ae07-4392c9a673e4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:59.671698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:59.672293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:59.672532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:59.672806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:59.683361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:53:59.688825 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:53:59.690093 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:53:59.691038 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 593/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:53:59.696468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10865db2-c344-4223-80ee-60f21eaf4b70 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:59.794748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10865db2-c344-4223-80ee-60f21eaf4b70 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:59.796276 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:59.828237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:59.828831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:59.829169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:59.829646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:59.830583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:53:59.830915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:59.833261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:59.841719 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 603/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:53:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:59.847833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:59.947963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332de00-bee0-4a83-a60a-6f3e5160c0b8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:59.960940 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:59.981123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:59.981761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:59.982074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:59.982351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] PATH_INFO: `/v3/users/938da91b6d3040819d7c12581743f301` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:59.983526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] RBAC: Authorizing `identity:get_user(user_id=938da91b6d3040819d7c12581743f301)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:59.984974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:59.986633 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 594/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Sun Aug 28 00:53:59 2022] GET /identity/v3/users/938da91b6d3040819d7c12581743f301 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:53:59.992672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:00.093834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec48a9-763e-4312-9a00-b4b6c93aa79b None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:00.126458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:00.127048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:00.127328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:00.127595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:00.159090 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:00.206077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:00.207467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:00.308856 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 604/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:53:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:54:00.314805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:00.413970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f504d9-7a99-4629-ba94-851eed4e6cba None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:00.449079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8d36b-8593-4328-81a6-f91e738bf14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:00.449712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8d36b-8593-4328-81a6-f91e738bf14d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:00.450027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8d36b-8593-4328-81a6-f91e738bf14d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:00.450304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8d36b-8593-4328-81a6-f91e738bf14d None admin] PATH_INFO: `/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:00.451414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8d36b-8593-4328-81a6-f91e738bf14d None admin] RBAC: Authorizing `identity:get_project(project_id=45d2a5e83dbd46c0850f0fdfa1739192)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:00.452869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8d36b-8593-4328-81a6-f91e738bf14d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:00.454568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 595/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Sun Aug 28 00:54:00 2022] GET /identity/v3/projects/45d2a5e83dbd46c0850f0fdfa1739192 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:00.460794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:00.520972 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:00.557647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56657ec-ee35-47d6-a842-64ab7389ee1a None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:00.592356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de59bc7-f58d-4d1b-a901-4bd4043b84e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:00.592944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59bc7-f58d-4d1b-a901-4bd4043b84e4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:00.593219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59bc7-f58d-4d1b-a901-4bd4043b84e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:00.593485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59bc7-f58d-4d1b-a901-4bd4043b84e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:00.594254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de59bc7-f58d-4d1b-a901-4bd4043b84e4 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=45d2a5e83dbd46c0850f0fdfa1739192, user.id=938da91b6d3040819d7c12581743f301) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:00.594555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de59bc7-f58d-4d1b-a901-4bd4043b84e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:00.596018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de59bc7-f58d-4d1b-a901-4bd4043b84e4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:00.601699 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 605/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:54:00 2022] GET /identity/v3/role_assignments?user.id=938da91b6d3040819d7c12581743f301&scope.project.id=45d2a5e83dbd46c0850f0fdfa1739192&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:10.444932 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=76 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:10.599112 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=36 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:19.575739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cba8a4-a1ee-4035-a34d-4ea447c17f5d None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:19.576338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cba8a4-a1ee-4035-a34d-4ea447c17f5d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:19.576338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cba8a4-a1ee-4035-a34d-4ea447c17f5d None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:19.577648 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 596/1201] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:19.582945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14a0f6-ed20-4730-8e5b-5276d8d72f40 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:19.586734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14a0f6-ed20-4730-8e5b-5276d8d72f40 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:19.586734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14a0f6-ed20-4730-8e5b-5276d8d72f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:19.602147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fa14a0f6-ed20-4730-8e5b-5276d8d72f40 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:19.603299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fa14a0f6-ed20-4730-8e5b-5276d8d72f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:19.672252 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 606/1202] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:19.951479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cba8a4-a1ee-4035-a34d-4ea447c17f5d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:20.055432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cba8a4-a1ee-4035-a34d-4ea447c17f5d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:20.090185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:20.097157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.097157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.097157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.101654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:20.103319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:20.118078 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:20.120039 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:20.121156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:20.121156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:20.121156 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:20.121156 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 597/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:20.126336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14a0f6-ed20-4730-8e5b-5276d8d72f40 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:20.226754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14a0f6-ed20-4730-8e5b-5276d8d72f40 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:20.255514 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:20.261239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a562a1e-3ba1-4156-8066-43fff8088b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:20.261935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562a1e-3ba1-4156-8066-43fff8088b5e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.262218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562a1e-3ba1-4156-8066-43fff8088b5e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.262487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a562a1e-3ba1-4156-8066-43fff8088b5e None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.263120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a562a1e-3ba1-4156-8066-43fff8088b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:20.263418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a562a1e-3ba1-4156-8066-43fff8088b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:20.264773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a562a1e-3ba1-4156-8066-43fff8088b5e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:20.276790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 607/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:20.282943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:20.338180 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:20.383418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d1a64-25cb-4f66-803e-c6f54bf71cb7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:20.417151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0fbba-1b9e-4c9c-9cc0-1d0dfa520f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:20.422269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0fbba-1b9e-4c9c-9cc0-1d0dfa520f8f None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:20.422269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0fbba-1b9e-4c9c-9cc0-1d0dfa520f8f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:20.422269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0fbba-1b9e-4c9c-9cc0-1d0dfa520f8f None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:20.422269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0fbba-1b9e-4c9c-9cc0-1d0dfa520f8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:20.422269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0fbba-1b9e-4c9c-9cc0-1d0dfa520f8f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:20.532952 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 598/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Sun Aug 28 00:55:20 2022] POST /identity/v3/users => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:55:22.531943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000c55-ca46-4e54-9acc-11f2f73605b2 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.532500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000c55-ca46-4e54-9acc-11f2f73605b2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.532500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000c55-ca46-4e54-9acc-11f2f73605b2 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.533882 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 608/1206] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:22.539274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60fad1-5adb-4e45-a9d8-93e7ffe6af6f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:22.539717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60fad1-5adb-4e45-a9d8-93e7ffe6af6f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:22.539818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60fad1-5adb-4e45-a9d8-93e7ffe6af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:22.559003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6c60fad1-5adb-4e45-a9d8-93e7ffe6af6f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:22.568785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6c60fad1-5adb-4e45-a9d8-93e7ffe6af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:22.626549 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 599/1207] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:22.893834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000c55-ca46-4e54-9acc-11f2f73605b2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:22.999242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000c55-ca46-4e54-9acc-11f2f73605b2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.033703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.034450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.034717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.034985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.045550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:55:23.050214 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:23.051324 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:23.052649 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 609/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:55:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:23.058685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60fad1-5adb-4e45-a9d8-93e7ffe6af6f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.100025 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:23.160772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60fad1-5adb-4e45-a9d8-93e7ffe6af6f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.194941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.195549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.195830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.196102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.196763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:23.197179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.199645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.207553 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 600/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:23.213396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.264270 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:23.313000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8232dd-0b8d-4578-bcbf-63ac3c3f8755 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.345612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.346249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.346522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.346788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.357501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.358949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:23.373349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:23.383186 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:23.384211 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:23.384211 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:23.384211 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:23.384211 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 610/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:23.384457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.480028 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:23.482834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1b1c8-d298-40f0-80af-635b1d96fb95 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.516006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.516607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.516903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.517151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.517776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:23.518103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.519486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.531464 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 601/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:23.537757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.641257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfa7a0-b01f-4d12-b795-3df60c127a6e None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.642895 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:23.679722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.680352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.680632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.680904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.689549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.691061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:55:23.703009 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:23.704251 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:23.705382 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 611/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:23.710014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.809016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5cf61-3a63-4e4e-ba57-3f55e946ea16 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:23.845306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:23.845942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:23.846229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:23.846506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:23.847235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:23.847541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:23.848947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:23.867529 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 602/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:23.874023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:23.975545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46a2fd-6adf-4c20-8ae6-6b26732c91e9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.010364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.011032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.011305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.011582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.041558 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.080540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.081958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.181040 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 612/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:55:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:55:24.188130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.207135 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.287520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdfcd2-dd17-4b55-9210-7b85c281722e None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.323097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.323727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.324005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.324275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.334503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.335902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:24.350625 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:24.351741 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:24.353000 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:24.353000 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:24.353000 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:24.353000 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 603/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:24.358129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.420733 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.460883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1ef53-9727-4cdf-b201-950c24ce8afe None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.496649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.497256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.497535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.497832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.498479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:24.498783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.500151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.512456 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 613/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:24.518205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.591046 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.622283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b9619-91d9-42b1-b059-b583f27c29e4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.655339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.655969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.656243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.656534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.663989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.666919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:55:24.677749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:24.678861 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:24.679807 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 604/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:55:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:24.685250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.785950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a04040-4c7c-490b-a1a9-bfb81ca9ac21 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.808216 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.819673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb9100-5834-4c0c-92e2-92061a27232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.820271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb9100-5834-4c0c-92e2-92061a27232e None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.820568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb9100-5834-4c0c-92e2-92061a27232e None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.820821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb9100-5834-4c0c-92e2-92061a27232e None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.821499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb9100-5834-4c0c-92e2-92061a27232e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:24.821800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb9100-5834-4c0c-92e2-92061a27232e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.823972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb9100-5834-4c0c-92e2-92061a27232e None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.835606 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 614/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:55:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:24.842619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:24.944723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0069857-7406-4d1d-a819-8101f878ca88 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:24.971889 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:24.977566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72f2b3-e406-415e-b583-e722fa931cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:24.994305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f2b3-e406-415e-b583-e722fa931cb7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:24.994305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f2b3-e406-415e-b583-e722fa931cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:24.994305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f2b3-e406-415e-b583-e722fa931cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:24.994305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f2b3-e406-415e-b583-e722fa931cb7 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=1a6e2642bd934f6b856bcdcbcf5751a1) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:24.994305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f2b3-e406-415e-b583-e722fa931cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:24.994305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f2b3-e406-415e-b583-e722fa931cb7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:24.995408 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 605/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:55:24 2022] GET /identity/v3/role_assignments?user.id=1a6e2642bd934f6b856bcdcbcf5751a1&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:26.918609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec30d-2132-4fd6-9496-46db412d61de None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:26.919204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec30d-2132-4fd6-9496-46db412d61de None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:26.919204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec30d-2132-4fd6-9496-46db412d61de None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:26.920588 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 615/1220] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:26.925895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3479-3aa9-4dab-a363-29b94690c8e1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:26.926326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3479-3aa9-4dab-a363-29b94690c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:26.926437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3479-3aa9-4dab-a363-29b94690c8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:26.944935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8f7d3479-3aa9-4dab-a363-29b94690c8e1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:26.946178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8f7d3479-3aa9-4dab-a363-29b94690c8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:27.013589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 606/1221] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:27.296817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec30d-2132-4fd6-9496-46db412d61de None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.397398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec30d-2132-4fd6-9496-46db412d61de None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.432212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.432846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.433158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.433430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.447485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:55:27.452379 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:27.453624 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:27.454771 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 616/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:27.459705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3479-3aa9-4dab-a363-29b94690c8e1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.560174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3479-3aa9-4dab-a363-29b94690c8e1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.583166 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:27.594198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.594805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.595087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.595358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.596017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] RBAC: Adding query filter params (name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:27.596320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.597677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.606108 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 607/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:27.611918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.658123 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:27.715495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9aae5-ad1b-4ab5-aacb-752db25257fd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.749752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.750404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.750685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.750955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.761568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.763038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:27.777955 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:27.779072 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:27.780430 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:27.780430 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:27.780430 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:27.780430 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 617/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:27.784913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:27.887265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb1dc1-4196-4b48-ae80-81fdcc56f059 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:27.921162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:27.921765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:27.922081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:27.922356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:27.922994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:27.923298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:27.924700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:27.936911 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 608/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:27.942665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.042962 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:28.049580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2e23-11b4-4711-aba2-05d080fa0e24 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.083862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125231-4388-451c-9e26-076b220318cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.084490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125231-4388-451c-9e26-076b220318cb None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.084767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125231-4388-451c-9e26-076b220318cb None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.085038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125231-4388-451c-9e26-076b220318cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.092341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125231-4388-451c-9e26-076b220318cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.093774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125231-4388-451c-9e26-076b220318cb None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-83125231-4388-451c-9e26-076b220318cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:55:28.105360 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:28.106516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:28.107824 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 618/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:28.112482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.159544 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:28.213171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24eebb-e7c2-4997-8049-2cd4a08257a6 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.245961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.246561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.246841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.247112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.247830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:28.248135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.249542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.266026 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 609/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:28.272111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125231-4388-451c-9e26-076b220318cb None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.374624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125231-4388-451c-9e26-076b220318cb None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.408322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.408992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.409274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.409594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.420463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.421996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:28.437213 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:28.438438 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:28.439570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:28.439570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:28.439570 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:28.439570 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 619/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:28.444445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.544238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26bc41-4358-4496-a305-b476ba8b7bd4 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.546662 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:28.579363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.579971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.580254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.580530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.581158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:28.581521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.582924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.595484 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 610/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:28.601331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.611116 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:28.707540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f207d-288f-48ba-9585-59598b3e4f3d None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.740541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.741164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.741510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.741788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.748506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.749967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:55:28.761400 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:28.762517 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:28.763679 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 620/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:28.768415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.867895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0c7c7-477c-427a-83fd-06b984ae65e7 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:28.902855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56180725-22d1-48d8-a2d4-dcd9d4c0c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:28.903467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180725-22d1-48d8-a2d4-dcd9d4c0c758 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:28.903749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180725-22d1-48d8-a2d4-dcd9d4c0c758 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:28.904023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180725-22d1-48d8-a2d4-dcd9d4c0c758 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:28.904716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56180725-22d1-48d8-a2d4-dcd9d4c0c758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:28.905027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56180725-22d1-48d8-a2d4-dcd9d4c0c758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:28.906482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56180725-22d1-48d8-a2d4-dcd9d4c0c758 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:28.920133 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 611/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:55:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:28.926468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:28.994385 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:29.029268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debc5a4-d7a9-4b0d-8d11-17e7e51fa9fb None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:29.062506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8d85b-bf76-43a3-bda2-6253727fabb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:29.063154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d85b-bf76-43a3-bda2-6253727fabb0 None admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:29.063433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d85b-bf76-43a3-bda2-6253727fabb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:29.063704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d85b-bf76-43a3-bda2-6253727fabb0 None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/1a6e2642bd934f6b856bcdcbcf5751a1/roles/4605266f425143d29e63e37830ba3ad7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:29.077898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8d85b-bf76-43a3-bda2-6253727fabb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=1a6e2642bd934f6b856bcdcbcf5751a1, role_id=4605266f425143d29e63e37830ba3ad7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:29.079357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8d85b-bf76-43a3-bda2-6253727fabb0 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:29.299577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 621/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:55:28 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/1a6e2642bd934f6b856bcdcbcf5751a1/roles/4605266f425143d29e63e37830ba3ad7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:31.206127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3039c-e800-4f62-956a-fb808d534dbd None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:31.206742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3039c-e800-4f62-956a-fb808d534dbd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:31.206742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3039c-e800-4f62-956a-fb808d534dbd None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:31.208060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 612/1233] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:31.213460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6c5f-5dcc-4192-b2e8-c2e9b970ae16 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:31.213892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6c5f-5dcc-4192-b2e8-c2e9b970ae16 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:31.217541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6c5f-5dcc-4192-b2e8-c2e9b970ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:31.233338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-018b6c5f-5dcc-4192-b2e8-c2e9b970ae16 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:31.234583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-018b6c5f-5dcc-4192-b2e8-c2e9b970ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:31.308036 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 622/1234] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:31.588660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3039c-e800-4f62-956a-fb808d534dbd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:31.614632 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:31.701530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3039c-e800-4f62-956a-fb808d534dbd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:31.737390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:31.738051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:31.738330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:31.738605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] PATH_INFO: `/v3/roles/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:31.749951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:55:31.754721 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:31.764963 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:31.766009 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 613/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Sun Aug 28 00:55:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:31.766957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b6c5f-5dcc-4192-b2e8-c2e9b970ae16 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:31.808434 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:31.861334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b6c5f-5dcc-4192-b2e8-c2e9b970ae16 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:31.896675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:31.897279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:31.897558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:31.897862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:31.898533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] RBAC: Adding query filter params (name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:31.898842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:31.900497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:31.910490 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 623/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Sun Aug 28 00:55:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:31.916967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.000798 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:32.015846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc949-a18f-4ea3-8cb2-9b1cd68db8be None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.050887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.051512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.051784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.052047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.062120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.063555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:32.078936 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:32.080105 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:32.081378 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:32.081378 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:32.081378 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:32.081378 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 614/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:32.086119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.192180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7d15-189d-4f2b-97fe-e298e607ebdc None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.201019 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:32.225572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.226192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.226469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.226746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.227540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:32.228431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.229786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.241397 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 624/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:32.247619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.349825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17011bdd-1326-49b1-8f29-b19aefc78f55 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.382587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.383210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.383486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.383759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.386999 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:32.391967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.393443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:55:32.405506 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:32.411599 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:32.413387 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 615/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:32.414083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.512776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b6620-5f67-4929-9bed-c79622e21e9c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.548378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.548976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.549249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.549517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.550283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:32.550581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.551993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.569216 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 625/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:32.575704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.678496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78602978-0aa8-4dad-b3b7-bcd33dc3ab60 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:32.713479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:32.714122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:32.714406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:32.714680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:32.776058 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:32.782245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:32.783691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:32.879363 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 616/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:55:32.885996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:32.913010 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:32.987377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260cf69-c1c1-4436-bf64-4b4f50a02fcd None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.022193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.022815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.023093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.023360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.034122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.035500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:33.050646 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:33.051649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:33.052577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:33.052577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:33.052577 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:33.052577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 626/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:33.058422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.155233 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:33.161914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dce63-f803-47de-9ffc-e9fe59cce517 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.197386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.198043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.198330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.198593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.199229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:33.199537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.200899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.211974 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 617/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:33.217739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.297524 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:33.324037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b59a7-95c0-4b9a-904e-120bdbdf49c9 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.358824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.359480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.359760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.360033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.366585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.368014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:55:33.380884 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:33.386563 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:33.387712 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 627/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:33.388341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.490674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e9093-fc78-4f70-b47c-24b9652333f1 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.530429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58240f5-5cab-4b0e-9198-a69806cf6cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.531042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58240f5-5cab-4b0e-9198-a69806cf6cd9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.531316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58240f5-5cab-4b0e-9198-a69806cf6cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.531584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58240f5-5cab-4b0e-9198-a69806cf6cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.532278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58240f5-5cab-4b0e-9198-a69806cf6cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:33.532579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58240f5-5cab-4b0e-9198-a69806cf6cd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.534022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58240f5-5cab-4b0e-9198-a69806cf6cd9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.546801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 618/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:33.553083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:33.654065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daf755-ad25-415d-8dac-0e040f1d8313 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:33.688201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074bea17-1365-4f32-b310-097db369df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:33.688796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bea17-1365-4f32-b310-097db369df28 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:33.689071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bea17-1365-4f32-b310-097db369df28 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:33.689339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bea17-1365-4f32-b310-097db369df28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:33.690167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bea17-1365-4f32-b310-097db369df28 None admin] RBAC: Adding query filter params (role.id=4605266f425143d29e63e37830ba3ad7, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=1a6e2642bd934f6b856bcdcbcf5751a1) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:33.690473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bea17-1365-4f32-b310-097db369df28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:33.691896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074bea17-1365-4f32-b310-097db369df28 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:33.698573 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 628/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:55:33 2022] GET /identity/v3/role_assignments?user.id=1a6e2642bd934f6b856bcdcbcf5751a1&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=4605266f425143d29e63e37830ba3ad7 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:35.717948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95186f0-d673-4bfc-89d9-6f9cfac23d69 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:35.718487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95186f0-d673-4bfc-89d9-6f9cfac23d69 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:35.718487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95186f0-d673-4bfc-89d9-6f9cfac23d69 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:35.719903 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 619/1247] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:35.725255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e43fe-0d12-413d-9c2a-fe8c4e2bd56d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:35.730713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e43fe-0d12-413d-9c2a-fe8c4e2bd56d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:35.730713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e43fe-0d12-413d-9c2a-fe8c4e2bd56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:35.733305 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:35.745262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b89e43fe-0d12-413d-9c2a-fe8c4e2bd56d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:35.746479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b89e43fe-0d12-413d-9c2a-fe8c4e2bd56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:35.814054 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 629/1248] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:36.086390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95186f0-d673-4bfc-89d9-6f9cfac23d69 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.105540 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:36.190930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95186f0-d673-4bfc-89d9-6f9cfac23d69 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.224836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.225457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.225732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.226029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.236801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:55:36.242012 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:36.243157 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:36.244088 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 620/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:36.249931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e43fe-0d12-413d-9c2a-fe8c4e2bd56d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.361154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e43fe-0d12-413d-9c2a-fe8c4e2bd56d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.390976 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:36.395952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.396556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.396836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.397100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.397775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:36.409550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.409550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.409550 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 630/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:36.414095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.494123 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:36.515878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99456da1-7e47-4753-8ec2-46f416cc9c5c None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.549515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.550190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.550471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.550745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.561553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.563200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:36.576594 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:36.577719 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:36.578852 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:36.578852 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:36.578852 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:36.578852 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 621/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:36.583598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.690189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4b51f-4be1-48d4-b4ba-4b2961618fa3 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.730938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.731556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.731801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.732073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.732709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:36.733015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.734415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.751285 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 631/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:36.757084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.859020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d99e3d-bd6b-4ed7-aa75-8aab4c72ceec None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:36.885829 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:36.893514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:36.894177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:36.894462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:36.894736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] PATH_INFO: `/v3/users/placement` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:36.903045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:36.904591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:55:36.916363 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:36.917490 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:36.918844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 622/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:36.923465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:36.983102 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:37.026657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f7453-d9fe-412b-9b92-af097009818f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.061628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.062286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.062566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.062841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.063599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:37.063903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.065393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.084511 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 632/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Sun Aug 28 00:55:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:37.090373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.201134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed24ff-6e62-46b4-be47-39ca3ccdf5de None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.237486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.237486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.237486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.237486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.288992 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:37.301552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.303098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.402900 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 623/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:55:37.408787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.508319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf8ab6-c2db-46b8-a2d9-7af0f45a3344 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.521753 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:37.543889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.544507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.544786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.545060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.563712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.565180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:37.579960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:37.581048 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:37.581983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:37.581983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:37.581983 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:37.585940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 633/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:37.587682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.672578 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:37.684301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3834db-fcd0-453a-9d6d-fbd5174a3c2d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.718055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.718549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.718826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.719108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.719718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:37.720015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.721351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.732568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 624/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:37.738463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:37.847898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35eb1f-4ea7-479e-a65e-00098dc75e51 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:37.880555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:37.881169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:37.881444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:37.881712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:37.888987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:37.890518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:55:37.902043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:37.903035 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:37.904149 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 634/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:37.909009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.012280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eac5e5-cf8a-4638-a16a-f9a8429c1c04 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.046708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd35a66-922a-48ff-86fd-a953a86982a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.047315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35a66-922a-48ff-86fd-a953a86982a8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.047632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35a66-922a-48ff-86fd-a953a86982a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.047866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd35a66-922a-48ff-86fd-a953a86982a8 None admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.048550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd35a66-922a-48ff-86fd-a953a86982a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:38.048854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd35a66-922a-48ff-86fd-a953a86982a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.050376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd35a66-922a-48ff-86fd-a953a86982a8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.063704 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 625/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:38.069980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:38.096103 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:38.171965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b92c1-c34e-49cc-8e8f-7eae7a98db21 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:38.210425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3942294-ac44-4cff-90bc-4389ea242f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:38.211024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3942294-ac44-4cff-90bc-4389ea242f30 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:38.211297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3942294-ac44-4cff-90bc-4389ea242f30 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:38.211690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3942294-ac44-4cff-90bc-4389ea242f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:38.212530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3942294-ac44-4cff-90bc-4389ea242f30 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=1a6e2642bd934f6b856bcdcbcf5751a1) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:38.212835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3942294-ac44-4cff-90bc-4389ea242f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:38.214276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3942294-ac44-4cff-90bc-4389ea242f30 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:38.219694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 635/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:55:38 2022] GET /identity/v3/role_assignments?user.id=1a6e2642bd934f6b856bcdcbcf5751a1&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=6ef968d350d64b4496757a252fa42707 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:40.141940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb722ddb-c2cb-416d-9a9c-4eb5b6853075 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.142489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb722ddb-c2cb-416d-9a9c-4eb5b6853075 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.142489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb722ddb-c2cb-416d-9a9c-4eb5b6853075 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.143878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 626/1261] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:40.149118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa316-fc9d-4884-befb-b48c2ac10221 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.149673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa316-fc9d-4884-befb-b48c2ac10221 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.150007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fa316-fc9d-4884-befb-b48c2ac10221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.168878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-053fa316-fc9d-4884-befb-b48c2ac10221 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:40.170095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-053fa316-fc9d-4884-befb-b48c2ac10221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:40.239429 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 636/1262] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:40.518436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb722ddb-c2cb-416d-9a9c-4eb5b6853075 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.530341 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:40.621754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb722ddb-c2cb-416d-9a9c-4eb5b6853075 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.656779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.657336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.657620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.657925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.668186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:55:40.678130 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:40.679242 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:40.680298 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 627/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:55:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:55:40.681280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fa316-fc9d-4884-befb-b48c2ac10221 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.699388 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:40.781035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fa316-fc9d-4884-befb-b48c2ac10221 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.814958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.815555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.815830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.816097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.816752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:40.817048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.818428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:40.827017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 637/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:40.833156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:40.904151 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:40.939593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cd6ca-b837-433f-97f2-5620a9b5f307 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:40.974228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:40.974849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:40.975123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:40.975391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:40.986473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:40.987918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:41.002375 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:41.003569 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:41.004672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:41.004672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:41.004672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:41.004672 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 628/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:41.009527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.092241 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:41.111690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6501ce-c665-4f6a-9333-3dacc29173c5 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.145511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.146136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.146805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.146978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.147820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:41.148569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.150629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.162835 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 638/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:41.169369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.269942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5424a9-1862-40f5-9efb-bbe59fa470b9 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.289367 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:41.304416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.305044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.305407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.306229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.313787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.315237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:55:41.326260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:41.327243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:41.328299 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 629/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:41.333375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.435397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb980242-24cf-4e4c-b321-df041c9efdca None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.468936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.469538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.469843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.470111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.470830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:41.471133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.472557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.481754 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:41.490286 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 639/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:41.496780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.596111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e8c3-6f3a-47fe-a2fa-9c88094aa8b8 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.629752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.630406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.630682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.630950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.641589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.643029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:41.660136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:41.667849 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:41.669052 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:41.669052 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:41.669052 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:41.669052 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 630/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:41.669342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.769563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098aa3d-9d3f-4a99-a974-afb6ec4dde81 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.802868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.803469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.803749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.804038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.804674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:41.804976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.806969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.818404 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 640/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:41.824970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:41.856409 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:41.923424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176c231-70ca-4b43-bee4-5ed32a0eaf85 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:41.956488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:41.957106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:41.957385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:41.958307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:41.964209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:41.975887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:55:41.976829 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:41.978119 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:41.979210 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 631/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:41.984028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.044009 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:42.086314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b164-cd58-40f4-9aa3-298ca6ef8699 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.120345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa8410-f2c0-4fff-8891-7cd31e22c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.120885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa8410-f2c0-4fff-8891-7cd31e22c008 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.121167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa8410-f2c0-4fff-8891-7cd31e22c008 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.121440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa8410-f2c0-4fff-8891-7cd31e22c008 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.122161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa8410-f2c0-4fff-8891-7cd31e22c008 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:42.122466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa8410-f2c0-4fff-8891-7cd31e22c008 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:42.123982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa8410-f2c0-4fff-8891-7cd31e22c008 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.136331 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 641/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:42.142362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:42.235368 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:42.244426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f70ef2-19ae-4685-988f-855cfd8b0601 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:42.276921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc1310-05b8-4e93-9d92-96d500dc040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:42.277567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc1310-05b8-4e93-9d92-96d500dc040a None admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:42.277949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc1310-05b8-4e93-9d92-96d500dc040a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:42.278263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc1310-05b8-4e93-9d92-96d500dc040a None admin] PATH_INFO: `/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/1a6e2642bd934f6b856bcdcbcf5751a1/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:42.280186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc1310-05b8-4e93-9d92-96d500dc040a None admin] RBAC: Authorizing `identity:create_grant(project_id=673aef12c24946c3ba53dc5db0e25c0e, user_id=1a6e2642bd934f6b856bcdcbcf5751a1, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:42.281655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc1310-05b8-4e93-9d92-96d500dc040a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:42.406290 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 632/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Sun Aug 28 00:55:42 2022] PUT /identity/v3/projects/673aef12c24946c3ba53dc5db0e25c0e/users/1a6e2642bd934f6b856bcdcbcf5751a1/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:55:44.300018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964050b6-cae0-4577-9f00-ea39cbd2b48b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:44.300557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964050b6-cae0-4577-9f00-ea39cbd2b48b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:44.300648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964050b6-cae0-4577-9f00-ea39cbd2b48b None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:44.302070 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 642/1274] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:44.308275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589764-bb88-41d0-a005-3dd001d1467e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:44.308788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589764-bb88-41d0-a005-3dd001d1467e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:44.308884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589764-bb88-41d0-a005-3dd001d1467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:44.327562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d3589764-bb88-41d0-a005-3dd001d1467e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:44.328860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d3589764-bb88-41d0-a005-3dd001d1467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:44.398391 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 633/1275] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:44.679011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964050b6-cae0-4577-9f00-ea39cbd2b48b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:44.783597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964050b6-cae0-4577-9f00-ea39cbd2b48b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:44.800885 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:44.817396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:44.818036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:44.818310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:44.818578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:44.828931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:55:44.833885 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:44.835027 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:44.836100 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 643/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Sun Aug 28 00:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:44.841915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589764-bb88-41d0-a005-3dd001d1467e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:44.923426 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:44.941494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589764-bb88-41d0-a005-3dd001d1467e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:44.974813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:44.975608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:44.976178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:44.976631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:44.978312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:44.978763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:44.980263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:44.988551 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 634/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Sun Aug 28 00:55:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:44.994439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.097418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216532-3718-4c27-b331-7d50d4660713 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.130725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.131349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.131629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.131901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.142889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.144320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:45.159187 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:45.160312 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:45.161269 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:45.161269 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:45.161269 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:45.161269 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 644/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:45.166541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.266783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e218490-9422-43ec-a6ed-7ef24655d146 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.299984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.300611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.300893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.301163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.301793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:45.302128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.303477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.315868 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 635/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:45.321831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.353765 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:45.424673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9e62-548a-48b8-bcb7-ca90e4fd681c None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.459519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.460140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.460470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.460963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.469991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.471472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:55:45.483280 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:45.484323 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:45.485443 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 645/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:55:45.490345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.494590 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:45.589829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d8dce-1460-4972-864b-ded384d5b74b None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.625335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.625982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.628637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.628637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.628637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:45.628637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.628637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.647054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 636/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Sun Aug 28 00:55:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:45.653840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.748802 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:45.758351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddc384-5fbb-43a7-a8b8-6de5c6e14085 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.791772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.792366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.792646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.792960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.861326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.862776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.955047 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:45.965040 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 646/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Sun Aug 28 00:55:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:55:45.971196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.032187 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:46.069677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b75cba-8d6a-4c45-8ca5-79d0b2379415 None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.103565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.104196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.104476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.104753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.114574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.115958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:55:46.132180 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:46.133279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:55:46.134418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:55:46.134418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:55:46.134418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:46.138029 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 637/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 00:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:46.139464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.246979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e397127-c112-4521-b95d-d6e9c1a47330 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.285960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.286589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.286865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.287136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.287772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:46.288070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.289459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.301478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 647/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Sun Aug 28 00:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:46.307528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.411463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890364-d6a7-4d2b-8202-c37de7af1e7d None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.425896 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:46.446618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.447278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.447661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.447937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.454687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.456116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:55:46.468124 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:46.469232 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 00:55:46.470224 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 638/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Sun Aug 28 00:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:46.475315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.526654 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:46.580916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80fce7-7ca6-4998-8e51-a4bdd0157388 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.617825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4bc4-187a-4be7-ac65-be28672300c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.618502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4bc4-187a-4be7-ac65-be28672300c4 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.619889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4bc4-187a-4be7-ac65-be28672300c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.620171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4bc4-187a-4be7-ac65-be28672300c4 None admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.620875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4bc4-187a-4be7-ac65-be28672300c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:46.621181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4bc4-187a-4be7-ac65-be28672300c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.622640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4bc4-187a-4be7-ac65-be28672300c4 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.636941 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 648/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Sun Aug 28 00:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:46.644880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.752055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843cce-0550-422b-8a25-e8290978a2ce None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.785966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d07d5-8fae-4f71-99ae-d9c28b4c2e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.786550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d07d5-8fae-4f71-99ae-d9c28b4c2e98 None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.786834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d07d5-8fae-4f71-99ae-d9c28b4c2e98 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.787106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d07d5-8fae-4f71-99ae-d9c28b4c2e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.787829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d07d5-8fae-4f71-99ae-d9c28b4c2e98 None admin] RBAC: Adding query filter params (role.id=6ef968d350d64b4496757a252fa42707, scope.project.id=673aef12c24946c3ba53dc5db0e25c0e, user.id=1a6e2642bd934f6b856bcdcbcf5751a1) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:46.788136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d07d5-8fae-4f71-99ae-d9c28b4c2e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.789551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d07d5-8fae-4f71-99ae-d9c28b4c2e98 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.795810 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 639/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Sun Aug 28 00:55:46 2022] GET /identity/v3/role_assignments?user.id=1a6e2642bd934f6b856bcdcbcf5751a1&scope.project.id=673aef12c24946c3ba53dc5db0e25c0e&role.id=6ef968d350d64b4496757a252fa42707 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:48.748032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722d17-1690-47f5-94f3-6d7e9711b3ae None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.748611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722d17-1690-47f5-94f3-6d7e9711b3ae None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.748611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d722d17-1690-47f5-94f3-6d7e9711b3ae None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.750089 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 649/1288] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:48.755254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be86e3-31d9-4b7b-bfc3-08e0ba6ce1bc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:48.762496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be86e3-31d9-4b7b-bfc3-08e0ba6ce1bc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:48.762496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be86e3-31d9-4b7b-bfc3-08e0ba6ce1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:48.774463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-28be86e3-31d9-4b7b-bfc3-08e0ba6ce1bc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:48.776418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-28be86e3-31d9-4b7b-bfc3-08e0ba6ce1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:48.805609 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:48.844599 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 640/1289] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:49.113264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d722d17-1690-47f5-94f3-6d7e9711b3ae None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.218480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d722d17-1690-47f5-94f3-6d7e9711b3ae None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.229859 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:49.253482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.254169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.254450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.254725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.255298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.256648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:49.266026 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:49.267321 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:49.268630 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 650/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:55:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:49.273145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be86e3-31d9-4b7b-bfc3-08e0ba6ce1bc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.372256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be86e3-31d9-4b7b-bfc3-08e0ba6ce1bc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.406553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ba74b-6e8e-4ab2-81b8-c627ae9aed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.407567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ba74b-6e8e-4ab2-81b8-c627ae9aed9e None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.408057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ba74b-6e8e-4ab2-81b8-c627ae9aed9e None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.409194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ba74b-6e8e-4ab2-81b8-c627ae9aed9e None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.409712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ba74b-6e8e-4ab2-81b8-c627ae9aed9e None admin] RBAC: Adding query filter params (name=placement) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:49.410307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ba74b-6e8e-4ab2-81b8-c627ae9aed9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.412866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ba74b-6e8e-4ab2-81b8-c627ae9aed9e None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.420844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 641/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Sun Aug 28 00:55:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:49.426882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:49.529075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce6d24-e733-40d1-addd-68f12341e802 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:49.568492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57508a2b-a6ed-43c8-b82b-f902ae64000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:49.569099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57508a2b-a6ed-43c8-b82b-f902ae64000a None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:49.569372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57508a2b-a6ed-43c8-b82b-f902ae64000a None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:49.569640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57508a2b-a6ed-43c8-b82b-f902ae64000a None admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:49.570292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57508a2b-a6ed-43c8-b82b-f902ae64000a None admin] RBAC: Adding query filter params (type=placement) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:49.572506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57508a2b-a6ed-43c8-b82b-f902ae64000a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:49.572506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57508a2b-a6ed-43c8-b82b-f902ae64000a None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:49.576502 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 651/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Sun Aug 28 00:55:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:51.516354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b9ad-8c9c-4d43-99f6-609bc8b597b0 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:51.516933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b9ad-8c9c-4d43-99f6-609bc8b597b0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:51.516933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b9ad-8c9c-4d43-99f6-609bc8b597b0 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:51.518365 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 642/1293] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:51.524772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea8c3-1461-4da5-bd56-680097e8874f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:51.524772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea8c3-1461-4da5-bd56-680097e8874f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:51.524772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dea8c3-1461-4da5-bd56-680097e8874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:51.542218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-14dea8c3-1461-4da5-bd56-680097e8874f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:51.543393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-14dea8c3-1461-4da5-bd56-680097e8874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:51.574840 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:51.612053 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 652/1294] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:51.890603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b9ad-8c9c-4d43-99f6-609bc8b597b0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:51.921826 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:51.990931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b9ad-8c9c-4d43-99f6-609bc8b597b0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:52.025454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab0c4d-f3b7-4dc0-8708-c49f792c2014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:52.030703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0c4d-f3b7-4dc0-8708-c49f792c2014 None admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:52.030703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0c4d-f3b7-4dc0-8708-c49f792c2014 None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:52.030703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab0c4d-f3b7-4dc0-8708-c49f792c2014 None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:52.030703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab0c4d-f3b7-4dc0-8708-c49f792c2014 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:52.030703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab0c4d-f3b7-4dc0-8708-c49f792c2014 None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:52.141996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 643/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Sun Aug 28 00:55:51 2022] POST /identity/v3/services => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:55:54.077011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a1b38-9804-4b49-a689-b4c3adbc0bbe None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.077621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a1b38-9804-4b49-a689-b4c3adbc0bbe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.077621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a1b38-9804-4b49-a689-b4c3adbc0bbe None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.078975 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 653/1296] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:54.084239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad96fcb-a785-483d-9d9b-f03693e81a97 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.084700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad96fcb-a785-483d-9d9b-f03693e81a97 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.084861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad96fcb-a785-483d-9d9b-f03693e81a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.103417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3ad96fcb-a785-483d-9d9b-f03693e81a97 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:54.104609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3ad96fcb-a785-483d-9d9b-f03693e81a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:54.180269 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 644/1297] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:54.458410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a1b38-9804-4b49-a689-b4c3adbc0bbe None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:54.561314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a1b38-9804-4b49-a689-b4c3adbc0bbe None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:54.596351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:54.596988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.597268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.597556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.598174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:54.599541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:54.609201 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:54.612266 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:54.613135 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 654/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:55:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:55:54.616635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad96fcb-a785-483d-9d9b-f03693e81a97 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:54.636014 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:54.734267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad96fcb-a785-483d-9d9b-f03693e81a97 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:54.780357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:54.780970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.781242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.781508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.782236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:54.782536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:54.783879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:54.789092 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 645/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Sun Aug 28 00:55:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:55:54.795542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:54.828669 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:54.898910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3770-26b6-432a-a801-62eea928a375 None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:54.934181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae948b-7c4b-4552-b1e4-83b3d9d64569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:54.934798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae948b-7c4b-4552-b1e4-83b3d9d64569 None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:54.935065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae948b-7c4b-4552-b1e4-83b3d9d64569 None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:54.935347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae948b-7c4b-4552-b1e4-83b3d9d64569 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:54.936079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae948b-7c4b-4552-b1e4-83b3d9d64569 None admin] RBAC: Adding query filter params (interface=public, service_id=dc8a1ae0ae684f03b14d54ffa12a8197, region_id=RegionOne) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:54.936389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae948b-7c4b-4552-b1e4-83b3d9d64569 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:54.937755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae948b-7c4b-4552-b1e4-83b3d9d64569 None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:54.948204 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 655/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Sun Aug 28 00:55:54 2022] GET /identity/v3/endpoints?service_id=dc8a1ae0ae684f03b14d54ffa12a8197&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:54.954922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:55.042175 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:55.069331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f07290-3979-422f-910c-b8edd07a85ca None admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:55.108755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9795798-a645-4e4a-bdda-edc6fbf0280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:55.109383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9795798-a645-4e4a-bdda-edc6fbf0280f None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:55.109665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9795798-a645-4e4a-bdda-edc6fbf0280f None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:55.109974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9795798-a645-4e4a-bdda-edc6fbf0280f None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:55.110605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9795798-a645-4e4a-bdda-edc6fbf0280f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:55.111957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9795798-a645-4e4a-bdda-edc6fbf0280f None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:55.120220 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 646/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Sun Aug 28 00:55:54 2022] GET /identity/v3/services => generated 2191 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:55:57.046637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9c37-3d5c-4a7d-ad74-3ee2a4e5bf15 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:57.047203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9c37-3d5c-4a7d-ad74-3ee2a4e5bf15 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:57.047203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9c37-3d5c-4a7d-ad74-3ee2a4e5bf15 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:57.048541 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 656/1302] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 00:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:57.053684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b359c-11f0-49ce-90bb-d0bd2c430b39 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:57.059784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b359c-11f0-49ce-90bb-d0bd2c430b39 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:57.059784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b359c-11f0-49ce-90bb-d0bd2c430b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:57.072841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-169b359c-11f0-49ce-90bb-d0bd2c430b39 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:57.077046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-169b359c-11f0-49ce-90bb-d0bd2c430b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:57.139154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 647/1303] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 00:55:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:55:57.407090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9c37-3d5c-4a7d-ad74-3ee2a4e5bf15 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:57.505172 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:57.512654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9c37-3d5c-4a7d-ad74-3ee2a4e5bf15 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:57.545483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:57.546132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:57.546431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:57.546707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] PATH_INFO: `/v3/services/placement` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:57.547267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:57.548630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:55:57.558032 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:55:57.559376 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 00:55:57.560411 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 657/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Sun Aug 28 00:55:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:55:57.565556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b359c-11f0-49ce-90bb-d0bd2c430b39 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:57.642996 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:57.666337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b359c-11f0-49ce-90bb-d0bd2c430b39 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:57.700789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354796d-7b65-4afd-b9d8-a1e91944218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:57.701390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354796d-7b65-4afd-b9d8-a1e91944218a None admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:57.701668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354796d-7b65-4afd-b9d8-a1e91944218a None admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:57.701969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354796d-7b65-4afd-b9d8-a1e91944218a None admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:57.702593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354796d-7b65-4afd-b9d8-a1e91944218a None admin] RBAC: Adding query filter params (name=placement) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:55:57.702891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354796d-7b65-4afd-b9d8-a1e91944218a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:57.704240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354796d-7b65-4afd-b9d8-a1e91944218a None admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:57.710258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 648/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Sun Aug 28 00:55:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:57.716320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:57.819058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5699cc-6110-45c8-ad2e-a4c3c8a19e0f None admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:57.852860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c23190-84cb-4a21-9c43-043a9787ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:57.853470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c23190-84cb-4a21-9c43-043a9787ddaf None admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:57.853752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c23190-84cb-4a21-9c43-043a9787ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:57.854056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c23190-84cb-4a21-9c43-043a9787ddaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:57.854725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c23190-84cb-4a21-9c43-043a9787ddaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:57.856099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c23190-84cb-4a21-9c43-043a9787ddaf None admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:58.015896 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 658/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 00:55:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:56:07.707295 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=30 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:08.010982 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:25.427908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320bac-29b4-4a64-92de-78c300362e3b None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:25.429252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320bac-29b4-4a64-92de-78c300362e3b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:25.430109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320bac-29b4-4a64-92de-78c300362e3b None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:25.443052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf93c-7084-4f25-8b38-9b60b3dff99d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:25.443499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf93c-7084-4f25-8b38-9b60b3dff99d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:25.443711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bf93c-7084-4f25-8b38-9b60b3dff99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:25.450068 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 649/1307] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:25 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:02:25.619498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4e3bf93c-7084-4f25-8b38-9b60b3dff99d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:25.621502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4e3bf93c-7084-4f25-8b38-9b60b3dff99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:25.783380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 659/1308] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:26.071807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3595a6-d706-4ff9-99cc-6d655db3d222 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.072090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3595a6-d706-4ff9-99cc-6d655db3d222 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.072367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3595a6-d706-4ff9-99cc-6d655db3d222 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.074035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 650/1309] 10.222.0.59 () {54 vars in 965 bytes} [Sun Aug 28 01:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:26.080181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d308-74f4-4abf-b66a-a83798224a15 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.080599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d308-74f4-4abf-b66a-a83798224a15 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.080980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d308-74f4-4abf-b66a-a83798224a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.182244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-97b4d308-74f4-4abf-b66a-a83798224a15 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:26.183732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97b4d308-74f4-4abf-b66a-a83798224a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:26.212731 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:26.282248 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 660/1310] 10.222.0.59 () {58 vars in 1062 bytes} [Sun Aug 28 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:26.292032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3595a6-d706-4ff9-99cc-6d655db3d222 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:26.293800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa3595a6-d706-4ff9-99cc-6d655db3d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:26.437711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3595a6-d706-4ff9-99cc-6d655db3d222 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:26.524673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524b6d3-04e1-4f4a-a157-ef8b8f301db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:26.525713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b6d3-04e1-4f4a-a157-ef8b8f301db1 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.526139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b6d3-04e1-4f4a-a157-ef8b8f301db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.526628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b6d3-04e1-4f4a-a157-ef8b8f301db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.528370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5524b6d3-04e1-4f4a-a157-ef8b8f301db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:26.593063 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:26.660043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524b6d3-04e1-4f4a-a157-ef8b8f301db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:26.662285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524b6d3-04e1-4f4a-a157-ef8b8f301db1 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:26.717256 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 651/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:28.974441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e6b7-7a46-4bf1-80e4-af3f71d1ae52 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:28.974441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e6b7-7a46-4bf1-80e4-af3f71d1ae52 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:28.975463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0e6b7-7a46-4bf1-80e4-af3f71d1ae52 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:28.976472 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 661/1312] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:28.981453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52502bb-36f8-41a7-99d5-dff194d6f82e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:28.981908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52502bb-36f8-41a7-99d5-dff194d6f82e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:28.982196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52502bb-36f8-41a7-99d5-dff194d6f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:29.066717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b52502bb-36f8-41a7-99d5-dff194d6f82e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:29.068068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b52502bb-36f8-41a7-99d5-dff194d6f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:29.168424 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 652/1313] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:29.457154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0e6b7-7a46-4bf1-80e4-af3f71d1ae52 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:29.458746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-91f0e6b7-7a46-4bf1-80e4-af3f71d1ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:29.563543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0e6b7-7a46-4bf1-80e4-af3f71d1ae52 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:29.633920 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:29.636494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25fd5a-dd0a-4647-9f99-830efc74d23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:29.637085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25fd5a-dd0a-4647-9f99-830efc74d23e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:29.637367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25fd5a-dd0a-4647-9f99-830efc74d23e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:29.637639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25fd5a-dd0a-4647-9f99-830efc74d23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:29.639292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ea25fd5a-dd0a-4647-9f99-830efc74d23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:29.751988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25fd5a-dd0a-4647-9f99-830efc74d23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:29.753420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25fd5a-dd0a-4647-9f99-830efc74d23e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:29.772490 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 662/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:32.257879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577335-8d26-4c3d-9251-a5fa91327caa None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:32.258435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577335-8d26-4c3d-9251-a5fa91327caa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:32.258435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe577335-8d26-4c3d-9251-a5fa91327caa None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:32.259822 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 653/1315] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:32.265022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe667d3-1a44-4d9d-bf48-e497a08e66c2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:32.265442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe667d3-1a44-4d9d-bf48-e497a08e66c2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:32.265574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe667d3-1a44-4d9d-bf48-e497a08e66c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:32.335092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ffe667d3-1a44-4d9d-bf48-e497a08e66c2 None None] MFA Rules not processed for user `1bf5e8c2f99d4f90b8f75c87bbe55274`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:32.336305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ffe667d3-1a44-4d9d-bf48-e497a08e66c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:32.392592 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:32.438728 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 663/1316] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:32.735700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577335-8d26-4c3d-9251-a5fa91327caa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:32.737257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fe577335-8d26-4c3d-9251-a5fa91327caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:32.747567 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:32.839576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe577335-8d26-4c3d-9251-a5fa91327caa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:32.911177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993748c6-1d65-4a46-9c74-ad219b768d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:32.911841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993748c6-1d65-4a46-9c74-ad219b768d93 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:32.912119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993748c6-1d65-4a46-9c74-ad219b768d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:32.912389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993748c6-1d65-4a46-9c74-ad219b768d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:32.914013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-993748c6-1d65-4a46-9c74-ad219b768d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:32.976096 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:33.022972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993748c6-1d65-4a46-9c74-ad219b768d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:33.024404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993748c6-1d65-4a46-9c74-ad219b768d93 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:33.042174 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 654/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:35.767116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d65f0-cc47-40fd-a322-b5e6a07b76c2 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:35.767657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d65f0-cc47-40fd-a322-b5e6a07b76c2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:35.767657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d65f0-cc47-40fd-a322-b5e6a07b76c2 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:35.769050 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 664/1318] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:35.775115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcac28-366b-4903-9417-ac795b6ac50d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:35.775564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcac28-366b-4903-9417-ac795b6ac50d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:35.775811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcac28-366b-4903-9417-ac795b6ac50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:35.840346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bddcac28-366b-4903-9417-ac795b6ac50d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:35.841567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bddcac28-366b-4903-9417-ac795b6ac50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:35.936693 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 655/1319] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:36.224238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d65f0-cc47-40fd-a322-b5e6a07b76c2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:36.226110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f21d65f0-cc47-40fd-a322-b5e6a07b76c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:36.331533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d65f0-cc47-40fd-a322-b5e6a07b76c2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:36.406017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9c2d5-6b1c-487f-82e3-78bc358762f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:36.406623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c2d5-6b1c-487f-82e3-78bc358762f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:36.406898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c2d5-6b1c-487f-82e3-78bc358762f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:36.407171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c2d5-6b1c-487f-82e3-78bc358762f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:36.408765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e3e9c2d5-6b1c-487f-82e3-78bc358762f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:36.416941 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:36.520445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9c2d5-6b1c-487f-82e3-78bc358762f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:36.521926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9c2d5-6b1c-487f-82e3-78bc358762f3 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:36.542415 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 665/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:39.486276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f06e-4a9b-4d44-bb0c-cc09ebd7e8e1 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:39.486810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f06e-4a9b-4d44-bb0c-cc09ebd7e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:39.486905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0f06e-4a9b-4d44-bb0c-cc09ebd7e8e1 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:39.488279 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 656/1321] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:39.493628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21819926-417d-42de-a3b3-f8d5a573154d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:39.494131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21819926-417d-42de-a3b3-f8d5a573154d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:39.494229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21819926-417d-42de-a3b3-f8d5a573154d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:39.563197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-21819926-417d-42de-a3b3-f8d5a573154d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:39.564399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-21819926-417d-42de-a3b3-f8d5a573154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:39.634170 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:39.684972 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 666/1322] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:39.967297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0f06e-4a9b-4d44-bb0c-cc09ebd7e8e1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:39.969033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dff0f06e-4a9b-4d44-bb0c-cc09ebd7e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:39.989512 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:40.078598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0f06e-4a9b-4d44-bb0c-cc09ebd7e8e1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:40.154452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4894da0-b2bd-4274-a7f6-5f4cc4589dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:40.155076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894da0-b2bd-4274-a7f6-5f4cc4589dba service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:40.155354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894da0-b2bd-4274-a7f6-5f4cc4589dba service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:40.155628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894da0-b2bd-4274-a7f6-5f4cc4589dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:40.157221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c4894da0-b2bd-4274-a7f6-5f4cc4589dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:40.230518 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:40.269776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4894da0-b2bd-4274-a7f6-5f4cc4589dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:40.271239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4894da0-b2bd-4274-a7f6-5f4cc4589dba service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:40.290116 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 657/1323] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:42.280373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a014cd-d1e8-45af-ab2b-b56eeedfa63e None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.281043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a014cd-d1e8-45af-ab2b-b56eeedfa63e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.281043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a014cd-d1e8-45af-ab2b-b56eeedfa63e None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.282241 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 667/1324] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:42.287712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53836b-f726-4771-b812-a8dcc29d23ef None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.288202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53836b-f726-4771-b812-a8dcc29d23ef None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.288371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53836b-f726-4771-b812-a8dcc29d23ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.356442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0b53836b-f726-4771-b812-a8dcc29d23ef None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:42.357648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b53836b-f726-4771-b812-a8dcc29d23ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:42.468259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 658/1325] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:42.756522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a014cd-d1e8-45af-ab2b-b56eeedfa63e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.758224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-47a014cd-d1e8-45af-ab2b-b56eeedfa63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:42.873038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a014cd-d1e8-45af-ab2b-b56eeedfa63e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.964898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547d38-fee8-430b-ae2a-6095f803cb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.965506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547d38-fee8-430b-ae2a-6095f803cb0a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.965787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547d38-fee8-430b-ae2a-6095f803cb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.966106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547d38-fee8-430b-ae2a-6095f803cb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.967673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f4547d38-fee8-430b-ae2a-6095f803cb0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:42.986663 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:43.087747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547d38-fee8-430b-ae2a-6095f803cb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:43.089247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547d38-fee8-430b-ae2a-6095f803cb0a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.108483 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 668/1326] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:45.083888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d544-8dd7-4316-9a3e-830c8fd87b1e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:45.084516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d544-8dd7-4316-9a3e-830c8fd87b1e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:45.084516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d544-8dd7-4316-9a3e-830c8fd87b1e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:45.085908 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 659/1327] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:45.091968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c346-2e12-4411-b241-180355e83ce2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:45.092517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c346-2e12-4411-b241-180355e83ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:45.092611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c346-2e12-4411-b241-180355e83ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:45.159897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-20b9c346-2e12-4411-b241-180355e83ce2 None None] MFA Rules not processed for user `1bf5e8c2f99d4f90b8f75c87bbe55274`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:45.161090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-20b9c346-2e12-4411-b241-180355e83ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:45.227449 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:45.259114 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 669/1328] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:45.545255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39d544-8dd7-4316-9a3e-830c8fd87b1e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:45.546848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c39d544-8dd7-4316-9a3e-830c8fd87b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:45.583786 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:45.661146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39d544-8dd7-4316-9a3e-830c8fd87b1e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:45.740390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a449e-1a42-4fca-842d-d1f1869ec27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:45.741069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a449e-1a42-4fca-842d-d1f1869ec27d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:45.741345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a449e-1a42-4fca-842d-d1f1869ec27d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:45.741615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a449e-1a42-4fca-842d-d1f1869ec27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:45.743289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-050a449e-1a42-4fca-842d-d1f1869ec27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:45.823299 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:45.856943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a449e-1a42-4fca-842d-d1f1869ec27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:45.858424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a449e-1a42-4fca-842d-d1f1869ec27d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:45.877102 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 660/1329] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:48.470480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be0882-fc19-4a1f-aa7e-c964014bda87 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.471327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be0882-fc19-4a1f-aa7e-c964014bda87 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.471491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be0882-fc19-4a1f-aa7e-c964014bda87 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.472913 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 670/1330] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:48.479346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403ca42-92e8-44e9-993b-63f4ace6a266 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.479804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403ca42-92e8-44e9-993b-63f4ace6a266 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.480104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403ca42-92e8-44e9-993b-63f4ace6a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.551839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9403ca42-92e8-44e9-993b-63f4ace6a266 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:48.561654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9403ca42-92e8-44e9-993b-63f4ace6a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.671342 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 661/1331] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:48.971456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be0882-fc19-4a1f-aa7e-c964014bda87 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.972979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b8be0882-fc19-4a1f-aa7e-c964014bda87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:49.081702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be0882-fc19-4a1f-aa7e-c964014bda87 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:49.158948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60dff1-e264-4b56-96bc-4be42b0650a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:49.159615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60dff1-e264-4b56-96bc-4be42b0650a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:49.159892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60dff1-e264-4b56-96bc-4be42b0650a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:49.160169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60dff1-e264-4b56-96bc-4be42b0650a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:49.161730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0e60dff1-e264-4b56-96bc-4be42b0650a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:49.193752 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:49.282652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60dff1-e264-4b56-96bc-4be42b0650a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:49.284098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60dff1-e264-4b56-96bc-4be42b0650a6 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:49.303458 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 671/1332] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:51.299241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed8cd5-b526-4ace-a402-02d3279ccb80 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.299893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed8cd5-b526-4ace-a402-02d3279ccb80 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.300009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed8cd5-b526-4ace-a402-02d3279ccb80 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.301660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 662/1333] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:51.308067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36010878-65b2-461d-bcde-27534297c06d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.308560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36010878-65b2-461d-bcde-27534297c06d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.308911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36010878-65b2-461d-bcde-27534297c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.377070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-36010878-65b2-461d-bcde-27534297c06d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:51.378416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36010878-65b2-461d-bcde-27534297c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:51.463964 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:51.486412 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 672/1334] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:51.786625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed8cd5-b526-4ace-a402-02d3279ccb80 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.788700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2ed8cd5-b526-4ace-a402-02d3279ccb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:51.829535 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:51.898269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed8cd5-b526-4ace-a402-02d3279ccb80 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.974171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86601b-315b-4fe2-b28e-f6b4840ff808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.975354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86601b-315b-4fe2-b28e-f6b4840ff808 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.975636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86601b-315b-4fe2-b28e-f6b4840ff808 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.975995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86601b-315b-4fe2-b28e-f6b4840ff808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.977620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-af86601b-315b-4fe2-b28e-f6b4840ff808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:52.071203 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:52.098594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86601b-315b-4fe2-b28e-f6b4840ff808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:52.101020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86601b-315b-4fe2-b28e-f6b4840ff808 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:52.120826 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 663/1335] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:54.762906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255545e-1971-443d-a643-1db426ee7171 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:54.763446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255545e-1971-443d-a643-1db426ee7171 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:54.763446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255545e-1971-443d-a643-1db426ee7171 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:54.764839 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 673/1336] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:54.770129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b341-bb45-4797-b146-9495cb8a1285 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:54.770572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b341-bb45-4797-b146-9495cb8a1285 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:54.770691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b341-bb45-4797-b146-9495cb8a1285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:54.837900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-62b5b341-bb45-4797-b146-9495cb8a1285 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:54.839129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-62b5b341-bb45-4797-b146-9495cb8a1285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:54.935443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 664/1337] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:55.219800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255545e-1971-443d-a643-1db426ee7171 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:55.221320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3255545e-1971-443d-a643-1db426ee7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:55.328590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255545e-1971-443d-a643-1db426ee7171 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:55.405720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c0d1c-d377-4a0c-9e16-7d7fb809cfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:55.406271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0d1c-d377-4a0c-9e16-7d7fb809cfbb service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:55.406547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0d1c-d377-4a0c-9e16-7d7fb809cfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:55.406816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c0d1c-d377-4a0c-9e16-7d7fb809cfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:55.408508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3c3c0d1c-d377-4a0c-9e16-7d7fb809cfbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:55.447705 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:55.523528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0d1c-d377-4a0c-9e16-7d7fb809cfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:55.524970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c0d1c-d377-4a0c-9e16-7d7fb809cfbb service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:55.543464 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 674/1338] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:59.667238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a645-83fe-40e0-a23c-196c0a55d58e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:59.667821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a645-83fe-40e0-a23c-196c0a55d58e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:59.667821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701a645-83fe-40e0-a23c-196c0a55d58e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:59.669123 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 665/1339] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:02:59.674862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33336c1c-4f55-4a53-bc6f-7a70d7e1efad None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:59.675374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33336c1c-4f55-4a53-bc6f-7a70d7e1efad None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:59.675493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33336c1c-4f55-4a53-bc6f-7a70d7e1efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:59.744045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-33336c1c-4f55-4a53-bc6f-7a70d7e1efad None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:59.745257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33336c1c-4f55-4a53-bc6f-7a70d7e1efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:59.838935 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:59.850651 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 675/1340] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:00.148810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0422-cc93-4d62-b333-eeafabc80e2f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:00.155091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0422-cc93-4d62-b333-eeafabc80e2f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:00.155091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb0422-cc93-4d62-b333-eeafabc80e2f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:00.155091 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 666/1341] 10.222.0.59 () {54 vars in 965 bytes} [Sun Aug 28 01:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:03:00.157106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7b4c-62e1-4053-b6f3-db1db3e151cb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:00.157490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7b4c-62e1-4053-b6f3-db1db3e151cb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:00.157869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7b4c-62e1-4053-b6f3-db1db3e151cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:00.239275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-128c7b4c-62e1-4053-b6f3-db1db3e151cb None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:00.241234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-128c7b4c-62e1-4053-b6f3-db1db3e151cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:00.321922 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 676/1342] 10.222.0.59 () {58 vars in 1062 bytes} [Sun Aug 28 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:00.330905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb0422-cc93-4d62-b333-eeafabc80e2f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:00.332512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5cb0422-cc93-4d62-b333-eeafabc80e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:00.382439 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:00.440791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb0422-cc93-4d62-b333-eeafabc80e2f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:00.516536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b113fd-32db-4923-a4d8-0ef0efae85cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:00.517151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b113fd-32db-4923-a4d8-0ef0efae85cc service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:00.517433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b113fd-32db-4923-a4d8-0ef0efae85cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:00.517707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b113fd-32db-4923-a4d8-0ef0efae85cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:00.519419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-90b113fd-32db-4923-a4d8-0ef0efae85cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:00.616322 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:00.639487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b113fd-32db-4923-a4d8-0ef0efae85cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:00.639487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b113fd-32db-4923-a4d8-0ef0efae85cc service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:00.655723 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 667/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:04.167393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6c278-eb2c-4b64-b43e-a7e707aa719c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:04.167983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6c278-eb2c-4b64-b43e-a7e707aa719c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:04.167983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6c278-eb2c-4b64-b43e-a7e707aa719c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:04.169380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 677/1344] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:04.175471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ac97-e45f-4dc0-a2d3-cd02ea9ce368 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:04.179839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ac97-e45f-4dc0-a2d3-cd02ea9ce368 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:04.179839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ac97-e45f-4dc0-a2d3-cd02ea9ce368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:04.247636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a303ac97-e45f-4dc0-a2d3-cd02ea9ce368 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:04.248825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a303ac97-e45f-4dc0-a2d3-cd02ea9ce368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:04.346569 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 668/1345] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:04.629333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6c278-eb2c-4b64-b43e-a7e707aa719c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:04.631916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-82a6c278-eb2c-4b64-b43e-a7e707aa719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:04.728970 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:04.747101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6c278-eb2c-4b64-b43e-a7e707aa719c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:04.827973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e940e-30c9-46f4-ace1-477dfa337fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:04.828616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e940e-30c9-46f4-ace1-477dfa337fce service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:04.828894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e940e-30c9-46f4-ace1-477dfa337fce service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:04.829161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e940e-30c9-46f4-ace1-477dfa337fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:04.830787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-382e940e-30c9-46f4-ace1-477dfa337fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:04.948752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e940e-30c9-46f4-ace1-477dfa337fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:04.950308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e940e-30c9-46f4-ace1-477dfa337fce service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:04.969726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 678/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:09.340768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2cd7-26f5-4821-9e81-61b76ef0823f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:09.341307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2cd7-26f5-4821-9e81-61b76ef0823f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:09.341307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2cd7-26f5-4821-9e81-61b76ef0823f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:09.343564 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 669/1347] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:09.348340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9fcf-0c7c-4d7d-9770-23cdb49b03bd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:09.348858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9fcf-0c7c-4d7d-9770-23cdb49b03bd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:09.349020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c9fcf-0c7c-4d7d-9770-23cdb49b03bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:09.366060 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:09.428476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d78c9fcf-0c7c-4d7d-9770-23cdb49b03bd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:09.429723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d78c9fcf-0c7c-4d7d-9770-23cdb49b03bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:09.552707 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 679/1348] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:09.841150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2cd7-26f5-4821-9e81-61b76ef0823f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:09.842749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c72a2cd7-26f5-4821-9e81-61b76ef0823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:09.903060 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:09.950636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2cd7-26f5-4821-9e81-61b76ef0823f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:10.025316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa181417-d764-457e-a46e-30a82b074d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:10.025971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181417-d764-457e-a46e-30a82b074d34 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:10.026250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181417-d764-457e-a46e-30a82b074d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:10.026525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa181417-d764-457e-a46e-30a82b074d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:10.028165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa181417-d764-457e-a46e-30a82b074d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:10.135594 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:10.139175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa181417-d764-457e-a46e-30a82b074d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:10.140609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa181417-d764-457e-a46e-30a82b074d34 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:10.158568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 670/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:15.097705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2d66-4600-4c26-b882-40aac2327b6b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:15.098265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2d66-4600-4c26-b882-40aac2327b6b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:15.098265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2d66-4600-4c26-b882-40aac2327b6b None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:15.100425 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 680/1350] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:15.105469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080f96a-aa8c-4d77-96c4-c9c210a4c21b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:15.105943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080f96a-aa8c-4d77-96c4-c9c210a4c21b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:15.106255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080f96a-aa8c-4d77-96c4-c9c210a4c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:15.217576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f080f96a-aa8c-4d77-96c4-c9c210a4c21b None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:15.219035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f080f96a-aa8c-4d77-96c4-c9c210a4c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:15.408594 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 671/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:19.548251 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=59 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:19.695167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ad10d-1397-4d2d-9093-ce799c4f255e None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:19.695669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ad10d-1397-4d2d-9093-ce799c4f255e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:19.696129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ad10d-1397-4d2d-9093-ce799c4f255e None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:19.697978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 681/1352] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:19.703929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72311e-17aa-4d9a-87ba-c4ef532f4b1a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:19.704417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72311e-17aa-4d9a-87ba-c4ef532f4b1a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:19.704500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72311e-17aa-4d9a-87ba-c4ef532f4b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:19.761706 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:19.785156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bb72311e-17aa-4d9a-87ba-c4ef532f4b1a None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:19.787338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb72311e-17aa-4d9a-87ba-c4ef532f4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:19.904718 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 672/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:21.233773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f2fe-4cc4-4ccc-8494-d191e6b0bea6 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:21.234390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f2fe-4cc4-4ccc-8494-d191e6b0bea6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:21.234390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462f2fe-4cc4-4ccc-8494-d191e6b0bea6 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:21.235718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 682/1354] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:21.240881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2246-b120-4f49-af1e-8a93a36e697c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:21.241375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2246-b120-4f49-af1e-8a93a36e697c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:21.241517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc2246-b120-4f49-af1e-8a93a36e697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:21.322151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1adc2246-b120-4f49-af1e-8a93a36e697c None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:21.323857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1adc2246-b120-4f49-af1e-8a93a36e697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:21.366621 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:21.436804 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 673/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:24.741718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270995-8afd-4405-a083-8a8ab37baf5f None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:24.742428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270995-8afd-4405-a083-8a8ab37baf5f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:24.742428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270995-8afd-4405-a083-8a8ab37baf5f None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:24.743655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 683/1356] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:24.748870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755d04-74ea-47cd-b295-bcb97b4f3dbc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:24.749297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755d04-74ea-47cd-b295-bcb97b4f3dbc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:24.749471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755d04-74ea-47cd-b295-bcb97b4f3dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:24.829939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4a755d04-74ea-47cd-b295-bcb97b4f3dbc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:24.831146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a755d04-74ea-47cd-b295-bcb97b4f3dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:24.966592 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 674/1357] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:25.276042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71ee5-e71c-4d34-8501-68b446f57a5c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:25.276673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71ee5-e71c-4d34-8501-68b446f57a5c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:25.277152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71ee5-e71c-4d34-8501-68b446f57a5c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:25.279083 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 684/1358] 10.222.0.59 () {54 vars in 962 bytes} [Sun Aug 28 01:03:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:25.287267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab66d-3aa5-474c-9e55-80ee824d1d01 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:25.290042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab66d-3aa5-474c-9e55-80ee824d1d01 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:25.290042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ab66d-3aa5-474c-9e55-80ee824d1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:25.304485 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:25.374365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f33ab66d-3aa5-474c-9e55-80ee824d1d01 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:25.375630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f33ab66d-3aa5-474c-9e55-80ee824d1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:25.543760 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 675/1359] 10.222.0.59 () {58 vars in 1059 bytes} [Sun Aug 28 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:25.551928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71ee5-e71c-4d34-8501-68b446f57a5c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:25.553543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-08b71ee5-e71c-4d34-8501-68b446f57a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:25.784656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71ee5-e71c-4d34-8501-68b446f57a5c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:25.907644 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:25.963505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7eb6d-c9a4-4c1f-9513-267174b3ab29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:25.964418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7eb6d-c9a4-4c1f-9513-267174b3ab29 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:25.964708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7eb6d-c9a4-4c1f-9513-267174b3ab29 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:25.964982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7eb6d-c9a4-4c1f-9513-267174b3ab29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:25.966694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-99c7eb6d-c9a4-4c1f-9513-267174b3ab29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:26.083489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7eb6d-c9a4-4c1f-9513-267174b3ab29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:26.085515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7eb6d-c9a4-4c1f-9513-267174b3ab29 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:26.111476 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 685/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:28.336947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872285f-8220-4bb3-b9bb-7937c1903936 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:28.337499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872285f-8220-4bb3-b9bb-7937c1903936 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:28.337499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872285f-8220-4bb3-b9bb-7937c1903936 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:28.339083 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 676/1361] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:28.344177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba369de-4712-4e68-a218-2e0a3be82174 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:28.344598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba369de-4712-4e68-a218-2e0a3be82174 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:28.344769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba369de-4712-4e68-a218-2e0a3be82174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:28.424176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eba369de-4712-4e68-a218-2e0a3be82174 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:28.425370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eba369de-4712-4e68-a218-2e0a3be82174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:28.468657 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:28.542552 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 686/1362] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:28.834952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872285f-8220-4bb3-b9bb-7937c1903936 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:28.836494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d872285f-8220-4bb3-b9bb-7937c1903936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:28.903733 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:28.995177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872285f-8220-4bb3-b9bb-7937c1903936 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:29.136203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b2048-986c-4405-b6af-d600d7905229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:29.136894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b2048-986c-4405-b6af-d600d7905229 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:29.137053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b2048-986c-4405-b6af-d600d7905229 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:29.137455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b2048-986c-4405-b6af-d600d7905229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:29.139268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-508b2048-986c-4405-b6af-d600d7905229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:29.175064 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:29.252220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b2048-986c-4405-b6af-d600d7905229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:29.254006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b2048-986c-4405-b6af-d600d7905229 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:29.277848 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 677/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:31.820664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772abb8-1953-49b6-8c99-43626b5de35a None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:31.821235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772abb8-1953-49b6-8c99-43626b5de35a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:31.821235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772abb8-1953-49b6-8c99-43626b5de35a None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:31.822914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 687/1364] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:31.828635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132518a9-3c56-4e68-aebb-c7c47900e1bc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:31.829166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132518a9-3c56-4e68-aebb-c7c47900e1bc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:31.829378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132518a9-3c56-4e68-aebb-c7c47900e1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:31.923856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-132518a9-3c56-4e68-aebb-c7c47900e1bc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:31.925143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-132518a9-3c56-4e68-aebb-c7c47900e1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:32.048303 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:32.053615 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 678/1365] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:32.357877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b19f0d-53f8-4b38-a10d-1e591dc2eeee None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:32.358272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b19f0d-53f8-4b38-a10d-1e591dc2eeee None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:32.358695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b19f0d-53f8-4b38-a10d-1e591dc2eeee None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:32.360212 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 688/1366] 10.222.0.59 () {54 vars in 962 bytes} [Sun Aug 28 01:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:32.366986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ab44c-a8f8-48f2-ba28-6b59e5e8b852 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:32.370350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ab44c-a8f8-48f2-ba28-6b59e5e8b852 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:32.370350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ab44c-a8f8-48f2-ba28-6b59e5e8b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:32.463823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e18ab44c-a8f8-48f2-ba28-6b59e5e8b852 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:32.465056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e18ab44c-a8f8-48f2-ba28-6b59e5e8b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:32.645669 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 679/1367] 10.222.0.59 () {58 vars in 1059 bytes} [Sun Aug 28 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:32.654321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b19f0d-53f8-4b38-a10d-1e591dc2eeee None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:32.655804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-80b19f0d-53f8-4b38-a10d-1e591dc2eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:32.821430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b19f0d-53f8-4b38-a10d-1e591dc2eeee None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:32.844241 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:32.953804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ef537-8e20-4bdb-a07e-edc6d1619905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:32.954458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ef537-8e20-4bdb-a07e-edc6d1619905 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:32.954741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ef537-8e20-4bdb-a07e-edc6d1619905 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:32.955014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ef537-8e20-4bdb-a07e-edc6d1619905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:32.956622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e20ef537-8e20-4bdb-a07e-edc6d1619905 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:33.071543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ef537-8e20-4bdb-a07e-edc6d1619905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:33.073330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ef537-8e20-4bdb-a07e-edc6d1619905 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:33.094882 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 689/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:35.550694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e14e0-cdb5-49a5-a0b4-cd166fbf84fe None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:35.552448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e14e0-cdb5-49a5-a0b4-cd166fbf84fe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:35.552896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e14e0-cdb5-49a5-a0b4-cd166fbf84fe None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:35.559013 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 680/1369] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:35.560569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27c33-1b16-48fa-8b67-1978711622a6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:35.561035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27c33-1b16-48fa-8b67-1978711622a6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:35.561164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27c33-1b16-48fa-8b67-1978711622a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:35.596959 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:35.636986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-32f27c33-1b16-48fa-8b67-1978711622a6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:35.638689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32f27c33-1b16-48fa-8b67-1978711622a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:35.749457 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 690/1370] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:36.068820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e14e0-cdb5-49a5-a0b4-cd166fbf84fe None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:36.070378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a5e14e0-cdb5-49a5-a0b4-cd166fbf84fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:36.141843 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:36.258890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e14e0-cdb5-49a5-a0b4-cd166fbf84fe None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:36.412620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf243a2-3ced-4f33-855f-e8d1e06ba107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:36.413263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf243a2-3ced-4f33-855f-e8d1e06ba107 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:36.413560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf243a2-3ced-4f33-855f-e8d1e06ba107 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:36.413867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf243a2-3ced-4f33-855f-e8d1e06ba107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:36.427133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cdf243a2-3ced-4f33-855f-e8d1e06ba107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:36.444349 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:36.549880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf243a2-3ced-4f33-855f-e8d1e06ba107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:36.552322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf243a2-3ced-4f33-855f-e8d1e06ba107 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:36.575509 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 681/1371] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:37.398408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf02f5f-caaa-40b1-a384-89a367ea7306 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:37.398948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf02f5f-caaa-40b1-a384-89a367ea7306 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:37.398948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf02f5f-caaa-40b1-a384-89a367ea7306 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:37.400337 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 691/1372] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:37.406714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496e892-2f61-4e27-90a5-d4f3d259a2b5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:37.409232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496e892-2f61-4e27-90a5-d4f3d259a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:37.409232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496e892-2f61-4e27-90a5-d4f3d259a2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:37.492615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2496e892-2f61-4e27-90a5-d4f3d259a2b5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:37.493841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2496e892-2f61-4e27-90a5-d4f3d259a2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:37.583354 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:37.606012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 682/1373] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:38.191263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89288-aed2-4a5f-bc7d-2b7dd42a9bff None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:38.191263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89288-aed2-4a5f-bc7d-2b7dd42a9bff None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:38.191263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89288-aed2-4a5f-bc7d-2b7dd42a9bff None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:38.191263 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 692/1374] 10.222.0.59 () {54 vars in 964 bytes} [Sun Aug 28 01:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:38.196126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77956f31-8c2a-48bc-a940-8355b3ee020d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:38.196414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77956f31-8c2a-48bc-a940-8355b3ee020d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:38.196691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77956f31-8c2a-48bc-a940-8355b3ee020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:38.279145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-77956f31-8c2a-48bc-a940-8355b3ee020d None None] MFA Rules not processed for user `10fe5abbf8c24c3882d8ad3addd241b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:38.280365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77956f31-8c2a-48bc-a940-8355b3ee020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:38.364161 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 683/1375] 10.222.0.59 () {58 vars in 1061 bytes} [Sun Aug 28 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:38.371506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89288-aed2-4a5f-bc7d-2b7dd42a9bff None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:38.373328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bfa89288-aed2-4a5f-bc7d-2b7dd42a9bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:38.508201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89288-aed2-4a5f-bc7d-2b7dd42a9bff None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:38.513828 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:38.598484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ba5b2-20fd-4f98-8ce7-7412aafdcae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:38.598484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba5b2-20fd-4f98-8ce7-7412aafdcae2 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:38.598484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba5b2-20fd-4f98-8ce7-7412aafdcae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:38.598896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ba5b2-20fd-4f98-8ce7-7412aafdcae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:38.601165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aa8ba5b2-20fd-4f98-8ce7-7412aafdcae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:38.742995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ba5b2-20fd-4f98-8ce7-7412aafdcae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:38.744449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ba5b2-20fd-4f98-8ce7-7412aafdcae2 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:38.767044 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 693/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:38.774057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7db3e-26c0-4adb-a27a-044cc93e7859 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:38.774585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7db3e-26c0-4adb-a27a-044cc93e7859 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:38.774761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7db3e-26c0-4adb-a27a-044cc93e7859 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:38.776331 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 684/1377] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:38.781537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8f1c-5d70-485d-ac3a-a428f2a2e6ff None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:38.781847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8f1c-5d70-485d-ac3a-a428f2a2e6ff None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:38.782131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8f1c-5d70-485d-ac3a-a428f2a2e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:38.836158 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:38.860535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8cfb8f1c-5d70-485d-ac3a-a428f2a2e6ff None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:38.861880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8cfb8f1c-5d70-485d-ac3a-a428f2a2e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:38.978715 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 694/1378] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:39.282869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7db3e-26c0-4adb-a27a-044cc93e7859 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:39.284671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5dc7db3e-26c0-4adb-a27a-044cc93e7859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:39.380507 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:39.466088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7db3e-26c0-4adb-a27a-044cc93e7859 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:39.614741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ef5a5-cf74-4616-bcbb-f395c614057a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:39.615567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ef5a5-cf74-4616-bcbb-f395c614057a service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:39.615839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ef5a5-cf74-4616-bcbb-f395c614057a service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:39.616111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ef5a5-cf74-4616-bcbb-f395c614057a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:39.617787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-389ef5a5-cf74-4616-bcbb-f395c614057a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:39.672610 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:39.733192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ef5a5-cf74-4616-bcbb-f395c614057a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:39.734983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ef5a5-cf74-4616-bcbb-f395c614057a service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:39.762517 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 685/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:41.920477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1e956-847d-42ee-91bb-4344894b70a0 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:41.920996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1e956-847d-42ee-91bb-4344894b70a0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:41.920996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1e956-847d-42ee-91bb-4344894b70a0 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:41.922355 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 695/1380] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:41.928148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbf74-293b-47ae-ae49-9710808bd694 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:41.928661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbf74-293b-47ae-ae49-9710808bd694 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:41.928820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dbf74-293b-47ae-ae49-9710808bd694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:42.002966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-646dbf74-293b-47ae-ae49-9710808bd694 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:42.004574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-646dbf74-293b-47ae-ae49-9710808bd694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:42.121695 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 686/1381] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:42.424947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1e956-847d-42ee-91bb-4344894b70a0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:42.427431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6be1e956-847d-42ee-91bb-4344894b70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:42.547114 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:42.591433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1e956-847d-42ee-91bb-4344894b70a0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:42.790611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d55f-9c71-424d-a87c-0cce28520135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:42.792593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d55f-9c71-424d-a87c-0cce28520135 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:42.792990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d55f-9c71-424d-a87c-0cce28520135 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:42.793367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d55f-9c71-424d-a87c-0cce28520135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:42.795765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6004d55f-9c71-424d-a87c-0cce28520135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:42.911027 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:42.926194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d55f-9c71-424d-a87c-0cce28520135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:42.928119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d55f-9c71-424d-a87c-0cce28520135 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:42.960073 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 696/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:45.138149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f76ea-4156-4c9c-8f29-a2cfe010440f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:45.138729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f76ea-4156-4c9c-8f29-a2cfe010440f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:45.138729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f76ea-4156-4c9c-8f29-a2cfe010440f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:45.140139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 687/1383] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:45.145787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c62df-ec93-41fa-9e96-0df4cf61d705 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:45.146394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c62df-ec93-41fa-9e96-0df4cf61d705 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:45.146394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c62df-ec93-41fa-9e96-0df4cf61d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:45.228297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1c2c62df-ec93-41fa-9e96-0df4cf61d705 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:45.229509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1c2c62df-ec93-41fa-9e96-0df4cf61d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:45.361853 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 697/1384] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:45.654519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f76ea-4156-4c9c-8f29-a2cfe010440f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:45.656296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-209f76ea-4156-4c9c-8f29-a2cfe010440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:45.678652 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:45.826195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f76ea-4156-4c9c-8f29-a2cfe010440f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:45.927624 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:45.955862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786c86c-3ca5-4bad-bcd2-3db26ed184f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:45.957514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c86c-3ca5-4bad-bcd2-3db26ed184f5 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:45.958522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c86c-3ca5-4bad-bcd2-3db26ed184f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:45.958895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c86c-3ca5-4bad-bcd2-3db26ed184f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:45.960728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7786c86c-3ca5-4bad-bcd2-3db26ed184f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:46.080464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786c86c-3ca5-4bad-bcd2-3db26ed184f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:46.083006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786c86c-3ca5-4bad-bcd2-3db26ed184f5 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:46.108776 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 688/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:48.312090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688dd6-c19f-480f-9a00-efcee73fb2d3 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:48.312702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688dd6-c19f-480f-9a00-efcee73fb2d3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:48.312810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688dd6-c19f-480f-9a00-efcee73fb2d3 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:48.314503 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 698/1386] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:48.321168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ccc-1c3a-4f33-b14c-6266170ba22b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:48.321836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ccc-1c3a-4f33-b14c-6266170ba22b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:48.321836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ccc-1c3a-4f33-b14c-6266170ba22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:48.396502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-62fa2ccc-1c3a-4f33-b14c-6266170ba22b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:48.397743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-62fa2ccc-1c3a-4f33-b14c-6266170ba22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:48.456348 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:48.517244 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 689/1387] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:48.814062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688dd6-c19f-480f-9a00-efcee73fb2d3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:48.815587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ec688dd6-c19f-480f-9a00-efcee73fb2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:48.876512 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:48.986224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688dd6-c19f-480f-9a00-efcee73fb2d3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:49.131487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab51f8-3291-423c-9b77-11d9f0546924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:49.131999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab51f8-3291-423c-9b77-11d9f0546924 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:49.132278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab51f8-3291-423c-9b77-11d9f0546924 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:49.132576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab51f8-3291-423c-9b77-11d9f0546924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:49.134250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-45ab51f8-3291-423c-9b77-11d9f0546924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:49.150323 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:49.275513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab51f8-3291-423c-9b77-11d9f0546924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:49.278321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab51f8-3291-423c-9b77-11d9f0546924 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:49.306869 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 699/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:03:51.578586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaa78d-5d8c-443b-aba6-143b627c98c0 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:51.579182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaa78d-5d8c-443b-aba6-143b627c98c0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:51.579182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaa78d-5d8c-443b-aba6-143b627c98c0 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:51.580577 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 690/1389] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:03:51.587502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeb868-3a57-4ffd-8130-4fd9010d6d41 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:51.588178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeb868-3a57-4ffd-8130-4fd9010d6d41 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:51.588178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eeb868-3a57-4ffd-8130-4fd9010d6d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:51.670309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-28eeb868-3a57-4ffd-8130-4fd9010d6d41 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:51.671481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-28eeb868-3a57-4ffd-8130-4fd9010d6d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:51.783315 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:51.796898 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 700/1390] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:52.161836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfaa78d-5d8c-443b-aba6-143b627c98c0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:52.163441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8dfaa78d-5d8c-443b-aba6-143b627c98c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:52.340450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfaa78d-5d8c-443b-aba6-143b627c98c0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:52.389697 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:52.481168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d5d72-0e99-421a-b33f-4d251e2f5c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:52.482227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5d72-0e99-421a-b33f-4d251e2f5c57 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:52.482679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5d72-0e99-421a-b33f-4d251e2f5c57 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:52.483206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5d72-0e99-421a-b33f-4d251e2f5c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:52.486335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-735d5d72-0e99-421a-b33f-4d251e2f5c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:52.607801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d5d72-0e99-421a-b33f-4d251e2f5c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:52.609845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d5d72-0e99-421a-b33f-4d251e2f5c57 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:52.634906 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 691/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:54.696655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd016-ed53-45f9-af8f-ef3a0a942ce8 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:54.697326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd016-ed53-45f9-af8f-ef3a0a942ce8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:54.697326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dd016-ed53-45f9-af8f-ef3a0a942ce8 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:54.698531 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 701/1392] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:54.703838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed3b0-cc22-48a7-8316-47d03b85804c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:54.704355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed3b0-cc22-48a7-8316-47d03b85804c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:54.704450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed3b0-cc22-48a7-8316-47d03b85804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:54.763731 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:54.778755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-457ed3b0-cc22-48a7-8316-47d03b85804c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:54.780011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-457ed3b0-cc22-48a7-8316-47d03b85804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:54.886038 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 692/1393] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:55.042533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9959ee8-2369-4975-83ef-a4f9d3b3eecd None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:55.042941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9959ee8-2369-4975-83ef-a4f9d3b3eecd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:55.043328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9959ee8-2369-4975-83ef-a4f9d3b3eecd None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:55.044835 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 702/1394] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:55.050781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:55.051076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:55.051355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:55.120569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:55.121790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:55.192687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b9da-2960-4ceb-bcd1-21b1138edd4a None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:55.193030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b9da-2960-4ceb-bcd1-21b1138edd4a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:55.193310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b9da-2960-4ceb-bcd1-21b1138edd4a None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:55.194738 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 703/1395] 10.222.0.59 () {54 vars in 967 bytes} [Sun Aug 28 01:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:03:55.196040 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:55.200070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:55.200353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:55.200635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:55.231403 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 693/1396] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:55.290933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] MFA Rules not processed for user `55ea28229f144d47826791bcade28b24`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:55.292162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:55.375568 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 704/1397] 10.222.0.59 () {58 vars in 1064 bytes} [Sun Aug 28 01:03:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:55.384130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:55.385375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:55.491151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9742cf-af11-4ca0-8540-06f3ef3facac None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:55.529433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:55.531461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:55.590261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d4d1-dfdd-46a0-804f-206b9fee3660 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:55.591102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d4d1-dfdd-46a0-804f-206b9fee3660 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:55.591408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d4d1-dfdd-46a0-804f-206b9fee3660 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:55.591676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d4d1-dfdd-46a0-804f-206b9fee3660 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:55.593544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67c3d4d1-dfdd-46a0-804f-206b9fee3660 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:55.630354 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:55.647527 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:55.679406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882d812-67b1-4fa8-be66-5f5edae34d80 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:55.726754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d4d1-dfdd-46a0-804f-206b9fee3660 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:55.728273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d4d1-dfdd-46a0-804f-206b9fee3660 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:55.749613 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 694/1398] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:55.819337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c40b0f-86f2-4c9c-8c52-4b8060367f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:55.820040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40b0f-86f2-4c9c-8c52-4b8060367f87 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:55.820205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40b0f-86f2-4c9c-8c52-4b8060367f87 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:55.820475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40b0f-86f2-4c9c-8c52-4b8060367f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:55.822109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-82c40b0f-86f2-4c9c-8c52-4b8060367f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:55.903076 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:55.918677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c40b0f-86f2-4c9c-8c52-4b8060367f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:55.920335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c40b0f-86f2-4c9c-8c52-4b8060367f87 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:55.940478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 705/1399] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:56.694953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b504fa-4dde-4627-9499-e8335b413828 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:56.695262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b504fa-4dde-4627-9499-e8335b413828 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:56.695541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b504fa-4dde-4627-9499-e8335b413828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:56.768155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a8b504fa-4dde-4627-9499-e8335b413828 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:56.769400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8b504fa-4dde-4627-9499-e8335b413828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:56.858986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 695/1400] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:56.908983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3840a-ab22-4e69-a860-7e465be44ddb None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:56.910031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3840a-ab22-4e69-a860-7e465be44ddb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:56.910129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3840a-ab22-4e69-a860-7e465be44ddb None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:56.911600 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 706/1401] 10.222.0.59 () {54 vars in 943 bytes} [Sun Aug 28 01:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:56.919610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df268-349a-4e24-8b58-074e1617885f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:56.920011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df268-349a-4e24-8b58-074e1617885f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:56.920374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df268-349a-4e24-8b58-074e1617885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:56.933884 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:57.006390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9f9df268-349a-4e24-8b58-074e1617885f None None] MFA Rules not processed for user `33919497efcb42f49a4b9034352f3045`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:57.007893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f9df268-349a-4e24-8b58-074e1617885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:57.123922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 696/1402] 10.222.0.59 () {58 vars in 1040 bytes} [Sun Aug 28 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:57.135456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3840a-ab22-4e69-a860-7e465be44ddb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:57.135999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fcf3840a-ab22-4e69-a860-7e465be44ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:57.287016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3840a-ab22-4e69-a860-7e465be44ddb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:57.348776 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:57.397330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9d89a-a33c-44eb-a1b9-24c325be5dcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:57.397976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d89a-a33c-44eb-a1b9-24c325be5dcf service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:57.398256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d89a-a33c-44eb-a1b9-24c325be5dcf service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:57.398526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d89a-a33c-44eb-a1b9-24c325be5dcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:57.400164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ddd9d89a-a33c-44eb-a1b9-24c325be5dcf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:57.495470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9d89a-a33c-44eb-a1b9-24c325be5dcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:57.497147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9d89a-a33c-44eb-a1b9-24c325be5dcf service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:57.506945 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 707/1403] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:03:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:03:58.055028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08750-f1df-4055-b711-a9bf04254bd4 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:58.055547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08750-f1df-4055-b711-a9bf04254bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:58.055547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08750-f1df-4055-b711-a9bf04254bd4 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:58.057490 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 697/1404] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:03:58.062801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98f20-5268-4b87-9112-d7426341611b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:58.063265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98f20-5268-4b87-9112-d7426341611b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:58.063373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98f20-5268-4b87-9112-d7426341611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:58.146536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dfc98f20-5268-4b87-9112-d7426341611b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:58.148082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dfc98f20-5268-4b87-9112-d7426341611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:58.217999 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:58.286695 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 708/1405] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:58.744899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08750-f1df-4055-b711-a9bf04254bd4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:58.746745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cda08750-f1df-4055-b711-a9bf04254bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:58.837454 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:58.922801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08750-f1df-4055-b711-a9bf04254bd4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:59.053562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4c819-8e73-492e-a8d8-c182a657e3d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:59.054250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4c819-8e73-492e-a8d8-c182a657e3d9 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:59.054533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4c819-8e73-492e-a8d8-c182a657e3d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:59.054809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4c819-8e73-492e-a8d8-c182a657e3d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:59.056727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4fb4c819-8e73-492e-a8d8-c182a657e3d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:59.089227 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:59.176462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4c819-8e73-492e-a8d8-c182a657e3d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:59.178242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4c819-8e73-492e-a8d8-c182a657e3d9 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:59.198931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 698/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:01.338277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83deac8-6c5d-4448-bd3e-a4376bb50084 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:01.338848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83deac8-6c5d-4448-bd3e-a4376bb50084 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:01.338848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83deac8-6c5d-4448-bd3e-a4376bb50084 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:01.342301 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 709/1407] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:01.345515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2efb72-ca12-4e9b-826c-14db4d1901ae None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:01.345988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2efb72-ca12-4e9b-826c-14db4d1901ae None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:01.346098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2efb72-ca12-4e9b-826c-14db4d1901ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:01.417517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9f2efb72-ca12-4e9b-826c-14db4d1901ae None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:01.429292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f2efb72-ca12-4e9b-826c-14db4d1901ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:01.543929 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 699/1408] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:01.841162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83deac8-6c5d-4448-bd3e-a4376bb50084 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:01.842700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d83deac8-6c5d-4448-bd3e-a4376bb50084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:02.012832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83deac8-6c5d-4448-bd3e-a4376bb50084 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:02.054903 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:02.150020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df08757-a05e-4a50-bc8b-5d478f610524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:02.151024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df08757-a05e-4a50-bc8b-5d478f610524 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:02.151293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df08757-a05e-4a50-bc8b-5d478f610524 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:02.151560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df08757-a05e-4a50-bc8b-5d478f610524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:02.153222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5df08757-a05e-4a50-bc8b-5d478f610524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:02.259692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df08757-a05e-4a50-bc8b-5d478f610524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:02.261574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df08757-a05e-4a50-bc8b-5d478f610524 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:02.281702 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 710/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:11.542231 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:12.278687 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:20.694074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4414-a053-4891-a699-d2d79b423ea5 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:20.694621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4414-a053-4891-a699-d2d79b423ea5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:20.694621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4414-a053-4891-a699-d2d79b423ea5 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:20.696020 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 700/1410] 10.222.0.59 () {54 vars in 918 bytes} [Sun Aug 28 01:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:20.701227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205dc4f-16e4-4eee-a74a-5543d058f825 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:20.701707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205dc4f-16e4-4eee-a74a-5543d058f825 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:20.701958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205dc4f-16e4-4eee-a74a-5543d058f825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:20.777897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c205dc4f-16e4-4eee-a74a-5543d058f825 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:20.779105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c205dc4f-16e4-4eee-a74a-5543d058f825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:20.886920 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 711/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Sun Aug 28 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:04:20.901151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299033-284c-4c8b-8957-1db3c41ac090 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:20.901436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299033-284c-4c8b-8957-1db3c41ac090 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:20.901712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299033-284c-4c8b-8957-1db3c41ac090 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:20.903193 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 701/1412] 10.222.0.59 () {54 vars in 918 bytes} [Sun Aug 28 01:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:20.907882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28233bb7-9de6-44cd-aec4-738c1ad61dc3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:20.909249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28233bb7-9de6-44cd-aec4-738c1ad61dc3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:20.909531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28233bb7-9de6-44cd-aec4-738c1ad61dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:20.983759 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:20.987769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-28233bb7-9de6-44cd-aec4-738c1ad61dc3 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:20.988992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-28233bb7-9de6-44cd-aec4-738c1ad61dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:21.111006 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 712/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Sun Aug 28 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:23.521469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd50b22-c366-41b2-8119-ff5a568ca664 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.522069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd50b22-c366-41b2-8119-ff5a568ca664 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.522069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd50b22-c366-41b2-8119-ff5a568ca664 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.523475 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:23.528906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd637-6399-47f9-a606-ae1efd57d9c2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.529357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd637-6399-47f9-a606-ae1efd57d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.529470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd637-6399-47f9-a606-ae1efd57d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.596911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6c9cd637-6399-47f9-a606-ae1efd57d9c2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:23.598152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6c9cd637-6399-47f9-a606-ae1efd57d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:23.652152 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:23.695992 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:23.984920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd50b22-c366-41b2-8119-ff5a568ca664 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:23.987145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4fd50b22-c366-41b2-8119-ff5a568ca664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:24.135806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd50b22-c366-41b2-8119-ff5a568ca664 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:24.208442 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:24.248721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440727-de0a-498f-a7e8-3d143f5a42d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:24.249333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440727-de0a-498f-a7e8-3d143f5a42d9 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:24.249615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440727-de0a-498f-a7e8-3d143f5a42d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:24.249920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440727-de0a-498f-a7e8-3d143f5a42d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:24.251550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fd440727-de0a-498f-a7e8-3d143f5a42d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:24.343521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440727-de0a-498f-a7e8-3d143f5a42d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:24.347580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440727-de0a-498f-a7e8-3d143f5a42d9 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:24.367274 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 703/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:25.264259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8f63f-e847-4518-a2bc-a855c3d76a5b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:25.264805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8f63f-e847-4518-a2bc-a855c3d76a5b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:25.264805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8f63f-e847-4518-a2bc-a855c3d76a5b None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:25.266240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:04:25.271825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797e7f4-4a9e-4089-91ad-ffd56da69660 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:25.272277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797e7f4-4a9e-4089-91ad-ffd56da69660 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:25.272383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797e7f4-4a9e-4089-91ad-ffd56da69660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:25.349783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3797e7f4-4a9e-4089-91ad-ffd56da69660 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:25.351367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3797e7f4-4a9e-4089-91ad-ffd56da69660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:25.379219 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:25.455727 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:25.626446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8f63f-e847-4518-a2bc-a855c3d76a5b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:25.628583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-57b8f63f-e847-4518-a2bc-a855c3d76a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:25.814420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8f63f-e847-4518-a2bc-a855c3d76a5b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:25.864304 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:25.947320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c684-db05-4c29-bf64-cadbff53aeeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:25.948042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c684-db05-4c29-bf64-cadbff53aeeb service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:25.948326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c684-db05-4c29-bf64-cadbff53aeeb service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:25.948651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c684-db05-4c29-bf64-cadbff53aeeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:25.950310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a6c4c684-db05-4c29-bf64-cadbff53aeeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:26.048049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c684-db05-4c29-bf64-cadbff53aeeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:26.051720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c684-db05-4c29-bf64-cadbff53aeeb service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:26.072160 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 715/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:26.987892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89afb9-d0b8-4e97-bec4-90c3c38ed007 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:26.988472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89afb9-d0b8-4e97-bec4-90c3c38ed007 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:26.988472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89afb9-d0b8-4e97-bec4-90c3c38ed007 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:26.989948 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:26.995095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe1a2a-c0bd-444c-8b56-b33c83a3f651 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:26.996438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe1a2a-c0bd-444c-8b56-b33c83a3f651 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:26.996438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe1a2a-c0bd-444c-8b56-b33c83a3f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:27.051670 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:27.073120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eefe1a2a-c0bd-444c-8b56-b33c83a3f651 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:27.074362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eefe1a2a-c0bd-444c-8b56-b33c83a3f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:27.176224 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:27.328357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89afb9-d0b8-4e97-bec4-90c3c38ed007 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:27.329975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6e89afb9-d0b8-4e97-bec4-90c3c38ed007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:27.481669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89afb9-d0b8-4e97-bec4-90c3c38ed007 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:27.494083 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:27.600294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ffc64-7851-4ce7-a342-a0e6d733fb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:27.600906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ffc64-7851-4ce7-a342-a0e6d733fb58 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:27.601188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ffc64-7851-4ce7-a342-a0e6d733fb58 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:27.601463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ffc64-7851-4ce7-a342-a0e6d733fb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:27.603125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-124ffc64-7851-4ce7-a342-a0e6d733fb58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:27.694427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ffc64-7851-4ce7-a342-a0e6d733fb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:27.695993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ffc64-7851-4ce7-a342-a0e6d733fb58 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:27.714581 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 706/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:28.584105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3a98-729e-4fcf-9098-eaac4d387b0b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:28.584685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3a98-729e-4fcf-9098-eaac4d387b0b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:28.584685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3a98-729e-4fcf-9098-eaac4d387b0b None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:28.586130 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:28.591124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570d267-8b05-4453-84d2-2a70d7130cdb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:28.591545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570d267-8b05-4453-84d2-2a70d7130cdb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:28.591654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570d267-8b05-4453-84d2-2a70d7130cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:28.612819 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:28.670051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3570d267-8b05-4453-84d2-2a70d7130cdb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:28.671178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3570d267-8b05-4453-84d2-2a70d7130cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:28.773478 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:28.922189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3a98-729e-4fcf-9098-eaac4d387b0b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:28.923697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8aed3a98-729e-4fcf-9098-eaac4d387b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:29.036447 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:29.073831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3a98-729e-4fcf-9098-eaac4d387b0b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:29.190857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db464d7-d919-46b5-b561-7dbe2e6b7838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:29.191398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db464d7-d919-46b5-b561-7dbe2e6b7838 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:29.191673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db464d7-d919-46b5-b561-7dbe2e6b7838 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:29.191943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db464d7-d919-46b5-b561-7dbe2e6b7838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:29.193558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2db464d7-d919-46b5-b561-7dbe2e6b7838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:29.276093 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:29.290449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db464d7-d919-46b5-b561-7dbe2e6b7838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:29.292114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db464d7-d919-46b5-b561-7dbe2e6b7838 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:29.311605 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 718/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:30.213251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf1f6c-cedb-4845-b824-cec7991207a8 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:30.213953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf1f6c-cedb-4845-b824-cec7991207a8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:30.213953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf1f6c-cedb-4845-b824-cec7991207a8 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:30.215262 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:30.220967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe401-5c86-423e-b20f-5f826a3b0d76 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:30.221417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe401-5c86-423e-b20f-5f826a3b0d76 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:30.227750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe401-5c86-423e-b20f-5f826a3b0d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:30.298900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8ddfe401-5c86-423e-b20f-5f826a3b0d76 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:30.300207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ddfe401-5c86-423e-b20f-5f826a3b0d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:30.396950 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:30.548443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf1f6c-cedb-4845-b824-cec7991207a8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:30.550010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2abf1f6c-cedb-4845-b824-cec7991207a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:30.638126 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:30.701640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf1f6c-cedb-4845-b824-cec7991207a8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:30.815526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5a502-27de-4b22-bdf4-4d3f3bde79e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:30.816049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5a502-27de-4b22-bdf4-4d3f3bde79e1 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:30.816334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5a502-27de-4b22-bdf4-4d3f3bde79e1 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:30.816611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5a502-27de-4b22-bdf4-4d3f3bde79e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:30.818268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bab5a502-27de-4b22-bdf4-4d3f3bde79e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:30.867603 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:30.911053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5a502-27de-4b22-bdf4-4d3f3bde79e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:30.912649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5a502-27de-4b22-bdf4-4d3f3bde79e1 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:30.931381 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 709/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:31.793416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ceff0-5c73-4fc9-8601-62c8cb2f21c6 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:31.794032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ceff0-5c73-4fc9-8601-62c8cb2f21c6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:31.794032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ceff0-5c73-4fc9-8601-62c8cb2f21c6 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:31.795383 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:31.802217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7ccda-ca11-4fca-8b6a-d1b8ef44ab01 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:31.802859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7ccda-ca11-4fca-8b6a-d1b8ef44ab01 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:31.803205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7ccda-ca11-4fca-8b6a-d1b8ef44ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:31.915213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6ba7ccda-ca11-4fca-8b6a-d1b8ef44ab01 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:31.916431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6ba7ccda-ca11-4fca-8b6a-d1b8ef44ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:32.016243 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:32.168433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ceff0-5c73-4fc9-8601-62c8cb2f21c6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:32.169890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-208ceff0-5c73-4fc9-8601-62c8cb2f21c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:32.222488 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:32.320152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ceff0-5c73-4fc9-8601-62c8cb2f21c6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:32.441971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c4691-aa1a-443e-a33b-49ecd9d046f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:32.442503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c4691-aa1a-443e-a33b-49ecd9d046f5 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:32.442779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c4691-aa1a-443e-a33b-49ecd9d046f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:32.443045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c4691-aa1a-443e-a33b-49ecd9d046f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:32.444671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b90c4691-aa1a-443e-a33b-49ecd9d046f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:32.453432 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:32.540052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c4691-aa1a-443e-a33b-49ecd9d046f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:32.541677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c4691-aa1a-443e-a33b-49ecd9d046f5 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:32.567751 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 721/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:33.464549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfba04-c9f8-457c-b2e4-25dab7637635 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:33.465091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfba04-c9f8-457c-b2e4-25dab7637635 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:33.465091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfba04-c9f8-457c-b2e4-25dab7637635 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:33.466432 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:33.471596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5622-acb2-441a-b1ec-053922392fcf None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:33.472052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5622-acb2-441a-b1ec-053922392fcf None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:33.472331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5622-acb2-441a-b1ec-053922392fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:33.552987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1cbe5622-acb2-441a-b1ec-053922392fcf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:33.554257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1cbe5622-acb2-441a-b1ec-053922392fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:33.624499 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:33.655963 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:33.807632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfba04-c9f8-457c-b2e4-25dab7637635 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:33.809170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7ecfba04-c9f8-457c-b2e4-25dab7637635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:33.827927 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:33.960859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfba04-c9f8-457c-b2e4-25dab7637635 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:34.054460 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:34.086442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b166385-56f3-4cf4-9db4-b2f609da7709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:34.087193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166385-56f3-4cf4-9db4-b2f609da7709 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:34.087460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166385-56f3-4cf4-9db4-b2f609da7709 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:34.087743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b166385-56f3-4cf4-9db4-b2f609da7709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:34.089433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1b166385-56f3-4cf4-9db4-b2f609da7709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:34.189054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b166385-56f3-4cf4-9db4-b2f609da7709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:34.190721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b166385-56f3-4cf4-9db4-b2f609da7709 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:34.210717 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 712/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:35.143593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e3436-3766-4cd1-aec6-2bd7b052caac None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:35.144193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e3436-3766-4cd1-aec6-2bd7b052caac None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:35.144193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e3436-3766-4cd1-aec6-2bd7b052caac None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:35.145549 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:35.150861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64f211-f3a9-4ebd-8e5e-8580d8823ba5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:35.151311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64f211-f3a9-4ebd-8e5e-8580d8823ba5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:35.151475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64f211-f3a9-4ebd-8e5e-8580d8823ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:35.230505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2f64f211-f3a9-4ebd-8e5e-8580d8823ba5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:35.231730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2f64f211-f3a9-4ebd-8e5e-8580d8823ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:35.274560 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:35.333970 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:04:35.491056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e3436-3766-4cd1-aec6-2bd7b052caac None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:35.492659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cc6e3436-3766-4cd1-aec6-2bd7b052caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:35.663050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e3436-3766-4cd1-aec6-2bd7b052caac None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:35.726092 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:35.798845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61ad50-76fb-4e26-a133-2a2c97b0893e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:35.799714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ad50-76fb-4e26-a133-2a2c97b0893e service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:35.799996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ad50-76fb-4e26-a133-2a2c97b0893e service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:35.800273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61ad50-76fb-4e26-a133-2a2c97b0893e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:35.801994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9e61ad50-76fb-4e26-a133-2a2c97b0893e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:35.900554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ad50-76fb-4e26-a133-2a2c97b0893e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:35.902187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61ad50-76fb-4e26-a133-2a2c97b0893e service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:35.920459 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 724/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:36.797733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e73d8-2012-4f0e-9557-d352cc783283 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:36.798617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e73d8-2012-4f0e-9557-d352cc783283 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:36.798617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e73d8-2012-4f0e-9557-d352cc783283 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:36.799889 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:36.805935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603a2fe-4f1c-48b6-bf41-1aba319b2f3b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:36.806437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603a2fe-4f1c-48b6-bf41-1aba319b2f3b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:36.806559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603a2fe-4f1c-48b6-bf41-1aba319b2f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:36.888559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e603a2fe-4f1c-48b6-bf41-1aba319b2f3b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:36.889827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e603a2fe-4f1c-48b6-bf41-1aba319b2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:36.892078 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:36.993547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:37.147449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e73d8-2012-4f0e-9557-d352cc783283 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:37.148975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2a5e73d8-2012-4f0e-9557-d352cc783283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:37.338105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e73d8-2012-4f0e-9557-d352cc783283 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:37.371282 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:37.485752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c633b-39a6-48cc-bd95-67485e454974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:37.486481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c633b-39a6-48cc-bd95-67485e454974 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:37.486760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c633b-39a6-48cc-bd95-67485e454974 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:37.487024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c633b-39a6-48cc-bd95-67485e454974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:37.488859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-876c633b-39a6-48cc-bd95-67485e454974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:37.602368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c633b-39a6-48cc-bd95-67485e454974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:37.604034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c633b-39a6-48cc-bd95-67485e454974 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:37.625974 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 715/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:39.484339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd2fd-4ef5-453b-88bd-c457dfa44377 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:39.484892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd2fd-4ef5-453b-88bd-c457dfa44377 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:39.484892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd2fd-4ef5-453b-88bd-c457dfa44377 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:39.486763 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:39.492385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252a3a9-daf9-4e77-943c-0393eae33f78 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:39.492832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252a3a9-daf9-4e77-943c-0393eae33f78 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:39.492947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252a3a9-daf9-4e77-943c-0393eae33f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:39.536674 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:39.563166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9252a3a9-daf9-4e77-943c-0393eae33f78 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:39.564690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9252a3a9-daf9-4e77-943c-0393eae33f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:39.667930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:39.961510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd2fd-4ef5-453b-88bd-c457dfa44377 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:39.963330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-389bd2fd-4ef5-453b-88bd-c457dfa44377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:40.077195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd2fd-4ef5-453b-88bd-c457dfa44377 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:40.113051 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:40.159066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59604d2-0a70-42cc-9c4c-a9645211e60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:40.159679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59604d2-0a70-42cc-9c4c-a9645211e60a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:40.159952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59604d2-0a70-42cc-9c4c-a9645211e60a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:40.160223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59604d2-0a70-42cc-9c4c-a9645211e60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:40.161829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c59604d2-0a70-42cc-9c4c-a9645211e60a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:40.282940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59604d2-0a70-42cc-9c4c-a9645211e60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:40.284784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59604d2-0a70-42cc-9c4c-a9645211e60a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:40.305838 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 727/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:42.595822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ce03-7f08-4c1f-a46c-75f877cb423f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:42.596514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ce03-7f08-4c1f-a46c-75f877cb423f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:42.596514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7ce03-7f08-4c1f-a46c-75f877cb423f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:42.597851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:42.604030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ad88e-ca09-44a0-8f33-26b99e032a17 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:42.604635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ad88e-ca09-44a0-8f33-26b99e032a17 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:42.604635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ad88e-ca09-44a0-8f33-26b99e032a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:42.679575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-246ad88e-ca09-44a0-8f33-26b99e032a17 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:42.680694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-246ad88e-ca09-44a0-8f33-26b99e032a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:42.694766 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:42.796420 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:04:43.099990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7ce03-7f08-4c1f-a46c-75f877cb423f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:43.101547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6fd7ce03-7f08-4c1f-a46c-75f877cb423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:43.225130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7ce03-7f08-4c1f-a46c-75f877cb423f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:43.238337 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:43.310101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658305c3-54aa-4487-bd50-1fa40a5e5cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:43.310718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658305c3-54aa-4487-bd50-1fa40a5e5cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:43.310991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658305c3-54aa-4487-bd50-1fa40a5e5cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:43.311259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658305c3-54aa-4487-bd50-1fa40a5e5cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:43.312887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-658305c3-54aa-4487-bd50-1fa40a5e5cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:43.433787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658305c3-54aa-4487-bd50-1fa40a5e5cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:43.435253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658305c3-54aa-4487-bd50-1fa40a5e5cf4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:43.456584 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 718/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:45.828282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7e12-e5e0-4d23-b216-74268a68299d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:45.829250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7e12-e5e0-4d23-b216-74268a68299d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:45.829250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7e12-e5e0-4d23-b216-74268a68299d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:45.830834 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:45.836726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcdc98-ad90-4492-b828-efe94cacc04c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:45.837169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcdc98-ad90-4492-b828-efe94cacc04c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:45.837291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcdc98-ad90-4492-b828-efe94cacc04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:45.894187 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:45.914617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b2dcdc98-ad90-4492-b828-efe94cacc04c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:45.921461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2dcdc98-ad90-4492-b828-efe94cacc04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:46.030053 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:46.321088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f7e12-e5e0-4d23-b216-74268a68299d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:46.322638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f19f7e12-e5e0-4d23-b216-74268a68299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:46.450076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f7e12-e5e0-4d23-b216-74268a68299d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:46.492202 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:46.527592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074779c-9aef-4446-8b48-b6be9c810ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:46.528211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074779c-9aef-4446-8b48-b6be9c810ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:46.528489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074779c-9aef-4446-8b48-b6be9c810ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:46.528762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074779c-9aef-4446-8b48-b6be9c810ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:46.530393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e074779c-9aef-4446-8b48-b6be9c810ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:46.655753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074779c-9aef-4446-8b48-b6be9c810ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:46.657954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074779c-9aef-4446-8b48-b6be9c810ba2 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:46.677359 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 730/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:48.788780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c8be-65d9-4873-8678-0050c31186cd None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:48.789354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c8be-65d9-4873-8678-0050c31186cd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:48.789354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5c8be-65d9-4873-8678-0050c31186cd None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:48.790748 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:48.796048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee873-d4df-472e-91de-7036f05cf869 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:48.796537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee873-d4df-472e-91de-7036f05cf869 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:48.796644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee873-d4df-472e-91de-7036f05cf869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:48.863569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-334ee873-d4df-472e-91de-7036f05cf869 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:48.864773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-334ee873-d4df-472e-91de-7036f05cf869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:48.885379 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:48.963423 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:49.254341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c8be-65d9-4873-8678-0050c31186cd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:49.255891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1ac5c8be-65d9-4873-8678-0050c31186cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:49.366337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5c8be-65d9-4873-8678-0050c31186cd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:49.386427 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:49.443452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8963ef1-45ba-4d83-a7cf-3261d9f0d24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:49.444068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8963ef1-45ba-4d83-a7cf-3261d9f0d24c service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:49.444350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8963ef1-45ba-4d83-a7cf-3261d9f0d24c service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:49.444628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8963ef1-45ba-4d83-a7cf-3261d9f0d24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:49.446290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d8963ef1-45ba-4d83-a7cf-3261d9f0d24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:49.560098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8963ef1-45ba-4d83-a7cf-3261d9f0d24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:49.561536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8963ef1-45ba-4d83-a7cf-3261d9f0d24c service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:49.580564 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 721/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:51.583228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8f68-9767-48a2-9acd-c3aebc1d3002 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:51.583889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8f68-9767-48a2-9acd-c3aebc1d3002 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:51.583889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8f68-9767-48a2-9acd-c3aebc1d3002 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:51.585159 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:51.590562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e2364-9256-4a9b-a7c1-fe9f3d856a70 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:51.591048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e2364-9256-4a9b-a7c1-fe9f3d856a70 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:51.591157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e2364-9256-4a9b-a7c1-fe9f3d856a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:51.656248 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:51.659149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9e0e2364-9256-4a9b-a7c1-fe9f3d856a70 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:51.660386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9e0e2364-9256-4a9b-a7c1-fe9f3d856a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:51.760565 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:52.044918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8f68-9767-48a2-9acd-c3aebc1d3002 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:52.046466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-541b8f68-9767-48a2-9acd-c3aebc1d3002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:52.156010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8f68-9767-48a2-9acd-c3aebc1d3002 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:52.208833 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:52.233781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08424e-fe7e-4ae0-8cac-dfacd1293c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:52.235497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08424e-fe7e-4ae0-8cac-dfacd1293c7e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:52.235997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08424e-fe7e-4ae0-8cac-dfacd1293c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:52.236391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08424e-fe7e-4ae0-8cac-dfacd1293c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:52.238382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5c08424e-fe7e-4ae0-8cac-dfacd1293c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:52.348748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08424e-fe7e-4ae0-8cac-dfacd1293c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:52.350115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08424e-fe7e-4ae0-8cac-dfacd1293c7e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:52.369280 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 733/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:54.420408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a67dd1-c15d-4276-80f0-80714c70c673 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:54.420934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a67dd1-c15d-4276-80f0-80714c70c673 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:54.421061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a67dd1-c15d-4276-80f0-80714c70c673 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:54.423482 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:54.431386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7e8b-7b7d-4396-b3ce-2cd7adc08cee None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:54.431907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7e8b-7b7d-4396-b3ce-2cd7adc08cee None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:54.431907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7e8b-7b7d-4396-b3ce-2cd7adc08cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:54.499494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a6cf7e8b-7b7d-4396-b3ce-2cd7adc08cee None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:54.501435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a6cf7e8b-7b7d-4396-b3ce-2cd7adc08cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:54.530040 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:54.603797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:54.890300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a67dd1-c15d-4276-80f0-80714c70c673 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:54.892359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6a67dd1-c15d-4276-80f0-80714c70c673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:54.998734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a67dd1-c15d-4276-80f0-80714c70c673 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:55.027565 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:55.073139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784019f3-4979-44bd-b494-70c0a13c4d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:55.073745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784019f3-4979-44bd-b494-70c0a13c4d0d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:55.074053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784019f3-4979-44bd-b494-70c0a13c4d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:55.074326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784019f3-4979-44bd-b494-70c0a13c4d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:55.075963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-784019f3-4979-44bd-b494-70c0a13c4d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:55.194731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784019f3-4979-44bd-b494-70c0a13c4d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:55.196068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784019f3-4979-44bd-b494-70c0a13c4d0d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:55.214934 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 724/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:57.251019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e69d9-d724-4b13-92b4-49d2d05b928d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.251562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e69d9-d724-4b13-92b4-49d2d05b928d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.251562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e69d9-d724-4b13-92b4-49d2d05b928d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.252967 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:04:57.258503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a874d-8f5d-48e8-9d26-39f7cde8d15d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.258930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a874d-8f5d-48e8-9d26-39f7cde8d15d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.259068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a874d-8f5d-48e8-9d26-39f7cde8d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.330970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-213a874d-8f5d-48e8-9d26-39f7cde8d15d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:57.332188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-213a874d-8f5d-48e8-9d26-39f7cde8d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:57.340506 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:57.555613 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:57.840920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e69d9-d724-4b13-92b4-49d2d05b928d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:57.842471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e73e69d9-d724-4b13-92b4-49d2d05b928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:57.946300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e69d9-d724-4b13-92b4-49d2d05b928d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:58.001828 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:58.021111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9db0e-234b-42dc-b5d0-e0a8842d2244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:58.021716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9db0e-234b-42dc-b5d0-e0a8842d2244 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:58.022088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9db0e-234b-42dc-b5d0-e0a8842d2244 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:58.022354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9db0e-234b-42dc-b5d0-e0a8842d2244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:58.023926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-efc9db0e-234b-42dc-b5d0-e0a8842d2244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:58.131736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9db0e-234b-42dc-b5d0-e0a8842d2244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:58.133153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9db0e-234b-42dc-b5d0-e0a8842d2244 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:58.152221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 736/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:00.118454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78393c-14b8-420d-893f-e3566184c1d5 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:00.119047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78393c-14b8-420d-893f-e3566184c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:00.119047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78393c-14b8-420d-893f-e3566184c1d5 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:00.120379 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:00.126580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcdf1c-1284-4dd5-bbb4-ef395e486612 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:00.127024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcdf1c-1284-4dd5-bbb4-ef395e486612 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:00.127245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcdf1c-1284-4dd5-bbb4-ef395e486612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:00.193248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9ffcdf1c-1284-4dd5-bbb4-ef395e486612 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:00.194473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ffcdf1c-1284-4dd5-bbb4-ef395e486612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:00.231918 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:00.292162 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:00.579724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78393c-14b8-420d-893f-e3566184c1d5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:00.581270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ce78393c-14b8-420d-893f-e3566184c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:00.688235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78393c-14b8-420d-893f-e3566184c1d5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:00.726419 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:00.764616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e3b7-2790-4024-b36a-deb363adc773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:00.765275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e3b7-2790-4024-b36a-deb363adc773 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:00.765570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e3b7-2790-4024-b36a-deb363adc773 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:00.765868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e3b7-2790-4024-b36a-deb363adc773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:00.767585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b5b6e3b7-2790-4024-b36a-deb363adc773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:00.881634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e3b7-2790-4024-b36a-deb363adc773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:00.883093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e3b7-2790-4024-b36a-deb363adc773 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:00.901782 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 727/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:02.854129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828dd4-e1bb-4a6c-9aa3-b3f0e7e79368 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:02.854689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828dd4-e1bb-4a6c-9aa3-b3f0e7e79368 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:02.854689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828dd4-e1bb-4a6c-9aa3-b3f0e7e79368 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:02.856080 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:02.862517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045647a-f0f8-4d41-8ca6-e46c2fdd2310 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:02.863041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045647a-f0f8-4d41-8ca6-e46c2fdd2310 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:02.863041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045647a-f0f8-4d41-8ca6-e46c2fdd2310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:02.932428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d045647a-f0f8-4d41-8ca6-e46c2fdd2310 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:02.933710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d045647a-f0f8-4d41-8ca6-e46c2fdd2310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:02.953172 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:03.033993 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:03.317959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828dd4-e1bb-4a6c-9aa3-b3f0e7e79368 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:03.319583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b1828dd4-e1bb-4a6c-9aa3-b3f0e7e79368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:03.425720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828dd4-e1bb-4a6c-9aa3-b3f0e7e79368 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:03.495139 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:03.503080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f796af1-3ec0-4fef-9da3-6ab61e97c963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:03.503690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796af1-3ec0-4fef-9da3-6ab61e97c963 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:03.503970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796af1-3ec0-4fef-9da3-6ab61e97c963 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:03.504241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796af1-3ec0-4fef-9da3-6ab61e97c963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:03.505882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6f796af1-3ec0-4fef-9da3-6ab61e97c963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:03.619404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f796af1-3ec0-4fef-9da3-6ab61e97c963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:03.620861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f796af1-3ec0-4fef-9da3-6ab61e97c963 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:03.641097 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 739/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:05.587903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c5f46-3388-4cef-8ac3-b6706bfe4a65 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:05.588483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c5f46-3388-4cef-8ac3-b6706bfe4a65 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:05.588483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c5f46-3388-4cef-8ac3-b6706bfe4a65 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:05.589832 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:05.596772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d6fe-934e-4b0d-9187-602d0b0e402d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:05.597563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d6fe-934e-4b0d-9187-602d0b0e402d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:05.597723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d6fe-934e-4b0d-9187-602d0b0e402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:05.666734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4a02d6fe-934e-4b0d-9187-602d0b0e402d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:05.667972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4a02d6fe-934e-4b0d-9187-602d0b0e402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:05.717787 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:05.769079 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:06.051156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c5f46-3388-4cef-8ac3-b6706bfe4a65 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:06.052737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8d4c5f46-3388-4cef-8ac3-b6706bfe4a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:06.156824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c5f46-3388-4cef-8ac3-b6706bfe4a65 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:06.206214 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:06.233304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c986-784f-4a2c-b5fc-e54209a6e3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:06.234625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c986-784f-4a2c-b5fc-e54209a6e3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:06.234911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c986-784f-4a2c-b5fc-e54209a6e3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:06.235295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c986-784f-4a2c-b5fc-e54209a6e3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:06.236934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7fa6c986-784f-4a2c-b5fc-e54209a6e3b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:06.362198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6c986-784f-4a2c-b5fc-e54209a6e3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:06.363584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6c986-784f-4a2c-b5fc-e54209a6e3b7 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:06.382630 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 730/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:15.767363 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=22 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:16.380387 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=66 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:27.113300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee25f-12ec-4586-a7b1-d65fca41135f None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:27.114035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee25f-12ec-4586-a7b1-d65fca41135f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:27.114583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee25f-12ec-4586-a7b1-d65fca41135f None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:27.116228 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 741/1471] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:27.122816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29124a9-7d9d-4877-8da5-604b44f4f6e1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:27.123694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29124a9-7d9d-4877-8da5-604b44f4f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:27.124232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29124a9-7d9d-4877-8da5-604b44f4f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:27.222651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d29124a9-7d9d-4877-8da5-604b44f4f6e1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:27.223927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d29124a9-7d9d-4877-8da5-604b44f4f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:27.367051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 731/1472] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:27.715358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2284-c51b-4016-81b6-4685ce284219 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:27.715876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2284-c51b-4016-81b6-4685ce284219 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:27.716378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2284-c51b-4016-81b6-4685ce284219 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:27.719557 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 742/1473] 10.222.0.59 () {54 vars in 967 bytes} [Sun Aug 28 01:05:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:27.725981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b03f-3c63-49ec-9cc8-329175b92aba None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:27.726422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b03f-3c63-49ec-9cc8-329175b92aba None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:27.726885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b03f-3c63-49ec-9cc8-329175b92aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:27.850759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cac6b03f-3c63-49ec-9cc8-329175b92aba None None] MFA Rules not processed for user `55ea28229f144d47826791bcade28b24`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:27.852028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cac6b03f-3c63-49ec-9cc8-329175b92aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:27.880044 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:27.960743 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 732/1474] 10.222.0.59 () {58 vars in 1064 bytes} [Sun Aug 28 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:27.969637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2284-c51b-4016-81b6-4685ce284219 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:27.971275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bc4e2284-c51b-4016-81b6-4685ce284219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:28.110875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2284-c51b-4016-81b6-4685ce284219 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:28.212217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eccbe-acb1-4340-abe7-55f95a1eee2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:28.212926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eccbe-acb1-4340-abe7-55f95a1eee2a service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:28.213065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eccbe-acb1-4340-abe7-55f95a1eee2a service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:28.213282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eccbe-acb1-4340-abe7-55f95a1eee2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:28.215070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d07eccbe-acb1-4340-abe7-55f95a1eee2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:28.280391 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:28.347057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eccbe-acb1-4340-abe7-55f95a1eee2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:28.348688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eccbe-acb1-4340-abe7-55f95a1eee2a service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:28.371345 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 743/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:30.510186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c110dcc-ec40-4aaf-a411-1e7824608ea6 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:30.511064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c110dcc-ec40-4aaf-a411-1e7824608ea6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:30.511064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c110dcc-ec40-4aaf-a411-1e7824608ea6 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:30.512744 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 733/1476] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:30.519957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe13b9-6a78-49d2-b989-a32dbe560752 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:30.520589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe13b9-6a78-49d2-b989-a32dbe560752 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:30.520589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe13b9-6a78-49d2-b989-a32dbe560752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:30.602219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-43fe13b9-6a78-49d2-b989-a32dbe560752 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:30.603498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-43fe13b9-6a78-49d2-b989-a32dbe560752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:30.735715 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 744/1477] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:31.022146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c110dcc-ec40-4aaf-a411-1e7824608ea6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:31.023755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c110dcc-ec40-4aaf-a411-1e7824608ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:31.180392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c110dcc-ec40-4aaf-a411-1e7824608ea6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:31.261563 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:31.317574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f525d1-0da1-4a74-984d-0a16a0aadf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:31.318133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f525d1-0da1-4a74-984d-0a16a0aadf48 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:31.318421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f525d1-0da1-4a74-984d-0a16a0aadf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:31.318694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f525d1-0da1-4a74-984d-0a16a0aadf48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:31.319383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f525d1-0da1-4a74-984d-0a16a0aadf48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:31.321280 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-d7f525d1-0da1-4a74-984d-0a16a0aadf48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:05:31.321280 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:05:31.321280 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:05:31.322495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f525d1-0da1-4a74-984d-0a16a0aadf48 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:31.346205 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 734/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Sun Aug 28 01:05:31 2022] GET /identity/v3/projects => generated 2553 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:05:33.395275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920b6e3-81f1-4699-8e36-20d11325dcdc None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:33.395898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920b6e3-81f1-4699-8e36-20d11325dcdc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:33.395898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920b6e3-81f1-4699-8e36-20d11325dcdc None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:33.397275 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 745/1479] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:05:33.407482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454215bf-e890-4584-b17c-4766c34e2ebf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:33.408082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454215bf-e890-4584-b17c-4766c34e2ebf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:33.408670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454215bf-e890-4584-b17c-4766c34e2ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:33.505339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-454215bf-e890-4584-b17c-4766c34e2ebf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:33.506637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-454215bf-e890-4584-b17c-4766c34e2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:33.616250 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 735/1480] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:33.921879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920b6e3-81f1-4699-8e36-20d11325dcdc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:33.923620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c920b6e3-81f1-4699-8e36-20d11325dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:33.936001 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:34.098267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920b6e3-81f1-4699-8e36-20d11325dcdc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:34.192710 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:34.227181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c901ef-7fc6-4443-a1b0-28ab018e8230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:34.228015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c901ef-7fc6-4443-a1b0-28ab018e8230 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:34.228553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c901ef-7fc6-4443-a1b0-28ab018e8230 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:34.228879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c901ef-7fc6-4443-a1b0-28ab018e8230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:34.231037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-10c901ef-7fc6-4443-a1b0-28ab018e8230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:34.348797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c901ef-7fc6-4443-a1b0-28ab018e8230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:34.350914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c901ef-7fc6-4443-a1b0-28ab018e8230 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:34.375287 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 746/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:36.697398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a8943-3679-48cb-96fa-a3e16e9428e6 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:36.697975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a8943-3679-48cb-96fa-a3e16e9428e6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:36.698277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a8943-3679-48cb-96fa-a3e16e9428e6 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:36.699955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 736/1482] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:05:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:36.706840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37552e9c-0267-4abb-92fd-5070b48bd9d8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:36.707402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37552e9c-0267-4abb-92fd-5070b48bd9d8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:36.707402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37552e9c-0267-4abb-92fd-5070b48bd9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:36.801546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-37552e9c-0267-4abb-92fd-5070b48bd9d8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:36.803353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-37552e9c-0267-4abb-92fd-5070b48bd9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:36.883047 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:36.948538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 747/1483] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:37.257203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a8943-3679-48cb-96fa-a3e16e9428e6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:37.258943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ce7a8943-3679-48cb-96fa-a3e16e9428e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:37.288998 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:37.393877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a8943-3679-48cb-96fa-a3e16e9428e6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:37.490989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad77c38-1f88-40ab-9303-4ace75ed9ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:37.491672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad77c38-1f88-40ab-9303-4ace75ed9ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:37.492036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad77c38-1f88-40ab-9303-4ace75ed9ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:37.492483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad77c38-1f88-40ab-9303-4ace75ed9ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:37.495807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4ad77c38-1f88-40ab-9303-4ace75ed9ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:37.612690 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:37.650077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad77c38-1f88-40ab-9303-4ace75ed9ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:37.651535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad77c38-1f88-40ab-9303-4ace75ed9ca6 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:37.673054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 737/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:39.748373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc7891-7fd8-4cf1-aac8-77b73def5b07 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:39.749252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc7891-7fd8-4cf1-aac8-77b73def5b07 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:39.749252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc7891-7fd8-4cf1-aac8-77b73def5b07 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:39.751010 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 748/1485] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:05:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:05:39.757592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dfecd-116f-4c95-b1fd-64c78912f13f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:39.758300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dfecd-116f-4c95-b1fd-64c78912f13f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:39.758300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dfecd-116f-4c95-b1fd-64c78912f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:39.848452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-902dfecd-116f-4c95-b1fd-64c78912f13f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:39.849697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-902dfecd-116f-4c95-b1fd-64c78912f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:39.971353 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 738/1486] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:40.303087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc7891-7fd8-4cf1-aac8-77b73def5b07 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:40.303087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3efc7891-7fd8-4cf1-aac8-77b73def5b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:40.454344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc7891-7fd8-4cf1-aac8-77b73def5b07 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:40.545954 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:40.547707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa8709-16ad-4c75-b2df-b9f11ab87ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:40.548482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8709-16ad-4c75-b2df-b9f11ab87ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:40.548949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8709-16ad-4c75-b2df-b9f11ab87ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:40.549238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8709-16ad-4c75-b2df-b9f11ab87ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:40.551004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-daaa8709-16ad-4c75-b2df-b9f11ab87ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:40.696859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa8709-16ad-4c75-b2df-b9f11ab87ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:40.698618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa8709-16ad-4c75-b2df-b9f11ab87ae3 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:40.720048 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 749/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:05:42.923125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2236c3-f529-4967-bb2a-f03cfdfdb3c0 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:42.923813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2236c3-f529-4967-bb2a-f03cfdfdb3c0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:42.923813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2236c3-f529-4967-bb2a-f03cfdfdb3c0 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:42.925107 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 739/1488] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:42.935490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235a59-3e4b-4548-a773-d738d0f4c7b3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:42.936769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235a59-3e4b-4548-a773-d738d0f4c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:42.937207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235a59-3e4b-4548-a773-d738d0f4c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:43.052251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9a235a59-3e4b-4548-a773-d738d0f4c7b3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:43.054315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9a235a59-3e4b-4548-a773-d738d0f4c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:43.117828 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:43.172896 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 750/1489] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:43.474576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2236c3-f529-4967-bb2a-f03cfdfdb3c0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:43.476154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ae2236c3-f529-4967-bb2a-f03cfdfdb3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:43.516737 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:43.605113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2236c3-f529-4967-bb2a-f03cfdfdb3c0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:43.699466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5396024-9e65-4f56-90fc-f5529f0c330e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:43.700084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5396024-9e65-4f56-90fc-f5529f0c330e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:43.701208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5396024-9e65-4f56-90fc-f5529f0c330e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:43.701493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5396024-9e65-4f56-90fc-f5529f0c330e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:43.703374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5396024-9e65-4f56-90fc-f5529f0c330e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:43.798587 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:43.833049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5396024-9e65-4f56-90fc-f5529f0c330e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:43.834694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5396024-9e65-4f56-90fc-f5529f0c330e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:43.854975 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 740/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:05:46.551857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa03938-c576-4e12-8f34-cf88c8ea7076 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.552399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa03938-c576-4e12-8f34-cf88c8ea7076 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.552399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa03938-c576-4e12-8f34-cf88c8ea7076 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.553769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 751/1491] 10.222.0.59 () {54 vars in 927 bytes} [Sun Aug 28 01:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:05:46.559137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61e231-34e8-42d6-a8c9-ed9b4a0fd5f0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:46.559614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61e231-34e8-42d6-a8c9-ed9b4a0fd5f0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:46.559727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61e231-34e8-42d6-a8c9-ed9b4a0fd5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:46.631608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fd61e231-34e8-42d6-a8c9-ed9b4a0fd5f0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:46.632837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fd61e231-34e8-42d6-a8c9-ed9b4a0fd5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:46.738374 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 741/1492] 10.222.0.59 () {58 vars in 1024 bytes} [Sun Aug 28 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:47.047856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa03938-c576-4e12-8f34-cf88c8ea7076 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:47.049372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6aa03938-c576-4e12-8f34-cf88c8ea7076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:47.170730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa03938-c576-4e12-8f34-cf88c8ea7076 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:47.251709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93acc3-f75e-43e0-8f89-8bbb4fd0cb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:47.252269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93acc3-f75e-43e0-8f89-8bbb4fd0cb5d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:47.252548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93acc3-f75e-43e0-8f89-8bbb4fd0cb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:47.252823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93acc3-f75e-43e0-8f89-8bbb4fd0cb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:47.254731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cd93acc3-f75e-43e0-8f89-8bbb4fd0cb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:47.265768 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:47.376762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93acc3-f75e-43e0-8f89-8bbb4fd0cb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:47.378331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93acc3-f75e-43e0-8f89-8bbb4fd0cb5d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:47.398782 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 752/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:56.736538 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=82 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:57.396427 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=50 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:12.718680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:12.719288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:12.719288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:12.795809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:12.797008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:12.896653 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 742/1494] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:12.905020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1bedd-3a11-4dc0-a9e3-24e7a1b85186 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:12.905564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1bedd-3a11-4dc0-a9e3-24e7a1b85186 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:12.905564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1bedd-3a11-4dc0-a9e3-24e7a1b85186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:12.984392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fee1bedd-3a11-4dc0-a9e3-24e7a1b85186 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:12.985528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fee1bedd-3a11-4dc0-a9e3-24e7a1b85186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:13.081978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 753/1495] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:13.086646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:13.087864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:13.099933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949606e3-3ae0-4cae-a219-a17dec2ffaf2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:13.163609 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:13.197722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:13.198359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:13.198738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:13.198912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:13.199549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:07:13.199893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:13.200893 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:13.200893 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:07:13.200893 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:07:13.201776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:13.213657 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 743/1496] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:07:13.222396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1bedd-3a11-4dc0-a9e3-24e7a1b85186 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:13.232207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1bedd-3a11-4dc0-a9e3-24e7a1b85186 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:13.293374 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:13.328861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:13.329470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:13.329752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:13.330055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:13.330682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:13.332450 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:13.332450 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:07:13.332450 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:07:13.333662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:13.475388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 754/1497] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:07:13 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:07:13.479630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:13.482025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:13.521731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c79ba-a2a2-4e96-aaf5-ed1dbbec0b8d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:13.615349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:13.615863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:13.616144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:13.616412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:13.617022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:13.618052 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:13.618052 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:07:13.618052 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:07:13.619242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:13.709642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 744/1498] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:07:13 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:07:13.713778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:13.716812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:13.780261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd181-2fd0-4890-9394-57335f8aecf9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:13.868569 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:13.879575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:13.883126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:13.883126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:13.883126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:13.883126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:13.883126 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:13.883126 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:07:13.883126 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:07:13.883778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:13.896650 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 755/1499] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:07:13.900790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:13.902595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:13.914965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6695-7fdb-4261-b272-fe7f7a92db2e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:13.942018 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:14.017308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2103b-5c67-426b-86e0-92ee193eb5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:14.017965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2103b-5c67-426b-86e0-92ee193eb5df admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:14.018249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2103b-5c67-426b-86e0-92ee193eb5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:14.018523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2103b-5c67-426b-86e0-92ee193eb5df admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:14.019303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2103b-5c67-426b-86e0-92ee193eb5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:14.020319 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-d7f2103b-5c67-426b-86e0-92ee193eb5df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:14.020319 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:07:14.020319 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:07:14.021208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2103b-5c67-426b-86e0-92ee193eb5df admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:14.034441 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 745/1500] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:07:14.038760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:14.040294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:14.092989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67493a-c74c-46e9-8885-1c77f151cf33 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:14.308342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc48ee-6c03-4811-8dd7-1098fb76006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:14.308997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc48ee-6c03-4811-8dd7-1098fb76006e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:14.309908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc48ee-6c03-4811-8dd7-1098fb76006e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:14.310183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc48ee-6c03-4811-8dd7-1098fb76006e admin admin] PATH_INFO: `/v3/projects/1a11f3b7a0a24bc09c62b9f4a01aca06/users/470b3e345286429987ab93e8770c89fb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:14.331754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc48ee-6c03-4811-8dd7-1098fb76006e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a11f3b7a0a24bc09c62b9f4a01aca06, user_id=470b3e345286429987ab93e8770c89fb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:14.332787 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-8efc48ee-6c03-4811-8dd7-1098fb76006e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:14.332787 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:07:14.332787 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:07:14.334738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc48ee-6c03-4811-8dd7-1098fb76006e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:14.417353 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 756/1501] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:07:14 2022] PUT /identity/v3/projects/1a11f3b7a0a24bc09c62b9f4a01aca06/users/470b3e345286429987ab93e8770c89fb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:07:14.430924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae362e-6fb3-46c2-a2a6-8f3267ec3c80 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:14.431213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae362e-6fb3-46c2-a2a6-8f3267ec3c80 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:14.431487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae362e-6fb3-46c2-a2a6-8f3267ec3c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:14.488686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-feae362e-6fb3-46c2-a2a6-8f3267ec3c80 None None] MFA Rules not processed for user `470b3e345286429987ab93e8770c89fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:14.489962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-feae362e-6fb3-46c2-a2a6-8f3267ec3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:14.567953 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 746/1502] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:14.581310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655ade-ebbb-4957-b0c4-2b6299fcd244 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:14.581596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655ade-ebbb-4957-b0c4-2b6299fcd244 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:14.581906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655ade-ebbb-4957-b0c4-2b6299fcd244 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:14.583295 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 757/1503] 10.222.0.59 () {54 vars in 964 bytes} [Sun Aug 28 01:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:07:14.588213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d511-85cb-4df7-b5a8-4adf613192f1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:14.588548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d511-85cb-4df7-b5a8-4adf613192f1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:14.588853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d511-85cb-4df7-b5a8-4adf613192f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:14.620177 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:14.666632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-42c5d511-85cb-4df7-b5a8-4adf613192f1 None None] MFA Rules not processed for user `10fe5abbf8c24c3882d8ad3addd241b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:14.667873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-42c5d511-85cb-4df7-b5a8-4adf613192f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:14.747137 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 747/1504] 10.222.0.59 () {58 vars in 1061 bytes} [Sun Aug 28 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:14.754655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b655ade-ebbb-4957-b0c4-2b6299fcd244 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:14.756186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3b655ade-ebbb-4957-b0c4-2b6299fcd244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:14.807259 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:14.861424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b655ade-ebbb-4957-b0c4-2b6299fcd244 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:14.936788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:14.937382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:14.937662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:14.937969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:14.939562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:15.041230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:15.042699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:15.046868 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:15.063109 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 758/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:07:15.111249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76c6-7a78-4fa8-bc52-4da5b8154e9e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:15.111831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76c6-7a78-4fa8-bc52-4da5b8154e9e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:15.111831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76c6-7a78-4fa8-bc52-4da5b8154e9e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:15.113094 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 748/1506] 10.222.0.59 () {52 vars in 830 bytes} [Sun Aug 28 01:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:07:15.116785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:15.118034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:15.227637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622afd-368a-4f0d-98e4-77a450640cca service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:15.326266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:15.326889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:15.327163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:15.327430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] PATH_INFO: `/v3/users/470b3e345286429987ab93e8770c89fb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:15.340100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470b3e345286429987ab93e8770c89fb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:15.341981 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:15.341981 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:07:15.341981 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:07:15.343162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:15.353353 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:15.583401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470b3e345286429987ab93e8770c89fb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:15.583936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470b3e345286429987ab93e8770c89fb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:15.661270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470b3e345286429987ab93e8770c89fb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:15.674267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470b3e345286429987ab93e8770c89fb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:15.674751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470b3e345286429987ab93e8770c89fb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:15.705208 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 759/1507] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:07:15 2022] DELETE /identity/v3/users/470b3e345286429987ab93e8770c89fb => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:07:15.709657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:15.709973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:15.710248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:15.769676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:15.770909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:15.885423 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:15.901196 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 749/1508] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:15.912859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:15.914091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:16.020370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c28da-cd62-4534-ac4c-fdb9061f03a3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:16.084168 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:16.107764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ee02-24ab-4776-804a-8cbf0a0280d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:16.108442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ee02-24ab-4776-804a-8cbf0a0280d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:16.108714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ee02-24ab-4776-804a-8cbf0a0280d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:16.109022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ee02-24ab-4776-804a-8cbf0a0280d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:16.110677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fdd3ee02-24ab-4776-804a-8cbf0a0280d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:16.230336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ee02-24ab-4776-804a-8cbf0a0280d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:16.232301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ee02-24ab-4776-804a-8cbf0a0280d4 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:16.251222 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 760/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:07:16.744397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:16.745674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:16.759268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca3b7-1aef-4a44-a097-ce7edbd31c9a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:16.867872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:16.868498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:16.868773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:16.869067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] PATH_INFO: `/v3/projects/1a11f3b7a0a24bc09c62b9f4a01aca06` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:16.880011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a11f3b7a0a24bc09c62b9f4a01aca06)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:16.881033 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:07:16.881033 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:07:16.881033 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:07:16.882265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:17.034933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a11f3b7a0a24bc09c62b9f4a01aca06', 'request_id': 'req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:17.041132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a11f3b7a0a24bc09c62b9f4a01aca06', 'request_id': 'req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:17.193832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a11f3b7a0a24bc09c62b9f4a01aca06', 'request_id': 'req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:17.227332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] The token cache is being invalidate because project 1a11f3b7a0a24bc09c62b9f4a01aca06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:07:17.227622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:17.228054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26368b83-41f6-4d1d-bc34-2f4ef79f02cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:17.229548 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 750/1510] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:07:16 2022] DELETE /identity/v3/projects/1a11f3b7a0a24bc09c62b9f4a01aca06 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:07:26.248775 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=62 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:27.225113 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:28.446570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59989-ae98-450b-8734-f4a1d475d590 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:28.447148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59989-ae98-450b-8734-f4a1d475d590 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:28.447270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59989-ae98-450b-8734-f4a1d475d590 None None] PATH_INFO: `/v3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:28.448523 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 761/1511] 10.222.0.71 () {54 vars in 925 bytes} [Sun Aug 28 01:10:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:10:28.457295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37d379-b164-4bd8-a514-2374d5951c23 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:28.457764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37d379-b164-4bd8-a514-2374d5951c23 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:28.457905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37d379-b164-4bd8-a514-2374d5951c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:28.539967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ec37d379-b164-4bd8-a514-2374d5951c23 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:28.541182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ec37d379-b164-4bd8-a514-2374d5951c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:28.663858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 751/1512] 10.222.0.71 () {58 vars in 1015 bytes} [Sun Aug 28 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:30.268609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f3d8-6ad7-417a-8fd3-8b18d9e5bd88 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:30.269782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f3d8-6ad7-417a-8fd3-8b18d9e5bd88 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:30.269782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f3d8-6ad7-417a-8fd3-8b18d9e5bd88 None None] PATH_INFO: `/v3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:30.271038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 762/1513] 10.222.0.72 () {54 vars in 925 bytes} [Sun Aug 28 01:10:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:10:30.277179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213b97-9010-4cf1-bb3d-b2953cfae0bf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:30.277688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213b97-9010-4cf1-bb3d-b2953cfae0bf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:30.277797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21213b97-9010-4cf1-bb3d-b2953cfae0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:30.300062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-21213b97-9010-4cf1-bb3d-b2953cfae0bf None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:30.301193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-21213b97-9010-4cf1-bb3d-b2953cfae0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:30.309901 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 752/1514] 10.222.0.72 () {58 vars in 1015 bytes} [Sun Aug 28 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:38.001987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f3ff0-7fae-4fae-9340-519896806341 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:38.002534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f3ff0-7fae-4fae-9340-519896806341 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:38.002534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f3ff0-7fae-4fae-9340-519896806341 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:38.003894 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 763/1515] 10.222.0.59 () {54 vars in 961 bytes} [Sun Aug 28 01:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:10:38.009221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653be717-4795-4158-b643-ac73b8239157 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:38.009702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653be717-4795-4158-b643-ac73b8239157 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:38.009838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653be717-4795-4158-b643-ac73b8239157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:38.029718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-653be717-4795-4158-b643-ac73b8239157 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:38.030940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-653be717-4795-4158-b643-ac73b8239157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:38.040517 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 753/1516] 10.222.0.59 () {58 vars in 1058 bytes} [Sun Aug 28 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:38.047967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f3ff0-7fae-4fae-9340-519896806341 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:38.062226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f3ff0-7fae-4fae-9340-519896806341 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:38.067110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c63fa-ac67-422a-8eb9-62cd1b46501f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:38.067848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c63fa-ac67-422a-8eb9-62cd1b46501f service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:38.068182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c63fa-ac67-422a-8eb9-62cd1b46501f service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:38.068392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c63fa-ac67-422a-8eb9-62cd1b46501f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:38.076565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c63fa-ac67-422a-8eb9-62cd1b46501f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:38.078180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c63fa-ac67-422a-8eb9-62cd1b46501f service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:38.088307 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 764/1517] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:39.117486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653be717-4795-4158-b643-ac73b8239157 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:39.127581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653be717-4795-4158-b643-ac73b8239157 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:39.134713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4722-1445-4be9-88a3-e03f43e747a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:39.135318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4722-1445-4be9-88a3-e03f43e747a0 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:39.135603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4722-1445-4be9-88a3-e03f43e747a0 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:39.135887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4722-1445-4be9-88a3-e03f43e747a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:39.144445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4722-1445-4be9-88a3-e03f43e747a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:39.146057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4722-1445-4be9-88a3-e03f43e747a0 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:39.156191 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 754/1518] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:48.084292 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:49.152014 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:50.158143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db7fa8-dab4-4547-ad2a-50003c56cd12 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:50.158754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db7fa8-dab4-4547-ad2a-50003c56cd12 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:50.158754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db7fa8-dab4-4547-ad2a-50003c56cd12 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:50.160095 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 765/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:10:50.165533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654004-0cfc-427b-ac95-4e8c314e2be2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:50.166083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654004-0cfc-427b-ac95-4e8c314e2be2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:50.166491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654004-0cfc-427b-ac95-4e8c314e2be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:50.228010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cd654004-0cfc-427b-ac95-4e8c314e2be2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:50.229234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cd654004-0cfc-427b-ac95-4e8c314e2be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:50.313526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 755/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:50.471674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db7fa8-dab4-4547-ad2a-50003c56cd12 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:50.473413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f2db7fa8-dab4-4547-ad2a-50003c56cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:50.590815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db7fa8-dab4-4547-ad2a-50003c56cd12 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:50.596875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbbd3-fd90-4039-ad4d-b88876c9854a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:50.597654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbbd3-fd90-4039-ad4d-b88876c9854a service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:50.597967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbbd3-fd90-4039-ad4d-b88876c9854a service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:50.598242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbbd3-fd90-4039-ad4d-b88876c9854a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:50.607516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbbd3-fd90-4039-ad4d-b88876c9854a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:50.609143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbbd3-fd90-4039-ad4d-b88876c9854a service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:50.620323 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 766/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:51.481957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c34a-7176-404c-8f3e-9d9272103f4e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:51.482542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c34a-7176-404c-8f3e-9d9272103f4e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:51.482542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46c34a-7176-404c-8f3e-9d9272103f4e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:51.483900 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 01:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:10:51.489084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9461c-c5d7-4d80-8277-2307f74c12fc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:51.489553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9461c-c5d7-4d80-8277-2307f74c12fc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:51.489657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9461c-c5d7-4d80-8277-2307f74c12fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:51.508848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-12f9461c-c5d7-4d80-8277-2307f74c12fc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:51.510859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-12f9461c-c5d7-4d80-8277-2307f74c12fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:51.518525 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:51.672490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c34a-7176-404c-8f3e-9d9272103f4e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:51.687137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46c34a-7176-404c-8f3e-9d9272103f4e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:51.692506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a66854-88dc-4f20-8441-8803723d8515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:51.693099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a66854-88dc-4f20-8441-8803723d8515 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:51.693376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a66854-88dc-4f20-8441-8803723d8515 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:51.693645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a66854-88dc-4f20-8441-8803723d8515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:51.702408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a66854-88dc-4f20-8441-8803723d8515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:51.703973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a66854-88dc-4f20-8441-8803723d8515 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:51.713751 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 757/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:55.635231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c65c-1b68-4b2b-9554-227546dd35cb None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:55.635821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c65c-1b68-4b2b-9554-227546dd35cb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:55.635821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c65c-1b68-4b2b-9554-227546dd35cb None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:55.637161 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:10:55.645577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b125f-2cab-46d1-add7-bd87ff74703e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:55.645577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b125f-2cab-46d1-add7-bd87ff74703e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:55.645577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b125f-2cab-46d1-add7-bd87ff74703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:55.665798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-067b125f-2cab-46d1-add7-bd87ff74703e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:55.667060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-067b125f-2cab-46d1-add7-bd87ff74703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:55.675172 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:10:55.965424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90c65c-1b68-4b2b-9554-227546dd35cb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:55.967179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6d90c65c-1b68-4b2b-9554-227546dd35cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:56.054340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90c65c-1b68-4b2b-9554-227546dd35cb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:56.058789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44fd70-2176-42c9-a740-63c12a642dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:56.059479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44fd70-2176-42c9-a740-63c12a642dcc service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:56.059750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44fd70-2176-42c9-a740-63c12a642dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:56.060020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44fd70-2176-42c9-a740-63c12a642dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:56.070859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44fd70-2176-42c9-a740-63c12a642dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:56.073022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44fd70-2176-42c9-a740-63c12a642dcc service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:56.084468 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 769/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:58.076789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260c59-2efa-45c5-b154-2635567e1e94 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:58.077372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260c59-2efa-45c5-b154-2635567e1e94 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:58.077372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1260c59-2efa-45c5-b154-2635567e1e94 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:58.078763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 01:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:10:58.084110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f516d-b933-4e02-9a27-2efe771c58ff None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:58.084573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f516d-b933-4e02-9a27-2efe771c58ff None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:58.084679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f516d-b933-4e02-9a27-2efe771c58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:58.104584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bc9f516d-b933-4e02-9a27-2efe771c58ff None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:58.105801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bc9f516d-b933-4e02-9a27-2efe771c58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:58.113561 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:58.409344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1260c59-2efa-45c5-b154-2635567e1e94 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:58.421040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1260c59-2efa-45c5-b154-2635567e1e94 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:58.424642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51327a4e-524a-4dff-bcf3-f6427ed3f29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:58.425253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327a4e-524a-4dff-bcf3-f6427ed3f29f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:58.425549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327a4e-524a-4dff-bcf3-f6427ed3f29f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:58.425804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327a4e-524a-4dff-bcf3-f6427ed3f29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:58.435805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51327a4e-524a-4dff-bcf3-f6427ed3f29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:58.437234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51327a4e-524a-4dff-bcf3-f6427ed3f29f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:58.446698 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 760/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:08.099204 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:08.442532 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=65 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:51.381179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b9ac2-36ea-4742-af25-43ba30f53dfb None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:51.381735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b9ac2-36ea-4742-af25-43ba30f53dfb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:51.381867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b9ac2-36ea-4742-af25-43ba30f53dfb None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:51.384456 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 771/1531] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:11:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:11:51.389649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa938ffa-ac7f-495c-9dfb-b86dc4ff5dbf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:51.390167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa938ffa-ac7f-495c-9dfb-b86dc4ff5dbf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:51.390252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa938ffa-ac7f-495c-9dfb-b86dc4ff5dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:51.412594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aa938ffa-ac7f-495c-9dfb-b86dc4ff5dbf None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:11:51.413801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aa938ffa-ac7f-495c-9dfb-b86dc4ff5dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:51.423018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 761/1532] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:12:01.406911 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:24.309944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2095b8c-f2aa-4eb7-ace5-c35e04b54afd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.310544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2095b8c-f2aa-4eb7-ace5-c35e04b54afd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.310544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2095b8c-f2aa-4eb7-ace5-c35e04b54afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.327981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72c7be-64cb-42f9-8d28-2bde5bddbaba None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.336436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72c7be-64cb-42f9-8d28-2bde5bddbaba None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.336436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72c7be-64cb-42f9-8d28-2bde5bddbaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.373009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d2095b8c-f2aa-4eb7-ace5-c35e04b54afd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.374293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d2095b8c-f2aa-4eb7-ace5-c35e04b54afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.382563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7b72c7be-64cb-42f9-8d28-2bde5bddbaba None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.383878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7b72c7be-64cb-42f9-8d28-2bde5bddbaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.406029 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 772/1533] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.409038 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 762/1534] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.417691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db740-282f-48b5-b35c-71dc94be2310 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.418073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db740-282f-48b5-b35c-71dc94be2310 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.418293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db740-282f-48b5-b35c-71dc94be2310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.423185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1282-3f43-4027-bc52-fed8f334e034 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.423504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1282-3f43-4027-bc52-fed8f334e034 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.423755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1282-3f43-4027-bc52-fed8f334e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.495602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b22db740-282f-48b5-b35c-71dc94be2310 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.496847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b22db740-282f-48b5-b35c-71dc94be2310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.500452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b44f1282-3f43-4027-bc52-fed8f334e034 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.501685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b44f1282-3f43-4027-bc52-fed8f334e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.518014 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 773/1535] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.519549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9987-3575-47ea-bff8-e8a38ae35076 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.519838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9987-3575-47ea-bff8-e8a38ae35076 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.520113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9987-3575-47ea-bff8-e8a38ae35076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.524629 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 763/1536] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.525542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1282-3f43-4027-bc52-fed8f334e034 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:24.545683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1282-3f43-4027-bc52-fed8f334e034 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:24.562456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:24.563002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.563285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.563561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.564221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:24.564532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:24.567626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6fec9987-3575-47ea-bff8-e8a38ae35076 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.569452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6fec9987-3575-47ea-bff8-e8a38ae35076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.570745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:24.590076 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 774/1537] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.591154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9987-3575-47ea-bff8-e8a38ae35076 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:24.594037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 764/1538] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:24.602568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9987-3575-47ea-bff8-e8a38ae35076 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:24.607673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:24.608292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.608579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.608851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.609510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:24.609831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:24.610858 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:12:24.610858 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:12:24.610858 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:12:24.611999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59d72-10b1-42b8-aeb6-3de509dc5667 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:24.613162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:24.628395 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 775/1539] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:24.629722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f2996-b976-4768-8a42-1c314be121be None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.630016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f2996-b976-4768-8a42-1c314be121be None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.630293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f2996-b976-4768-8a42-1c314be121be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.631898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a5b4-f2a8-4cb8-a52b-54cb4bde251c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:24.641991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef537-6cfd-48e8-80e4-fc9470bed52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:24.642965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef537-6cfd-48e8-80e4-fc9470bed52d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.643450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef537-6cfd-48e8-80e4-fc9470bed52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.643919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef537-6cfd-48e8-80e4-fc9470bed52d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.644746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbef537-6cfd-48e8-80e4-fc9470bed52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:24.646061 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-2bbef537-6cfd-48e8-80e4-fc9470bed52d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:12:24.646061 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:12:24.646061 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:12:24.653994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-662f2996-b976-4768-8a42-1c314be121be None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.654572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbef537-6cfd-48e8-80e4-fc9470bed52d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:24.656847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-662f2996-b976-4768-8a42-1c314be121be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.671705 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 776/1540] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.672995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b70a-f666-4771-bcbf-cd639cf6e905 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.673900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b70a-f666-4771-bcbf-cd639cf6e905 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.674177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5b70a-f666-4771-bcbf-cd639cf6e905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.697367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b2c5b70a-f666-4771-bcbf-cd639cf6e905 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.698600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2c5b70a-f666-4771-bcbf-cd639cf6e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.708264 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 777/1541] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.709960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b70a-f666-4771-bcbf-cd639cf6e905 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:24.721077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5b70a-f666-4771-bcbf-cd639cf6e905 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:24.726924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55f6ba-2568-48f9-83f3-fe8b42677890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:24.727546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55f6ba-2568-48f9-83f3-fe8b42677890 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.727827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55f6ba-2568-48f9-83f3-fe8b42677890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.728102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55f6ba-2568-48f9-83f3-fe8b42677890 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.728749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55f6ba-2568-48f9-83f3-fe8b42677890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:24.730773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55f6ba-2568-48f9-83f3-fe8b42677890 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:24.766552 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 765/1542] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/projects => generated 393 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:24.771151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c229-b54e-46ce-b69c-03dd54f04469 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.772449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c229-b54e-46ce-b69c-03dd54f04469 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.773013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c229-b54e-46ce-b69c-03dd54f04469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.795470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8822c229-b54e-46ce-b69c-03dd54f04469 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.797079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8822c229-b54e-46ce-b69c-03dd54f04469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.860155 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 766/1543] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.860884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822c229-b54e-46ce-b69c-03dd54f04469 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:24.862859 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 778/1544] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:24.864116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417e512-b769-483d-9175-1a8e99ada4fe None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.864393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417e512-b769-483d-9175-1a8e99ada4fe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.864660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417e512-b769-483d-9175-1a8e99ada4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.875669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822c229-b54e-46ce-b69c-03dd54f04469 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:24.885566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0417e512-b769-483d-9175-1a8e99ada4fe None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.886800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0417e512-b769-483d-9175-1a8e99ada4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.937083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:24.937703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.938008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.938286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.938934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:24.939243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:24.940965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:24.948303 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 779/1545] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.949583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90fd3-4278-464e-9ac1-349aa76cd203 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.949902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90fd3-4278-464e-9ac1-349aa76cd203 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.950178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90fd3-4278-464e-9ac1-349aa76cd203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.962093 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 767/1546] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:24.962093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:24.967378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6155f-6e6e-44b4-a904-c62d496a90f7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:24.972557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:24.973159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.973441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.973712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:24.974403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:24.976674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:24.976903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a6a90fd3-4278-464e-9ac1-349aa76cd203 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:24.978207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a6a90fd3-4278-464e-9ac1-349aa76cd203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:24.986150 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 780/1547] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:24.987358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d6598-7234-4745-9b0a-d5100e87b232 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:24.987642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d6598-7234-4745-9b0a-d5100e87b232 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:24.987919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d6598-7234-4745-9b0a-d5100e87b232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.007589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0f8d6598-7234-4745-9b0a-d5100e87b232 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:25.008789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f8d6598-7234-4745-9b0a-d5100e87b232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:25.016711 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 781/1548] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:25.017907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d00b-a199-439c-bc53-2712ec8ae828 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.018218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d00b-a199-439c-bc53-2712ec8ae828 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.018497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d00b-a199-439c-bc53-2712ec8ae828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.039503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3988d00b-a199-439c-bc53-2712ec8ae828 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:25.040785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3988d00b-a199-439c-bc53-2712ec8ae828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:25.049161 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 782/1549] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:25.050520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878598a-40ae-4769-9969-834171a077f9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.050811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878598a-40ae-4769-9969-834171a077f9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.051088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878598a-40ae-4769-9969-834171a077f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.071835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8878598a-40ae-4769-9969-834171a077f9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:25.073051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8878598a-40ae-4769-9969-834171a077f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:25.081600 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 783/1550] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:25.082445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878598a-40ae-4769-9969-834171a077f9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.086600 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 768/1551] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:24 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:25.087609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.093249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878598a-40ae-4769-9969-834171a077f9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.097862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd67d-d793-4f1e-9773-ee35b1e1090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.098332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de332-c259-4949-81f3-c25679b48fb5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.098462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd67d-d793-4f1e-9773-ee35b1e1090e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.098747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd67d-d793-4f1e-9773-ee35b1e1090e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.099033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd67d-d793-4f1e-9773-ee35b1e1090e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.099997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd67d-d793-4f1e-9773-ee35b1e1090e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.101457 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-027fd67d-d793-4f1e-9773-ee35b1e1090e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:12:25.101457 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:12:25.101457 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:12:25.102714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd67d-d793-4f1e-9773-ee35b1e1090e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.104234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.104479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.104758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.105028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.105677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:25.106007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.107784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.121111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 769/1552] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:25.121868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.132148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad6eb6-4835-4c88-97d5-f2bc748a7a04 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.137623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.137623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.137930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.138205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.138859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.140812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.145429 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:25.238273 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 784/1553] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:25.239534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ab44-caf0-4a38-b5e3-c421d11a1909 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.239823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ab44-caf0-4a38-b5e3-c421d11a1909 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.240655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307ab44-caf0-4a38-b5e3-c421d11a1909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.261001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f307ab44-caf0-4a38-b5e3-c421d11a1909 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:25.264853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f307ab44-caf0-4a38-b5e3-c421d11a1909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:25.270084 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 785/1554] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:25.271262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aef19-1dd9-412d-ac87-5b3c44b61e25 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.271594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aef19-1dd9-412d-ac87-5b3c44b61e25 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.271863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aef19-1dd9-412d-ac87-5b3c44b61e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.291112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-855aef19-1dd9-412d-ac87-5b3c44b61e25 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:25.292340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-855aef19-1dd9-412d-ac87-5b3c44b61e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:25.300252 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 786/1555] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:25.301409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11b46-e56b-44b6-9d17-1375fc50b84d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.301692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11b46-e56b-44b6-9d17-1375fc50b84d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.301997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11b46-e56b-44b6-9d17-1375fc50b84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.321659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-22d11b46-e56b-44b6-9d17-1375fc50b84d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:25.322999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-22d11b46-e56b-44b6-9d17-1375fc50b84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:25.330803 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 787/1556] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:25.331570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11b46-e56b-44b6-9d17-1375fc50b84d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.341213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11b46-e56b-44b6-9d17-1375fc50b84d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.346001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.346590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.346874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.347148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.347816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:25.348121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.350243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.362876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 788/1557] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:25.363752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.379411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0650e-b02c-4e5a-a8a1-1e1b588f2bdb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.379611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.380205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.380513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.381387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.382056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.383643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.394508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 789/1558] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:25.395449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.405839 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:25.412686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912636d-073c-400f-9423-2d926faec22f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.412686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.412686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.412686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.413857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.413857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.414894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.459154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 770/1559] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/projects => generated 381 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:25.459154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.521760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5590734-f14d-4ed4-be9e-3f60cbb269f5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.526840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.528591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.528591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.528591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.528842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.530532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.541538 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 771/1560] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:25.542390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.551855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303fe18-9221-49ea-ae36-a08d8140343c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.557521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.565659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.565659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.565659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.565659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:25.566056 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 790/1561] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:25.566147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.566226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.566318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.575484 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 772/1562] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:25.576667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.587921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa27040-a323-4ccf-9ebc-a955613849b9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.634695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdf7b6-f61c-4720-9b1a-23b76987704d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.639375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.639987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.640268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.640538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.641251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:25.641523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.643171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.651027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.651679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.651964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.652648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.652894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:25.653205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.655118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.663358 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 791/1563] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:25.663358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.667779 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 773/1564] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:25.668828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.680934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be8c14-36de-4f62-9dd8-dd55c2fba126 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.685962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.686468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd924e5-4bb5-4477-b41c-52cd77d79015 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.686612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.686965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.687261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.687851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.689842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.692106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.692106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.692326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.692480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.693156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.694772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.705855 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 774/1565] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:25.709966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.719859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3518d22-3f99-4401-939a-55155f2db1d8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.725088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.725700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.726372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.726654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.727309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.729201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.793184 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 792/1566] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:25.793184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.830131 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 775/1567] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:25.830131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.838254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009911d7-7b7b-4849-ab7c-1044e697121e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.863590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe490d1-2a3c-4ea0-bc2e-a107ab79ae49 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.869183 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:25.869314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.869714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.870022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.870294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.870937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.872549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.883417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 793/1568] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:25.884228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:25.895945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6a06-1c57-409a-8b6d-3f7732182139 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:25.898308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.899008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.899288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.899395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:25.899605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.899949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:25.900229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:25.900332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.900502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:25.901120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:25.902345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.903077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:25.992646 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 776/1569] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:25.993440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.003166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be68d-3614-4246-95c8-4a84fcef21bb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.008641 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 794/1570] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:26.008641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.039521 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:26.066266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.066877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.067156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.067423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.069008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.071202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.073284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237a2ab-0ad6-49cf-9bdb-3f8221240b4b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.077599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.078238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.078520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.078793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.079427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.081352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.175088 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 777/1571] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:25 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:26.175936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.207744 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 795/1572] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:26 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:26.207744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.241367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690ea0-b757-40cc-9460-08a7017a1c85 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.274171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dcea-a854-4804-b8a1-0c095b781669 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.278895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.279536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.280074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.280349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.281037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.283141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.296316 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:26.303982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.304662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.304942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.305215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] PATH_INFO: `/v3/projects/8bf2921c4efa4f5cb9ae512a63571070/users/3f3e53092a8940339fd588b46293a924/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.320843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf2921c4efa4f5cb9ae512a63571070, user_id=3f3e53092a8940339fd588b46293a924, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.326045 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:12:26.326045 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:12:26.326045 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:12:26.326045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.386285 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 796/1573] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:26 2022] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:26.387109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.397515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf5a8c-3ef7-4464-bf9c-7439bb095192 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.402079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.402672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.402950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.403220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.403852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.405762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.417087 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 797/1574] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.418173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.423526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 778/1575] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:26 2022] PUT /identity/v3/projects/8bf2921c4efa4f5cb9ae512a63571070/users/3f3e53092a8940339fd588b46293a924/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:26.432390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e33a-f896-4ccf-9cb0-4e35cea200c4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.433508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.496174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.496839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.497252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.497531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] PATH_INFO: `/v3/projects/71e504bc07ea45f09123ad98138acf2b/users/0a5b5ed8ca6947eba375a1baf8e3f6a1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.501269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60166f7f-e500-4f71-b164-3e92c679412c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.507170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.507947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.508232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.508505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.509191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.510824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.514066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e504bc07ea45f09123ad98138acf2b, user_id=0a5b5ed8ca6947eba375a1baf8e3f6a1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.515391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.521206 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 779/1576] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.522271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.532044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3d8f7-db16-4fa8-971c-1bbeebe78cba admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.536748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.538000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.542789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.542789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.542789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.542789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.597501 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 798/1577] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:26 2022] PUT /identity/v3/projects/71e504bc07ea45f09123ad98138acf2b/users/0a5b5ed8ca6947eba375a1baf8e3f6a1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:26.598459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.617427 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:26.632304 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 780/1578] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:26 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:26.634249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.644329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ac3d9-f912-401a-b059-a64153adf9b5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.662922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797f860-9196-48c3-b495-3f42d024236e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.667982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.668598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.668913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.669192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.669841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.671844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.705138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.705676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.705998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.706290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.706966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.709508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.785597 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 781/1579] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:26 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:26.789690 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 799/1580] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:26 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:26.789969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.790061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.799026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016134a8-e550-498e-980b-83d2016bb20f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.799650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faba686-951e-4004-80b0-f00c7c84e8e7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.803982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.804341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617002-ea85-4b62-abc0-50b4cea727dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.804584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.804869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.804964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617002-ea85-4b62-abc0-50b4cea727dd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.805149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.805239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617002-ea85-4b62-abc0-50b4cea727dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.805452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617002-ea85-4b62-abc0-50b4cea727dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.805791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.806147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617002-ea85-4b62-abc0-50b4cea727dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.807413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.807808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617002-ea85-4b62-abc0-50b4cea727dd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.818446 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 800/1581] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.818951 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 782/1582] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.819496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.819802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354f29b-568c-4586-ac8e-b9e954ce37be None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.820079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354f29b-568c-4586-ac8e-b9e954ce37be None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.820464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354f29b-568c-4586-ac8e-b9e954ce37be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.830017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4492a6d-202d-4381-a7fe-cf8428e21551 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.835303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5b1b-0f6a-47d4-a4cc-3eefceee73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.835935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5b1b-0f6a-47d4-a4cc-3eefceee73dc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.836213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5b1b-0f6a-47d4-a4cc-3eefceee73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.836492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5b1b-0f6a-47d4-a4cc-3eefceee73dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.837128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5b1b-0f6a-47d4-a4cc-3eefceee73dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.838746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5b1b-0f6a-47d4-a4cc-3eefceee73dc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.848205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9354f29b-568c-4586-ac8e-b9e954ce37be None None] MFA Rules not processed for user `3f3e53092a8940339fd588b46293a924`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:26.849447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9354f29b-568c-4586-ac8e-b9e954ce37be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:26.853663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 783/1583] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.853663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba313-6d40-4547-9634-fb13434630fe None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.853663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba313-6d40-4547-9634-fb13434630fe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.853663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba313-6d40-4547-9634-fb13434630fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.879686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f05ba313-6d40-4547-9634-fb13434630fe None None] MFA Rules not processed for user `0a5b5ed8ca6947eba375a1baf8e3f6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:26.880947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f05ba313-6d40-4547-9634-fb13434630fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:26.898629 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:26.919775 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 801/1584] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:26.920685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354f29b-568c-4586-ac8e-b9e954ce37be None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.931824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354f29b-568c-4586-ac8e-b9e954ce37be None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.938152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.939197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.939739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.940183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.941362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.945039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.953702 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 784/1585] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:26.953702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba313-6d40-4547-9634-fb13434630fe None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.957689 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 802/1586] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.958488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.961526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba313-6d40-4547-9634-fb13434630fe None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.966531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.967137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.967426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.967706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.968364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b765-efe3-4deb-9d05-5484c2029ab8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:26.968486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.970021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.973095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:26.973696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:26.974013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:26.974338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:26.975156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:26.976859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:26.981833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 785/1587] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.982824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.988107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 803/1588] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:26.989509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:26.996268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77303-47b9-463f-a0ba-59de0fbfd38a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.000518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24421862-0760-4093-8868-fd75fe62f0a3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.001046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.002004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.002288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.002563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] PATH_INFO: `/v3/projects/0ee74efdc6484fe69fd16416784472f1/users/55f47c4e3dfa47f8afb0b059e47dcad9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.005131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.006345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.006630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.006927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.007547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.009139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.018985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee74efdc6484fe69fd16416784472f1, user_id=55f47c4e3dfa47f8afb0b059e47dcad9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.023964 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 804/1589] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:27.023964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.024148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.031267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4164d-2384-4baa-9229-092e88e079e1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.036037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.036725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.037036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.037386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] PATH_INFO: `/v3/projects/29e4542bf2a74ae7bb21448cc8aaa079/users/844b9eb1cf1041459a1e1cd1c3c8fdbc/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.051853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e4542bf2a74ae7bb21448cc8aaa079, user_id=844b9eb1cf1041459a1e1cd1c3c8fdbc, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.055156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.107433 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 786/1590] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:26 2022] PUT /identity/v3/projects/0ee74efdc6484fe69fd16416784472f1/users/55f47c4e3dfa47f8afb0b059e47dcad9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:27.108023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.158595 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 805/1591] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:27 2022] PUT /identity/v3/projects/29e4542bf2a74ae7bb21448cc8aaa079/users/844b9eb1cf1041459a1e1cd1c3c8fdbc/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:27.159215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.180091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e3b7-f9c4-48eb-9ea0-041742908ff1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.196063 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:27.233429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521b63e-92ab-4ca8-bcdc-f5599f2d6c38 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.238339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.239018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.239319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.239588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.240286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.241459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.242114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.244381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.244490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.244569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.244569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.245138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.252979 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 806/1592] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:27.255150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.257985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:27.314667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb47d27-9a32-42ff-ad11-5415e1721de3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.319065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.319752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.320028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.320302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.341390 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 787/1593] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:27 2022] POST /identity/v3/projects => generated 395 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:27.341887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.356813 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:27.382465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.383922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.393921 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 807/1594] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:27.395200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.410719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25fc5-7e38-4c08-aa3f-b97afccf6d7e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.412804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7883-1f6e-4ae8-887b-1fd21d675078 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.416381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955956d-e4b2-4760-b396-df5d6b360b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.417100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955956d-e4b2-4760-b396-df5d6b360b52 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.417454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955956d-e4b2-4760-b396-df5d6b360b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.417622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.417897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955956d-e4b2-4760-b396-df5d6b360b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.421726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.421726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.421991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955956d-e4b2-4760-b396-df5d6b360b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.422111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.422111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.422265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955956d-e4b2-4760-b396-df5d6b360b52 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.422349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.434701 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 788/1595] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:27.435624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.441449 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 808/1596] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:27.443506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce653df-1e80-4ea8-b662-883384b9367b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.444690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce653df-1e80-4ea8-b662-883384b9367b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.445047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce653df-1e80-4ea8-b662-883384b9367b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.448504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2b131-e815-4c2a-9159-f9b5b5f8103e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.457044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.457044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.457044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.457044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] PATH_INFO: `/v3/projects/67ab0dbe553e4ecda923545bdcd19e34/users/e3b41f02eca449e4ac13e3a36d65d57c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.475212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ab0dbe553e4ecda923545bdcd19e34, user_id=e3b41f02eca449e4ac13e3a36d65d57c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.478360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.479093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8ce653df-1e80-4ea8-b662-883384b9367b None None] MFA Rules not processed for user `55f47c4e3dfa47f8afb0b059e47dcad9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:27.480411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ce653df-1e80-4ea8-b662-883384b9367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:27.538943 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:27.548262 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 809/1597] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:27.549582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6438cbe-9f64-46ae-bbb3-2a5a4935a62f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.550000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6438cbe-9f64-46ae-bbb3-2a5a4935a62f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.550339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6438cbe-9f64-46ae-bbb3-2a5a4935a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.575721 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 789/1598] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:27 2022] PUT /identity/v3/projects/67ab0dbe553e4ecda923545bdcd19e34/users/e3b41f02eca449e4ac13e3a36d65d57c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:27.578337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.581764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c6438cbe-9f64-46ae-bbb3-2a5a4935a62f None None] MFA Rules not processed for user `844b9eb1cf1041459a1e1cd1c3c8fdbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:27.583020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c6438cbe-9f64-46ae-bbb3-2a5a4935a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:27.650952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1d7a-aa53-4557-bf21-5976362316f7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.656021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.656435 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 810/1599] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:27.657268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6438cbe-9f64-46ae-bbb3-2a5a4935a62f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.660127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.660407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.660678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] PATH_INFO: `/v3/projects/d38deb3f03f1474a9f4b89967807d763/users/2efb9a5cdcce45a4aae5da632f80af88/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.669700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6438cbe-9f64-46ae-bbb3-2a5a4935a62f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.674693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.675297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.675585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.675954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38deb3f03f1474a9f4b89967807d763, user_id=2efb9a5cdcce45a4aae5da632f80af88, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.676057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.676605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.679106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.679301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.775322 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 790/1600] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:27 2022] PUT /identity/v3/projects/d38deb3f03f1474a9f4b89967807d763/users/2efb9a5cdcce45a4aae5da632f80af88/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:27.776123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.800556 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 811/1601] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:27 2022] POST /identity/v3/users => generated 304 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:27.800556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.808630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79dc7-c42a-421e-9940-0641d6442c7e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.840122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d13a69-5fd9-43d2-a20f-f187863de2be admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:27.844917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.845574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.845898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.846161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] PATH_INFO: `/v3/projects/bfd9b2dce09f40daad9100d256e67557/users/b6a0d182189743298110f925ff07e153/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.858324 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:27.862518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd9b2dce09f40daad9100d256e67557, user_id=b6a0d182189743298110f925ff07e153, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.865563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.867945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff09e1-b6b0-42fb-b55d-20e551c68f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:27.868639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff09e1-b6b0-42fb-b55d-20e551c68f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.868914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff09e1-b6b0-42fb-b55d-20e551c68f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.869185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff09e1-b6b0-42fb-b55d-20e551c68f13 admin admin] PATH_INFO: `/v3/projects/c16da8ed6fb24dbebd053e32122bfbfd/users/e03fabbf78b74eb6a545c2fe1c81dd3c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.884604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff09e1-b6b0-42fb-b55d-20e551c68f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16da8ed6fb24dbebd053e32122bfbfd, user_id=e03fabbf78b74eb6a545c2fe1c81dd3c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:27.887380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff09e1-b6b0-42fb-b55d-20e551c68f13 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:27.940305 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 791/1602] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:27 2022] PUT /identity/v3/projects/bfd9b2dce09f40daad9100d256e67557/users/b6a0d182189743298110f925ff07e153/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:27.941251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:27.964679 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 812/1603] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:27 2022] PUT /identity/v3/projects/c16da8ed6fb24dbebd053e32122bfbfd/users/e03fabbf78b74eb6a545c2fe1c81dd3c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:27.966227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f0646-b3c2-491d-92b3-7b18598daa4d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:27.966513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f0646-b3c2-491d-92b3-7b18598daa4d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:27.966789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f0646-b3c2-491d-92b3-7b18598daa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:27.996091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ef5f0646-b3c2-491d-92b3-7b18598daa4d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:27.997310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef5f0646-b3c2-491d-92b3-7b18598daa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.006135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba12fec-f935-410f-ae13-309ee4f598b0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.043614 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:28.058259 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 813/1604] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:28.059000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f0646-b3c2-491d-92b3-7b18598daa4d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.064453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.065082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.065372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.065785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.066468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.069636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.070136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f0646-b3c2-491d-92b3-7b18598daa4d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.074940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8865e-43df-4e7e-bd6b-e0bbbd9c5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.075550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8865e-43df-4e7e-bd6b-e0bbbd9c5d7f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.075910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8865e-43df-4e7e-bd6b-e0bbbd9c5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.076283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8865e-43df-4e7e-bd6b-e0bbbd9c5d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.077172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8865e-43df-4e7e-bd6b-e0bbbd9c5d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.079816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8865e-43df-4e7e-bd6b-e0bbbd9c5d7f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.181383 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 792/1605] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:27 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:28.182413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.193952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 814/1606] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/projects => generated 397 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:28.195251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d14b-3e5d-46d5-983c-91ac80e1c1e6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.195547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d14b-3e5d-46d5-983c-91ac80e1c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.195938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d14b-3e5d-46d5-983c-91ac80e1c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.224976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e388d14b-3e5d-46d5-983c-91ac80e1c1e6 None None] MFA Rules not processed for user `2efb9a5cdcce45a4aae5da632f80af88`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:28.226246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e388d14b-3e5d-46d5-983c-91ac80e1c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.249196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e3d74-7d80-4d5f-8144-631534e937f2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.290877 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:28.295529 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 815/1607] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:28.298745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d14b-3e5d-46d5-983c-91ac80e1c1e6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.325681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.326607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.326892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.327172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] PATH_INFO: `/v3/users/0a5b5ed8ca6947eba375a1baf8e3f6a1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.328634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5b5ed8ca6947eba375a1baf8e3f6a1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.329750 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:12:28.329750 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:12:28.329750 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:12:28.331009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.364016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d14b-3e5d-46d5-983c-91ac80e1c1e6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.369738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7f75e-bc7e-40df-a493-02b3190af8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.370452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f75e-bc7e-40df-a493-02b3190af8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.370740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f75e-bc7e-40df-a493-02b3190af8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.371016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7f75e-bc7e-40df-a493-02b3190af8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.371668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7f75e-bc7e-40df-a493-02b3190af8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.373299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7f75e-bc7e-40df-a493-02b3190af8a2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.384503 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 816/1608] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:28.385918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b812-cde1-4238-b355-9387a195bba1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.386249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b812-cde1-4238-b355-9387a195bba1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.386525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240b812-cde1-4238-b355-9387a195bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.416075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f240b812-cde1-4238-b355-9387a195bba1 None None] MFA Rules not processed for user `b6a0d182189743298110f925ff07e153`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:28.417317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f240b812-cde1-4238-b355-9387a195bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.464000 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:28.484463 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 817/1609] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:28.485709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6c68-0712-4a11-8f95-89041a4476d1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.486029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6c68-0712-4a11-8f95-89041a4476d1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.486306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6c68-0712-4a11-8f95-89041a4476d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.514850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c9fe6c68-0712-4a11-8f95-89041a4476d1 None None] MFA Rules not processed for user `e03fabbf78b74eb6a545c2fe1c81dd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:28.516061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c9fe6c68-0712-4a11-8f95-89041a4476d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.569384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5b5ed8ca6947eba375a1baf8e3f6a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:28.584294 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 818/1610] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:28.585162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6c68-0712-4a11-8f95-89041a4476d1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.591783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5b5ed8ca6947eba375a1baf8e3f6a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:28.603827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5b5ed8ca6947eba375a1baf8e3f6a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:28.604575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5b5ed8ca6947eba375a1baf8e3f6a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:28.640971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6c68-0712-4a11-8f95-89041a4476d1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.645105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.645713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.646039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.646495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.651984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.660600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.662579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.671798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5b5ed8ca6947eba375a1baf8e3f6a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:28.671977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 819/1611] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:28.672739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.674010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.682899 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 793/1612] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:28 2022] DELETE /identity/v3/users/0a5b5ed8ca6947eba375a1baf8e3f6a1 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:28.682899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.682899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.688828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243a25-f0c1-4afb-92b2-b525690bbcae service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.752014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.752224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.752391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.752657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.753283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.755277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.756377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036dd7-4ece-4392-9c2f-965d8cf5780f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.761255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.761991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.762272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.762548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.763375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.766479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.867392 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 820/1613] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:28.868206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.869934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.882603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94137cb-1d4d-4fe1-b0c7-2ba0e09bb9a0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.887299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.888050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.889456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.889456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.889456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.890139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 794/1614] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/users => generated 305 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:28.890769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.891562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.894407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:28.898054 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:28.907258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226602cd-17d3-4657-a018-ffce21af17b0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:28.912477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:28.913168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:28.913491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:28.913770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] PATH_INFO: `/v3/projects/4871c040fd974f43a72e5c1966d480b7/users/144ba69115584ac697fae53cece0a5e2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:28.930697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4871c040fd974f43a72e5c1966d480b7, user_id=144ba69115584ac697fae53cece0a5e2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:28.933748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:28.995825 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 821/1615] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:28.995825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:28.995825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:29.005673 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 795/1616] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:28 2022] PUT /identity/v3/projects/4871c040fd974f43a72e5c1966d480b7/users/144ba69115584ac697fae53cece0a5e2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:29.007018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.008885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:29.025254 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:29.078775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172904ea-3e18-4fe5-8f7c-71855cf31552 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.079523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65fef0-055e-4462-8154-bb215b6de582 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.084284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdfe3a-1f2a-470a-a5d8-9e9615cdc655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.085037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfe3a-1f2a-470a-a5d8-9e9615cdc655 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.085295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.085938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.086044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfe3a-1f2a-470a-a5d8-9e9615cdc655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.086232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.089920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfe3a-1f2a-470a-a5d8-9e9615cdc655 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.090144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.090232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdfe3a-1f2a-470a-a5d8-9e9615cdc655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.090310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.090399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdfe3a-1f2a-470a-a5d8-9e9615cdc655 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.090478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.174215 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 796/1617] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:29 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:29.174215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b85d12-00a2-4449-a160-40fa546ebe6b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.174215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b85d12-00a2-4449-a160-40fa546ebe6b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.174482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b85d12-00a2-4449-a160-40fa546ebe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.196181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-75b85d12-00a2-4449-a160-40fa546ebe6b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:29.197453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-75b85d12-00a2-4449-a160-40fa546ebe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:29.213874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 822/1618] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:28 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:29.213874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.274237 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 797/1619] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:29.275521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b85d12-00a2-4449-a160-40fa546ebe6b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.288325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b85d12-00a2-4449-a160-40fa546ebe6b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.304465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4d44e-3493-49de-ac8a-4f8603274297 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.309221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.309958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.310286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.310678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.311388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.313244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.327505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 823/1620] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:29.327505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.335725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4657b-0ca3-423c-ab8a-d49df911882f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.340596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.341227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.341510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.341782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.342459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.344427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.349930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.350648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.350984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.351211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.351855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.353792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.367446 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 798/1621] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:29.367446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.377373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769964f-fd46-494c-8c54-6f8413ade418 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.382811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.383441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.383869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.384119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.384839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.386471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.399642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 799/1622] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:29.400488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.414666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e879-7128-4064-9cc3-9dd8ec9455a1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.420353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.421043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.421271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.421549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.422248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.424613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.473280 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 824/1623] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:29 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:29.476723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.487925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b208d-51b5-4d31-a81b-6e7b9cda58bb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.493129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.493775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.494119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.494660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.495303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.497373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.540552 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 800/1624] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:29 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:29.541625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.543531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:29.554114 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:29.592320 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 825/1625] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:29 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:29.593170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.605094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cd9d4-2cdb-4f59-85ea-652a0a4ca26c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.605342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96560e9-6282-4f08-8e23-e7555c498706 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.609005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.609660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.610038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.610380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.613249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.614096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.614432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.614812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] PATH_INFO: `/v3/projects/6d88f4d1dec344e6b4518896c6c5ced3/users/b4dd86883fd14a9181d3b186a898ec37/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.621357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.621849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.632986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d88f4d1dec344e6b4518896c6c5ced3, user_id=b4dd86883fd14a9181d3b186a898ec37, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.633710 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 801/1626] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:29.634454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.646870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea89eb-cb10-4431-bcfe-edd305da36f8 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.651303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.653433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.654495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.655032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.655307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] PATH_INFO: `/v3/projects/cfb90935c1d14886825039092785e1aa/users/7ed177db7c1a4495be7e0f5517b445fa/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.672908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb90935c1d14886825039092785e1aa, user_id=7ed177db7c1a4495be7e0f5517b445fa, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.675726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.706425 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 826/1627] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:29 2022] PUT /identity/v3/projects/6d88f4d1dec344e6b4518896c6c5ced3/users/b4dd86883fd14a9181d3b186a898ec37/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:29.707464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.719396 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:29.735838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 802/1628] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:29 2022] PUT /identity/v3/projects/cfb90935c1d14886825039092785e1aa/users/7ed177db7c1a4495be7e0f5517b445fa/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:29.737139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.776772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a77fd-cfa6-4294-917c-00993f293bff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.802406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560e09d-2c43-4e41-9d4b-8683268f8918 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.807168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.807968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.808267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.808533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.809177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.810866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.822477 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 803/1629] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:29.823341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.836265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31034a-f2ba-4896-b769-17275b7c6d02 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.841713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.842372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.842710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.842989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.843631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.845222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.850163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.851735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.852200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.852499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] PATH_INFO: `/v3/projects/4871c040fd974f43a72e5c1966d480b7/users/144ba69115584ac697fae53cece0a5e2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.858931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4871c040fd974f43a72e5c1966d480b7, user_id=144ba69115584ac697fae53cece0a5e2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.859014 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 804/1630] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:29.859014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.860397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.869404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a349997-8a6c-445d-9ae9-58cba6895eec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:29.875216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:29.875940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:29.876287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:29.876627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:29.877370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:29.879432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:29.882301 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 827/1631] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:29 2022] PUT /identity/v3/projects/4871c040fd974f43a72e5c1966d480b7/users/144ba69115584ac697fae53cece0a5e2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:29.883780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.900606 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 805/1632] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:29.901629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:29.914315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f35253-aa1e-4e73-bf35-366bd7f2f362 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.011269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.011914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.012202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.012504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.019577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.023235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.024821 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:30.029247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8d37e-aa97-4593-8398-2d6de09e8cc1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.036063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.038698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.038698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.038698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.038698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.039699 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 806/1633] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:30.040943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.041428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.055289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdb9f-d251-4039-9f96-02ca1a8adaa4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.057661 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 828/1634] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:30.058663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.061753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3bd4a-2df6-4c76-9d6c-cf6073430c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.062468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3bd4a-2df6-4c76-9d6c-cf6073430c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.062752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3bd4a-2df6-4c76-9d6c-cf6073430c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.063027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3bd4a-2df6-4c76-9d6c-cf6073430c59 admin admin] PATH_INFO: `/v3/projects/f8ef810d00a8496bb0333233ba849ae0/users/8da5372651e643bea049b59a48a31b65/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.070589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e095dd0-c113-4f77-aa75-3cc0a9322c0d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.083605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3bd4a-2df6-4c76-9d6c-cf6073430c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ef810d00a8496bb0333233ba849ae0, user_id=8da5372651e643bea049b59a48a31b65, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.086261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3bd4a-2df6-4c76-9d6c-cf6073430c59 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.086926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.089032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.090660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.090660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] PATH_INFO: `/v3/projects/07926fa8ad9541e9ba19492bf3f252d8/users/f579f0782b73455cbc0278814c663855/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.111513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07926fa8ad9541e9ba19492bf3f252d8, user_id=f579f0782b73455cbc0278814c663855, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.114289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.194206 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 807/1635] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:30 2022] PUT /identity/v3/projects/f8ef810d00a8496bb0333233ba849ae0/users/8da5372651e643bea049b59a48a31b65/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:30.198552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64b03a-56cd-496c-8c41-16f551e37ebc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.198846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64b03a-56cd-496c-8c41-16f551e37ebc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.199121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64b03a-56cd-496c-8c41-16f551e37ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.237749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8c64b03a-56cd-496c-8c41-16f551e37ebc None None] MFA Rules not processed for user `144ba69115584ac697fae53cece0a5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:30.239242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8c64b03a-56cd-496c-8c41-16f551e37ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:30.254014 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 829/1636] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:30 2022] PUT /identity/v3/projects/07926fa8ad9541e9ba19492bf3f252d8/users/f579f0782b73455cbc0278814c663855/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:30.256445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.292783 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:30.336380 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 808/1637] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:30.337347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64b03a-56cd-496c-8c41-16f551e37ebc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.369178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b8bd-90d5-4544-acac-88183c9c03e1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.376492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.377168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.377515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.377888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] PATH_INFO: `/v3/projects/8865766536c94cc0944d66c5fb23cb8c/users/8720fe4f6f174e91beb090fdde76f9b7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.395816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8865766536c94cc0944d66c5fb23cb8c, user_id=8720fe4f6f174e91beb090fdde76f9b7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.399121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.414354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64b03a-56cd-496c-8c41-16f551e37ebc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.422107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.422107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.422107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.422107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] PATH_INFO: `/v3/projects/cfb90935c1d14886825039092785e1aa/users/7ed177db7c1a4495be7e0f5517b445fa/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.422727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb90935c1d14886825039092785e1aa, user_id=7ed177db7c1a4495be7e0f5517b445fa, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.425386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.437688 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 809/1638] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:30 2022] PUT /identity/v3/projects/cfb90935c1d14886825039092785e1aa/users/7ed177db7c1a4495be7e0f5517b445fa/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:30.438834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.476518 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 830/1639] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:30 2022] PUT /identity/v3/projects/8865766536c94cc0944d66c5fb23cb8c/users/8720fe4f6f174e91beb090fdde76f9b7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:30.478245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.481229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:30.510837 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:30.524226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632036a-c18c-48fa-9dab-2e055d58e61d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.550584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee22ed2-3f81-4948-8069-6a7cdb1cfb05 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.556458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.561166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.561166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.561166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] PATH_INFO: `/v3/projects/71e504bc07ea45f09123ad98138acf2b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.561166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e504bc07ea45f09123ad98138acf2b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.561166 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:12:30.561166 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:12:30.561166 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:12:30.561647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.594351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.595319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.595319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.595610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] PATH_INFO: `/v3/projects/6d88f4d1dec344e6b4518896c6c5ced3/users/b4dd86883fd14a9181d3b186a898ec37/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.597618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d88f4d1dec344e6b4518896c6c5ced3, user_id=b4dd86883fd14a9181d3b186a898ec37, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.600969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.612129 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 810/1640] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:30 2022] PUT /identity/v3/projects/6d88f4d1dec344e6b4518896c6c5ced3/users/b4dd86883fd14a9181d3b186a898ec37/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:30.613192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.703946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d026-e5ce-4ec4-8178-a4d8f86c85db admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.726431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e504bc07ea45f09123ad98138acf2b', 'request_id': 'req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:30.744990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e504bc07ea45f09123ad98138acf2b', 'request_id': 'req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:30.774293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.775255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.775704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.776145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.776793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.778514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.789944 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 811/1641] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:30.793205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.800530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33734-089f-4032-8a05-498679ad2815 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.806223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d06c-eecb-4b39-86df-4bed1e3c7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.806873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d06c-eecb-4b39-86df-4bed1e3c7b8b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.807159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d06c-eecb-4b39-86df-4bed1e3c7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.807440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d06c-eecb-4b39-86df-4bed1e3c7b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.808088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d06c-eecb-4b39-86df-4bed1e3c7b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.809683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d06c-eecb-4b39-86df-4bed1e3c7b8b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.822139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 812/1642] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:30.823532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.823829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.824107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.827918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e504bc07ea45f09123ad98138acf2b', 'request_id': 'req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:30.843391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] The token cache is being invalidate because project 71e504bc07ea45f09123ad98138acf2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:30.843777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:30.846242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c1fe01bb-8e19-4f1c-851e-6474b7bfe6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:30.846434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] MFA Rules not processed for user `3f3e53092a8940339fd588b46293a924`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:30.848184 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 831/1643] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:30 2022] DELETE /identity/v3/projects/71e504bc07ea45f09123ad98138acf2b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:30.848371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:30.856034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.856320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.856596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.877415 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:30.886061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] MFA Rules not processed for user `7ed177db7c1a4495be7e0f5517b445fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:30.887366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:30.909587 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:30.924452 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 813/1644] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:30.925343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:30.930994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:30.948192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446dcd-9c96-4f95-bafc-e1f670bed65e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:30.957696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335707-3dd1-4023-a6d6-46981f36f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:30.958389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335707-3dd1-4023-a6d6-46981f36f304 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.959847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335707-3dd1-4023-a6d6-46981f36f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:30.959847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335707-3dd1-4023-a6d6-46981f36f304 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:30.963618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8335707-3dd1-4023-a6d6-46981f36f304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:30.965842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8335707-3dd1-4023-a6d6-46981f36f304 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:30.996594 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 814/1645] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:30.999506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12e62-3501-49f5-930d-7ad2ffd1cd02 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:30.999506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12e62-3501-49f5-930d-7ad2ffd1cd02 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.002266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12e62-3501-49f5-930d-7ad2ffd1cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.019529 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 832/1646] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.019529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:31.019529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.035055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b54f-f03a-499a-a7ca-91fa759da195 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:31.041299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:31.042677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.043012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.043296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] PATH_INFO: `/v3/projects/f8ef810d00a8496bb0333233ba849ae0/users/8da5372651e643bea049b59a48a31b65/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.047175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ef810d00a8496bb0333233ba849ae0, user_id=8da5372651e643bea049b59a48a31b65, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:31.050913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:31.062568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-73b12e62-3501-49f5-930d-7ad2ffd1cd02 None None] MFA Rules not processed for user `b4dd86883fd14a9181d3b186a898ec37`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.064325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-73b12e62-3501-49f5-930d-7ad2ffd1cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.071245 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 833/1647] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:31 2022] PUT /identity/v3/projects/f8ef810d00a8496bb0333233ba849ae0/users/8da5372651e643bea049b59a48a31b65/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:31.072096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:31.076378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.174912 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 815/1648] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.176621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92cad-f9ec-485e-ba8e-9e69e245ce08 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.176979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92cad-f9ec-485e-ba8e-9e69e245ce08 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.177378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92cad-f9ec-485e-ba8e-9e69e245ce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.177625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f53f68-adc9-4ef6-a808-d5d7da9ec0aa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:31.187593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0e941-7464-4340-bfab-c51fadef9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:31.188770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0e941-7464-4340-bfab-c51fadef9a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.188988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0e941-7464-4340-bfab-c51fadef9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.189275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0e941-7464-4340-bfab-c51fadef9a03 admin admin] PATH_INFO: `/v3/projects/07926fa8ad9541e9ba19492bf3f252d8/users/f579f0782b73455cbc0278814c663855/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.195324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0e941-7464-4340-bfab-c51fadef9a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07926fa8ad9541e9ba19492bf3f252d8, user_id=f579f0782b73455cbc0278814c663855, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:31.214715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0e941-7464-4340-bfab-c51fadef9a03 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:31.234964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c5e92cad-f9ec-485e-ba8e-9e69e245ce08 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.234964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5e92cad-f9ec-485e-ba8e-9e69e245ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.235580 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 834/1649] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:31 2022] PUT /identity/v3/projects/07926fa8ad9541e9ba19492bf3f252d8/users/f579f0782b73455cbc0278814c663855/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:31.247351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7160aad-e8d1-43fc-95cb-a63b8671ae7d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.247631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7160aad-e8d1-43fc-95cb-a63b8671ae7d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.247912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7160aad-e8d1-43fc-95cb-a63b8671ae7d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.249599 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 835/1650] 10.222.0.59 () {54 vars in 962 bytes} [Sun Aug 28 01:12:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:31.250465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7160aad-e8d1-43fc-95cb-a63b8671ae7d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:31.338925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7160aad-e8d1-43fc-95cb-a63b8671ae7d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:31.344285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 816/1651] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.344285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bccbe-6356-4b74-bc5a-180df479c087 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.344285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bccbe-6356-4b74-bc5a-180df479c087 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.344285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bccbe-6356-4b74-bc5a-180df479c087 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.344285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 817/1652] 10.222.0.59 () {54 vars in 962 bytes} [Sun Aug 28 01:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:31.344285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018770b5-b554-447c-a394-5a86dc77fa88 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.345108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018770b5-b554-447c-a394-5a86dc77fa88 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.345388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018770b5-b554-447c-a394-5a86dc77fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.351386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3370f7-f77d-41ae-9f56-ffa9c8390ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:31.352407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3370f7-f77d-41ae-9f56-ffa9c8390ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.352936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3370f7-f77d-41ae-9f56-ffa9c8390ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.353314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3370f7-f77d-41ae-9f56-ffa9c8390ed1 admin admin] PATH_INFO: `/v3/projects/8865766536c94cc0944d66c5fb23cb8c/users/8720fe4f6f174e91beb090fdde76f9b7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.355652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3370f7-f77d-41ae-9f56-ffa9c8390ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8865766536c94cc0944d66c5fb23cb8c, user_id=8720fe4f6f174e91beb090fdde76f9b7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:31.359475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3370f7-f77d-41ae-9f56-ffa9c8390ed1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:31.370568 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 836/1653] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:31 2022] PUT /identity/v3/projects/8865766536c94cc0944d66c5fb23cb8c/users/8720fe4f6f174e91beb090fdde76f9b7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:31.371839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df21af-1b9a-4c7a-b714-948f7d33e5f7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.372131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df21af-1b9a-4c7a-b714-948f7d33e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.372407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df21af-1b9a-4c7a-b714-948f7d33e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.384075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-018770b5-b554-447c-a394-5a86dc77fa88 None None] MFA Rules not processed for user `8da5372651e643bea049b59a48a31b65`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.385305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-018770b5-b554-447c-a394-5a86dc77fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.409385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-14df21af-1b9a-4c7a-b714-948f7d33e5f7 None None] MFA Rules not processed for user `f579f0782b73455cbc0278814c663855`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.412645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-14df21af-1b9a-4c7a-b714-948f7d33e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.430383 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:31.480945 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 818/1654] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.480945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85efd45-415e-47b2-9b6e-316e6c4e96ce None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.480945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85efd45-415e-47b2-9b6e-316e6c4e96ce None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.480945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85efd45-415e-47b2-9b6e-316e6c4e96ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.522322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 837/1655] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.523859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80c53-595c-4b45-8608-e0a18910ad3c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.524159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80c53-595c-4b45-8608-e0a18910ad3c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.525493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80c53-595c-4b45-8608-e0a18910ad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.556941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e85efd45-415e-47b2-9b6e-316e6c4e96ce None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.562483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e85efd45-415e-47b2-9b6e-316e6c4e96ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.594266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c3c80c53-595c-4b45-8608-e0a18910ad3c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.596027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3c80c53-595c-4b45-8608-e0a18910ad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.659247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 819/1656] 10.222.0.59 () {58 vars in 1059 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.660654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05bb8-c5f6-4067-a65c-5f64ccffacbe None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.661018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05bb8-c5f6-4067-a65c-5f64ccffacbe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.661376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05bb8-c5f6-4067-a65c-5f64ccffacbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.675508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 838/1657] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.675508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5be58-eb2e-4c2b-99d0-ca99308b48f1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.675508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5be58-eb2e-4c2b-99d0-ca99308b48f1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.675508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5be58-eb2e-4c2b-99d0-ca99308b48f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.684123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-80c05bb8-c5f6-4067-a65c-5f64ccffacbe None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.685591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-80c05bb8-c5f6-4067-a65c-5f64ccffacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.698104 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 820/1658] 10.222.0.59 () {58 vars in 1059 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.699171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05bb8-c5f6-4067-a65c-5f64ccffacbe None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:31.707611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f5c5be58-eb2e-4c2b-99d0-ca99308b48f1 None None] MFA Rules not processed for user `8720fe4f6f174e91beb090fdde76f9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:31.709713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5c5be58-eb2e-4c2b-99d0-ca99308b48f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.720416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05bb8-c5f6-4067-a65c-5f64ccffacbe None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:31.727881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:31.729163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.729703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.730225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.732529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:31.810387 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 839/1659] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:31.810387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5be58-eb2e-4c2b-99d0-ca99308b48f1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:31.817198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5be58-eb2e-4c2b-99d0-ca99308b48f1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:31.829278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:31.830414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:31.831048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.831327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.831603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.832118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:31.832293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:31.832561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:31.835764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:31.844815 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 821/1660] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:31.859038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:31.869046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 840/1661] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:31.872240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:31.878156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59261d3-5540-4b25-851f-afdb7e939968 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:31.883438 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:31.885010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bfb46-d5a1-4249-a4bc-9907b76c181e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:31.886257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bfb46-d5a1-4249-a4bc-9907b76c181e service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.886542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bfb46-d5a1-4249-a4bc-9907b76c181e service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.887033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bfb46-d5a1-4249-a4bc-9907b76c181e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.889876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cf05d-1edb-4961-9698-eef85decb03e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:31.895879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:31.896946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:31.897521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:31.897953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:31.898771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:31.900976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:31.934341 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:31.964984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bfb46-d5a1-4249-a4bc-9907b76c181e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:31.967511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bfb46-d5a1-4249-a4bc-9907b76c181e service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.003521 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 841/1662] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:31 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:12:32.006573 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 822/1663] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:31 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:32.008571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.129313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa55fa-7513-42b7-bf00-e96535f01f1b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.143206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.143891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.144190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.144481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.145111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.147164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.191796 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:32.217290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c7678-b72b-40b5-b3a7-300e03210688 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.217580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c7678-b72b-40b5-b3a7-300e03210688 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.217895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c7678-b72b-40b5-b3a7-300e03210688 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.219622 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 823/1664] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:32.225797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442773-99ba-48d6-9323-59e95501136b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.226304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442773-99ba-48d6-9323-59e95501136b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.226785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8442773-99ba-48d6-9323-59e95501136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.258101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f8442773-99ba-48d6-9323-59e95501136b None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:32.259930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f8442773-99ba-48d6-9323-59e95501136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:32.263818 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 842/1665] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:32 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:32.273120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.292503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e23074-aff0-4139-b07a-f3ebfd47763f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.304667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.305288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.305842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.306004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.306659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.308267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.336899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 843/1666] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:32.337364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.372324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 824/1667] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:12:32.373495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8442773-99ba-48d6-9323-59e95501136b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.394132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8442773-99ba-48d6-9323-59e95501136b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.401162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.406244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.406244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.406244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.406244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.406244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.423257 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 825/1668] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:32.424263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.426280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:32.454708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600123a-6504-4eb9-95d1-6613a70c1b8d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.462414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.463473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.464321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.464639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.526544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4c4c3-48a8-4b45-b733-be3807d4aba3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.531919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.531919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.532352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.532459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.544766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.545666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.546343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.547147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.561181 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 826/1669] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:32.562064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.571306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 844/1670] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:32.573528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6dec1-4c34-41c6-9e67-59e372bf082a service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.578962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c52ec-00b5-498c-b669-5d7e53c66b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.580003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c52ec-00b5-498c-b669-5d7e53c66b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.580434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c52ec-00b5-498c-b669-5d7e53c66b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.580866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c52ec-00b5-498c-b669-5d7e53c66b28 admin admin] PATH_INFO: `/v3/projects/fc89e3437e5a41cba7100269e83f0b8e/users/fe1a97cc9f524f42a0956bfafe504c7e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.604358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c52ec-00b5-498c-b669-5d7e53c66b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc89e3437e5a41cba7100269e83f0b8e, user_id=fe1a97cc9f524f42a0956bfafe504c7e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.607466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c52ec-00b5-498c-b669-5d7e53c66b28 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.654229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.668823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713d44-c135-43ee-b540-49c93b98499c service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.675408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.676147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.676505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.676914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.690247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 827/1671] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:32 2022] PUT /identity/v3/projects/fc89e3437e5a41cba7100269e83f0b8e/users/fe1a97cc9f524f42a0956bfafe504c7e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:32.707440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87fe15-b1f0-4e2b-82bc-334238bda2d6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.707792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87fe15-b1f0-4e2b-82bc-334238bda2d6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.708137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87fe15-b1f0-4e2b-82bc-334238bda2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.727378 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:32.748044 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:32.751256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4f87fe15-b1f0-4e2b-82bc-334238bda2d6 None None] MFA Rules not processed for user `fe1a97cc9f524f42a0956bfafe504c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:32.752643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4f87fe15-b1f0-4e2b-82bc-334238bda2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:32.822800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.826330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:32.857386 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 845/1672] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:32.870841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 828/1673] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:12:32.872766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87fe15-b1f0-4e2b-82bc-334238bda2d6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.983560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87fe15-b1f0-4e2b-82bc-334238bda2d6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:32.990497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:32.991647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:32.992197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:32.992811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:32.993290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:32.994178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:32.997266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.006405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8b031-2399-4b15-a0ef-7ee113308f90 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.085700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.086416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.086817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.086995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.092803 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 829/1674] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:32 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:33.096951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:33.185470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.187483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.208995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f644ae-c462-4f81-8228-40b92ec5f3d8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.212065 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 846/1675] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:12:33.214633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.214955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.215240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.215518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.216161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.218868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.257176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:33.268343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f677d7-2ea0-4ec0-bcd2-53f2f4ac9e30 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.313047 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 830/1676] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:33 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:12:33.322468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:33.347861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738ee00-52e8-438d-9381-f74630771ad5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.362729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.365305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.365487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.366268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.367657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.375251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.375522 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:33.402373 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 831/1677] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:33.406770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:33.430909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc545-9615-4c57-9be8-77ae677e8c38 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.438989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5ca6c-b71d-49e9-9681-4fc29aee5d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.439905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5ca6c-b71d-49e9-9681-4fc29aee5d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.440297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5ca6c-b71d-49e9-9681-4fc29aee5d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.441001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5ca6c-b71d-49e9-9681-4fc29aee5d66 admin admin] PATH_INFO: `/v3/projects/76e03d7b2f6c4cb0b6cb26fc14aae97c/users/309047f352cd47da93aeedb494ae052c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.443991 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:33.457407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fe3cf-4daa-4e76-a26f-48e0785e15f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.458758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe3cf-4daa-4e76-a26f-48e0785e15f6 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.458918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe3cf-4daa-4e76-a26f-48e0785e15f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.459319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fe3cf-4daa-4e76-a26f-48e0785e15f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.486933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5ca6c-b71d-49e9-9681-4fc29aee5d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e03d7b2f6c4cb0b6cb26fc14aae97c, user_id=309047f352cd47da93aeedb494ae052c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.513087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5ca6c-b71d-49e9-9681-4fc29aee5d66 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.612003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fe3cf-4daa-4e76-a26f-48e0785e15f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.614110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fe3cf-4daa-4e76-a26f-48e0785e15f6 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.622182 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 832/1678] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:33 2022] PUT /identity/v3/projects/76e03d7b2f6c4cb0b6cb26fc14aae97c/users/309047f352cd47da93aeedb494ae052c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:12:33.632525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7766-281e-44fb-b330-7479afb9cff5 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.634842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7766-281e-44fb-b330-7479afb9cff5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.635532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7766-281e-44fb-b330-7479afb9cff5 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.640818 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 833/1679] 10.222.0.59 () {54 vars in 961 bytes} [Sun Aug 28 01:12:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:33.642204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7766-281e-44fb-b330-7479afb9cff5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:33.656221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 847/1680] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:33.657700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2226ec-d0b7-4fe0-9b0c-1988084ea0db None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.658041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2226ec-d0b7-4fe0-9b0c-1988084ea0db None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.658310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2226ec-d0b7-4fe0-9b0c-1988084ea0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.709404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5e2226ec-d0b7-4fe0-9b0c-1988084ea0db None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:33.710691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5e2226ec-d0b7-4fe0-9b0c-1988084ea0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:33.810949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f7766-281e-44fb-b330-7479afb9cff5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.834805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.836058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.836534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.837173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.839756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.843009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.865841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 834/1681] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:33.867862 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 848/1682] 10.222.0.59 () {58 vars in 1058 bytes} [Sun Aug 28 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:33.877599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:33.881792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2226ec-d0b7-4fe0-9b0c-1988084ea0db None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:33.896402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2226ec-d0b7-4fe0-9b0c-1988084ea0db None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.915083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7a53-78c0-4cdc-a614-102acea0ab52 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:33.923097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.923726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.924010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.924284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.927713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60797620-eb88-4d64-8a19-12ce6173cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:33.928604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60797620-eb88-4d64-8a19-12ce6173cd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.928902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60797620-eb88-4d64-8a19-12ce6173cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.929246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60797620-eb88-4d64-8a19-12ce6173cd42 admin admin] PATH_INFO: `/v3/projects/76e03d7b2f6c4cb0b6cb26fc14aae97c/users/309047f352cd47da93aeedb494ae052c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.930792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:33.933925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60797620-eb88-4d64-8a19-12ce6173cd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e03d7b2f6c4cb0b6cb26fc14aae97c, user_id=309047f352cd47da93aeedb494ae052c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.941085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60797620-eb88-4d64-8a19-12ce6173cd42 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.979924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:33.979924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:33.984552 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 835/1683] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:33 2022] PUT /identity/v3/projects/76e03d7b2f6c4cb0b6cb26fc14aae97c/users/309047f352cd47da93aeedb494ae052c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:33.984552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370bd0-a931-40c5-b26b-878538bd3111 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.984552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370bd0-a931-40c5-b26b-878538bd3111 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.984552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370bd0-a931-40c5-b26b-878538bd3111 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:33.985283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 836/1684] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:33.986511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf89b-c040-45f7-8181-0679b4d9c6b1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:33.986863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf89b-c040-45f7-8181-0679b4d9c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:33.987204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cf89b-c040-45f7-8181-0679b4d9c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:34.002461 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 849/1685] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:34.003722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:12:34.025435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6c5cf89b-c040-45f7-8181-0679b4d9c6b1 None None] MFA Rules not processed for user `309047f352cd47da93aeedb494ae052c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:34.027025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6c5cf89b-c040-45f7-8181-0679b4d9c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:34.112845 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:34.139417 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 01:12:34.140214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:34.181943 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 837/1686] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:34.185736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037da1bc-95ad-4f99-b213-a3d12692a0ed None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:34.186281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037da1bc-95ad-4f99-b213-a3d12692a0ed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:34.189769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037da1bc-95ad-4f99-b213-a3d12692a0ed None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:34.189769 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 838/1687] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:12:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:34.199016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:34.199594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:34.200015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:34.229124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:34.230955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:34.231332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211ac8a-2b89-4310-b4c1-7d387bc87f80 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:34.301825 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:34.338901 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 839/1688] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:34.345772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8720fe4f6f174e91beb090fdde76f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8865766536c94cc0944d66c5fb23cb8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:34.347340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:34.347340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:34.347340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] PATH_INFO: `/v3/projects/bfd9b2dce09f40daad9100d256e67557` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:34.350951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] RBAC: Authorizing `identity:get_project(project_id=bfd9b2dce09f40daad9100d256e67557)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:34.353560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:34.369076 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 850/1689] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:12:34 2022] GET /identity/v3/projects/bfd9b2dce09f40daad9100d256e67557 => generated 379 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:34.370410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:34.373082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:34.419117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e2ab-7831-4c47-bec6-d5250ab1299e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:34.433185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:34.433766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:34.434096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:34.434361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:34.454186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:34.454186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:34.490822 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 840/1690] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:34.564602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:34.666097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798bce8-1873-4f29-b8e8-dc2eaa8a1796 tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:34.671870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:34.672743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:34.672977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:34.673261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:34.689750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:34.715174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a05696-3a99-41a1-87be-4cfeca05dbb7 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:34.733464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06358a-e5c4-4d84-84fb-189ef51ebaea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:34.737180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06358a-e5c4-4d84-84fb-189ef51ebaea service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:34.744136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06358a-e5c4-4d84-84fb-189ef51ebaea service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:34.744136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06358a-e5c4-4d84-84fb-189ef51ebaea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:34.749509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fc06358a-e5c4-4d84-84fb-189ef51ebaea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:34.762491 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:34.794656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:34.804597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:34.812741 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 851/1691] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:34.856284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:34.887621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06358a-e5c4-4d84-84fb-189ef51ebaea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:34.899446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06358a-e5c4-4d84-84fb-189ef51ebaea service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:34.936047 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 841/1692] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:12:34.993719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93565d15-209e-4311-b5ef-8ec970ad9717 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:35.007370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:35.008239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:35.009910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:35.009910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] PATH_INFO: `/v3/users/fe1a97cc9f524f42a0956bfafe504c7e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:35.010972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1a97cc9f524f42a0956bfafe504c7e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:35.013149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:35.153768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4395-3b10-4580-9637-c7773a6dbbce None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:35.154103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4395-3b10-4580-9637-c7773a6dbbce None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:35.154664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4395-3b10-4580-9637-c7773a6dbbce None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:35.156348 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 842/1693] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:12:35.166589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4395-3b10-4580-9637-c7773a6dbbce None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:12:35.196937 n-d-master-1 devstack@keystone.service[82006]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4395-3b10-4580-9637-c7773a6dbbce None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 01:12:35.197561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4395-3b10-4580-9637-c7773a6dbbce None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:35.213909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4395-3b10-4580-9637-c7773a6dbbce None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:35.228537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb28beb-be71-44df-bcdd-f03fd90be1ea tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8720fe4f6f174e91beb090fdde76f9b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8865766536c94cc0944d66c5fb23cb8c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:35.231537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28beb-be71-44df-bcdd-f03fd90be1ea tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:35.231537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28beb-be71-44df-bcdd-f03fd90be1ea tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:35.231537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28beb-be71-44df-bcdd-f03fd90be1ea tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] PATH_INFO: `/v3/projects/bfd9b2dce09f40daad9100d256e67557` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:35.232673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb28beb-be71-44df-bcdd-f03fd90be1ea tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] RBAC: Authorizing `identity:get_project(project_id=bfd9b2dce09f40daad9100d256e67557)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:35.246866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1a97cc9f524f42a0956bfafe504c7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:35.247791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb28beb-be71-44df-bcdd-f03fd90be1ea tempest-FlavorsAccessTestJSON-367177796 tempest-FlavorsAccessTestJSON-367177796-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:35.248245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1a97cc9f524f42a0956bfafe504c7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:35.254708 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 843/1694] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:12:35 2022] GET /identity/v3/projects/bfd9b2dce09f40daad9100d256e67557 => generated 379 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:12:35.337602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1a97cc9f524f42a0956bfafe504c7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:35.366606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1a97cc9f524f42a0956bfafe504c7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:35.368670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1a97cc9f524f42a0956bfafe504c7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:35.420059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:35.420703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:35.421005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:35.424681 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 852/1695] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:34 2022] DELETE /identity/v3/users/fe1a97cc9f524f42a0956bfafe504c7e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:35.468310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:35.469648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:35.670526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 844/1696] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:35.696878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:35.698730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:35.764034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:35.765752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:35.804252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36deb41-1ecb-4592-9b38-6f71f504604a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:35.824171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:35.824922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:35.825447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:35.825789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] PATH_INFO: `/v3/users/55f47c4e3dfa47f8afb0b059e47dcad9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:35.829409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f47c4e3dfa47f8afb0b059e47dcad9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:35.831845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:35.894041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99295-7765-4473-b2a2-b65248029760 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:35.912265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff64306-9946-4201-9ec2-039e0591cf9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:35.914338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff64306-9946-4201-9ec2-039e0591cf9b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:35.914338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff64306-9946-4201-9ec2-039e0591cf9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:35.914529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff64306-9946-4201-9ec2-039e0591cf9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:35.937939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff64306-9946-4201-9ec2-039e0591cf9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:35.939606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff64306-9946-4201-9ec2-039e0591cf9b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:35.961912 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 853/1697] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:35.966713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:35.966713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:35.966713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:35.975100 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:36.003511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] MFA Rules not processed for user `e3b41f02eca449e4ac13e3a36d65d57c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:36.004808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:36.123856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f47c4e3dfa47f8afb0b059e47dcad9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:36.130850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 854/1698] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:36.131816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:36.133205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:36.148898 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:36.167118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f47c4e3dfa47f8afb0b059e47dcad9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:36.206225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f47c4e3dfa47f8afb0b059e47dcad9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:36.224231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f47c4e3dfa47f8afb0b059e47dcad9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:36.310542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f47c4e3dfa47f8afb0b059e47dcad9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:36.324273 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 845/1699] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:35 2022] DELETE /identity/v3/users/55f47c4e3dfa47f8afb0b059e47dcad9 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:36.324417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0889901-b784-4f0a-905b-e667a73de4f3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:36.324511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:36.326894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:36.450892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373ad1b-0434-4867-9486-d9aa3bf2c193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:36.451526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ad1b-0434-4867-9486-d9aa3bf2c193 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:36.455631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ad1b-0434-4867-9486-d9aa3bf2c193 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:36.455631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ad1b-0434-4867-9486-d9aa3bf2c193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:36.456098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f373ad1b-0434-4867-9486-d9aa3bf2c193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:36.496814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebbcb6-c9cb-4a12-84da-e9e11a2b09a2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:36.507041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:36.508023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:36.508484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:36.508935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:36.509773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:36.512064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:36.539243 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:36.578850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373ad1b-0434-4867-9486-d9aa3bf2c193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:36.580519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373ad1b-0434-4867-9486-d9aa3bf2c193 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:36.591954 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 855/1700] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:36.605653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:36.605653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:36.605653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:36.626118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:36.627322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:36.635372 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 856/1701] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:36.651040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:36.652780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:36.654733 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 846/1702] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:36 2022] POST /identity/v3/projects => generated 403 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:36.659013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:36.730693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728157c-75e1-4b09-8216-5e0848a00383 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:36.797154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4d5c7-5af7-439d-84e7-84387c2a1f53 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:36.797675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:36.800577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:36.801020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:36.801307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:36.811194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970876b-83a5-44f5-a987-836aae8b8691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:36.811194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970876b-83a5-44f5-a987-836aae8b8691 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:36.811194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970876b-83a5-44f5-a987-836aae8b8691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:36.811194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970876b-83a5-44f5-a987-836aae8b8691 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:36.812222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970876b-83a5-44f5-a987-836aae8b8691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:36.814501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970876b-83a5-44f5-a987-836aae8b8691 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:36.820103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:36.821836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:36.834855 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 857/1703] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:36.835642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:36.837417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:36.867455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e16cfa-fe3c-4c42-afc0-da9d9b5ccb65 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:36.872517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:36.873165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:36.873449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:36.873726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] PATH_INFO: `/v3/projects/fc89e3437e5a41cba7100269e83f0b8e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:36.874895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc89e3437e5a41cba7100269e83f0b8e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:36.877038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:36.917597 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 847/1704] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:36 2022] POST /identity/v3/users => generated 308 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:12:36.918775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0869633-4e23-45d9-beb3-18fb0e9506f6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:36.919057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0869633-4e23-45d9-beb3-18fb0e9506f6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:36.930682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0869633-4e23-45d9-beb3-18fb0e9506f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:36.958198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c0869633-4e23-45d9-beb3-18fb0e9506f6 None None] MFA Rules not processed for user `e03fabbf78b74eb6a545c2fe1c81dd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:36.959921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c0869633-4e23-45d9-beb3-18fb0e9506f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:37.027174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc89e3437e5a41cba7100269e83f0b8e', 'request_id': 'req-249048c4-cd93-47ad-8b74-7cf8cbd56569'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.037495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc89e3437e5a41cba7100269e83f0b8e', 'request_id': 'req-249048c4-cd93-47ad-8b74-7cf8cbd56569'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.043010 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:37.078094 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 848/1705] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:37.080408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0869633-4e23-45d9-beb3-18fb0e9506f6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:37.105359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0869633-4e23-45d9-beb3-18fb0e9506f6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:37.117503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc89e3437e5a41cba7100269e83f0b8e', 'request_id': 'req-249048c4-cd93-47ad-8b74-7cf8cbd56569'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.142461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] The token cache is being invalidate because project fc89e3437e5a41cba7100269e83f0b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:37.143211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.144311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.151370 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 858/1706] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:36 2022] DELETE /identity/v3/projects/fc89e3437e5a41cba7100269e83f0b8e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:37.152626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:37.160138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:37.169333 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:37.209635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:37.210349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:37.210629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:37.210907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:37.211586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:37.213264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:37.225642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 849/1707] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:37.226627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:37.234730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:37.316767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249048c4-cd93-47ad-8b74-7cf8cbd56569 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:37.324717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:37.325400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:37.325682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:37.326058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] PATH_INFO: `/v3/users/b6a0d182189743298110f925ff07e153` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:37.327222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a0d182189743298110f925ff07e153)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:37.329322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:37.410057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07650e-3121-41a4-87db-15cdc87e2ec1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:37.417635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:37.423224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:37.423538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:37.424049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:37.426598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:37.523038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:37.525415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:37.539381 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 850/1708] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:37.540426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:37.542177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:37.558730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb720b-34b9-4985-99dc-2883fe808ff1 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:37.580266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:37.582365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:37.583502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:37.591838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a0d182189743298110f925ff07e153'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.593715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a0d182189743298110f925ff07e153'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.597158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] PATH_INFO: `/v3/users/309047f352cd47da93aeedb494ae052c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:37.600542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=309047f352cd47da93aeedb494ae052c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:37.605613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:37.656353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a0d182189743298110f925ff07e153'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.665129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a0d182189743298110f925ff07e153'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.666402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a0d182189743298110f925ff07e153'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.687723 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 859/1709] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:37 2022] DELETE /identity/v3/users/b6a0d182189743298110f925ff07e153 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:37.689257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:37.691002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:37.767191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1a9ee-8e5d-4a4d-aa7a-32ba58a52a93 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:37.773645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:37.774366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:37.774651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:37.774931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] PATH_INFO: `/v3/projects/b262b09d15ec442e9b09e7f5977da728/users/2da7d01e0dea48d9b7bacd959928ff20/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:37.794303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b262b09d15ec442e9b09e7f5977da728, user_id=2da7d01e0dea48d9b7bacd959928ff20, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:37.797853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:37.805055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309047f352cd47da93aeedb494ae052c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.831912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309047f352cd47da93aeedb494ae052c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.840469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309047f352cd47da93aeedb494ae052c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.841374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309047f352cd47da93aeedb494ae052c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.897208 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 860/1710] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:37 2022] PUT /identity/v3/projects/b262b09d15ec442e9b09e7f5977da728/users/2da7d01e0dea48d9b7bacd959928ff20/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:37.898850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:37.900910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:37.911959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9b3717d-1083-4f9c-8499-80c8c64eb1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309047f352cd47da93aeedb494ae052c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:37.924201 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:37.925543 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 851/1711] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:37 2022] DELETE /identity/v3/users/309047f352cd47da93aeedb494ae052c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:37.927706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:37.928383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:37.928999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:37.960757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:37.963023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:38.086922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 852/1712] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:38.087669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:38.089870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:38.090554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ca72-1d2a-41c7-87c7-79d207a8a9c4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:38.095707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:38.096360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.096684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.096959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] PATH_INFO: `/v3/projects/0ee74efdc6484fe69fd16416784472f1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.104158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee74efdc6484fe69fd16416784472f1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:38.104158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:38.104693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11760-9701-4aaa-9ebb-4de3a1854171 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:38.115124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:38.115861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.116148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.116427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.117092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:38.118835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:38.132418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 853/1713] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:38.135853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:38.138958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:38.157089 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:38.227137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d8e8-9c68-4169-8c9d-b2d8179227cc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:38.232282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:38.233202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.233894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.235436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.279799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:38.283163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee74efdc6484fe69fd16416784472f1', 'request_id': 'req-bcb88018-cf68-4d8c-97c5-105e5248a7db'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:38.287669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:38.303225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee74efdc6484fe69fd16416784472f1', 'request_id': 'req-bcb88018-cf68-4d8c-97c5-105e5248a7db'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:38.321178 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 854/1714] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:38.329931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:38.350592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a17dd-dddf-4088-8ce6-3a5aa341ffdd service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:38.369594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee74efdc6484fe69fd16416784472f1', 'request_id': 'req-bcb88018-cf68-4d8c-97c5-105e5248a7db'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:38.414284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] The token cache is being invalidate because project 0ee74efdc6484fe69fd16416784472f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:38.414284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:38.415375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bcb88018-cf68-4d8c-97c5-105e5248a7db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:38.421731 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 861/1715] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:37 2022] DELETE /identity/v3/projects/0ee74efdc6484fe69fd16416784472f1 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:38.421731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b1cca-8181-43e2-8cb6-7b56259778b6 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.421731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b1cca-8181-43e2-8cb6-7b56259778b6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.421731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b1cca-8181-43e2-8cb6-7b56259778b6 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.423137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 862/1716] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:38.433759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b1cca-8181-43e2-8cb6-7b56259778b6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:38.445699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f0b1cca-8181-43e2-8cb6-7b56259778b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:38.466727 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:38.488637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c46fe6-7508-4f5b-8d8d-fa64c4b41d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:38.490594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c46fe6-7508-4f5b-8d8d-fa64c4b41d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.490873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c46fe6-7508-4f5b-8d8d-fa64c4b41d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.492349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c46fe6-7508-4f5b-8d8d-fa64c4b41d34 admin admin] PATH_INFO: `/v3/projects/b262b09d15ec442e9b09e7f5977da728/users/2da7d01e0dea48d9b7bacd959928ff20/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.498407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c46fe6-7508-4f5b-8d8d-fa64c4b41d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b262b09d15ec442e9b09e7f5977da728, user_id=2da7d01e0dea48d9b7bacd959928ff20, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:38.508754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c46fe6-7508-4f5b-8d8d-fa64c4b41d34 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:38.534628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b1cca-8181-43e2-8cb6-7b56259778b6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:38.542919 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 855/1717] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:38 2022] PUT /identity/v3/projects/b262b09d15ec442e9b09e7f5977da728/users/2da7d01e0dea48d9b7bacd959928ff20/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:38.544908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.545541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.546027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.579714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:38.582607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:38.636013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:38.636672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.636953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.637226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] PATH_INFO: `/v3/users/b4dd86883fd14a9181d3b186a898ec37` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.638832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dd86883fd14a9181d3b186a898ec37)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:38.644089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:38.741216 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 856/1718] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:38.758470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:38.764940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:38.897488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dd86883fd14a9181d3b186a898ec37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:38.898581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dd86883fd14a9181d3b186a898ec37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:38.898687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7add8a-27fc-4b53-969c-235b34a22380 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:38.909442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417fe7f-7106-42e1-9723-a744910eb9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:38.910661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417fe7f-7106-42e1-9723-a744910eb9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.912233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417fe7f-7106-42e1-9723-a744910eb9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.913928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417fe7f-7106-42e1-9723-a744910eb9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:38.947865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417fe7f-7106-42e1-9723-a744910eb9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:38.950181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417fe7f-7106-42e1-9723-a744910eb9a0 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:38.974584 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 857/1719] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:38.974584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:38.974584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:38.974584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:39.019466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dd86883fd14a9181d3b186a898ec37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.032128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dd86883fd14a9181d3b186a898ec37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.032988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dd86883fd14a9181d3b186a898ec37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.046510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:39.047988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:39.070766 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 863/1720] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:38 2022] DELETE /identity/v3/users/b4dd86883fd14a9181d3b186a898ec37 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:39.105904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:39.107457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:39.150602 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:39.169420 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 858/1721] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:39.240647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7356930-a187-4d69-8229-16b6dcd8ef05 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:39.244491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:39.245140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:39.245426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:39.245703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] PATH_INFO: `/v3/projects/76e03d7b2f6c4cb0b6cb26fc14aae97c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:39.247004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e03d7b2f6c4cb0b6cb26fc14aae97c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:39.249767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:39.446165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e03d7b2f6c4cb0b6cb26fc14aae97c', 'request_id': 'req-6399990d-43ec-4996-b216-99a008fefa53'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.455710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e03d7b2f6c4cb0b6cb26fc14aae97c', 'request_id': 'req-6399990d-43ec-4996-b216-99a008fefa53'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.527858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e03d7b2f6c4cb0b6cb26fc14aae97c', 'request_id': 'req-6399990d-43ec-4996-b216-99a008fefa53'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.538921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:39.540827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:39.556799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] The token cache is being invalidate because project 76e03d7b2f6c4cb0b6cb26fc14aae97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:39.559072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.559072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6399990d-43ec-4996-b216-99a008fefa53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.568131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50903d-1897-4038-a018-136d80bea3ce None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:39.574868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 864/1722] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:39 2022] DELETE /identity/v3/projects/76e03d7b2f6c4cb0b6cb26fc14aae97c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:12:39.580719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:39.581618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:39.581934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:39.648793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:39.653093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:39.706382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:39.707073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:39.707868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:39.708216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] PATH_INFO: `/v3/projects/bfd9b2dce09f40daad9100d256e67557` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:39.714757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd9b2dce09f40daad9100d256e67557)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:39.718484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:39.776063 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:39.816420 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 865/1723] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:12:39.818349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:39.819880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:39.893470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd9b2dce09f40daad9100d256e67557', 'request_id': 'req-08246560-0911-4e6b-9982-67dcd2597976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.900994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd9b2dce09f40daad9100d256e67557', 'request_id': 'req-08246560-0911-4e6b-9982-67dcd2597976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.942666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533f0ab-3267-4a0b-889e-a0958d75217c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:39.981717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd9b2dce09f40daad9100d256e67557', 'request_id': 'req-08246560-0911-4e6b-9982-67dcd2597976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.997147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] The token cache is being invalidate because project bfd9b2dce09f40daad9100d256e67557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:39.997654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:39.998510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-08246560-0911-4e6b-9982-67dcd2597976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:40.001734 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 859/1724] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:39 2022] DELETE /identity/v3/projects/bfd9b2dce09f40daad9100d256e67557 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:40.006190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f5cda-76a7-4f64-96f0-517dab91d3ea None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:40.007364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f5cda-76a7-4f64-96f0-517dab91d3ea None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:40.007758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f5cda-76a7-4f64-96f0-517dab91d3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:40.026098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:40.026098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:40.026098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:40.026098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:40.026563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:40.036149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f91f5cda-76a7-4f64-96f0-517dab91d3ea None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:40.037788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f91f5cda-76a7-4f64-96f0-517dab91d3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:40.118330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:40.121098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:40.135661 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 866/1725] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:12:40.136765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:40.142324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:40.267352 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 860/1726] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:40.268449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f5cda-76a7-4f64-96f0-517dab91d3ea None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:40.292301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f5cda-76a7-4f64-96f0-517dab91d3ea None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:40.310224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:40.311058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:40.311768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:40.312052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:40.312724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:40.313085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:40.322086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:40.373184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 861/1727] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:40.374190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:40.394790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4c868-1739-4036-ac7d-8db302ac395c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:40.398765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6c0e-6acb-4c4c-b9d9-e59006cec5b9 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:40.409141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:40.410229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:40.410551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:40.411705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:40.413534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:40.414371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:40.414657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:40.414931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] PATH_INFO: `/v3/users/8720fe4f6f174e91beb090fdde76f9b7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:40.416467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:40.417080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8720fe4f6f174e91beb090fdde76f9b7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:40.421924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:40.427530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:40.554676 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 862/1728] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:40 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:40.555904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:40.563560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:40.660083 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:40.677861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8720fe4f6f174e91beb090fdde76f9b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:40.682994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8720fe4f6f174e91beb090fdde76f9b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:40.736662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1864d8-0a38-4c5f-8d08-e2f56e7a49d4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:40.745300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8720fe4f6f174e91beb090fdde76f9b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:40.761845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8720fe4f6f174e91beb090fdde76f9b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:40.762340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:40.763097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:40.763411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:40.763694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] PATH_INFO: `/v3/projects/6d88f4d1dec344e6b4518896c6c5ced3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:40.764586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8720fe4f6f174e91beb090fdde76f9b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:40.767892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d88f4d1dec344e6b4518896c6c5ced3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:40.775494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:40.856122 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 867/1729] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:40 2022] DELETE /identity/v3/users/8720fe4f6f174e91beb090fdde76f9b7 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:40.857220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:40.861547 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:40.861758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:41.023729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d88f4d1dec344e6b4518896c6c5ced3', 'request_id': 'req-dd8c695e-10eb-46af-949f-697e9be42426'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:41.041638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d88f4d1dec344e6b4518896c6c5ced3', 'request_id': 'req-dd8c695e-10eb-46af-949f-697e9be42426'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:41.052330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94a4d-4565-41dc-b6e4-bd16289eced0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:41.164228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:41.165496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.166218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.166501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.167270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:41.169594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:41.212398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d88f4d1dec344e6b4518896c6c5ced3', 'request_id': 'req-dd8c695e-10eb-46af-949f-697e9be42426'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:41.233541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] The token cache is being invalidate because project 6d88f4d1dec344e6b4518896c6c5ced3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:41.237345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:41.238337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd8c695e-10eb-46af-949f-697e9be42426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:41.241514 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 863/1730] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:40 2022] DELETE /identity/v3/projects/6d88f4d1dec344e6b4518896c6c5ced3 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:41.247091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6d3e-39a2-4ca1-8af0-ed50ea8d2105 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.247655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6d3e-39a2-4ca1-8af0-ed50ea8d2105 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.248040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6d3e-39a2-4ca1-8af0-ed50ea8d2105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.303430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6f2e6d3e-39a2-4ca1-8af0-ed50ea8d2105 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:41.307565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6f2e6d3e-39a2-4ca1-8af0-ed50ea8d2105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:41.309774 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 868/1731] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:40 2022] POST /identity/v3/users => generated 294 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:41.310737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:41.313801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:41.332007 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 864/1732] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:41.340771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e586b-5e5c-4c52-93fa-a95f31fd1442 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.341207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e586b-5e5c-4c52-93fa-a95f31fd1442 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.345155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e586b-5e5c-4c52-93fa-a95f31fd1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.358390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dd020-7144-4af6-afa4-b5b04f671bab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:41.368815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:41.369478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.369847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.370136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.370789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:41.372416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:41.389333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-411e586b-5e5c-4c52-93fa-a95f31fd1442 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:41.391874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-411e586b-5e5c-4c52-93fa-a95f31fd1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:41.424630 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 869/1733] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:41.450893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 865/1734] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:41.451851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:41.451933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e586b-5e5c-4c52-93fa-a95f31fd1442 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:41.483692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce3b87-e54e-4c83-9cb0-ddd7d99b90ee admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:41.575840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e586b-5e5c-4c52-93fa-a95f31fd1442 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:41.577407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:41.577407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.577407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.577407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.577864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:41.577864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:41.578228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:41.578228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.578228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.578228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.578758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:41.578758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:41.578758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:41.578758 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 866/1735] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:41.579210 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 870/1736] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:41.579485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:41.579764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:41.615814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222b2db-5a51-4821-afe8-fa595a9c64a6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:41.645441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42a5b0-68d1-4b2a-aa19-c504d7db91ef admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:41.646662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb00e7-1040-4658-84f8-9d5f62bd3f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:41.646662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb00e7-1040-4658-84f8-9d5f62bd3f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.646662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb00e7-1040-4658-84f8-9d5f62bd3f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.646662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb00e7-1040-4658-84f8-9d5f62bd3f98 admin admin] PATH_INFO: `/v3/projects/cf86edb216d046ac938f57e420f22ff2/users/05f818f18a30419d8ed94d42b7ba3771/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.646944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126e9f-322c-4640-83bb-8a6b3a60be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:41.646944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126e9f-322c-4640-83bb-8a6b3a60be1a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:41.646944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126e9f-322c-4640-83bb-8a6b3a60be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:41.646944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126e9f-322c-4640-83bb-8a6b3a60be1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:41.647210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126e9f-322c-4640-83bb-8a6b3a60be1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:41.647210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126e9f-322c-4640-83bb-8a6b3a60be1a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:41.726062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb00e7-1040-4658-84f8-9d5f62bd3f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf86edb216d046ac938f57e420f22ff2, user_id=05f818f18a30419d8ed94d42b7ba3771, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:41.732421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb00e7-1040-4658-84f8-9d5f62bd3f98 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:42.017316 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 867/1737] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:41 2022] PUT /identity/v3/projects/cf86edb216d046ac938f57e420f22ff2/users/05f818f18a30419d8ed94d42b7ba3771/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:42.030921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282edc3-386e-4b8c-9aee-860a0bcb1531 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:42.039166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282edc3-386e-4b8c-9aee-860a0bcb1531 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:42.039319 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 871/1738] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:41 2022] POST /identity/v3/projects => generated 383 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:42.039409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282edc3-386e-4b8c-9aee-860a0bcb1531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:42.041326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:42.041663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:42.042010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:42.124982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] MFA Rules not processed for user `05f818f18a30419d8ed94d42b7ba3771`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:42.126383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:42.139497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c282edc3-386e-4b8c-9aee-860a0bcb1531 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:42.141799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c282edc3-386e-4b8c-9aee-860a0bcb1531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:42.265119 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 868/1739] 10.222.0.71 () {58 vars in 1015 bytes} [Sun Aug 28 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:42.266459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282edc3-386e-4b8c-9aee-860a0bcb1531 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:42.313352 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 872/1740] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:42.317971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:42.323384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:42.358884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93ad8f-90a8-4746-9e8a-2d44fe00448c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:42.369282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:42.371131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:42.371626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:42.372139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:42.384430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:42.388448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:42.422917 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 873/1741] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:42.422917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:42.495248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282edc3-386e-4b8c-9aee-860a0bcb1531 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:42.518686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:42.519331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:42.519617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:42.519895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:42.521342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:42.523477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:42.580114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09b14-4f4b-4c32-ae30-7cf89eed6e7b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:42.596379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:42.597369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:42.597953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:42.599548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:42.600436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:42.603244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:42.638612 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 869/1742] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:42 2022] POST /identity/v3/users => generated 292 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:42.640324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:42.643122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:42.663872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c2fb-2842-4b36-a0c9-c67c5f631d8b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:42.670218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:42.671299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:42.671804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:42.672348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] PATH_INFO: `/v3/projects/8865766536c94cc0944d66c5fb23cb8c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:42.673921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8865766536c94cc0944d66c5fb23cb8c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:42.676100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:42.752233 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 874/1743] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:42 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:42.753913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:42.920376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8865766536c94cc0944d66c5fb23cb8c', 'request_id': 'req-e174498a-d5a6-4b72-b998-2829d79add44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:42.929202 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:42.941442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61df60-0f3e-4b9e-a6ce-bdad55718de1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:42.945259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8865766536c94cc0944d66c5fb23cb8c', 'request_id': 'req-e174498a-d5a6-4b72-b998-2829d79add44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:43.041041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8865766536c94cc0944d66c5fb23cb8c', 'request_id': 'req-e174498a-d5a6-4b72-b998-2829d79add44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:43.098051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] The token cache is being invalidate because project 8865766536c94cc0944d66c5fb23cb8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:43.099335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:43.101951 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:43.103456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:43.106770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8467e-597b-4538-94f3-67542468040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:43.109028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8467e-597b-4538-94f3-67542468040c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.109300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8467e-597b-4538-94f3-67542468040c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.115550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8467e-597b-4538-94f3-67542468040c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.115550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8467e-597b-4538-94f3-67542468040c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:43.115550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8467e-597b-4538-94f3-67542468040c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:43.116418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 870/1744] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:42 2022] DELETE /identity/v3/projects/8865766536c94cc0944d66c5fb23cb8c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:43.117532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:43.130246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:43.171664 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 875/1745] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:43.173757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.174401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.174720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.174989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174498a-d5a6-4b72-b998-2829d79add44 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:43.197969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd056b4-299f-4863-a46f-003b27a08685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:43.201148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd056b4-299f-4863-a46f-003b27a08685 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.201464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd056b4-299f-4863-a46f-003b27a08685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.201888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd056b4-299f-4863-a46f-003b27a08685 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.208513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd056b4-299f-4863-a46f-003b27a08685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:43.223949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd056b4-299f-4863-a46f-003b27a08685 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:43.283212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:43.290130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:43.334930 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 876/1746] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:43.335761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:43.337466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:43.379306 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 871/1747] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:43 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:43.383374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffe650-6270-48dc-ba98-39b168d8d692 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.383901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffe650-6270-48dc-ba98-39b168d8d692 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.385490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffe650-6270-48dc-ba98-39b168d8d692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.408224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299066e-ca1c-4e02-a5f8-6b1ba1ca63d6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:43.435692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:43.438590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.440688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.443355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.445559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:43.454979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:43.462093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-77ffe650-6270-48dc-ba98-39b168d8d692 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:43.470850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77ffe650-6270-48dc-ba98-39b168d8d692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:43.538504 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 877/1748] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:43.542890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:43.543324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 872/1749] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:43.544966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffe650-6270-48dc-ba98-39b168d8d692 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:43.592241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffe650-6270-48dc-ba98-39b168d8d692 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:43.596973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dedf65-e2c4-44f7-801e-13f1eb9eadfb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:43.611301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:43.611772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.612088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.614907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.615773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:43.619225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:43.619609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:43.620133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.620518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.621205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] PATH_INFO: `/v3/projects/a615b2e92f2c44aba4bb57b07f651f92/users/41583dcf501f4775827271abd6cbdcb0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.657599 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 878/1750] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:43.660486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:43.675392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a615b2e92f2c44aba4bb57b07f651f92, user_id=41583dcf501f4775827271abd6cbdcb0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:43.696008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1701-e9ac-4fa7-b385-3cce8f937d7a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:43.712819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:43.713871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.713871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.714087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.714736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:43.714917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:43.715231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:43.717089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:43.753178 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 879/1751] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:43.753984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:43.780906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb3af-6c0c-49a8-b805-e72244716fa7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:43.794427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b104222-007d-4004-be3e-c256475e70d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:43.794427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b104222-007d-4004-be3e-c256475e70d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:43.794427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b104222-007d-4004-be3e-c256475e70d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:43.794427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b104222-007d-4004-be3e-c256475e70d4 admin admin] PATH_INFO: `/v3/projects/a9305346b98f497d9e9877c265affa39/users/fa6d75337cc64c1e9536896342fd0b7c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:43.853062 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 873/1752] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:43 2022] PUT /identity/v3/projects/a615b2e92f2c44aba4bb57b07f651f92/users/41583dcf501f4775827271abd6cbdcb0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:43.857406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:43.866092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b104222-007d-4004-be3e-c256475e70d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9305346b98f497d9e9877c265affa39, user_id=fa6d75337cc64c1e9536896342fd0b7c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:43.878256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b104222-007d-4004-be3e-c256475e70d4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:44.006598 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:44.013650 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 880/1753] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:43 2022] PUT /identity/v3/projects/a9305346b98f497d9e9877c265affa39/users/fa6d75337cc64c1e9536896342fd0b7c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:44.019517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b97bd5-898f-46fd-889c-0d05466b93ed None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.020910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b97bd5-898f-46fd-889c-0d05466b93ed None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.021333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b97bd5-898f-46fd-889c-0d05466b93ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.052513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429fe50-f663-4ada-964e-7bbe9988f771 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:44.108440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-45b97bd5-898f-46fd-889c-0d05466b93ed None None] MFA Rules not processed for user `41583dcf501f4775827271abd6cbdcb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:44.109540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-45b97bd5-898f-46fd-889c-0d05466b93ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:44.214519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:44.215592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.216034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.216466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.217257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:44.226770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:44.240894 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 881/1754] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:44.241933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b97bd5-898f-46fd-889c-0d05466b93ed None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:44.261353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b97bd5-898f-46fd-889c-0d05466b93ed None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:44.267371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:44.268023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.268363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.268644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.269463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:44.271912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:44.285104 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 882/1755] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:44.290099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:44.316314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72bb5-7d7d-4b6e-8565-c61a116a6595 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:44.322372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:44.322987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.323296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.323961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.325120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:44.327163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:44.417630 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 874/1756] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:43 2022] POST /identity/v3/projects => generated 393 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:44.422634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:44.427288 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 883/1757] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:44 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:44.430720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:44.515600 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:44.579064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445477-bb96-48b9-84c6-90d346b10730 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:44.586463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3b70f-8663-4feb-b8a9-6422f541f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:44.587420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b70f-8663-4feb-b8a9-6422f541f067 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.587815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b70f-8663-4feb-b8a9-6422f541f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.588324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b70f-8663-4feb-b8a9-6422f541f067 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.590246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3b70f-8663-4feb-b8a9-6422f541f067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:44.595416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3b70f-8663-4feb-b8a9-6422f541f067 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:44.634490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3e2db-2d10-4f63-a989-eb8c73a13275 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:44.639948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:44.640931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.641365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.641844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] PATH_INFO: `/v3/projects/a9305346b98f497d9e9877c265affa39/users/fa6d75337cc64c1e9536896342fd0b7c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.644193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9305346b98f497d9e9877c265affa39, user_id=fa6d75337cc64c1e9536896342fd0b7c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:44.647807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:44.664017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 875/1758] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:44 2022] PUT /identity/v3/projects/a9305346b98f497d9e9877c265affa39/users/fa6d75337cc64c1e9536896342fd0b7c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:44.671598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:44.702062 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 884/1759] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:44 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:44.704024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c48de-da97-4daf-a6d2-bf8c2eb6fd52 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.704479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c48de-da97-4daf-a6d2-bf8c2eb6fd52 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.707018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c48de-da97-4daf-a6d2-bf8c2eb6fd52 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.715846 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 885/1760] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:12:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:44.716256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f0e6-2972-4db1-a646-04d69d701538 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.716783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f0e6-2972-4db1-a646-04d69d701538 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.717060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36f0e6-2972-4db1-a646-04d69d701538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.780780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9c36f0e6-2972-4db1-a646-04d69d701538 None None] MFA Rules not processed for user `fa6d75337cc64c1e9536896342fd0b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:44.781755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9c36f0e6-2972-4db1-a646-04d69d701538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:44.799140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f919-e0f6-4aee-bf61-9a1fcabbf401 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:44.823649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:44.824303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.825328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.825328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.825516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:44.827542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:44.934625 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 876/1761] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:44 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:44.938906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:44.940683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 886/1762] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:44.943561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ca1eb-41b3-4d73-a4bc-bc55ca580821 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.944248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ca1eb-41b3-4d73-a4bc-bc55ca580821 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.944364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ca1eb-41b3-4d73-a4bc-bc55ca580821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.971273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb742ee-8a2f-469e-9485-d6b7a657bf13 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:44.984301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:44.987239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:44.987664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:44.988048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:44.988233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b02ca1eb-41b3-4d73-a4bc-bc55ca580821 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:44.992309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:44.993781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b02ca1eb-41b3-4d73-a4bc-bc55ca580821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:44.996510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:45.036579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 877/1763] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:45.039056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.056083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b552788-8726-4d19-9daf-0365a90a74ab admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:45.062871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08786518-d5b4-42cc-bfc8-5ec698a108bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:45.063823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786518-d5b4-42cc-bfc8-5ec698a108bd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.064505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786518-d5b4-42cc-bfc8-5ec698a108bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.065404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786518-d5b4-42cc-bfc8-5ec698a108bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.066219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08786518-d5b4-42cc-bfc8-5ec698a108bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:45.069501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08786518-d5b4-42cc-bfc8-5ec698a108bd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:45.093190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 878/1764] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:45.095714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b7de-0621-4f72-85d5-2817eab04cb4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.095714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b7de-0621-4f72-85d5-2817eab04cb4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.096387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b7de-0621-4f72-85d5-2817eab04cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.120493 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:45.141560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6694b7de-0621-4f72-85d5-2817eab04cb4 None None] MFA Rules not processed for user `05f818f18a30419d8ed94d42b7ba3771`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:45.143154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6694b7de-0621-4f72-85d5-2817eab04cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:45.185277 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 887/1765] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:12:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:45.186383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ca1eb-41b3-4d73-a4bc-bc55ca580821 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.200680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ca1eb-41b3-4d73-a4bc-bc55ca580821 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:45.227730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:45.230738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.230738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.230738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.231075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:45.232482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:45.266122 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 879/1766] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:45.267528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694b7de-0621-4f72-85d5-2817eab04cb4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.281096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 888/1767] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:45.282103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.286053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694b7de-0621-4f72-85d5-2817eab04cb4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:45.292850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:45.294040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.295312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.296375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] PATH_INFO: `/v3/projects/2639dfa4dedb4de89ae9f09d6c2d4126/users/3badcb9620a54244b3155bfb508e5523/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.314781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c91dff-3a45-4396-9a7a-84c95f26d828 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:45.322195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:45.323118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.323394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2639dfa4dedb4de89ae9f09d6c2d4126, user_id=3badcb9620a54244b3155bfb508e5523, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:45.325100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.325100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] PATH_INFO: `/v3/projects/e1e070b23a2943c190c7a6227f49b659/users/07e2186086344005b44c5083ca4f9561/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.329637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:45.346871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e070b23a2943c190c7a6227f49b659, user_id=07e2186086344005b44c5083ca4f9561, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:45.351104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:45.404437 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 880/1768] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:45 2022] PUT /identity/v3/projects/2639dfa4dedb4de89ae9f09d6c2d4126/users/3badcb9620a54244b3155bfb508e5523/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:45.405427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.409776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:45.454269 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:45.456533 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 889/1769] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:45 2022] PUT /identity/v3/projects/e1e070b23a2943c190c7a6227f49b659/users/07e2186086344005b44c5083ca4f9561/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:45.458510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.551966 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:45.674606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187882a-cea2-42b5-b35d-690d92c56748 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:45.677114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98172d-a411-428d-b741-08cde1640132 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:45.691055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7574f67-e406-4c8d-8417-7070a220d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:45.692746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574f67-e406-4c8d-8417-7070a220d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.693128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574f67-e406-4c8d-8417-7070a220d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.694464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574f67-e406-4c8d-8417-7070a220d9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.698153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7574f67-e406-4c8d-8417-7070a220d9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:45.699608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7574f67-e406-4c8d-8417-7070a220d9fa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:45.730968 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 890/1770] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:45.730968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f14fc-128d-4c85-b025-264872a62845 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.731632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f14fc-128d-4c85-b025-264872a62845 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.731926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f14fc-128d-4c85-b025-264872a62845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.751652 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:45.785644 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:45.809509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-419f14fc-128d-4c85-b025-264872a62845 None None] MFA Rules not processed for user `07e2186086344005b44c5083ca4f9561`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:45.810877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-419f14fc-128d-4c85-b025-264872a62845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:45.875304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:45.876601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:45.877115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:45.878521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:45.891249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:45.894271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:45.940357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 881/1771] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:45.941509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.951541 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:45.954697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:45.985021 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 891/1772] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:45.985842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f14fc-128d-4c85-b025-264872a62845 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:45.996056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0ec0f-14fa-484e-a240-91d9a329427e service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:46.002734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f14fc-128d-4c85-b025-264872a62845 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:46.010249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a6174-5da7-4ff9-b8b0-a5935effcfc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:46.011118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6174-5da7-4ff9-b8b0-a5935effcfc1 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:46.011481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6174-5da7-4ff9-b8b0-a5935effcfc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:46.011763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6174-5da7-4ff9-b8b0-a5935effcfc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:46.017044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d9a6174-5da7-4ff9-b8b0-a5935effcfc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:46.021779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:46.022733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:46.024449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:46.024807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] PATH_INFO: `/v3/projects/2639dfa4dedb4de89ae9f09d6c2d4126/users/3badcb9620a54244b3155bfb508e5523/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:46.027646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2639dfa4dedb4de89ae9f09d6c2d4126, user_id=3badcb9620a54244b3155bfb508e5523, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:46.033040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:46.069960 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 892/1773] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:45 2022] PUT /identity/v3/projects/2639dfa4dedb4de89ae9f09d6c2d4126/users/3badcb9620a54244b3155bfb508e5523/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:46.069960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:46.131737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a6174-5da7-4ff9-b8b0-a5935effcfc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:46.134482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a6174-5da7-4ff9-b8b0-a5935effcfc1 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:46.155337 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 882/1774] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:46.156949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bbee1-a728-46dc-9419-facbccc9a3b7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:46.157250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bbee1-a728-46dc-9419-facbccc9a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:46.157525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bbee1-a728-46dc-9419-facbccc9a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:46.254049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b93bbee1-a728-46dc-9419-facbccc9a3b7 None None] MFA Rules not processed for user `3badcb9620a54244b3155bfb508e5523`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:46.260300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b93bbee1-a728-46dc-9419-facbccc9a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:46.387486 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:46.395585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138b7f0-240b-4ece-8675-b4bfe85b2cc9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:46.411380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:46.414651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:46.415421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:46.427312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:46.428652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:46.431468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:46.498748 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 883/1775] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:46.570830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bbee1-a728-46dc-9419-facbccc9a3b7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:46.585870 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 893/1776] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:46 2022] POST /identity/v3/projects => generated 393 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:46.586078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bbee1-a728-46dc-9419-facbccc9a3b7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:46.615111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:46.761206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:46.761664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:46.762043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:46.762326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:46.762971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:46.766260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:46.804919 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:46.846710 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 884/1777] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:46 2022] POST /identity/v3/users => generated 303 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:46.852554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:46.862569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67909-043d-4529-b105-4fa3f2d28749 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:46.875465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:46.885248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:46.885748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:46.886350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:46.901431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121554d9-9265-4671-8a4d-24505dd091ef admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:46.932740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:46.934168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:46.937282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:46.937282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:46.937282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:46.937564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:46.998458 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 885/1778] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:47.001230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:47.023761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687375-8669-41fe-991d-83c251854b11 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:47.031764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:47.032454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:47.032737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:47.033076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] PATH_INFO: `/v3/projects/b941194c6cd84d9d8fc6cc3907d55209/users/2a43c14c9e0b496a82c3ec5231353f5e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:47.068512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b941194c6cd84d9d8fc6cc3907d55209, user_id=2a43c14c9e0b496a82c3ec5231353f5e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:47.074451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:47.093491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:47.095138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:47.115116 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 894/1779] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:47.164319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:47.166089 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 886/1780] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:46 2022] PUT /identity/v3/projects/b941194c6cd84d9d8fc6cc3907d55209/users/2a43c14c9e0b496a82c3ec5231353f5e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:47.182843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059084-a0c2-4e85-841f-af8d47382ec0 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:47.349204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803d1c3-129a-4e77-91ad-66603565e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:47.350199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d1c3-129a-4e77-91ad-66603565e26b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:47.350868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d1c3-129a-4e77-91ad-66603565e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:47.356973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803d1c3-129a-4e77-91ad-66603565e26b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:47.356973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803d1c3-129a-4e77-91ad-66603565e26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:47.356973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803d1c3-129a-4e77-91ad-66603565e26b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:47.370033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 895/1781] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:47.373702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:47.398813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c008-31dd-410f-b923-9bfc5b138f27 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:47.409212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:47.411960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:47.412447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:47.412873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] PATH_INFO: `/v3/projects/b941194c6cd84d9d8fc6cc3907d55209/users/2a43c14c9e0b496a82c3ec5231353f5e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:47.416588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b941194c6cd84d9d8fc6cc3907d55209, user_id=2a43c14c9e0b496a82c3ec5231353f5e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:47.421410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:47.441249 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 887/1782] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:47 2022] PUT /identity/v3/projects/b941194c6cd84d9d8fc6cc3907d55209/users/2a43c14c9e0b496a82c3ec5231353f5e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:47.452615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33f79-26a6-4ee4-aa93-6b07e317f95e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:47.453203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33f79-26a6-4ee4-aa93-6b07e317f95e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:47.453316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33f79-26a6-4ee4-aa93-6b07e317f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:47.553764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c9a33f79-26a6-4ee4-aa93-6b07e317f95e None None] MFA Rules not processed for user `2a43c14c9e0b496a82c3ec5231353f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:47.557549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c9a33f79-26a6-4ee4-aa93-6b07e317f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:47.802143 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 896/1783] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:48.122734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:48.248322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a33f79-26a6-4ee4-aa93-6b07e317f95e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:48.263509 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:48.298286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5bca4-7e3c-44b6-b98c-5d0580481bcf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:48.313631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:48.321784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:48.321784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:48.321784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] PATH_INFO: `/v3/users/41583dcf501f4775827271abd6cbdcb0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:48.321784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41583dcf501f4775827271abd6cbdcb0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:48.327535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:48.432356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a33f79-26a6-4ee4-aa93-6b07e317f95e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:48.448365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f553-cd76-4d19-9e84-3d3387ca9900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:48.448365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f553-cd76-4d19-9e84-3d3387ca9900 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:48.448365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f553-cd76-4d19-9e84-3d3387ca9900 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:48.448365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f553-cd76-4d19-9e84-3d3387ca9900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:48.467469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129f553-cd76-4d19-9e84-3d3387ca9900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:48.469505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129f553-cd76-4d19-9e84-3d3387ca9900 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:48.498830 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 897/1784] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:48.545385 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:48.565661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41583dcf501f4775827271abd6cbdcb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:48.606700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41583dcf501f4775827271abd6cbdcb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:48.619677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41583dcf501f4775827271abd6cbdcb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:48.624470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41583dcf501f4775827271abd6cbdcb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:48.740005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41583dcf501f4775827271abd6cbdcb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:48.750585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 888/1785] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:48 2022] DELETE /identity/v3/users/41583dcf501f4775827271abd6cbdcb0 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:48.756376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:48.756376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:48.756635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:48.790669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:48.792038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:48.931827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 898/1786] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:48.949087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:48.950941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:49.074518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cf579-d5f3-463f-9a42-c505e565967e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:49.078999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafe626-7b25-4c53-88d0-82c2b33c471e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:49.079856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe626-7b25-4c53-88d0-82c2b33c471e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:49.080317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe626-7b25-4c53-88d0-82c2b33c471e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:49.080644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe626-7b25-4c53-88d0-82c2b33c471e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:49.095731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafe626-7b25-4c53-88d0-82c2b33c471e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:49.099826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafe626-7b25-4c53-88d0-82c2b33c471e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:49.114599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:49.116396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:49.135371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187628c-6b7a-4b6b-a599-d3561dc50690 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:49.137153 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 889/1787] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:49.144383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:49.145440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:49.145959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:49.146432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] PATH_INFO: `/v3/users/07e2186086344005b44c5083ca4f9561` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:49.147855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e2186086344005b44c5083ca4f9561)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:49.150115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:49.513605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e2186086344005b44c5083ca4f9561'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:49.514644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e2186086344005b44c5083ca4f9561'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:49.614289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e2186086344005b44c5083ca4f9561'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:49.625249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e2186086344005b44c5083ca4f9561'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:49.626410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e2186086344005b44c5083ca4f9561'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:49.684503 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 899/1788] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:49 2022] DELETE /identity/v3/users/07e2186086344005b44c5083ca4f9561 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:49.686566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:49.687199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:49.687672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:49.723539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:49.725111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:49.831138 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 890/1789] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:49.843200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:49.844816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:49.861230 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:49.957217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390d11-39a7-4c72-9264-623b5aa36bac admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:49.971271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:49.972163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:49.972333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:49.972736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:50.023795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:50.023795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:50.023795 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 900/1790] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:50.565165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:50.568268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:50.594182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675300-63a4-4408-b738-a45f77c3e427 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:50.607208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:50.609656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:50.609656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:50.609656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] PATH_INFO: `/v3/projects/a615b2e92f2c44aba4bb57b07f651f92` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:50.613345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a615b2e92f2c44aba4bb57b07f651f92)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:50.616927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:50.828911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a615b2e92f2c44aba4bb57b07f651f92', 'request_id': 'req-b3b00287-84a2-41d8-a073-f60fe4495fb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:50.831254 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:50.850481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a615b2e92f2c44aba4bb57b07f651f92', 'request_id': 'req-b3b00287-84a2-41d8-a073-f60fe4495fb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:50.912741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a615b2e92f2c44aba4bb57b07f651f92', 'request_id': 'req-b3b00287-84a2-41d8-a073-f60fe4495fb0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:50.945431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] The token cache is being invalidate because project a615b2e92f2c44aba4bb57b07f651f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:50.946836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:50.949656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:50.952179 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 891/1791] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:50 2022] DELETE /identity/v3/projects/a615b2e92f2c44aba4bb57b07f651f92 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:50.956166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:50.977197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589b9c-50bf-4f7f-bd58-73482a15045b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:51.118998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:51.120647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:51.120946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:51.121273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] PATH_INFO: `/v3/users/3badcb9620a54244b3155bfb508e5523` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:51.123658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3badcb9620a54244b3155bfb508e5523)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:51.132285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:51.164124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:51.166201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:51.192735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00287-84a2-41d8-a073-f60fe4495fb0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:51.209111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:51.210262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:51.210428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:51.210781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] PATH_INFO: `/v3/projects/e1e070b23a2943c190c7a6227f49b659` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:51.212299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e070b23a2943c190c7a6227f49b659)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:51.227429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:51.439392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e070b23a2943c190c7a6227f49b659', 'request_id': 'req-98fc3345-7046-4911-a184-75ae0dd7e301'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.440119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3badcb9620a54244b3155bfb508e5523'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.441664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3badcb9620a54244b3155bfb508e5523'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.447542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e070b23a2943c190c7a6227f49b659', 'request_id': 'req-98fc3345-7046-4911-a184-75ae0dd7e301'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.522102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e070b23a2943c190c7a6227f49b659', 'request_id': 'req-98fc3345-7046-4911-a184-75ae0dd7e301'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.555783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] The token cache is being invalidate because project e1e070b23a2943c190c7a6227f49b659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:51.556532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.559357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98fc3345-7046-4911-a184-75ae0dd7e301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.562116 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 892/1792] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:51 2022] DELETE /identity/v3/projects/e1e070b23a2943c190c7a6227f49b659 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:51.562250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3badcb9620a54244b3155bfb508e5523'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.568161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05fff-eace-45c3-9110-1337f361ecb6 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:51.569461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05fff-eace-45c3-9110-1337f361ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:51.569975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d05fff-eace-45c3-9110-1337f361ecb6 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:51.572902 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 893/1793] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:12:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:12:51.573997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d05fff-eace-45c3-9110-1337f361ecb6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:51.576616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3badcb9620a54244b3155bfb508e5523'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.577488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2e40a61-38f5-4349-a742-bbb77f5b6f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3badcb9620a54244b3155bfb508e5523'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:51.579481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-99d05fff-eace-45c3-9110-1337f361ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:51.617991 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 901/1794] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:50 2022] DELETE /identity/v3/users/3badcb9620a54244b3155bfb508e5523 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:51.622798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a27867-ebca-461d-9033-458fed278090 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:51.623300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a27867-ebca-461d-9033-458fed278090 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:51.623388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a27867-ebca-461d-9033-458fed278090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:51.663978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-12a27867-ebca-461d-9033-458fed278090 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:51.665267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-12a27867-ebca-461d-9033-458fed278090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:51.727288 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:51.836970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d05fff-eace-45c3-9110-1337f361ecb6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:51.943581 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 902/1795] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:52.018095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:52.022156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:52.022760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:52.023911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] PATH_INFO: `/v3/users/2a43c14c9e0b496a82c3ec5231353f5e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:52.030419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a27867-ebca-461d-9033-458fed278090 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:52.032196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-12a27867-ebca-461d-9033-458fed278090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:52.038031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a43c14c9e0b496a82c3ec5231353f5e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:52.040609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:52.065890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a27867-ebca-461d-9033-458fed278090 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:52.086826 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:52.087577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca9b3-d267-4fd8-a2eb-ccc14f1ce3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:52.088220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca9b3-d267-4fd8-a2eb-ccc14f1ce3b3 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:52.088499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca9b3-d267-4fd8-a2eb-ccc14f1ce3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:52.088945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca9b3-d267-4fd8-a2eb-ccc14f1ce3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:52.104131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca9b3-d267-4fd8-a2eb-ccc14f1ce3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:52.110555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca9b3-d267-4fd8-a2eb-ccc14f1ce3b3 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:52.135214 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 903/1796] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:12:52.357796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a43c14c9e0b496a82c3ec5231353f5e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:52.402016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a43c14c9e0b496a82c3ec5231353f5e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:52.430296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a43c14c9e0b496a82c3ec5231353f5e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:52.435240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a43c14c9e0b496a82c3ec5231353f5e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:52.505150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a43c14c9e0b496a82c3ec5231353f5e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:52.513472 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 894/1797] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:51 2022] DELETE /identity/v3/users/2a43c14c9e0b496a82c3ec5231353f5e => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:52.913334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:52.913334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:52.913334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:52.913334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:52.916929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:53.037226 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 904/1798] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:53.071098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:53.071098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:53.201491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b31a04-2f5c-48a4-8b1e-6213a2130a25 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:53.209956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:53.210741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:53.211032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:53.211305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:53.221708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:53.224183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:53.243229 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 895/1799] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:12:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:12:53.361250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:53.361250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:53.487121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:53.489204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:53.549528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dc0f1-34bf-428e-921c-1c7da64f3ebb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:53.572495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:53.573080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:53.573363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:53.573630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] PATH_INFO: `/v3/projects/2639dfa4dedb4de89ae9f09d6c2d4126` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:53.590507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2639dfa4dedb4de89ae9f09d6c2d4126)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:53.592475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:53.688569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca7a47-1701-4e0b-aa2a-0b3535bdbf8d service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:53.698464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:53.700697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:53.701446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:53.701974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] PATH_INFO: `/v3/projects/b941194c6cd84d9d8fc6cc3907d55209` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:53.703332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b941194c6cd84d9d8fc6cc3907d55209)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:53.705400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:53.764811 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:53.877395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2639dfa4dedb4de89ae9f09d6c2d4126', 'request_id': 'req-38744876-9a85-4b49-8a48-5be6493a35b4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:53.900354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2639dfa4dedb4de89ae9f09d6c2d4126', 'request_id': 'req-38744876-9a85-4b49-8a48-5be6493a35b4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:53.901923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b941194c6cd84d9d8fc6cc3907d55209', 'request_id': 'req-1a906511-e0ba-49cb-8be6-4eeffd5006a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:53.914286 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:53.930440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b941194c6cd84d9d8fc6cc3907d55209', 'request_id': 'req-1a906511-e0ba-49cb-8be6-4eeffd5006a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:53.980405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2639dfa4dedb4de89ae9f09d6c2d4126', 'request_id': 'req-38744876-9a85-4b49-8a48-5be6493a35b4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:53.996010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] The token cache is being invalidate because project 2639dfa4dedb4de89ae9f09d6c2d4126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:53.996308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:53.997138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-38744876-9a85-4b49-8a48-5be6493a35b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:53.999306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 905/1800] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:53 2022] DELETE /identity/v3/projects/2639dfa4dedb4de89ae9f09d6c2d4126 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:54.022217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6a7f-38a3-4f6b-b821-4126d4f058d4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.022546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6a7f-38a3-4f6b-b821-4126d4f058d4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.022861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6a7f-38a3-4f6b-b821-4126d4f058d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.035686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b941194c6cd84d9d8fc6cc3907d55209', 'request_id': 'req-1a906511-e0ba-49cb-8be6-4eeffd5006a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:54.073389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] The token cache is being invalidate because project b941194c6cd84d9d8fc6cc3907d55209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:12:54.074095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:54.092283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a906511-e0ba-49cb-8be6-4eeffd5006a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:54.097219 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 896/1801] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:12:53 2022] DELETE /identity/v3/projects/b941194c6cd84d9d8fc6cc3907d55209 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:12:54.099450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b3743-61bf-46b6-a14a-d0291da045ed None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.099729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b3743-61bf-46b6-a14a-d0291da045ed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.100182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b3743-61bf-46b6-a14a-d0291da045ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.108720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6f0b6a7f-38a3-4f6b-b821-4126d4f058d4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:54.109953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6f0b6a7f-38a3-4f6b-b821-4126d4f058d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:54.152287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-439b3743-61bf-46b6-a14a-d0291da045ed None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:54.161546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-439b3743-61bf-46b6-a14a-d0291da045ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:54.265406 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 906/1802] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:54.277712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e5def-145b-402d-b142-0dcad0711fa4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.278032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e5def-145b-402d-b142-0dcad0711fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.278571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e5def-145b-402d-b142-0dcad0711fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.323574 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 897/1803] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:12:54.333498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128fc54-7d7c-4df0-972c-16e0622136db None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.333774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128fc54-7d7c-4df0-972c-16e0622136db None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.336005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128fc54-7d7c-4df0-972c-16e0622136db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.336674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a28e5def-145b-402d-b142-0dcad0711fa4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:54.337924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a28e5def-145b-402d-b142-0dcad0711fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:54.362349 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 907/1804] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:54.367050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e5def-145b-402d-b142-0dcad0711fa4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:54.375360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1128fc54-7d7c-4df0-972c-16e0622136db None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:54.376636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1128fc54-7d7c-4df0-972c-16e0622136db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:54.380319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e5def-145b-402d-b142-0dcad0711fa4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:54.387210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:54.388056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.388445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.388721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.389380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:54.389684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:54.393439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:54.406498 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 898/1805] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:54.409449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128fc54-7d7c-4df0-972c-16e0622136db None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:54.421779 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 908/1806] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:54.427679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:54.428748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128fc54-7d7c-4df0-972c-16e0622136db None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:54.435276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:54.437463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.438105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.438650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.440592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:12:54.444520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:54.447151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fa3ea-ee84-40fd-8fb8-e186b5de5cfb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:54.447872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:54.453935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:54.454616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.454900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.455223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.455927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:54.460474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:54.474000 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 899/1807] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:12:54.476123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:54.491877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290d90-35b4-463c-98e1-de74aaf27d95 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:54.504206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa222-7698-470b-88d3-681131f65e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:54.505396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa222-7698-470b-88d3-681131f65e55 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.505954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa222-7698-470b-88d3-681131f65e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.506466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa222-7698-470b-88d3-681131f65e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.507332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa222-7698-470b-88d3-681131f65e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:54.511098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aa222-7698-470b-88d3-681131f65e55 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:54.594872 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 909/1808] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:54.595973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:54.663828 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 900/1809] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:54.668384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf75c-aa38-42a4-8a8c-7272a9fc5a01 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.669951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf75c-aa38-42a4-8a8c-7272a9fc5a01 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.670373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf75c-aa38-42a4-8a8c-7272a9fc5a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.745283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13c064-cc69-406b-905c-498635bea2fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:54.760031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7bdaf75c-aa38-42a4-8a8c-7272a9fc5a01 None None] MFA Rules not processed for user `2da7d01e0dea48d9b7bacd959928ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:54.761503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7bdaf75c-aa38-42a4-8a8c-7272a9fc5a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:54.836612 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:54.888736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:54.891813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:54.892213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:54.892533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:54.893305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:54.895606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:54.957941 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:55.023520 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 901/1810] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:55.024559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf75c-aa38-42a4-8a8c-7272a9fc5a01 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.046319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf75c-aa38-42a4-8a8c-7272a9fc5a01 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.053520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.054177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.054456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.054727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.055455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.058003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.081536 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 910/1811] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:54 2022] POST /identity/v3/users => generated 286 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:55.084218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.093699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:55.235672 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 902/1812] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:55 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:55.244813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.251661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed56e93-5e22-448c-b2cf-bb44f6453147 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.258394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbb87b-57c5-4f15-a073-8368d818ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.259023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbb87b-57c5-4f15-a073-8368d818ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.259307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbb87b-57c5-4f15-a073-8368d818ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.259601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbb87b-57c5-4f15-a073-8368d818ceb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.260245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbb87b-57c5-4f15-a073-8368d818ceb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.262007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbb87b-57c5-4f15-a073-8368d818ceb4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.277264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 903/1813] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:55.279109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3091f3-b52f-48bf-9acb-9f440c924574 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.279404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3091f3-b52f-48bf-9acb-9f440c924574 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.279684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3091f3-b52f-48bf-9acb-9f440c924574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.307647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ea3091f3-b52f-48bf-9acb-9f440c924574 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:55.309113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea3091f3-b52f-48bf-9acb-9f440c924574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:55.333404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68de2da-3f65-47c3-88ce-c7e5bc001854 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.349354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.355246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.355561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.355874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.362667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:55.426757 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 904/1814] 10.222.0.72 () {58 vars in 1015 bytes} [Sun Aug 28 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:55.430232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3091f3-b52f-48bf-9acb-9f440c924574 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.446811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3091f3-b52f-48bf-9acb-9f440c924574 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.451848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.452523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.452752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.453025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.453798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.455654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.468244 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 905/1815] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:55.478707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.478865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.478865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.486162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6595e-d856-4fca-bec7-c0e100ccfba1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.498173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.499416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.500247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.501696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.503319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.506769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 911/1816] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:55.509997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.510679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.515437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:55.527950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb637b-a9f4-49fe-aefd-5172d4fc7acf service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.539478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.543890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.543890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.545088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.552660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 906/1817] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:55.561679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.580006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.584096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.588176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8bfa6-91e2-4daf-a2bf-2f64e6563179 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.604538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.605470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.605926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.606397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.609158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.630270 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 912/1818] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:55.632135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.632903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.662671 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 907/1819] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:55.667685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.677572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbb24-191a-4c08-bfaf-edcaab6d12c5 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.681464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:55.688707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.690356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.690356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.690592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] PATH_INFO: `/v3/projects/3db4526757ac41afbf2d54dd0d27b64b/users/e285fefe9cb44cadaec6e58a31ef3afe/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.728933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db4526757ac41afbf2d54dd0d27b64b, user_id=e285fefe9cb44cadaec6e58a31ef3afe, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.734809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.740667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05ea6-c276-44c5-a70a-cf8648d4c0a8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.764351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd93e5-3a0d-406b-b5b8-f1dec9c477b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.770660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd93e5-3a0d-406b-b5b8-f1dec9c477b8 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.771374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd93e5-3a0d-406b-b5b8-f1dec9c477b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.774196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd93e5-3a0d-406b-b5b8-f1dec9c477b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.792692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd93e5-3a0d-406b-b5b8-f1dec9c477b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:55.794993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd93e5-3a0d-406b-b5b8-f1dec9c477b8 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:55.809707 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 908/1820] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:55.820740 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 913/1821] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:55 2022] PUT /identity/v3/projects/3db4526757ac41afbf2d54dd0d27b64b/users/e285fefe9cb44cadaec6e58a31ef3afe/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:55.821609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:55.825950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.826575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.827743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:55.857161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:55.858877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:55.927061 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:55.970398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd6d60-e7a7-48bf-a1d4-c7399eed76f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:55.983919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0553d24-483e-42f8-925d-9a6bff0c5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:55.984463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0553d24-483e-42f8-925d-9a6bff0c5d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:55.984744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0553d24-483e-42f8-925d-9a6bff0c5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:55.985009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0553d24-483e-42f8-925d-9a6bff0c5d4e admin admin] PATH_INFO: `/v3/projects/8d423332c3194cd0aceaee643bcbf6c2/users/e1b656b3011f459e9e64f9e78fc83b0d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:56.014016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0553d24-483e-42f8-925d-9a6bff0c5d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d423332c3194cd0aceaee643bcbf6c2, user_id=e1b656b3011f459e9e64f9e78fc83b0d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:56.016837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0553d24-483e-42f8-925d-9a6bff0c5d4e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:56.026219 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 909/1822] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:56.033928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:56.036454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:56.122567 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 914/1823] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:55 2022] PUT /identity/v3/projects/8d423332c3194cd0aceaee643bcbf6c2/users/e1b656b3011f459e9e64f9e78fc83b0d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:56.124611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354787e-86c3-44e2-aed5-494b2737e1fa None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:56.124960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354787e-86c3-44e2-aed5-494b2737e1fa None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:56.127190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354787e-86c3-44e2-aed5-494b2737e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:56.140934 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:56.230920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1354787e-86c3-44e2-aed5-494b2737e1fa None None] MFA Rules not processed for user `e1b656b3011f459e9e64f9e78fc83b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:56.236195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1354787e-86c3-44e2-aed5-494b2737e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:56.252745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c25ef-9c5a-4970-b2a4-01f97e280d87 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:56.430492 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 915/1824] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:12:56.435037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354787e-86c3-44e2-aed5-494b2737e1fa None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:56.436285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:56.437073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:56.437359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:56.437636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:56.611989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:56.613989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:56.641110 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 910/1825] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:12:56.719079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354787e-86c3-44e2-aed5-494b2737e1fa None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:56.746650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:56.749392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:56.750346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:56.752135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:56.758898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:56.773860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:56.920466 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 916/1826] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:12:56 2022] POST /identity/v3/projects => generated 389 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:56.924329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:56.937444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed2b47-4b45-41b8-ac3d-d96f9505fff6 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:57.076462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:57.077103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:57.077393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:57.077669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:57.078335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:57.080413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:57.192506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:57.195866 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 911/1827] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:12:56 2022] POST /identity/v3/users => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:12:57.206563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f978c41-9f0c-42c0-b50f-49bc7a040c32 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:57.214966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:57.216149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:57.216469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:57.216826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:57.217802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:57.221211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:57.243975 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 917/1828] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:12:57.246031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:57.259858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14c44-fac3-4872-b5b3-525da79adbbf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:57.275823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:57.276770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:57.277491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:57.278221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] PATH_INFO: `/v3/projects/3c14da6f176b41039c2603f121bcc82a/users/fe6d272628904c36b42707e196c36528/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:57.316845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c14da6f176b41039c2603f121bcc82a, user_id=fe6d272628904c36b42707e196c36528, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:57.330213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:57.391197 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:57.405908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:57.406134 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 912/1829] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:57 2022] PUT /identity/v3/projects/3c14da6f176b41039c2603f121bcc82a/users/fe6d272628904c36b42707e196c36528/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:57.423823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3535-c462-47aa-b199-508935a9f0bb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:57.540907 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:57.627727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f60a9-b0ca-4921-9798-aa235dc91784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:57.628927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f60a9-b0ca-4921-9798-aa235dc91784 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:57.629292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f60a9-b0ca-4921-9798-aa235dc91784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:57.629743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f60a9-b0ca-4921-9798-aa235dc91784 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:57.630834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f60a9-b0ca-4921-9798-aa235dc91784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:57.633074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f60a9-b0ca-4921-9798-aa235dc91784 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:57.653480 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 918/1830] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:12:57.657298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:57.670987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d39707-6d94-459e-bf0b-30bb90cce827 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:57.679028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:57.682188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:57.683200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:57.683688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] PATH_INFO: `/v3/projects/3c14da6f176b41039c2603f121bcc82a/users/fe6d272628904c36b42707e196c36528/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:57.686520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c14da6f176b41039c2603f121bcc82a, user_id=fe6d272628904c36b42707e196c36528, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:57.690592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:57.719142 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 913/1831] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:12:57 2022] PUT /identity/v3/projects/3c14da6f176b41039c2603f121bcc82a/users/fe6d272628904c36b42707e196c36528/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:57.719387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da5306-e86a-453e-a805-93a4c305d03e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:57.727753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da5306-e86a-453e-a805-93a4c305d03e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:57.727753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da5306-e86a-453e-a805-93a4c305d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:57.789902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a5da5306-e86a-453e-a805-93a4c305d03e None None] MFA Rules not processed for user `fe6d272628904c36b42707e196c36528`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:57.791671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a5da5306-e86a-453e-a805-93a4c305d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:57.952775 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 919/1832] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:12:58.162647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:58.315861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8dcb-90f4-4e02-82c0-3be81f0c456d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:58.326813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeae946-6581-468e-b197-75d22155f304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:58.327341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae946-6581-468e-b197-75d22155f304 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:58.327725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae946-6581-468e-b197-75d22155f304 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:58.327971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeae946-6581-468e-b197-75d22155f304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:58.338469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae946-6581-468e-b197-75d22155f304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:58.340562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeae946-6581-468e-b197-75d22155f304 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:58.372511 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 914/1833] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:58.793137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da5306-e86a-453e-a805-93a4c305d03e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:58.881895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da5306-e86a-453e-a805-93a4c305d03e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:58.886975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:58.887631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:58.887913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:58.888231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] PATH_INFO: `/v3/users/e1b656b3011f459e9e64f9e78fc83b0d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:58.889386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b656b3011f459e9e64f9e78fc83b0d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:58.891535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:59.604334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b656b3011f459e9e64f9e78fc83b0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:59.605045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b656b3011f459e9e64f9e78fc83b0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:59.610119 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:59.722163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b656b3011f459e9e64f9e78fc83b0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:59.739614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b656b3011f459e9e64f9e78fc83b0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:59.740733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b656b3011f459e9e64f9e78fc83b0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:12:59.797491 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 920/1834] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:12:58 2022] DELETE /identity/v3/users/e1b656b3011f459e9e64f9e78fc83b0d => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:12:59.803420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:59.804654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:59.805857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:59.851949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:12:59.854145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:00.000315 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 915/1835] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:00.012380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:00.015095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:00.258433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fde6c-67c4-49a4-953c-435b2c9be193 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:00.279249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:00.280018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:00.282245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:00.282537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:00.309350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:00.311273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:00.329454 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 921/1836] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:13:01.461676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:01.464587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:01.494515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec044fa-89df-4f9d-81c8-8855bd1f9824 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:01.508879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:01.509726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:01.510252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:01.510781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] PATH_INFO: `/v3/projects/8d423332c3194cd0aceaee643bcbf6c2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:01.512894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d423332c3194cd0aceaee643bcbf6c2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:01.516406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:01.677620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d423332c3194cd0aceaee643bcbf6c2', 'request_id': 'req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:01.686248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d423332c3194cd0aceaee643bcbf6c2', 'request_id': 'req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:01.784095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d423332c3194cd0aceaee643bcbf6c2', 'request_id': 'req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:01.790673 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:01.806844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] The token cache is being invalidate because project 8d423332c3194cd0aceaee643bcbf6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:01.808166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:01.812104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ab1489b9-10a4-4580-a6d2-d3f7d2fb4b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:01.819017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 916/1837] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:01 2022] DELETE /identity/v3/projects/8d423332c3194cd0aceaee643bcbf6c2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:01.820246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:01.839379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555edfa2-eac0-4fa0-a84f-87858d596772 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:01.963803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:01.965415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:01.968875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:01.968875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] PATH_INFO: `/v3/users/fe6d272628904c36b42707e196c36528` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:01.970184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6d272628904c36b42707e196c36528)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:01.979930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:02.329074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6d272628904c36b42707e196c36528'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:02.330345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6d272628904c36b42707e196c36528'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:02.447173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6d272628904c36b42707e196c36528'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:02.451102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15472902-3725-4db3-ab86-da17b3eb6d6f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:02.451397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15472902-3725-4db3-ab86-da17b3eb6d6f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:02.456122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15472902-3725-4db3-ab86-da17b3eb6d6f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:02.456122 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 917/1838] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:13:02.456385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6d272628904c36b42707e196c36528'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:02.457247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8d436152-7637-4178-a4a5-e432d4b2b42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6d272628904c36b42707e196c36528'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:02.464705 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:02.466906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:02.467371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:02.468476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:02.482604 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 922/1839] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:01 2022] DELETE /identity/v3/users/fe6d272628904c36b42707e196c36528 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:02.498212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:02.500271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:02.633952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6ecc-27f3-47cf-ae57-dc4995eb8370 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:02.634344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6ecc-27f3-47cf-ae57-dc4995eb8370 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:02.634864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6ecc-27f3-47cf-ae57-dc4995eb8370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:02.636455 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 918/1840] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:02.668433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:02.668644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9b2e6ecc-27f3-47cf-ae57-dc4995eb8370 None None] MFA Rules not processed for user `e3b41f02eca449e4ac13e3a36d65d57c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:02.669926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:02.670142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b2e6ecc-27f3-47cf-ae57-dc4995eb8370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:02.697297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7361b-3fc9-4771-b9b5-425f6154ab19 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:02.713491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86aeee-a613-40ce-9ad7-779ed77c77c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:02.714335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86aeee-a613-40ce-9ad7-779ed77c77c5 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:02.714861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86aeee-a613-40ce-9ad7-779ed77c77c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:02.715334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86aeee-a613-40ce-9ad7-779ed77c77c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:02.729171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86aeee-a613-40ce-9ad7-779ed77c77c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:02.731600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86aeee-a613-40ce-9ad7-779ed77c77c5 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:02.756070 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 919/1841] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:13:02.760637 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 923/1842] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:03.408620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd195c-8023-4305-bd5e-7920bce3b73d None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:03.412924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd195c-8023-4305-bd5e-7920bce3b73d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:03.413328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd195c-8023-4305-bd5e-7920bce3b73d None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:03.418643 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 920/1843] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:03.420664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:03.421885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:03.422431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:03.433367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd195c-8023-4305-bd5e-7920bce3b73d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:03.437998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d4dd195c-8023-4305-bd5e-7920bce3b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:03.500938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:03.502706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:03.660780 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 924/1844] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:03.664223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd195c-8023-4305-bd5e-7920bce3b73d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:03.671704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:03.673013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:03.673450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:03.673923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] PATH_INFO: `/v3/projects/3c14da6f176b41039c2603f121bcc82a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:03.676238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c14da6f176b41039c2603f121bcc82a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:03.678162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:03.680296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:03.680488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:03.693217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e343de-601b-4d98-a2d2-bcbaa2176805 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:03.700014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73255384-229c-4d90-9f46-a9ef23221d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:03.701063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73255384-229c-4d90-9f46-a9ef23221d8e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:03.704033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73255384-229c-4d90-9f46-a9ef23221d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:03.704542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73255384-229c-4d90-9f46-a9ef23221d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:03.719855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73255384-229c-4d90-9f46-a9ef23221d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:03.722028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73255384-229c-4d90-9f46-a9ef23221d8e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:03.733498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 925/1845] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:03.812180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c14da6f176b41039c2603f121bcc82a', 'request_id': 'req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:03.818676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c14da6f176b41039c2603f121bcc82a', 'request_id': 'req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:03.881473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c14da6f176b41039c2603f121bcc82a', 'request_id': 'req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:03.912300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] The token cache is being invalidate because project 3c14da6f176b41039c2603f121bcc82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:03.912603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:03.913724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d0fc26a6-95e6-4b22-9e32-5cd7a0a429df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:03.923720 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 921/1846] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:03 2022] DELETE /identity/v3/projects/3c14da6f176b41039c2603f121bcc82a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:03.923872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6731-a36f-4f8d-bc84-0098a51177b5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:03.923872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6731-a36f-4f8d-bc84-0098a51177b5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:03.923872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee6731-a36f-4f8d-bc84-0098a51177b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:03.967564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-86ee6731-a36f-4f8d-bc84-0098a51177b5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:03.968814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-86ee6731-a36f-4f8d-bc84-0098a51177b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:04.047511 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 926/1847] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:04.055740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e71ea-3784-4736-89f7-fbf82148795e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.056028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e71ea-3784-4736-89f7-fbf82148795e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.056305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e71ea-3784-4736-89f7-fbf82148795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.064047 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:04.082574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b22e71ea-3784-4736-89f7-fbf82148795e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:04.084992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b22e71ea-3784-4736-89f7-fbf82148795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:04.094107 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 922/1848] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:04.100524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6731-a36f-4f8d-bc84-0098a51177b5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:04.112193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee6731-a36f-4f8d-bc84-0098a51177b5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:04.118358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:04.119110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.119540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.120017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.121196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:04.121196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:04.122969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:04.137249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 927/1849] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:04.141701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e71ea-3784-4736-89f7-fbf82148795e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:04.152383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e71ea-3784-4736-89f7-fbf82148795e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:04.157188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:04.157882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.158187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.160224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.160224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:04.161957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:04.271553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:04.274581 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 923/1850] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:04 2022] POST /identity/v3/projects => generated 407 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:04.285349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49e765-00fc-4c76-9b22-33e2aa402967 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:04.333909 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:04.394905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:04.396307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.397256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.397850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.399210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:04.401835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:04.527937 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 928/1851] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:04 2022] POST /identity/v3/users => generated 304 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:04.531810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:04.545408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb9a83-c9d7-44dd-b0b4-4031a2bd83d1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:04.550345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:04.551065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.551404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.554475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.554475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:04.554475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:04.567784 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 924/1852] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:04.572639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:04.585127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a735f39-d581-47a1-97f5-dae9dcc70100 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:04.590190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606b21-0eed-4b56-b99c-f173f60332e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:04.591052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606b21-0eed-4b56-b99c-f173f60332e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.591535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606b21-0eed-4b56-b99c-f173f60332e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.592078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606b21-0eed-4b56-b99c-f173f60332e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.592915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606b21-0eed-4b56-b99c-f173f60332e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:04.594843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606b21-0eed-4b56-b99c-f173f60332e9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:04.609801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 929/1853] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:04.614663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:04.634520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc175bf-1255-4cd6-92ad-0b161e867aa7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:04.646666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:04.648886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.649335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.649915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] PATH_INFO: `/v3/projects/aded6f1549044a3c8917488b209b18f5/users/36209fb73c74498398f27e5d5f0cafae/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.670626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aded6f1549044a3c8917488b209b18f5, user_id=36209fb73c74498398f27e5d5f0cafae, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:04.675906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:04.787285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 925/1854] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:04 2022] PUT /identity/v3/projects/aded6f1549044a3c8917488b209b18f5/users/36209fb73c74498398f27e5d5f0cafae/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:04.797573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8564a-1ee9-4587-ae95-164e1c9316a0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:04.798081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8564a-1ee9-4587-ae95-164e1c9316a0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:04.798598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8564a-1ee9-4587-ae95-164e1c9316a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:04.837733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-27d8564a-1ee9-4587-ae95-164e1c9316a0 None None] MFA Rules not processed for user `36209fb73c74498398f27e5d5f0cafae`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:04.839039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-27d8564a-1ee9-4587-ae95-164e1c9316a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:04.936040 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 930/1855] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:04.939914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:05.036017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739b369-1a69-4499-ac3e-0abdaf0aa8e9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:05.049478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:05.050065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:05.054347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:05.054347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:05.054347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:05.055226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:05.176218 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 926/1856] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:04 2022] POST /identity/v3/projects => generated 407 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:05.179842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8564a-1ee9-4587-ae95-164e1c9316a0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:05.193349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8564a-1ee9-4587-ae95-164e1c9316a0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:05.308512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:05.309136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:05.309417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:05.309690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:05.310388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:05.312359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:05.434516 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 931/1857] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:05 2022] POST /identity/v3/users => generated 310 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:05.438123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:05.458935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd35b3-d827-408e-a656-a06d176d144d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:05.476682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:05.480291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:05.480678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:05.482179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:05.485002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:05.489007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:05.510177 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 927/1858] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:05.512205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:05.529481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877165a-5bf3-407e-a8f0-e5f7947cccbb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:05.537294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:05.538241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:05.538686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:05.539126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] PATH_INFO: `/v3/projects/fa80e08356114b8e8bfa53a29b4a6692/users/f39a4de4984742a1849a902e5348441b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:05.559392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa80e08356114b8e8bfa53a29b4a6692, user_id=f39a4de4984742a1849a902e5348441b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:05.563097 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:05.563718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:05.645996 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 932/1859] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:05 2022] PUT /identity/v3/projects/fa80e08356114b8e8bfa53a29b4a6692/users/f39a4de4984742a1849a902e5348441b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:05.650394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:05.662373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e79bc-6cd9-4a5d-869b-8ee976bb4dce admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:05.752846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d679a21-1181-45a9-941a-cacceb4d185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:05.758744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d679a21-1181-45a9-941a-cacceb4d185b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:05.758744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d679a21-1181-45a9-941a-cacceb4d185b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:05.758744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d679a21-1181-45a9-941a-cacceb4d185b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:05.758744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d679a21-1181-45a9-941a-cacceb4d185b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:05.758744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d679a21-1181-45a9-941a-cacceb4d185b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:05.773192 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 928/1860] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:05.777201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:05.793572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d640b9-92a1-40c3-9f5a-87bf99e7e52e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:05.808743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:05.809704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:05.810025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:05.810423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] PATH_INFO: `/v3/projects/fa80e08356114b8e8bfa53a29b4a6692/users/f39a4de4984742a1849a902e5348441b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:05.816101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa80e08356114b8e8bfa53a29b4a6692, user_id=f39a4de4984742a1849a902e5348441b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:05.820331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:05.859002 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 933/1861] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:05 2022] PUT /identity/v3/projects/fa80e08356114b8e8bfa53a29b4a6692/users/f39a4de4984742a1849a902e5348441b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:05.861377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de2c21-6bcf-4272-aecf-7934c709011c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:05.861779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de2c21-6bcf-4272-aecf-7934c709011c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:05.862317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de2c21-6bcf-4272-aecf-7934c709011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:05.892489 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:05.905054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d4de2c21-6bcf-4272-aecf-7934c709011c None None] MFA Rules not processed for user `f39a4de4984742a1849a902e5348441b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:05.906683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d4de2c21-6bcf-4272-aecf-7934c709011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:06.089841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 929/1862] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:05 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:06.118669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:06.122406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:06.246397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb78d2-0e03-441d-af15-93e19b6ba110 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:06.253629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:06.254479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:06.254635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:06.254900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:06.264650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:06.266368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:06.292058 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 934/1863] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:06.389213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de2c21-6bcf-4272-aecf-7934c709011c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:06.446712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de2c21-6bcf-4272-aecf-7934c709011c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:06.464293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a338222-2769-4396-8fd0-998ab383d804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:06.467079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338222-2769-4396-8fd0-998ab383d804 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:06.467347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338222-2769-4396-8fd0-998ab383d804 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:06.467634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a338222-2769-4396-8fd0-998ab383d804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:06.574629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a338222-2769-4396-8fd0-998ab383d804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:06.578259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a338222-2769-4396-8fd0-998ab383d804 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:06.593295 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 930/1864] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:06.760591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:06.873618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088c75-d6c0-4306-9be7-9945fb671823 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:06.922224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:06.923187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:06.923620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:06.925055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] PATH_INFO: `/v3/users/36209fb73c74498398f27e5d5f0cafae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:06.938272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36209fb73c74498398f27e5d5f0cafae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:06.940997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:07.268335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36209fb73c74498398f27e5d5f0cafae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:07.271122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36209fb73c74498398f27e5d5f0cafae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:07.360563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36209fb73c74498398f27e5d5f0cafae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:07.372725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36209fb73c74498398f27e5d5f0cafae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:07.373492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ef1e1d8-d0b3-473f-b052-3b8d1ff0e885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36209fb73c74498398f27e5d5f0cafae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:07.376996 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:07.386761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:07.387865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:07.388349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:07.423392 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 935/1865] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:06 2022] DELETE /identity/v3/users/36209fb73c74498398f27e5d5f0cafae => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:07.428737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:07.428737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:07.429009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:07.435070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] MFA Rules not processed for user `e285fefe9cb44cadaec6e58a31ef3afe`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:07.438839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:07.464738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:07.466033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:07.615753 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 936/1866] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:07.620016 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 931/1867] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:07.632798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:07.634478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:07.634848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:07.637071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:07.652770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc5ef3-6042-4da0-863a-8913c2310ad9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:07.658749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:07.660083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:07.660837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:07.661123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:07.661837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:07.664047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:07.704986 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:07.764485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df185fe-76b9-4898-a3dc-d4f3f4fd0241 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:07.770435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:07.771675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:07.772120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:07.772495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:07.786767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:07.790358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:07.805503 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 937/1868] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:07 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:07.806465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:07.825672 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 932/1869] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:07.941613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480c8d-fa4c-4622-86dc-67d951847626 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:07.952805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:07.953887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:07.954279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:07.954714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:07.956656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:07.959081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:08.093876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 938/1870] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:07 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:08.098244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:08.112932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe3fb7-e0bf-4dd4-bb88-89360dabf9c4 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:08.120374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:08.122184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:08.122567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:08.122938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:08.123850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:08.136751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:08.167164 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 933/1871] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:13:08.172887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:08.194965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa170388-6e1f-4d76-8859-1c0cd12dbef1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:08.207624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:08.208421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:08.210241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:08.210744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] PATH_INFO: `/v3/projects/e68a8b3ff6724e53852d7c1d2e9045d5/users/b66ba66ffa184f0180b505e831bc4fe7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:08.249362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68a8b3ff6724e53852d7c1d2e9045d5, user_id=b66ba66ffa184f0180b505e831bc4fe7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:08.252995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:08.351888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 939/1872] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:08 2022] PUT /identity/v3/projects/e68a8b3ff6724e53852d7c1d2e9045d5/users/b66ba66ffa184f0180b505e831bc4fe7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:08.354311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:08.366762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1020-d70a-4708-9a8d-1683c3a4aa18 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:08.439677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:08.440413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:08.440677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:08.440980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:08.441627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:08.443259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:08.453788 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 934/1873] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:08.458572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:08.469518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794b821-a90d-4d62-a474-5563fb11cd24 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:08.475283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:08.476036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:08.476313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:08.476635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] PATH_INFO: `/v3/projects/e68a8b3ff6724e53852d7c1d2e9045d5/users/b66ba66ffa184f0180b505e831bc4fe7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:08.478673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68a8b3ff6724e53852d7c1d2e9045d5, user_id=b66ba66ffa184f0180b505e831bc4fe7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:08.481315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:08.492405 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 940/1874] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:08 2022] PUT /identity/v3/projects/e68a8b3ff6724e53852d7c1d2e9045d5/users/b66ba66ffa184f0180b505e831bc4fe7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:08.542090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:08.544021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:08.558368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15ef5b-0946-421f-8bc1-262f35dcfdc2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:08.638797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:08.639451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:08.639733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:08.640065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] PATH_INFO: `/v3/projects/aded6f1549044a3c8917488b209b18f5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:08.641514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aded6f1549044a3c8917488b209b18f5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:08.643336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:08.764499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aded6f1549044a3c8917488b209b18f5', 'request_id': 'req-c70c905d-752c-4242-abfb-e8ba9065d13a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:08.771203 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:08.774520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aded6f1549044a3c8917488b209b18f5', 'request_id': 'req-c70c905d-752c-4242-abfb-e8ba9065d13a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:08.835037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aded6f1549044a3c8917488b209b18f5', 'request_id': 'req-c70c905d-752c-4242-abfb-e8ba9065d13a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:08.853251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] The token cache is being invalidate because project aded6f1549044a3c8917488b209b18f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:08.853554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:08.854317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:08.857002 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 935/1875] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:08 2022] DELETE /identity/v3/projects/aded6f1549044a3c8917488b209b18f5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:08.860972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:08.863534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:08.882547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f060b0-1fa6-45ca-a055-ac368df0329c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:08.895652 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:08.955319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:08.957496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:08.958036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:08.958386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] PATH_INFO: `/v3/users/f39a4de4984742a1849a902e5348441b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:08.959693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39a4de4984742a1849a902e5348441b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:08.961882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:09.205859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39a4de4984742a1849a902e5348441b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:09.206740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39a4de4984742a1849a902e5348441b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:09.339933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39a4de4984742a1849a902e5348441b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:09.361308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39a4de4984742a1849a902e5348441b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:09.362781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-caa5341e-9c34-4226-835f-bb990710310a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39a4de4984742a1849a902e5348441b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:09.425988 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 941/1876] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:08 2022] DELETE /identity/v3/users/f39a4de4984742a1849a902e5348441b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:10.899204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:10.917709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c905d-752c-4242-abfb-e8ba9065d13a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:11.114170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:11.114839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:11.115119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:11.119067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] PATH_INFO: `/v3/projects/fa80e08356114b8e8bfa53a29b4a6692` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:11.126169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa80e08356114b8e8bfa53a29b4a6692)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:11.130778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:11.398009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa80e08356114b8e8bfa53a29b4a6692', 'request_id': 'req-951b2b5a-7840-4c2b-8acc-c45afc9388d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:11.411400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa80e08356114b8e8bfa53a29b4a6692', 'request_id': 'req-951b2b5a-7840-4c2b-8acc-c45afc9388d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:11.579018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa80e08356114b8e8bfa53a29b4a6692', 'request_id': 'req-951b2b5a-7840-4c2b-8acc-c45afc9388d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:11.602718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] The token cache is being invalidate because project fa80e08356114b8e8bfa53a29b4a6692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:11.602932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:11.603880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-951b2b5a-7840-4c2b-8acc-c45afc9388d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:11.605831 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 936/1877] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:10 2022] DELETE /identity/v3/projects/fa80e08356114b8e8bfa53a29b4a6692 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:11.613586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4b5d-166f-45b6-aac8-96e237e6700f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:11.616873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4b5d-166f-45b6-aac8-96e237e6700f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:11.616873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d4b5d-166f-45b6-aac8-96e237e6700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:11.660124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-756d4b5d-166f-45b6-aac8-96e237e6700f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:11.660528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-756d4b5d-166f-45b6-aac8-96e237e6700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:11.788805 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 942/1878] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:11.796561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd08d9-4c63-4b8b-8490-c073d1ca0855 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:11.796845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd08d9-4c63-4b8b-8490-c073d1ca0855 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:11.797121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd08d9-4c63-4b8b-8490-c073d1ca0855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:11.843742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b3dd08d9-4c63-4b8b-8490-c073d1ca0855 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:11.845023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b3dd08d9-4c63-4b8b-8490-c073d1ca0855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:11.872033 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 937/1879] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:11.879257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d4b5d-166f-45b6-aac8-96e237e6700f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:11.891756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d4b5d-166f-45b6-aac8-96e237e6700f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:11.901085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:11.902013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:11.902654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:11.903494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:11.904294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:11.905075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:11.907463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:11.973490 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 943/1880] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:11.977120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd08d9-4c63-4b8b-8490-c073d1ca0855 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:11.993058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd08d9-4c63-4b8b-8490-c073d1ca0855 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:12.006073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:12.006805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:12.007946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:12.008385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:12.009263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:12.012727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:12.217144 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 938/1881] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:11 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:12.222056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:12.234033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa8b4e-39da-4745-8826-538e24fa8440 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:12.255539 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:12.390477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:12.391124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:12.391410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:12.391685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:12.392472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:12.397157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:12.500317 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 944/1882] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:12 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:12.504181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:12.517062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048184d-1cd9-41e1-a7f4-25b3c67ed739 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:12.536982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:12.537636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:12.537954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:12.538246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:12.539212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:12.540615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:12.614787 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 939/1883] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:12.616079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:12.645208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8864-898e-47d4-aa68-922989af0298 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:12.654255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e7e9-3cf1-4b8e-aa7d-ebc1323a9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:12.654926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e7e9-3cf1-4b8e-aa7d-ebc1323a9fff admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:12.655211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e7e9-3cf1-4b8e-aa7d-ebc1323a9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:12.655743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e7e9-3cf1-4b8e-aa7d-ebc1323a9fff admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:12.657426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e7e9-3cf1-4b8e-aa7d-ebc1323a9fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:12.659469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e7e9-3cf1-4b8e-aa7d-ebc1323a9fff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:12.683495 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 945/1884] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:12.687900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:12.730496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab63789-922a-4451-8b21-623784d27b87 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:12.752359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:12.756152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:12.760679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:12.761114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] PATH_INFO: `/v3/projects/8756787b0d0c472693f831c8627fd395/users/3a73f5d7c23e425ea4a3d97cde35e3ec/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:12.802182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8756787b0d0c472693f831c8627fd395, user_id=3a73f5d7c23e425ea4a3d97cde35e3ec, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:12.809740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:12.928736 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 940/1885] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:12 2022] PUT /identity/v3/projects/8756787b0d0c472693f831c8627fd395/users/3a73f5d7c23e425ea4a3d97cde35e3ec/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:12.935521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e12e2-6e8d-4249-81dc-b6c2ea6a86e0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:12.936063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e12e2-6e8d-4249-81dc-b6c2ea6a86e0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:12.936524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e12e2-6e8d-4249-81dc-b6c2ea6a86e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:13.006037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-be6e12e2-6e8d-4249-81dc-b6c2ea6a86e0 None None] MFA Rules not processed for user `3a73f5d7c23e425ea4a3d97cde35e3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:13.007510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-be6e12e2-6e8d-4249-81dc-b6c2ea6a86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:13.212953 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 946/1886] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:13.217172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:13.253799 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:13.351957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f769616-4337-4ed3-a5ca-42b2d8557347 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:13.358291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:13.358291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:13.358616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:13.359294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:13.360230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:13.363032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:13.530632 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 941/1887] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:13 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:13.536328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e12e2-6e8d-4249-81dc-b6c2ea6a86e0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:13.552598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e12e2-6e8d-4249-81dc-b6c2ea6a86e0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:13.720913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:13.722855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:13.723150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:13.723426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:13.724097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:13.726087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:13.845906 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 947/1888] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:13 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:13.850695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:13.868904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc27ab-239e-4d4b-ba85-2f9dc8422662 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:13.874422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:13.875066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:13.875414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:13.875698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:13.876363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:13.880176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:13.910481 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 942/1889] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:13.912290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:13.928759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ecc9-aad8-41f5-95a4-c8e45037df48 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:13.942950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:13.943970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:13.944319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:13.944840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] PATH_INFO: `/v3/projects/2e29a6f85c3c40a58ae29bba11803984/users/55e15140f53d4e4f906d62752362441b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:13.969796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e29a6f85c3c40a58ae29bba11803984, user_id=55e15140f53d4e4f906d62752362441b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:13.975178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:14.120937 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 948/1890] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:13 2022] PUT /identity/v3/projects/2e29a6f85c3c40a58ae29bba11803984/users/55e15140f53d4e4f906d62752362441b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:14.125006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:14.140448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f0692-de6d-478a-8387-b650449925f4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:14.293265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:14.294002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:14.294323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:14.295294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:14.296033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:14.298369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:14.321572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:14.324049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:14.328170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 943/1891] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:14.329202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:14.341941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aec75-bbab-4175-980d-666e59ba4673 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:14.349585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d5825-fafa-4f68-a213-4775913a85c5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:14.358781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:14.362437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:14.362437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:14.362437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] PATH_INFO: `/v3/users/3f3e53092a8940339fd588b46293a924` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:14.364759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b206799-e78a-4866-906b-162fda19bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:14.365481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206799-e78a-4866-906b-162fda19bf98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:14.365769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206799-e78a-4866-906b-162fda19bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:14.366084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b206799-e78a-4866-906b-162fda19bf98 admin admin] PATH_INFO: `/v3/projects/2e29a6f85c3c40a58ae29bba11803984/users/55e15140f53d4e4f906d62752362441b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:14.368220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b206799-e78a-4866-906b-162fda19bf98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e29a6f85c3c40a58ae29bba11803984, user_id=55e15140f53d4e4f906d62752362441b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:14.370303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3e53092a8940339fd588b46293a924)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:14.372251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:14.372978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b206799-e78a-4866-906b-162fda19bf98 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:14.400826 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 944/1892] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:14 2022] PUT /identity/v3/projects/2e29a6f85c3c40a58ae29bba11803984/users/55e15140f53d4e4f906d62752362441b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:14.403390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd0ee4-c48d-4ea9-b57b-5e554562588d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:14.403798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd0ee4-c48d-4ea9-b57b-5e554562588d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:14.404191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd0ee4-c48d-4ea9-b57b-5e554562588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:14.449174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dedd0ee4-c48d-4ea9-b57b-5e554562588d None None] MFA Rules not processed for user `55e15140f53d4e4f906d62752362441b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:14.450746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dedd0ee4-c48d-4ea9-b57b-5e554562588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:14.561979 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 945/1893] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:14.573120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:14.573407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:14.573689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:14.625470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] MFA Rules not processed for user `3a73f5d7c23e425ea4a3d97cde35e3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:14.626985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:14.645435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3e53092a8940339fd588b46293a924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:14.646164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3e53092a8940339fd588b46293a924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:14.705034 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 946/1894] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:14.706617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:14.708332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:14.720270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3e53092a8940339fd588b46293a924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:14.731571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3e53092a8940339fd588b46293a924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:14.735703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3e53092a8940339fd588b46293a924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:14.774623 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 949/1895] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:14 2022] DELETE /identity/v3/users/3f3e53092a8940339fd588b46293a924 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:14.776124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:14.779858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:14.816408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39853d3a-e75e-4f61-8ba8-cf6001e0e089 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:14.842732 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:14.914802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfb319-eafc-4f4d-8ba8-fbe371e76e07 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:14.921187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:14.921795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:14.922652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:14.922840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:14.929439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:14.929990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc73c9-253e-4c55-ad26-21166511ffc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:14.931055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc73c9-253e-4c55-ad26-21166511ffc5 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:14.931603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc73c9-253e-4c55-ad26-21166511ffc5 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:14.932747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc73c9-253e-4c55-ad26-21166511ffc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:14.936769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ddc73c9-253e-4c55-ad26-21166511ffc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:15.015382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc73c9-253e-4c55-ad26-21166511ffc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:15.017692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc73c9-253e-4c55-ad26-21166511ffc5 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:15.022523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:15.025190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:15.028482 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 950/1896] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:15.030231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:15.030739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:15.031194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:15.040669 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 947/1897] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:15.053709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:15.055744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:15.134033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 951/1898] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:15.147601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:15.149174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:15.253275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6cf9-da81-49a4-9fbc-94ad475ecd96 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:15.258111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:15.258924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:15.259275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:15.259617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:15.270633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:15.272144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:15.288865 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 948/1899] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:15.728979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:15.730558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:15.750433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94037f3-4aff-4e72-9774-5c716e6b6d9e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:15.770203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:15.770203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:15.770203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:15.770203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] PATH_INFO: `/v3/projects/8bf2921c4efa4f5cb9ae512a63571070` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:15.770651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf2921c4efa4f5cb9ae512a63571070)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:15.771334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:15.829510 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:15.983420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf2921c4efa4f5cb9ae512a63571070', 'request_id': 'req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:15.992445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf2921c4efa4f5cb9ae512a63571070', 'request_id': 'req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.097880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf2921c4efa4f5cb9ae512a63571070', 'request_id': 'req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.122772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] The token cache is being invalidate because project 8bf2921c4efa4f5cb9ae512a63571070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:16.123074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.123763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-010a26f9-0e40-4c1a-9bf1-89530a3d6b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.125316 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 952/1900] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:15 2022] DELETE /identity/v3/projects/8bf2921c4efa4f5cb9ae512a63571070 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:16.130736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:16.143128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e5bb-dc0f-4066-a7c2-a4ce6d16ba99 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:16.268949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:16.269935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:16.276440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:16.276440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] PATH_INFO: `/v3/users/144ba69115584ac697fae53cece0a5e2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:16.276440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144ba69115584ac697fae53cece0a5e2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:16.276440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:16.562758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144ba69115584ac697fae53cece0a5e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.579074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144ba69115584ac697fae53cece0a5e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.597872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144ba69115584ac697fae53cece0a5e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.599168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144ba69115584ac697fae53cece0a5e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.715654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8219c-adec-4d4e-b81f-af86a3bb8f69 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:16.715952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8219c-adec-4d4e-b81f-af86a3bb8f69 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:16.716236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8219c-adec-4d4e-b81f-af86a3bb8f69 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:16.717846 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 953/1901] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:16.725206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:16.725498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:16.725784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:16.730613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144ba69115584ac697fae53cece0a5e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:16.735908 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:16.745365 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 949/1902] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:16 2022] DELETE /identity/v3/users/144ba69115584ac697fae53cece0a5e2 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:16.761014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:16.765985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:16.864232 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 954/1903] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:13:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:16.903719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:16.909042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:16.940170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd607ab-307f-4de9-9148-30c0fc8ea2e4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:16.946729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17891213-1f9d-4158-ad5c-b19fe68af076 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:16.947959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891213-1f9d-4158-ad5c-b19fe68af076 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:16.948399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891213-1f9d-4158-ad5c-b19fe68af076 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:16.949591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17891213-1f9d-4158-ad5c-b19fe68af076 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:16.960982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17891213-1f9d-4158-ad5c-b19fe68af076 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:16.962815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17891213-1f9d-4158-ad5c-b19fe68af076 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:16.974727 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 950/1904] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:17.809420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:17.811880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:17.813661 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:17.982399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2bd9-7db3-44bc-928d-f6275229be66 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:17.998132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:17.999690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.000150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.000581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] PATH_INFO: `/v3/projects/4871c040fd974f43a72e5c1966d480b7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.003494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4871c040fd974f43a72e5c1966d480b7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:18.005738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:18.125951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9103-bf8f-421f-a66f-c7a4b48daa76 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.127244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9103-bf8f-421f-a66f-c7a4b48daa76 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.127852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d9103-bf8f-421f-a66f-c7a4b48daa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.167257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-381d9103-bf8f-421f-a66f-c7a4b48daa76 None None] MFA Rules not processed for user `b66ba66ffa184f0180b505e831bc4fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:18.168812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-381d9103-bf8f-421f-a66f-c7a4b48daa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:18.251491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4871c040fd974f43a72e5c1966d480b7', 'request_id': 'req-087c6d26-4341-4770-bc80-3c5cea3d2c5b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:18.260184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4871c040fd974f43a72e5c1966d480b7', 'request_id': 'req-087c6d26-4341-4770-bc80-3c5cea3d2c5b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:18.274904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 951/1905] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:18.287162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a298-69e9-4e18-9a74-793e3929a799 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.287635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a298-69e9-4e18-9a74-793e3929a799 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.287986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a298-69e9-4e18-9a74-793e3929a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.312493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d460a298-69e9-4e18-9a74-793e3929a799 None None] MFA Rules not processed for user `e285fefe9cb44cadaec6e58a31ef3afe`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:18.313863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d460a298-69e9-4e18-9a74-793e3929a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:18.349023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4871c040fd974f43a72e5c1966d480b7', 'request_id': 'req-087c6d26-4341-4770-bc80-3c5cea3d2c5b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:18.369975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] The token cache is being invalidate because project 4871c040fd974f43a72e5c1966d480b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:18.370655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:18.375259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-087c6d26-4341-4770-bc80-3c5cea3d2c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:18.380999 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 955/1906] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:17 2022] DELETE /identity/v3/projects/4871c040fd974f43a72e5c1966d480b7 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:18.383041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43e1d-47cd-4d76-a28b-82a4e6c8766f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.383387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43e1d-47cd-4d76-a28b-82a4e6c8766f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.383678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43e1d-47cd-4d76-a28b-82a4e6c8766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.445337 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 952/1907] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:18.447226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c1d43e1d-47cd-4d76-a28b-82a4e6c8766f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:18.449993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c1d43e1d-47cd-4d76-a28b-82a4e6c8766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:18.542969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 956/1908] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:18.551447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.551787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.552069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.582920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:18.585242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:18.610355 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 953/1909] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:18.622562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43e1d-47cd-4d76-a28b-82a4e6c8766f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:18.652749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43e1d-47cd-4d76-a28b-82a4e6c8766f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:18.662179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:18.662993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.663299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.663544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.664205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:18.664623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:18.667914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:18.673506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:18.675521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:18.680392 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:18.689105 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 957/1910] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:18.694003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:18.710149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54365865-77d0-4ee1-97ab-4b6545621bca admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:18.724506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:18.725132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.725416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.726203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.730590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:18.730590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:18.789761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b481b32-2fb3-497e-8d9e-aa1ada21bc28 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:18.795525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:18.796078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.796354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.796626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.798641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:18.813082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:18.814848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:18.837968 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 954/1911] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:18.853320 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 958/1912] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:18 2022] POST /identity/v3/projects => generated 395 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:18.860889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:18.872355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dde16-07bb-49d6-ba61-d848844e162c service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:18.973839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08e9ff-7234-4164-9eb0-da388e94ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:18.977266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e9ff-7234-4164-9eb0-da388e94ebf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:18.977266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e9ff-7234-4164-9eb0-da388e94ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:18.977266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08e9ff-7234-4164-9eb0-da388e94ebf0 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:18.977266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e9ff-7234-4164-9eb0-da388e94ebf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:18.978102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08e9ff-7234-4164-9eb0-da388e94ebf0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:19.117531 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 955/1913] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:18 2022] POST /identity/v3/users => generated 298 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:19.121887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:19.137985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff72a6e-ccf5-42f7-8a0a-07a20fca5efa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:19.146313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:19.150044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:19.150044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:19.150044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:19.150044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:19.152612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:19.161995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:19.161995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:19.161995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:19.171358 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 959/1914] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:19.177291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:19.191695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0cd6-3507-4c1b-bd09-4bca0f1a780a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:19.197676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:19.198833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:19.199479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:19.199768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:19.201483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:19.201639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:19.202879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:19.203078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:19.215650 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 960/1915] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:13:19.220093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:19.233438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90d44-8a8b-4775-8c13-255a660cc061 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:19.241325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:19.242143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:19.242503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:19.243135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] PATH_INFO: `/v3/projects/794dc02a97d342a1bf6932cc1e906927/users/009f628e09b44e71bd3d92cb09248622/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:19.269197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] RBAC: Authorizing `identity:create_grant(project_id=794dc02a97d342a1bf6932cc1e906927, user_id=009f628e09b44e71bd3d92cb09248622, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:19.272932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:19.276024 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 956/1916] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:19.291449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:19.293397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:19.306692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908e719-1d05-453d-8dbc-54bb11ecf504 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:19.310729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecccc4-a0db-42fc-92e6-68f791aeb52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:19.311397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecccc4-a0db-42fc-92e6-68f791aeb52c service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:19.311683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecccc4-a0db-42fc-92e6-68f791aeb52c service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:19.311958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecccc4-a0db-42fc-92e6-68f791aeb52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:19.320892 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:19.322901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecccc4-a0db-42fc-92e6-68f791aeb52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:19.323618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecccc4-a0db-42fc-92e6-68f791aeb52c service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:19.332716 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 957/1917] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:19.431796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 961/1918] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:19 2022] PUT /identity/v3/projects/794dc02a97d342a1bf6932cc1e906927/users/009f628e09b44e71bd3d92cb09248622/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:19.442768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff116-dbc3-40b7-a43d-611fe41b235d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:19.443216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff116-dbc3-40b7-a43d-611fe41b235d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:19.443537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff116-dbc3-40b7-a43d-611fe41b235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:19.486182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9c5ff116-dbc3-40b7-a43d-611fe41b235d None None] MFA Rules not processed for user `009f628e09b44e71bd3d92cb09248622`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:19.488152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c5ff116-dbc3-40b7-a43d-611fe41b235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:19.611284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 958/1919] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:19.613116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:19.718371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93e58-671b-4210-915f-fdb83a79693f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:19.729114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:19.729749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:19.730063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:19.730341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:19.731111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:19.732952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:19.854380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 962/1920] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:19 2022] POST /identity/v3/projects => generated 393 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:19.858391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff116-dbc3-40b7-a43d-611fe41b235d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:19.875693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff116-dbc3-40b7-a43d-611fe41b235d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:20.011664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263dedd-95fe-4467-90ae-7e96d9a8bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:20.021665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263dedd-95fe-4467-90ae-7e96d9a8bce7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:20.022003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263dedd-95fe-4467-90ae-7e96d9a8bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:20.025059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263dedd-95fe-4467-90ae-7e96d9a8bce7 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:20.025059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263dedd-95fe-4467-90ae-7e96d9a8bce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:20.029296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263dedd-95fe-4467-90ae-7e96d9a8bce7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:20.167896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 959/1921] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:19 2022] POST /identity/v3/users => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:20.175010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:20.195989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111a95-ee49-4e02-a84c-212e70ae57d0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:20.201366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:20.202586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:20.203087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:20.203686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:20.204745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:20.207343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:20.227041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd93f2-6be3-4a45-b598-3c9a6723d0eb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:20.227232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd93f2-6be3-4a45-b598-3c9a6723d0eb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:20.228310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd93f2-6be3-4a45-b598-3c9a6723d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:20.236254 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 963/1922] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:20.241309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:20.253084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425714-7da9-4f7f-82ec-46904b1bdb59 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:20.253715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7efd93f2-6be3-4a45-b598-3c9a6723d0eb None None] MFA Rules not processed for user `05f818f18a30419d8ed94d42b7ba3771`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:20.255093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7efd93f2-6be3-4a45-b598-3c9a6723d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:20.258707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:20.261230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:20.261230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:20.261230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] PATH_INFO: `/v3/projects/17d1164c2f3f4b0aa38852581db30442/users/a942a9491df043b7953bb50060299762/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:20.278310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d1164c2f3f4b0aa38852581db30442, user_id=a942a9491df043b7953bb50060299762, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:20.281451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:20.338577 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 960/1923] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:20.404718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 964/1924] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:20 2022] PUT /identity/v3/projects/17d1164c2f3f4b0aa38852581db30442/users/a942a9491df043b7953bb50060299762/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:20.404928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd93f2-6be3-4a45-b598-3c9a6723d0eb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:20.415941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd93f2-6be3-4a45-b598-3c9a6723d0eb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:20.483519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a4e0f-d32f-4051-820c-6123a7efb3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:20.484228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4e0f-d32f-4051-820c-6123a7efb3aa admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:20.485457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4e0f-d32f-4051-820c-6123a7efb3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:20.485739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4e0f-d32f-4051-820c-6123a7efb3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:20.487363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a4e0f-d32f-4051-820c-6123a7efb3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:20.489396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a4e0f-d32f-4051-820c-6123a7efb3aa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:20.508911 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 961/1925] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:20.513415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:20.518210 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:20.538762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b4a8-3e5b-4a99-805d-b4881f47cc2b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:20.550610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:20.550902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:20.551177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:20.558494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] PATH_INFO: `/v3/projects/17d1164c2f3f4b0aa38852581db30442/users/a942a9491df043b7953bb50060299762/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:20.558494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d1164c2f3f4b0aa38852581db30442, user_id=a942a9491df043b7953bb50060299762, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:20.558494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:20.571542 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 965/1926] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:20 2022] PUT /identity/v3/projects/17d1164c2f3f4b0aa38852581db30442/users/a942a9491df043b7953bb50060299762/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:20.583484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbca52-900b-481b-b358-796c19954906 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:20.583821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbca52-900b-481b-b358-796c19954906 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:20.584095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbca52-900b-481b-b358-796c19954906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:20.621726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bbbbca52-900b-481b-b358-796c19954906 None None] MFA Rules not processed for user `a942a9491df043b7953bb50060299762`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:20.623817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bbbbca52-900b-481b-b358-796c19954906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:20.715313 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 962/1927] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:21.089711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:21.092593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:21.242071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677f37-707b-4be2-be6e-7ebb3a6888fd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:21.250035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:21.250686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:21.250970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:21.251247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:21.263029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:21.264918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:21.279207 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 966/1928] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:22.283349 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:23.281966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbca52-900b-481b-b358-796c19954906 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:23.307350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbca52-900b-481b-b358-796c19954906 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:23.323829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:23.324469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:23.324784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:23.325113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:23.439813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:23.443964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:23.472168 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 963/1929] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:23 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:23.507923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:23.527065 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:23.697787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5e4d-04ff-4bb2-bb64-4f0d6a3ba9b3 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:23.718534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:23.719293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:23.719560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:23.719829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] PATH_INFO: `/v3/users/009f628e09b44e71bd3d92cb09248622` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:23.721865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=009f628e09b44e71bd3d92cb09248622)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:23.725277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:24.044664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009f628e09b44e71bd3d92cb09248622'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.045900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009f628e09b44e71bd3d92cb09248622'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.143799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:24.145982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:24.172177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754021d-8b78-45cf-927a-9a72cac477eb service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:24.180917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:24.181941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:24.182583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:24.183080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] PATH_INFO: `/v3/users/2efb9a5cdcce45a4aae5da632f80af88` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:24.185101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efb9a5cdcce45a4aae5da632f80af88)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:24.195244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:24.208250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009f628e09b44e71bd3d92cb09248622'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.220432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009f628e09b44e71bd3d92cb09248622'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.221235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-512b70d5-819f-45ad-a3a9-142faaaacd1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009f628e09b44e71bd3d92cb09248622'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.260776 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 967/1930] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:23 2022] DELETE /identity/v3/users/009f628e09b44e71bd3d92cb09248622 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:24.267546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:24.268479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:24.268910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:24.310049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:24.310049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:24.430222 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 968/1931] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:24.443965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efb9a5cdcce45a4aae5da632f80af88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.478458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efb9a5cdcce45a4aae5da632f80af88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.498429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efb9a5cdcce45a4aae5da632f80af88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.499208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efb9a5cdcce45a4aae5da632f80af88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.532727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:24.534395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:24.572669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83bd3e33-fa9a-4fc3-ab23-feb266618dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efb9a5cdcce45a4aae5da632f80af88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:24.582888 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 964/1932] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:24 2022] DELETE /identity/v3/users/2efb9a5cdcce45a4aae5da632f80af88 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:24.584618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:24.584923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:24.585204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:24.633907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:24.637760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:24.659108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505f1a-ef14-4985-a9a9-0b6ed5f9b2ce None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:24.758310 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 965/1933] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:24.758593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:24.758593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:24.758593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:24.758593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:24.760760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:24.778328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:24.780547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:24.793955 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 969/1934] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:13:24.810739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:24.812238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:24.830368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b950ab-b3b5-4223-bdbc-aac9c9a8a592 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:24.840997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:24.842937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:24.843499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:24.844160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:24.863902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:24.867205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:24.880493 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 966/1935] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:25.807433 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:26.133527 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:26.399074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:26.401341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:26.419189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa24a1-2ee5-4a05-a7de-ad440074569a service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:26.422741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:26.424304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:26.427485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:26.428010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] PATH_INFO: `/v3/projects/794dc02a97d342a1bf6932cc1e906927` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:26.429615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=794dc02a97d342a1bf6932cc1e906927)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:26.431764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:26.645487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:26.647081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:26.670595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794dc02a97d342a1bf6932cc1e906927', 'request_id': 'req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:26.680479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77830e3-bcd5-4961-906a-6f95cce3e8b5 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:26.690188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794dc02a97d342a1bf6932cc1e906927', 'request_id': 'req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:26.801546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794dc02a97d342a1bf6932cc1e906927', 'request_id': 'req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:26.817591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] The token cache is being invalidate because project 794dc02a97d342a1bf6932cc1e906927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:26.818299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:26.821056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:26.826002 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 970/1936] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:26 2022] DELETE /identity/v3/projects/794dc02a97d342a1bf6932cc1e906927 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:26.826958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:26.827789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:26.829235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:26.830445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:26.831269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] PATH_INFO: `/v3/projects/d38deb3f03f1474a9f4b89967807d763` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:26.833399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:26.835432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38deb3f03f1474a9f4b89967807d763)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:26.843762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:26.859638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c091-3da0-4a11-9279-fc2d9f338b1a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:26.867471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:26.868802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:26.869357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:26.869879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] PATH_INFO: `/v3/users/a942a9491df043b7953bb50060299762` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:26.872080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a942a9491df043b7953bb50060299762)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:26.874413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:27.132444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a942a9491df043b7953bb50060299762'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.135196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a942a9491df043b7953bb50060299762'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.140447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38deb3f03f1474a9f4b89967807d763', 'request_id': 'req-c32d9534-244e-4902-a094-f409e8b0e3f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.149699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38deb3f03f1474a9f4b89967807d763', 'request_id': 'req-c32d9534-244e-4902-a094-f409e8b0e3f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.241463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a942a9491df043b7953bb50060299762'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.256116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a942a9491df043b7953bb50060299762'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.257336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a942a9491df043b7953bb50060299762'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.282128 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 971/1937] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:26 2022] DELETE /identity/v3/users/a942a9491df043b7953bb50060299762 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:27.283242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:27.285270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:27.369465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38deb3f03f1474a9f4b89967807d763', 'request_id': 'req-c32d9534-244e-4902-a094-f409e8b0e3f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.370309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46a7d9-3a3b-44e1-8be4-8eddcea32215 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:27.375292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:27.376070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:27.376453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:27.376830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] PATH_INFO: `/v3/users/844b9eb1cf1041459a1e1cd1c3c8fdbc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:27.378200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844b9eb1cf1041459a1e1cd1c3c8fdbc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:27.381327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:27.384371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] The token cache is being invalidate because project d38deb3f03f1474a9f4b89967807d763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:27.385355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.386391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.390977 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 967/1938] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:26 2022] DELETE /identity/v3/projects/d38deb3f03f1474a9f4b89967807d763 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:27.391928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:27.396046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:27.511305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d9534-244e-4902-a094-f409e8b0e3f6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:27.519795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:27.521504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:27.521892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:27.522239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] PATH_INFO: `/v3/users/e03fabbf78b74eb6a545c2fe1c81dd3c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:27.523615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03fabbf78b74eb6a545c2fe1c81dd3c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:27.526043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:27.667711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844b9eb1cf1041459a1e1cd1c3c8fdbc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.668511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844b9eb1cf1041459a1e1cd1c3c8fdbc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.766309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03fabbf78b74eb6a545c2fe1c81dd3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.779432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844b9eb1cf1041459a1e1cd1c3c8fdbc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.782930 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:27.791313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844b9eb1cf1041459a1e1cd1c3c8fdbc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.792146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844b9eb1cf1041459a1e1cd1c3c8fdbc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.792515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03fabbf78b74eb6a545c2fe1c81dd3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.808944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03fabbf78b74eb6a545c2fe1c81dd3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.813124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03fabbf78b74eb6a545c2fe1c81dd3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.821058 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 972/1939] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:27 2022] DELETE /identity/v3/users/844b9eb1cf1041459a1e1cd1c3c8fdbc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:27.821058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:27.821058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:27.898207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279fd8-8acb-4549-895e-a4ff9deb9b95 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:27.902646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:27.903271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:27.903812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:27.904082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] PATH_INFO: `/v3/users/8da5372651e643bea049b59a48a31b65` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:27.905228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da5372651e643bea049b59a48a31b65)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:27.907166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:27.933163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41b3b4ad-4226-4332-b0d1-16d933146728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03fabbf78b74eb6a545c2fe1c81dd3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:27.939661 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 968/1940] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:27 2022] DELETE /identity/v3/users/e03fabbf78b74eb6a545c2fe1c81dd3c => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:27.944165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793fa5-e419-4930-b6ec-6ced83642c32 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:27.944165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793fa5-e419-4930-b6ec-6ced83642c32 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:27.944165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e793fa5-e419-4930-b6ec-6ced83642c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:27.963337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0e793fa5-e419-4930-b6ec-6ced83642c32 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:27.964551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0e793fa5-e419-4930-b6ec-6ced83642c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:27.976580 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:28.031797 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 969/1941] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:28.033172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.033464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.041889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.052796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:28.054111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.067895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 970/1942] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:28.067895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:28.067895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.076886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906f008-1a51-417c-929b-8c288f0fc654 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:28.081766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:28.083136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.085747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.085747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] PATH_INFO: `/v3/projects/17d1164c2f3f4b0aa38852581db30442` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.085747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d1164c2f3f4b0aa38852581db30442)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:28.086822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:28.156374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da5372651e643bea049b59a48a31b65'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.156991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da5372651e643bea049b59a48a31b65'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.259648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d1164c2f3f4b0aa38852581db30442', 'request_id': 'req-60c8e298-099d-4938-a17b-86fe9f23673f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.264639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da5372651e643bea049b59a48a31b65'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.265687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d1164c2f3f4b0aa38852581db30442', 'request_id': 'req-60c8e298-099d-4938-a17b-86fe9f23673f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.275312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da5372651e643bea049b59a48a31b65'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.276121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da5372651e643bea049b59a48a31b65'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.303781 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 973/1943] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:27 2022] DELETE /identity/v3/users/8da5372651e643bea049b59a48a31b65 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:28.305223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:28.307759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.350409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d1164c2f3f4b0aa38852581db30442', 'request_id': 'req-60c8e298-099d-4938-a17b-86fe9f23673f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.364786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] The token cache is being invalidate because project 17d1164c2f3f4b0aa38852581db30442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:28.365093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.365802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:28.368715 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 971/1944] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:28 2022] DELETE /identity/v3/projects/17d1164c2f3f4b0aa38852581db30442 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:28.373502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:28.374962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.382832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868510ab-4547-475d-802d-b4094ad6d012 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:28.388385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d9a4-3778-42a7-9c49-062a7233394a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:28.388734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d9a4-3778-42a7-9c49-062a7233394a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.389085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d9a4-3778-42a7-9c49-062a7233394a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.389241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d9a4-3778-42a7-9c49-062a7233394a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.391295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4755d9a4-3778-42a7-9c49-062a7233394a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.463598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8e298-099d-4938-a17b-86fe9f23673f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:28.467737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50ca90-f35b-4e77-a929-54850b914298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:28.471666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ca90-f35b-4e77-a929-54850b914298 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.471666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ca90-f35b-4e77-a929-54850b914298 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.471666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50ca90-f35b-4e77-a929-54850b914298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.471963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755d9a4-3778-42a7-9c49-062a7233394a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:28.471963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755d9a4-3778-42a7-9c49-062a7233394a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:28.472136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d50ca90-f35b-4e77-a929-54850b914298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.482146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 974/1945] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:28.483494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e989-eb7b-4efc-bcfc-4ea3c7bc8697 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.483790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e989-eb7b-4efc-bcfc-4ea3c7bc8697 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.484074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53e989-eb7b-4efc-bcfc-4ea3c7bc8697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.496886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50ca90-f35b-4e77-a929-54850b914298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:28.499294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50ca90-f35b-4e77-a929-54850b914298 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:28.508661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9a53e989-eb7b-4efc-bcfc-4ea3c7bc8697 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:28.509990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9a53e989-eb7b-4efc-bcfc-4ea3c7bc8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.510994 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 972/1946] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:28.525964 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 975/1947] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:28.527969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657097cd-acf5-4d97-8567-1852a67283c4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.528265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657097cd-acf5-4d97-8567-1852a67283c4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.528953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657097cd-acf5-4d97-8567-1852a67283c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.558191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-657097cd-acf5-4d97-8567-1852a67283c4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:28.559219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-657097cd-acf5-4d97-8567-1852a67283c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:28.571372 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 973/1948] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:28.572659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53e989-eb7b-4efc-bcfc-4ea3c7bc8697 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:28.595164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53e989-eb7b-4efc-bcfc-4ea3c7bc8697 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:28.601854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:28.602445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.602846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.603155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.603891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:28.604188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:28.605857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:28.633511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657097cd-acf5-4d97-8567-1852a67283c4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:28.635017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 976/1949] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:28.653912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657097cd-acf5-4d97-8567-1852a67283c4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:28.680284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:28.681419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.681708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.682099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.682894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:28.692155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:28.765790 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 974/1950] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:28 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:13:28.774065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:28.788602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd656f-605c-42fc-bd33-d8ca691b6cf4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:28.870985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:28.872848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:28.873155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:28.873983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:28.874916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:28.876567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:29.036123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.040802 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 977/1951] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:28 2022] POST /identity/v3/users => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:29.061801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bfa26-80a6-4951-a05b-d354ac5b0346 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:29.087080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:29.100814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:29.100814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:29.100814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:29.100814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:29.102303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:29.124051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 975/1952] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:29.130247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.150537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a12d84-4faf-47e1-b407-6dd35e83de3b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:29.159646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:29.162061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:29.162593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:29.163216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:29.164544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:29.168012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:29.173838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.178710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:29.194894 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 978/1953] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:29.205840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.216262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2811-84f0-4065-a1e9-ad29460c2237 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:29.227383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4079a2-6853-4ddc-b1c4-939eb147550b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:29.234169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:29.235428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:29.236505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:29.236607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:29.236888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:29.237098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:29.237580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] PATH_INFO: `/v3/projects/2d664dd238984ea29ac89eded91e170f/users/32904cdad70c4aa495080be8601ddb78/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:29.238633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] PATH_INFO: `/v3/projects/c16da8ed6fb24dbebd053e32122bfbfd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:29.242589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16da8ed6fb24dbebd053e32122bfbfd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:29.246647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:29.268607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d664dd238984ea29ac89eded91e170f, user_id=32904cdad70c4aa495080be8601ddb78, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:29.276009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:29.388621 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 979/1954] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:29 2022] PUT /identity/v3/projects/2d664dd238984ea29ac89eded91e170f/users/32904cdad70c4aa495080be8601ddb78/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:29.390064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.397334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:29.449378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16da8ed6fb24dbebd053e32122bfbfd', 'request_id': 'req-2468675f-1853-4646-b73c-c92919485f00'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.465667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16da8ed6fb24dbebd053e32122bfbfd', 'request_id': 'req-2468675f-1853-4646-b73c-c92919485f00'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.550264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16da8ed6fb24dbebd053e32122bfbfd', 'request_id': 'req-2468675f-1853-4646-b73c-c92919485f00'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.550723 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:29.559138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270bef-df2e-4b7b-80dd-c6a07ba73a16 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:29.578010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] The token cache is being invalidate because project c16da8ed6fb24dbebd053e32122bfbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:29.578010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.580168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2468675f-1853-4646-b73c-c92919485f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.588289 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 976/1955] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:29 2022] DELETE /identity/v3/projects/c16da8ed6fb24dbebd053e32122bfbfd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:29.592509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:29.592509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:29.593216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:29.638232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:29.639124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:29.639495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:29.639830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] PATH_INFO: `/v3/projects/f8ef810d00a8496bb0333233ba849ae0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:29.641699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ef810d00a8496bb0333233ba849ae0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:29.643406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:29.646168 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:29.650760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] MFA Rules not processed for user `32904cdad70c4aa495080be8601ddb78`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:29.653462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:29.733332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 977/1956] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:29.734318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.735643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:29.750991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808351-cd39-4525-9d8e-2c01e804e759 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:29.757530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:29.758224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:29.758505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:29.758780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] PATH_INFO: `/v3/projects/29e4542bf2a74ae7bb21448cc8aaa079` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:29.759970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e4542bf2a74ae7bb21448cc8aaa079)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:29.761989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:29.812921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ef810d00a8496bb0333233ba849ae0', 'request_id': 'req-eeff8d0c-ff28-4ca2-8748-38fba3045b88'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.821333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ef810d00a8496bb0333233ba849ae0', 'request_id': 'req-eeff8d0c-ff28-4ca2-8748-38fba3045b88'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.881210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ef810d00a8496bb0333233ba849ae0', 'request_id': 'req-eeff8d0c-ff28-4ca2-8748-38fba3045b88'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.895799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] The token cache is being invalidate because project f8ef810d00a8496bb0333233ba849ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:29.896102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.896829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.898723 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 980/1957] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:29 2022] DELETE /identity/v3/projects/f8ef810d00a8496bb0333233ba849ae0 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:29.899861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.901838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:29.908650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e4542bf2a74ae7bb21448cc8aaa079', 'request_id': 'req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.915746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e4542bf2a74ae7bb21448cc8aaa079', 'request_id': 'req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.967904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e4542bf2a74ae7bb21448cc8aaa079', 'request_id': 'req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.977736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff8d0c-ff28-4ca2-8748-38fba3045b88 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:29.983000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] The token cache is being invalidate because project 29e4542bf2a74ae7bb21448cc8aaa079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:29.983609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.984303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:29.986635 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 978/1958] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:29 2022] DELETE /identity/v3/projects/29e4542bf2a74ae7bb21448cc8aaa079 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:29.987674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:29.992092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.041491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.042186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.042463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.042737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] PATH_INFO: `/v3/users/f579f0782b73455cbc0278814c663855` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.043944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f579f0782b73455cbc0278814c663855)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.045924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.066050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d02ea1-3bf3-47ce-9ee7-ce2cb0908de4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.070842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a586-a3d4-47c5-a293-cad2790c88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.071465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a586-a3d4-47c5-a293-cad2790c88c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.071741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a586-a3d4-47c5-a293-cad2790c88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.072209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a586-a3d4-47c5-a293-cad2790c88c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.073146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a586-a3d4-47c5-a293-cad2790c88c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.074772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a586-a3d4-47c5-a293-cad2790c88c4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.235452 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 979/1959] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:29 2022] POST /identity/v3/projects => generated 401 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:30.235452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.235761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.236305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.259111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:30.260350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.292000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f579f0782b73455cbc0278814c663855'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.292737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f579f0782b73455cbc0278814c663855'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.330053 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 980/1960] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:30.331058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.333613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.345668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4f014-aabb-4642-bdd5-bb68f9ccf86b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.351007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.351639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.352025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.352286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] PATH_INFO: `/v3/users/7ed177db7c1a4495be7e0f5517b445fa` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.353452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed177db7c1a4495be7e0f5517b445fa)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.355457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.367479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f579f0782b73455cbc0278814c663855'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.375399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f579f0782b73455cbc0278814c663855'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.376071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f579f0782b73455cbc0278814c663855'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.397132 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 981/1961] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:29 2022] DELETE /identity/v3/users/f579f0782b73455cbc0278814c663855 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:30.400379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.400379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.476247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85794-156c-4996-8f77-7ee903064e8f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.482243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056f18-025c-4ac7-9df5-8f5e6c6907d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.483147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056f18-025c-4ac7-9df5-8f5e6c6907d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.483327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056f18-025c-4ac7-9df5-8f5e6c6907d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.483706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056f18-025c-4ac7-9df5-8f5e6c6907d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.484445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056f18-025c-4ac7-9df5-8f5e6c6907d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.486604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056f18-025c-4ac7-9df5-8f5e6c6907d8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.527680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed177db7c1a4495be7e0f5517b445fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.542155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed177db7c1a4495be7e0f5517b445fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.550812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed177db7c1a4495be7e0f5517b445fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.552003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed177db7c1a4495be7e0f5517b445fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.561858 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 982/1962] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:30 2022] POST /identity/v3/users => generated 307 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:30.561858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.561858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.561858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.583710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:30.584335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.592107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 983/1963] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:30.592890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.594097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.606065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774c566-ce0f-43f7-9b2d-2f4b2a100db5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.610748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.611422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.611698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.611964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.612601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.614546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.625472 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 984/1964] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:30.629497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.640446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570635fe-a39b-4675-9f4c-cd8d705f2822 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.647001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.647518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed177db7c1a4495be7e0f5517b445fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:30.647846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.648225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.648590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.649387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:30.649790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.651655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.656835 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 981/1965] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:30 2022] DELETE /identity/v3/users/7ed177db7c1a4495be7e0f5517b445fa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:30.657748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.674785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 985/1966] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:30.675946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.689080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45239c4d-18ce-486c-958f-79102cd3e0b4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.746454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798432ad-e9ab-40e1-bca7-2dd8c7211060 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.751476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.752396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.752794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.753266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] PATH_INFO: `/v3/projects/6dc9692ae4de47aa856c5ab2ff579442/users/5b50b6c46c664d3fad4747b6ed5274c7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.756953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.757783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.758272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.758853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.759779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.762127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.771786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc9692ae4de47aa856c5ab2ff579442, user_id=5b50b6c46c664d3fad4747b6ed5274c7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.774967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.849357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 982/1967] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:30 2022] PUT /identity/v3/projects/6dc9692ae4de47aa856c5ab2ff579442/users/5b50b6c46c664d3fad4747b6ed5274c7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:30.850383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.852012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.873183 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:30.884925 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 986/1968] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:30 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:30.886002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.961531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe82e-1179-4e0e-aba7-726f8b0e90c7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.969639 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:30.979084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde1b96-247d-49a8-bbf1-05edb1d11519 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.984713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.985324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.985599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.985945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.986536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.988294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.000230 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 987/1969] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:31.001520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.015702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9874-1a05-43c0-8040-031b313ddeea admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.021253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.022052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.022176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.022483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.023263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.025090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.040376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.041224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.042180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.042180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] PATH_INFO: `/v3/projects/07926fa8ad9541e9ba19492bf3f252d8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.043147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07926fa8ad9541e9ba19492bf3f252d8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.045157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.111498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 988/1970] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:31 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:31.112317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.122042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f91d4-2d00-4587-8739-a9742386b5ff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.126968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.130534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.132952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.133910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] PATH_INFO: `/v3/projects/6dc9692ae4de47aa856c5ab2ff579442/users/5b50b6c46c664d3fad4747b6ed5274c7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.137077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc9692ae4de47aa856c5ab2ff579442, user_id=5b50b6c46c664d3fad4747b6ed5274c7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.143263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.159125 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 989/1971] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:31 2022] PUT /identity/v3/projects/6dc9692ae4de47aa856c5ab2ff579442/users/5b50b6c46c664d3fad4747b6ed5274c7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:31.160455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07926fa8ad9541e9ba19492bf3f252d8', 'request_id': 'req-fa71e1c9-adff-4c26-a0f7-245274435b95'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.169281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.169429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07926fa8ad9541e9ba19492bf3f252d8', 'request_id': 'req-fa71e1c9-adff-4c26-a0f7-245274435b95'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.234497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad8bf9-f7f2-4b7d-973e-9a1bf549a7c8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.239889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd52ded-2d67-4c99-b8ac-8452ba3cf51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.240501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52ded-2d67-4c99-b8ac-8452ba3cf51f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.240830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52ded-2d67-4c99-b8ac-8452ba3cf51f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.241106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52ded-2d67-4c99-b8ac-8452ba3cf51f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.241758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd52ded-2d67-4c99-b8ac-8452ba3cf51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.243399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd52ded-2d67-4c99-b8ac-8452ba3cf51f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.260500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07926fa8ad9541e9ba19492bf3f252d8', 'request_id': 'req-fa71e1c9-adff-4c26-a0f7-245274435b95'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.260743 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 990/1972] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:31.262048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.262336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.262611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.287114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] The token cache is being invalidate because project 07926fa8ad9541e9ba19492bf3f252d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:31.287568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.288337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.289997 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 983/1973] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:30 2022] DELETE /identity/v3/projects/07926fa8ad9541e9ba19492bf3f252d8 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:31.293296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.293296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.297205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] MFA Rules not processed for user `5b50b6c46c664d3fad4747b6ed5274c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:31.303117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.377821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71e1c9-adff-4c26-a0f7-245274435b95 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.383466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.384179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.384455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.384889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] PATH_INFO: `/v3/projects/cfb90935c1d14886825039092785e1aa` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.386131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb90935c1d14886825039092785e1aa)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.388913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.399229 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 991/1974] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:31.400237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.401572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.416432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b160e39-e9f8-4f0d-837e-d414b680643b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.421472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431dd14-9a48-422b-ab02-7fff97b14221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.422214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431dd14-9a48-422b-ab02-7fff97b14221 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.422570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431dd14-9a48-422b-ab02-7fff97b14221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.422772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431dd14-9a48-422b-ab02-7fff97b14221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.423429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431dd14-9a48-422b-ab02-7fff97b14221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.425057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431dd14-9a48-422b-ab02-7fff97b14221 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.443922 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 992/1975] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:31.443922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.443922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.443922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.466491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:31.468623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.480881 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 993/1976] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:31.482872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.483081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.521144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb90935c1d14886825039092785e1aa', 'request_id': 'req-63bf4e36-b144-41c7-9677-3eb9cbaff72e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.527054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb90935c1d14886825039092785e1aa', 'request_id': 'req-63bf4e36-b144-41c7-9677-3eb9cbaff72e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.559954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47058b-103f-47a3-8678-e30c8caecc63 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.579231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb90935c1d14886825039092785e1aa', 'request_id': 'req-63bf4e36-b144-41c7-9677-3eb9cbaff72e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.591809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] The token cache is being invalidate because project cfb90935c1d14886825039092785e1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:31.592099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.592763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:31.594343 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 984/1977] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:31 2022] DELETE /identity/v3/projects/cfb90935c1d14886825039092785e1aa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:31.595215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.596492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.627455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c878a99-075c-4a03-8be3-4778dd4e5488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.628457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878a99-075c-4a03-8be3-4778dd4e5488 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.628748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878a99-075c-4a03-8be3-4778dd4e5488 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.629023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878a99-075c-4a03-8be3-4778dd4e5488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.631040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6c878a99-075c-4a03-8be3-4778dd4e5488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.668366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf4e36-b144-41c7-9677-3eb9cbaff72e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.675166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.675878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.677074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.677875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] PATH_INFO: `/v3/projects/7bf06b2ed3714f1e819cde888aa1595b/users/37ace80292e8463b8669862a033336fb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.698795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf06b2ed3714f1e819cde888aa1595b, user_id=37ace80292e8463b8669862a033336fb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.702083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.712532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c878a99-075c-4a03-8be3-4778dd4e5488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.714202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c878a99-075c-4a03-8be3-4778dd4e5488 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.730562 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 994/1978] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:31 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:31.732304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e39918-77f7-4d08-8733-3f61900c47be None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.732665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e39918-77f7-4d08-8733-3f61900c47be None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.733011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e39918-77f7-4d08-8733-3f61900c47be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.758338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-46e39918-77f7-4d08-8733-3f61900c47be None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:31.762560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-46e39918-77f7-4d08-8733-3f61900c47be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.771202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 995/1979] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:31.772509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400bea-05fe-4b60-841d-78ed75ee78de None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.772802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400bea-05fe-4b60-841d-78ed75ee78de None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.773220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400bea-05fe-4b60-841d-78ed75ee78de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.798288 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 985/1980] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:31 2022] PUT /identity/v3/projects/7bf06b2ed3714f1e819cde888aa1595b/users/37ace80292e8463b8669862a033336fb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:31.798288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:31.804869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5b400bea-05fe-4b60-841d-78ed75ee78de None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:31.806232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5b400bea-05fe-4b60-841d-78ed75ee78de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:31.917369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51312a3-ad1a-4c6b-a74a-9d98bd5a9305 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:31.929591 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 996/1981] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:31.930523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347f378-358e-42a6-a59e-31ea4aa56787 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.930964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347f378-358e-42a6-a59e-31ea4aa56787 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.931342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347f378-358e-42a6-a59e-31ea4aa56787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.933537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9219f-1c93-4071-84fd-22a44aba14d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:31.935207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9219f-1c93-4071-84fd-22a44aba14d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.936198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9219f-1c93-4071-84fd-22a44aba14d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.938611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9219f-1c93-4071-84fd-22a44aba14d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.939307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9219f-1c93-4071-84fd-22a44aba14d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:31.939706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9219f-1c93-4071-84fd-22a44aba14d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:31.941467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9219f-1c93-4071-84fd-22a44aba14d5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:31.947301 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:31.963031 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 986/1982] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:31.964834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a46e8a-2241-4f95-abaa-32b8f3545f56 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:31.965192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a46e8a-2241-4f95-abaa-32b8f3545f56 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:31.965542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a46e8a-2241-4f95-abaa-32b8f3545f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:31.972826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d347f378-358e-42a6-a59e-31ea4aa56787 None None] MFA Rules not processed for user `37ace80292e8463b8669862a033336fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:31.974945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d347f378-358e-42a6-a59e-31ea4aa56787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:32.005108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-21a46e8a-2241-4f95-abaa-32b8f3545f56 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:32.006752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-21a46e8a-2241-4f95-abaa-32b8f3545f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:32.023458 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:32.029895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 987/1983] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:32.029895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a46e8a-2241-4f95-abaa-32b8f3545f56 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.041770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a46e8a-2241-4f95-abaa-32b8f3545f56 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.048699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.050004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.050744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.051118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.052242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.055714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.092840 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 997/1984] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:32.092840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347f378-358e-42a6-a59e-31ea4aa56787 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.119725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347f378-358e-42a6-a59e-31ea4aa56787 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.125199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.125944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.126321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.126786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.127565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:32.127966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.129801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.150675 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 998/1985] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:32.158028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.164972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffcf4d-da8e-4729-9072-7bea7dde41b0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.170457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.171143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.171564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.171768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.172411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.174361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.189731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 988/1986] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:32 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:32.190675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.282730 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 999/1987] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:32 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:32.282730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.299396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a853182-f473-4743-91bb-d33afb8b3c4a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.381949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cf6b1-fa8b-441c-9d61-4276a6d24f16 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.384002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.385204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.385766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.386228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.387320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.387443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.388128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.388336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.388793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.389503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.390436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.394558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.477710 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 989/1988] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:32 2022] POST /identity/v3/projects => generated 395 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:32.477710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.513480 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1000/1989] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:32 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:32.514612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.517054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:32.570648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d87df-c2eb-4539-bc26-6aa92b2b8ecd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.578357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.579855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.584192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.584192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.584192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.584192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.628708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02db192-be4a-4924-a2f7-ad49b1f0a9bd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.670114 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 990/1990] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:32 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:32.671166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.691086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526064b7-7dfd-47bd-8af2-a2db0813d2de admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.700529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.700529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.700529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.700529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.700865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.702832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.717830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.718642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.719057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.719467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.723319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:32.784911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.787539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.796984 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1001/1991] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:32.797800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.808050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586c413-3e26-4c48-b39d-32230bd72065 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.818527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.819276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.819643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.819991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.820708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.822481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.837497 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1002/1992] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:32.837497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.846561 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 991/1993] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:32 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:32.846561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.846804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb831f6-ca5a-4633-9922-4f5920083859 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.846910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:32.853328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.853987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.855606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.855606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.855606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.856907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.862012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd857d09-e53a-479c-b2f4-469f85f78abb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.866847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.867487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.867793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.868067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] PATH_INFO: `/v3/users/32904cdad70c4aa495080be8601ddb78` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.869029 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1003/1994] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:32.869280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32904cdad70c4aa495080be8601ddb78)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.869894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.871389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.883342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1c35-e86a-48c6-9f56-7b9243ba18cf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.889241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.889971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.890361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.890696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.891407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.893375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.905867 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1004/1995] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:32.909763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.920979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe8e26-9841-49b1-a5c4-db7e4c64a789 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.925556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.926186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.926512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.926808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.927432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.928996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:32.939256 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1005/1996] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:32.943513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:32.953236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0109ef-7d2d-4f20-8528-9899c8c31a49 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:32.958577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:32.959301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:32.959580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:32.959859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] PATH_INFO: `/v3/projects/c70be8e55d2a4b1ba14c7fd7848f605d/users/38dc6f2c67e44033b4794c4c30fd3a31/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:32.974603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70be8e55d2a4b1ba14c7fd7848f605d, user_id=38dc6f2c67e44033b4794c4c30fd3a31, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:32.977283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.061736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32904cdad70c4aa495080be8601ddb78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:33.066230 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1006/1997] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:32 2022] PUT /identity/v3/projects/c70be8e55d2a4b1ba14c7fd7848f605d/users/38dc6f2c67e44033b4794c4c30fd3a31/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:33.067052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.078331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32904cdad70c4aa495080be8601ddb78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:33.085323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32904cdad70c4aa495080be8601ddb78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:33.086098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32904cdad70c4aa495080be8601ddb78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:33.134615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51525-d043-4344-8e2a-cf4d89ce982f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:33.142500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:33.142500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.142500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.142500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] PATH_INFO: `/v3/projects/c8453817b18e4ab19001a61df131d3c8/users/f1f9b8db5bfe40df8d825a87f4011728/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.159039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8453817b18e4ab19001a61df131d3c8, user_id=f1f9b8db5bfe40df8d825a87f4011728, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:33.162946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32904cdad70c4aa495080be8601ddb78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:33.167818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.173131 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 992/1998] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:32 2022] DELETE /identity/v3/users/32904cdad70c4aa495080be8601ddb78 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:33.173131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.174419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.262418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6239a-aae4-43a9-8453-eb14cac2139b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:33.269441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930aeaf-6b08-4c28-938a-44fa23114047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:33.270244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930aeaf-6b08-4c28-938a-44fa23114047 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.274645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930aeaf-6b08-4c28-938a-44fa23114047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.274645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930aeaf-6b08-4c28-938a-44fa23114047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.274645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930aeaf-6b08-4c28-938a-44fa23114047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:33.274645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930aeaf-6b08-4c28-938a-44fa23114047 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.278372 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1007/1999] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:33 2022] PUT /identity/v3/projects/c8453817b18e4ab19001a61df131d3c8/users/f1f9b8db5bfe40df8d825a87f4011728/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:33.279853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.281519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.293889 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 993/2000] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:33.293889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df355-3d41-4857-b0d1-4468a7c38c04 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.293889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df355-3d41-4857-b0d1-4468a7c38c04 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.293889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df355-3d41-4857-b0d1-4468a7c38c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.312509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ca5df355-3d41-4857-b0d1-4468a7c38c04 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:33.313621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ca5df355-3d41-4857-b0d1-4468a7c38c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.375752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b867d8-fa73-4bf5-8e2e-8a78df010489 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:33.379046 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 994/2001] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:33.380882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.381166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.381448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.390711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:33.391368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.391669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.391945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.392746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:33.394380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.406658 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1008/2002] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:33.407339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.417036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] MFA Rules not processed for user `f1f9b8db5bfe40df8d825a87f4011728`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:33.417454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e177b4-3b1f-4e4a-8e4f-a640c4f169e6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:33.419331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.422694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:33.423566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.423685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.424115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] PATH_INFO: `/v3/projects/376ff1248cd54ba58a86f8946181a447/users/e856d14e980d4a92909b3f6b3d330175/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.441067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376ff1248cd54ba58a86f8946181a447, user_id=e856d14e980d4a92909b3f6b3d330175, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:33.444278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.490592 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 995/2003] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:33.491652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.492943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.553146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619985-541b-44c3-98af-59b7cfe37390 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:33.566070 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1009/2004] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:33 2022] PUT /identity/v3/projects/376ff1248cd54ba58a86f8946181a447/users/e856d14e980d4a92909b3f6b3d330175/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:33.566070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.610066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15937b-6ef3-46f4-bd0c-49acdec6b2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:33.610687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15937b-6ef3-46f4-bd0c-49acdec6b2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.610975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15937b-6ef3-46f4-bd0c-49acdec6b2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.611243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15937b-6ef3-46f4-bd0c-49acdec6b2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.640749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bb537-c284-428d-934d-a97329eefae7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:33.645667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:33.646364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.646644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.646925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] PATH_INFO: `/v3/projects/c70be8e55d2a4b1ba14c7fd7848f605d/users/38dc6f2c67e44033b4794c4c30fd3a31/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.648945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70be8e55d2a4b1ba14c7fd7848f605d, user_id=38dc6f2c67e44033b4794c4c30fd3a31, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:33.651639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.662505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1010/2005] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:33 2022] PUT /identity/v3/projects/c70be8e55d2a4b1ba14c7fd7848f605d/users/38dc6f2c67e44033b4794c4c30fd3a31/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:33.663085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.664796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.677288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15937b-6ef3-46f4-bd0c-49acdec6b2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:33.678783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15937b-6ef3-46f4-bd0c-49acdec6b2c3 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.689302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 996/2006] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:33.690421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281d5c4-ac02-4022-83bd-1632c899c3fa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.690711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281d5c4-ac02-4022-83bd-1632c899c3fa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.691000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281d5c4-ac02-4022-83bd-1632c899c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.697128 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:33.721593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9281d5c4-ac02-4022-83bd-1632c899c3fa None None] MFA Rules not processed for user `e856d14e980d4a92909b3f6b3d330175`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:33.723093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9281d5c4-ac02-4022-83bd-1632c899c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.765556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc5544-1a7a-4e39-852c-b80fd5042591 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:33.781936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:33.783150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.783466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.783710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.784866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:33.786907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:33.800319 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 997/2007] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:33.802295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7422a-ac92-4b8e-8b90-dde1c92b820d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:33.802578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7422a-ac92-4b8e-8b90-dde1c92b820d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:33.802854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7422a-ac92-4b8e-8b90-dde1c92b820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:33.841888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f3b7422a-ac92-4b8e-8b90-dde1c92b820d None None] MFA Rules not processed for user `38dc6f2c67e44033b4794c4c30fd3a31`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:33.843080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f3b7422a-ac92-4b8e-8b90-dde1c92b820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:33.851170 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:33.916693 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1011/2008] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:33 2022] POST /identity/v3/projects => generated 371 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:33.918605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.973929 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 998/2009] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:33.975016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7422a-ac92-4b8e-8b90-dde1c92b820d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:33.991631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7422a-ac92-4b8e-8b90-dde1c92b820d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.064262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e29de8-d998-43fd-91ab-bdd2b70b3cb1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.071079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.071797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.072152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.072497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.073207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.075350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.097244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.097244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.097554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.097803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.099099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.101474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.153736 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1012/2010] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:33 2022] POST /identity/v3/projects => generated 393 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:34.155058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.157007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:34.191894 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 999/2011] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:33 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:34.192774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.203838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882edcad-41d2-48ad-9c9b-9d00db8aed20 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.239431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb2d45-c782-4776-9c5f-2f0880c06721 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.245175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.245860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.246152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.246424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.283331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.284178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.284535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.284881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.285608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.289904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.326108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.327726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.339534 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1013/2012] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:34.340400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.351719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34581c-9589-4d86-aa0a-5dc0b68e2da4 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.356567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.359339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.359339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.359339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.359339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.360008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.371420 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1014/2013] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:34.372261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.375585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:34.387938 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1000/2014] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:34 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:34.388854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.399746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2a4f-b6f2-44b1-97d0-0edaaf93d899 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.400774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708588c-1b36-4806-a985-c5c1531042f7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.411911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.416783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.416938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.416938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.417130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.417206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] PATH_INFO: `/v3/projects/9948a8cd6d5845a393f76d12303d3f7c/users/90e59dd912f04bb7b230c9b1b48aec0a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.417297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.417297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] PATH_INFO: `/v3/projects/2d664dd238984ea29ac89eded91e170f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.417297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d664dd238984ea29ac89eded91e170f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.419419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.441271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9948a8cd6d5845a393f76d12303d3f7c, user_id=90e59dd912f04bb7b230c9b1b48aec0a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.445603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.530561 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1001/2015] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:34 2022] PUT /identity/v3/projects/9948a8cd6d5845a393f76d12303d3f7c/users/90e59dd912f04bb7b230c9b1b48aec0a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:34.531783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.572912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d664dd238984ea29ac89eded91e170f', 'request_id': 'req-e2aae5fc-b432-41c9-921e-e624bced1dfe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:34.586784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d664dd238984ea29ac89eded91e170f', 'request_id': 'req-e2aae5fc-b432-41c9-921e-e624bced1dfe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:34.627101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b60b44-61a8-41b5-b8d7-158906a40aa2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.644006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d664dd238984ea29ac89eded91e170f', 'request_id': 'req-e2aae5fc-b432-41c9-921e-e624bced1dfe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:34.663495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] The token cache is being invalidate because project 2d664dd238984ea29ac89eded91e170f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:34.664098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:34.665165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:34.669280 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1015/2016] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:34 2022] DELETE /identity/v3/projects/2d664dd238984ea29ac89eded91e170f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:34.670483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.672504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:34.701005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.767886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.767886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.767886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.767886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.767886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.767886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1002/2017] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:34.768494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.768494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:34.768494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fccddf-747a-4f89-aab8-b446ddd0fa78 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.768765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.768765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.768765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.768765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] PATH_INFO: `/v3/users/5b50b6c46c664d3fad4747b6ed5274c7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.769114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b50b6c46c664d3fad4747b6ed5274c7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.769114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.769298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aae5fc-b432-41c9-921e-e624bced1dfe admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.769298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.769298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.769298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.769652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.769652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.769652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.783772 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1016/2018] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:34.784834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:34.786821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:34.800763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ee98-ab9c-446e-8d0f-4d4b9e3a797e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:34.806573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:34.807247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:34.807515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:34.807789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] PATH_INFO: `/v3/projects/3903ce1482364d0386f57e1da769d787/users/f8095f59a9934405b6b467180a1bc7fa/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:34.823234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3903ce1482364d0386f57e1da769d787, user_id=f8095f59a9934405b6b467180a1bc7fa, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:34.826001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:34.969216 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1017/2019] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:34 2022] PUT /identity/v3/projects/3903ce1482364d0386f57e1da769d787/users/f8095f59a9934405b6b467180a1bc7fa/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:34.976792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.037009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d6d6d-88e4-4d04-a805-ad5dd55ca314 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.041852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.042513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.042795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.043069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] PATH_INFO: `/v3/projects/9948a8cd6d5845a393f76d12303d3f7c/users/90e59dd912f04bb7b230c9b1b48aec0a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.044987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9948a8cd6d5845a393f76d12303d3f7c, user_id=90e59dd912f04bb7b230c9b1b48aec0a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.047802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.059850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1018/2020] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:34 2022] PUT /identity/v3/projects/9948a8cd6d5845a393f76d12303d3f7c/users/90e59dd912f04bb7b230c9b1b48aec0a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:35.060853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.087724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b50b6c46c664d3fad4747b6ed5274c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.108733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b50b6c46c664d3fad4747b6ed5274c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.129458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b50b6c46c664d3fad4747b6ed5274c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.131530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b50b6c46c664d3fad4747b6ed5274c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.141859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc4323-1df6-4525-af06-144e83aa4b6a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.149710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16ea66-b107-4e4f-9c48-138a41c0663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.150722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ea66-b107-4e4f-9c48-138a41c0663a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.166005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ea66-b107-4e4f-9c48-138a41c0663a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.166005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ea66-b107-4e4f-9c48-138a41c0663a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.166005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16ea66-b107-4e4f-9c48-138a41c0663a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.166005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16ea66-b107-4e4f-9c48-138a41c0663a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.166005 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1019/2021] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:35.167092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.167092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.167916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.197455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] MFA Rules not processed for user `90e59dd912f04bb7b230c9b1b48aec0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:35.198717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.256595 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:35.274618 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1020/2022] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:35.275456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.276747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.290920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66049bbf-29f5-4a46-93cb-fa8a3ba9eb3d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.295570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.296220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.296502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.296775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] PATH_INFO: `/v3/projects/3903ce1482364d0386f57e1da769d787/users/f8095f59a9934405b6b467180a1bc7fa/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.298729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3903ce1482364d0386f57e1da769d787, user_id=f8095f59a9934405b6b467180a1bc7fa, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.303385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b50b6c46c664d3fad4747b6ed5274c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.303578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.309379 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1003/2023] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:34 2022] DELETE /identity/v3/users/5b50b6c46c664d3fad4747b6ed5274c7 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:35.313123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.314521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.315347 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1021/2024] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:35 2022] PUT /identity/v3/projects/3903ce1482364d0386f57e1da769d787/users/f8095f59a9934405b6b467180a1bc7fa/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:35.315983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.318211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.417470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aefe89-2baa-440c-9da3-28bc6b3b11c3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.422838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac92520-3390-41f4-b7d6-23bbde35487a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.424586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.424825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.425092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.425369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.428560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.486047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.486675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.487169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.487692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] PATH_INFO: `/v3/users/37ace80292e8463b8669862a033336fb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.488962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ace80292e8463b8669862a033336fb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.491945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.496299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.498095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.509246 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1022/2025] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:35.510726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.512315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.543389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac152-b07b-402e-8370-a2e67eb42449 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.549983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ca70-24cf-48a7-aeba-d09ffa356189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.551040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ca70-24cf-48a7-aeba-d09ffa356189 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.551480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ca70-24cf-48a7-aeba-d09ffa356189 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.552577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ca70-24cf-48a7-aeba-d09ffa356189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.640629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ca70-24cf-48a7-aeba-d09ffa356189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.642866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ca70-24cf-48a7-aeba-d09ffa356189 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.655963 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1023/2026] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:35.664403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988561-2f57-4d97-835f-8c95422af055 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.664403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988561-2f57-4d97-835f-8c95422af055 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.664403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988561-2f57-4d97-835f-8c95422af055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.699611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5f988561-2f57-4d97-835f-8c95422af055 None None] MFA Rules not processed for user `f8095f59a9934405b6b467180a1bc7fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:35.700313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f988561-2f57-4d97-835f-8c95422af055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.790145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ace80292e8463b8669862a033336fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.822865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ace80292e8463b8669862a033336fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.826239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1024/2027] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:35.830796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988561-2f57-4d97-835f-8c95422af055 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.834133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ace80292e8463b8669862a033336fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.835218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ace80292e8463b8669862a033336fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.853164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988561-2f57-4d97-835f-8c95422af055 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.861331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96dfaa-0eb6-444e-9603-35494fabd399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.863298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dfaa-0eb6-444e-9603-35494fabd399 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.864602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dfaa-0eb6-444e-9603-35494fabd399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.864602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dfaa-0eb6-444e-9603-35494fabd399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.864602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96dfaa-0eb6-444e-9603-35494fabd399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.866864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96dfaa-0eb6-444e-9603-35494fabd399 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.951856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ace80292e8463b8669862a033336fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:35.960339 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1004/2028] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:35 2022] DELETE /identity/v3/users/37ace80292e8463b8669862a033336fb => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:35.966049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.968584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.043112 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1025/2029] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:35 2022] POST /identity/v3/projects => generated 393 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:36.044677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.044972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.045271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.070476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462455-5b34-4930-b9ff-a9d27095d216 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.082076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:36.087484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.171020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.171817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.172312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.172865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] PATH_INFO: `/v3/users/f1f9b8db5bfe40df8d825a87f4011728` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.174579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f9b8db5bfe40df8d825a87f4011728)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.176695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.191046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1026/2030] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:36.194502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.195783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.212342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e8115-e3ca-43a3-ba09-816633549721 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.217745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.218400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.218682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.219031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.219621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.221591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.447692 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1027/2031] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:36 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:36.447692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.447692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.452513 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:36.462747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c336-29b5-49ea-979a-be90a7c0ed4e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.467716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.468548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.468687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.469120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] PATH_INFO: `/v3/projects/6dc9692ae4de47aa856c5ab2ff579442` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.470283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc9692ae4de47aa856c5ab2ff579442)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.470574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f9b8db5bfe40df8d825a87f4011728'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.472369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.483692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f9b8db5bfe40df8d825a87f4011728'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.491583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f9b8db5bfe40df8d825a87f4011728'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.492425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f9b8db5bfe40df8d825a87f4011728'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.563364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f9b8db5bfe40df8d825a87f4011728'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.570788 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1005/2032] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:35 2022] DELETE /identity/v3/users/f1f9b8db5bfe40df8d825a87f4011728 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:36.571645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.575265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.584400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc9692ae4de47aa856c5ab2ff579442', 'request_id': 'req-75e405a7-9fa8-443b-92ed-a9dc21ac9612'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.591851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc9692ae4de47aa856c5ab2ff579442', 'request_id': 'req-75e405a7-9fa8-443b-92ed-a9dc21ac9612'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.644864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761846c-79e0-451d-bf1f-1d8b588f01ca admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.649293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9b02e-b9da-4750-95af-39dcc6d18122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.649976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9b02e-b9da-4750-95af-39dcc6d18122 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.650263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9b02e-b9da-4750-95af-39dcc6d18122 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.650540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9b02e-b9da-4750-95af-39dcc6d18122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.652386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5ad9b02e-b9da-4750-95af-39dcc6d18122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.660561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc9692ae4de47aa856c5ab2ff579442', 'request_id': 'req-75e405a7-9fa8-443b-92ed-a9dc21ac9612'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.675305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] The token cache is being invalidate because project 6dc9692ae4de47aa856c5ab2ff579442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:36.675699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.676876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:36.685003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1028/2033] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:36 2022] DELETE /identity/v3/projects/6dc9692ae4de47aa856c5ab2ff579442 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:36.686423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.688109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.731810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9b02e-b9da-4750-95af-39dcc6d18122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.734147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9b02e-b9da-4750-95af-39dcc6d18122 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.748258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1006/2034] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:36.749929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f43de-68eb-4f4b-a03e-91b2eab82810 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.750209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f43de-68eb-4f4b-a03e-91b2eab82810 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.750630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f43de-68eb-4f4b-a03e-91b2eab82810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.774671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bb2f43de-68eb-4f4b-a03e-91b2eab82810 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:36.775961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb2f43de-68eb-4f4b-a03e-91b2eab82810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.792360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e405a7-9fa8-443b-92ed-a9dc21ac9612 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.795024 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1007/2035] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:36.804389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.808113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.808113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.808318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4cea-2728-48be-ae1f-d1bce40106c2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.808399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.808491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4cea-2728-48be-ae1f-d1bce40106c2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.808491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4cea-2728-48be-ae1f-d1bce40106c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.808733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.810507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.822831 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1029/2036] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:36.823753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.825460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.833498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c10b4cea-2728-48be-ae1f-d1bce40106c2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:36.834721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c10b4cea-2728-48be-ae1f-d1bce40106c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.843973 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1008/2037] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:36.844962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4cea-2728-48be-ae1f-d1bce40106c2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.859522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4cea-2728-48be-ae1f-d1bce40106c2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.864357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da4600-5b96-46fc-a695-6255a9727434 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.870712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045e577-7396-4c16-ae41-10921bc589d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.871439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e577-7396-4c16-ae41-10921bc589d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.871799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e577-7396-4c16-ae41-10921bc589d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.872349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e577-7396-4c16-ae41-10921bc589d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.873126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045e577-7396-4c16-ae41-10921bc589d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.880279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045e577-7396-4c16-ae41-10921bc589d5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.880435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.880435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.880435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.881471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.889043 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1009/2038] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:36.890859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b6e9-0516-4fd1-a524-ce77ffb1426b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.891300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b6e9-0516-4fd1-a524-ce77ffb1426b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.891735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b6e9-0516-4fd1-a524-ce77ffb1426b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.895657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.897412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.912389 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1030/2039] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:36.912389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.918618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2396b6e9-0516-4fd1-a524-ce77ffb1426b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:36.920273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2396b6e9-0516-4fd1-a524-ce77ffb1426b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:36.920859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcf80e-e081-4385-be72-14f818c08c57 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.925926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19af5b-b95e-4b14-ae75-0bbc6dca69c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.926730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19af5b-b95e-4b14-ae75-0bbc6dca69c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.926934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19af5b-b95e-4b14-ae75-0bbc6dca69c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.927716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19af5b-b95e-4b14-ae75-0bbc6dca69c5 admin admin] PATH_INFO: `/v3/projects/dd94cc1266b34c279f6396a2c1dd0aa7/users/f4a4658e56bd49568a3075ca36a9f9ae/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.931262 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1010/2040] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:36.936595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b6e9-0516-4fd1-a524-ce77ffb1426b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:36.951860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19af5b-b95e-4b14-ae75-0bbc6dca69c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd94cc1266b34c279f6396a2c1dd0aa7, user_id=f4a4658e56bd49568a3075ca36a9f9ae, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.956894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19af5b-b95e-4b14-ae75-0bbc6dca69c5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:36.961772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b6e9-0516-4fd1-a524-ce77ffb1426b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:36.965961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:36.966584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:36.967443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:36.967722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:36.968542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:36.969001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:36.970824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.007528 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1011/2041] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:37.017243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.029234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58fc6d-6575-48ad-9c79-0478fca76a73 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.034897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.035569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.035906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.036178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.036862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.039210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.067306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1031/2042] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:36 2022] PUT /identity/v3/projects/dd94cc1266b34c279f6396a2c1dd0aa7/users/f4a4658e56bd49568a3075ca36a9f9ae/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:37.078171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de9331-b685-476c-a4f8-7aa9c5ee64c4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.078479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de9331-b685-476c-a4f8-7aa9c5ee64c4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.078751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de9331-b685-476c-a4f8-7aa9c5ee64c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.115919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-81de9331-b685-476c-a4f8-7aa9c5ee64c4 None None] MFA Rules not processed for user `f4a4658e56bd49568a3075ca36a9f9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:37.117562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-81de9331-b685-476c-a4f8-7aa9c5ee64c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:37.182748 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1012/2043] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:37 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:37.187100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.189005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:37.210356 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1032/2044] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:37.211234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de9331-b685-476c-a4f8-7aa9c5ee64c4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.296965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de9331-b685-476c-a4f8-7aa9c5ee64c4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.297289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f86e-e424-4c50-873e-e4c7858a4fad admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.304190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.304957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.305214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.305491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.308029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:37.323295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.324977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.348949 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1013/2045] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:37.350022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.351846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:37.376399 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:37.394181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.394848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.395133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.395414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.396272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.398471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.456768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d157-b354-4788-bb24-26a0cba7f03e service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.463127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.463768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.464064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.464334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.473867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:37.491727 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1033/2046] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:37 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:37.496980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.517135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c881f1-08f5-480c-91bb-a0393e640d5f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.541413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.542150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.542432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.542705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.545327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.549115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.567700 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1034/2047] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:13:37.571901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.574639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:37.590332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accff2a-4754-45ac-aeb0-248cb4b2325d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.596521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.597157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.598084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.598463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.598839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] PATH_INFO: `/v3/projects/7bf06b2ed3714f1e819cde888aa1595b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.600882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf06b2ed3714f1e819cde888aa1595b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.602196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.604414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.617323 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1014/2048] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:37.618424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.632344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2e86b-decf-4496-a67b-6011d5165dc0 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.638771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.639462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.639747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.640026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.640778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.642815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.657029 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1015/2049] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:37.661282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.673689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1522a-863b-451d-8d34-1fbe8ee1b42f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.679494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7d185-44a2-477e-b079-e311246e43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.680442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7d185-44a2-477e-b079-e311246e43ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.680442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7d185-44a2-477e-b079-e311246e43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.680853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7d185-44a2-477e-b079-e311246e43ae admin admin] PATH_INFO: `/v3/projects/240c39c7f0884642a2fe1b9f8922bf43/users/941b2e985c9f4385a20d72381424c900/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.699845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7d185-44a2-477e-b079-e311246e43ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=240c39c7f0884642a2fe1b9f8922bf43, user_id=941b2e985c9f4385a20d72381424c900, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.705957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7d185-44a2-477e-b079-e311246e43ae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:37.839663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1016/2050] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:37 2022] PUT /identity/v3/projects/240c39c7f0884642a2fe1b9f8922bf43/users/941b2e985c9f4385a20d72381424c900/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:37.839663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614552e-a35a-4283-ac03-e999bafbf56e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.839663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614552e-a35a-4283-ac03-e999bafbf56e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.839663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614552e-a35a-4283-ac03-e999bafbf56e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.839663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1017/2051] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:37.839663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614552e-a35a-4283-ac03-e999bafbf56e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:37.840660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6614552e-a35a-4283-ac03-e999bafbf56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:37.874113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf06b2ed3714f1e819cde888aa1595b', 'request_id': 'req-c0a081fc-fd10-4d59-93c9-340454ef9ade'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:37.884318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf06b2ed3714f1e819cde888aa1595b', 'request_id': 'req-c0a081fc-fd10-4d59-93c9-340454ef9ade'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:37.928362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614552e-a35a-4283-ac03-e999bafbf56e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:37.933012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:37.933648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:37.933965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:37.934241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] PATH_INFO: `/v3/projects/c8453817b18e4ab19001a61df131d3c8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:37.935352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8453817b18e4ab19001a61df131d3c8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:37.937364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:38.009688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf06b2ed3714f1e819cde888aa1595b', 'request_id': 'req-c0a081fc-fd10-4d59-93c9-340454ef9ade'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.021222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] The token cache is being invalidate because project 7bf06b2ed3714f1e819cde888aa1595b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:38.021608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.022360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c0a081fc-fd10-4d59-93c9-340454ef9ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.023915 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1035/2052] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:37 2022] DELETE /identity/v3/projects/7bf06b2ed3714f1e819cde888aa1595b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:38.029833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.029833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.029833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.054258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] MFA Rules not processed for user `941b2e985c9f4385a20d72381424c900`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:38.062890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.068710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8453817b18e4ab19001a61df131d3c8', 'request_id': 'req-d217d77a-a057-41c6-8621-f45d0167c523'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.075038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8453817b18e4ab19001a61df131d3c8', 'request_id': 'req-d217d77a-a057-41c6-8621-f45d0167c523'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.119337 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1036/2053] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:38.120176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:13:38.121539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.181758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8453817b18e4ab19001a61df131d3c8', 'request_id': 'req-d217d77a-a057-41c6-8621-f45d0167c523'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.199128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:38.200536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.203505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] The token cache is being invalidate because project c8453817b18e4ab19001a61df131d3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:38.203868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.204620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.206246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1018/2054] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:37 2022] DELETE /identity/v3/projects/c8453817b18e4ab19001a61df131d3c8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:38.210701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:38.212066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.267895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a3121-5b32-4647-912b-7f9a2c052589 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:38.273406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8095f59a9934405b6b467180a1bc7fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3903ce1482364d0386f57e1da769d787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:38.274069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.276573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.276573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] PATH_INFO: `/v3/projects/376ff1248cd54ba58a86f8946181a447` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.276573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorizing `identity:get_project(project_id=376ff1248cd54ba58a86f8946181a447)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:38.277725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:38.278401 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:38.279629 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1037/2055] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:13:38 2022] GET /identity/v3/projects/376ff1248cd54ba58a86f8946181a447 => generated 395 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:38.280638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:38.282588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217d77a-a057-41c6-8621-f45d0167c523 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:38.283962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.288270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:38.288922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.289209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.289488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] PATH_INFO: `/v3/users/38dc6f2c67e44033b4794c4c30fd3a31` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.290711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38dc6f2c67e44033b4794c4c30fd3a31)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:38.292993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:38.300602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091ebc-3cd5-4ae0-9957-b06dca83515d tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:38.306394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:38.307009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.307312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.308117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.308942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:38.312362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:38.402336 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1038/2056] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:38 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:38.402336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:38.402336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.471355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327df41-28d0-4877-bc8a-d01f46124c77 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:38.477729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:38.482619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.482619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.482619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] PATH_INFO: `/v3/users/90e59dd912f04bb7b230c9b1b48aec0a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.487169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e59dd912f04bb7b230c9b1b48aec0a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:38.492184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:38.507753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dc6f2c67e44033b4794c4c30fd3a31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.524734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dc6f2c67e44033b4794c4c30fd3a31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.531988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dc6f2c67e44033b4794c4c30fd3a31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.532747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dc6f2c67e44033b4794c4c30fd3a31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.649414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dc6f2c67e44033b4794c4c30fd3a31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.656542 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1019/2057] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:38 2022] DELETE /identity/v3/users/38dc6f2c67e44033b4794c4c30fd3a31 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:38.657463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:38.659061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.692940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e59dd912f04bb7b230c9b1b48aec0a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.695059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e59dd912f04bb7b230c9b1b48aec0a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.733752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdccd9e-efe1-4ef0-874f-19addfc8892b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:38.738896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b8a4d-7d0b-4cf9-a9f8-18d0b375daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:38.743822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b8a4d-7d0b-4cf9-a9f8-18d0b375daad admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.743822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b8a4d-7d0b-4cf9-a9f8-18d0b375daad admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.743822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b8a4d-7d0b-4cf9-a9f8-18d0b375daad admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.743822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b8a4d-7d0b-4cf9-a9f8-18d0b375daad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:38.743822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b8a4d-7d0b-4cf9-a9f8-18d0b375daad admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:38.827151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e59dd912f04bb7b230c9b1b48aec0a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.838470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e59dd912f04bb7b230c9b1b48aec0a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.839562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe038c-abe4-414c-836b-390b24645af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e59dd912f04bb7b230c9b1b48aec0a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:38.864868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1039/2058] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:38 2022] DELETE /identity/v3/users/90e59dd912f04bb7b230c9b1b48aec0a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:38.864868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4808c9-f850-4bbb-86e3-a431a396a8a2 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.864868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4808c9-f850-4bbb-86e3-a431a396a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.864868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4808c9-f850-4bbb-86e3-a431a396a8a2 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.866524 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1020/2059] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:38 2022] POST /identity/v3/users => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:38.866911 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1040/2060] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:38.866986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.866986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.866986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.866986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1021/2061] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:38.867244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4808c9-f850-4bbb-86e3-a431a396a8a2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:38.868814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eb4808c9-f850-4bbb-86e3-a431a396a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.872511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:13:38.874454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.951847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4808c9-f850-4bbb-86e3-a431a396a8a2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:38.957369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0553-077c-46a1-9a2b-7bb7c6debadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:38.958014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0553-077c-46a1-9a2b-7bb7c6debadc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.958295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0553-077c-46a1-9a2b-7bb7c6debadc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.958618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0553-077c-46a1-9a2b-7bb7c6debadc admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.959318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d0553-077c-46a1-9a2b-7bb7c6debadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:38.960946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d0553-077c-46a1-9a2b-7bb7c6debadc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:38.975806 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1041/2062] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:38.975806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb6517-0230-4606-b819-3433ee4eff04 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:38.975806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb6517-0230-4606-b819-3433ee4eff04 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:38.975806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb6517-0230-4606-b819-3433ee4eff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:38.985855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:38.987362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:38.998426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-feeb6517-0230-4606-b819-3433ee4eff04 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:38.999640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-feeb6517-0230-4606-b819-3433ee4eff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.015040 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:39.016062 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1042/2063] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:39.017182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb6517-0230-4606-b819-3433ee4eff04 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.031309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb6517-0230-4606-b819-3433ee4eff04 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.038743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.040486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.040952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.041764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] PATH_INFO: `/v3/projects/98b3966cd7fc470aba6ffc908ba0d0a0/users/eae3e2938ac0455ab56efd47fc7521f3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.060120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b3966cd7fc470aba6ffc908ba0d0a0, user_id=eae3e2938ac0455ab56efd47fc7521f3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.062926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.066187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67328b80-3821-4da5-8634-bd740f6e41cd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.071377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8095f59a9934405b6b467180a1bc7fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3903ce1482364d0386f57e1da769d787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.072031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.072320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.072601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] PATH_INFO: `/v3/projects/376ff1248cd54ba58a86f8946181a447` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.073738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorizing `identity:get_project(project_id=376ff1248cd54ba58a86f8946181a447)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.075911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.077654 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1022/2064] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:13:38 2022] GET /identity/v3/projects/376ff1248cd54ba58a86f8946181a447 => generated 395 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:13:39.078459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.080126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.140659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd39c1-75e4-483d-bd2b-bfedd7d6488f tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.144607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6373864-bc00-49a4-8a03-b9a6f079d09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.147187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6373864-bc00-49a4-8a03-b9a6f079d09b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.147465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6373864-bc00-49a4-8a03-b9a6f079d09b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.147736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6373864-bc00-49a4-8a03-b9a6f079d09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.164067 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1043/2065] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:39 2022] PUT /identity/v3/projects/98b3966cd7fc470aba6ffc908ba0d0a0/users/eae3e2938ac0455ab56efd47fc7521f3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:39.165381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6373864-bc00-49a4-8a03-b9a6f079d09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.165381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6373864-bc00-49a4-8a03-b9a6f079d09b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.166872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.176969 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1023/2066] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:39.194220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40bf6-f30e-49f6-9d5c-51df1f8f5d4a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.194626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40bf6-f30e-49f6-9d5c-51df1f8f5d4a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.194965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40bf6-f30e-49f6-9d5c-51df1f8f5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.241158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-65c40bf6-f30e-49f6-9d5c-51df1f8f5d4a None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:39.243266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-65c40bf6-f30e-49f6-9d5c-51df1f8f5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.273745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769eb7a-7b9a-4f28-b33d-d525e9f7ec72 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.280970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.281293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.281566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.281885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.282629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.284148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.295701 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1044/2067] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:39.299878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.299878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.311995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7e187-62ea-4c7e-bf59-3381cfc83160 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.316783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.317423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.317698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.318005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] PATH_INFO: `/v3/projects/c70be8e55d2a4b1ba14c7fd7848f605d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.320190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70be8e55d2a4b1ba14c7fd7848f605d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.322566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.323543 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1024/2068] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:39.324269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40bf6-f30e-49f6-9d5c-51df1f8f5d4a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.347019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40bf6-f30e-49f6-9d5c-51df1f8f5d4a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.355207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.355891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.356173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.356564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] PATH_INFO: `/v3/projects/98b3966cd7fc470aba6ffc908ba0d0a0/users/eae3e2938ac0455ab56efd47fc7521f3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.358512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b3966cd7fc470aba6ffc908ba0d0a0, user_id=eae3e2938ac0455ab56efd47fc7521f3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.361217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.372378 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1025/2069] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:39 2022] PUT /identity/v3/projects/98b3966cd7fc470aba6ffc908ba0d0a0/users/eae3e2938ac0455ab56efd47fc7521f3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:39.373269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.447902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd3372-7909-463e-af46-7b32add70f8b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.452138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70be8e55d2a4b1ba14c7fd7848f605d', 'request_id': 'req-b46fa75d-889e-4fe8-914b-f2823403e9ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.461375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70be8e55d2a4b1ba14c7fd7848f605d', 'request_id': 'req-b46fa75d-889e-4fe8-914b-f2823403e9ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.502261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c1bc1-a333-43a2-9c48-8b536aa0cf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.502871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c1bc1-a333-43a2-9c48-8b536aa0cf52 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.503149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c1bc1-a333-43a2-9c48-8b536aa0cf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.503420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c1bc1-a333-43a2-9c48-8b536aa0cf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.512562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c1bc1-a333-43a2-9c48-8b536aa0cf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.514085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c1bc1-a333-43a2-9c48-8b536aa0cf52 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.522429 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1026/2070] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:39.523714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ac9b-45bf-4e3e-a120-c56391594de6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.523950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ac9b-45bf-4e3e-a120-c56391594de6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.524221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ac9b-45bf-4e3e-a120-c56391594de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.529137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70be8e55d2a4b1ba14c7fd7848f605d', 'request_id': 'req-b46fa75d-889e-4fe8-914b-f2823403e9ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.543304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] The token cache is being invalidate because project c70be8e55d2a4b1ba14c7fd7848f605d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:39.543604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.544288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.545893 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1045/2071] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:39 2022] DELETE /identity/v3/projects/c70be8e55d2a4b1ba14c7fd7848f605d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:39.546662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.547937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.562306 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:39.564325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-38b0ac9b-45bf-4e3e-a120-c56391594de6 None None] MFA Rules not processed for user `eae3e2938ac0455ab56efd47fc7521f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:39.565924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-38b0ac9b-45bf-4e3e-a120-c56391594de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.623015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fa75d-889e-4fe8-914b-f2823403e9ab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.628570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.629225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.629519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.629836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] PATH_INFO: `/v3/projects/9948a8cd6d5845a393f76d12303d3f7c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.631694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9948a8cd6d5845a393f76d12303d3f7c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.633599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.651630 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:39.658565 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1027/2072] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:39.659861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e4307-676d-4c2c-850a-e7d624730296 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.660093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e4307-676d-4c2c-850a-e7d624730296 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.660641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e4307-676d-4c2c-850a-e7d624730296 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.662042 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1028/2073] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:39.663277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.663738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.664020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.687234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:39.688533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.697903 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1029/2074] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:39.698789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:13:39.700316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.752300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9948a8cd6d5845a393f76d12303d3f7c', 'request_id': 'req-c751460c-d777-4f16-8aaf-43784a0ffbdd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.759774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9948a8cd6d5845a393f76d12303d3f7c', 'request_id': 'req-c751460c-d777-4f16-8aaf-43784a0ffbdd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.784605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.786175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.837687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9948a8cd6d5845a393f76d12303d3f7c', 'request_id': 'req-c751460c-d777-4f16-8aaf-43784a0ffbdd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.848959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] The token cache is being invalidate because project 9948a8cd6d5845a393f76d12303d3f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:39.849250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.850518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c751460c-d777-4f16-8aaf-43784a0ffbdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:39.855422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1046/2075] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:39 2022] DELETE /identity/v3/projects/9948a8cd6d5845a393f76d12303d3f7c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:39.855422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610147d-e0c5-417f-b815-6fc298a20b62 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.855422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610147d-e0c5-417f-b815-6fc298a20b62 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.855422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610147d-e0c5-417f-b815-6fc298a20b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.861510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37fb8-5125-4b47-bb43-cec76b26a7ed None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.874360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1610147d-e0c5-417f-b815-6fc298a20b62 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:39.875612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1610147d-e0c5-417f-b815-6fc298a20b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.885852 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:39.918641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d9869-1255-4bff-9e52-079c0058e726 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8095f59a9934405b6b467180a1bc7fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3903ce1482364d0386f57e1da769d787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.918641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d9869-1255-4bff-9e52-079c0058e726 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.919299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d9869-1255-4bff-9e52-079c0058e726 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.919299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d9869-1255-4bff-9e52-079c0058e726 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] PATH_INFO: `/v3/projects/376ff1248cd54ba58a86f8946181a447` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.920275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d9869-1255-4bff-9e52-079c0058e726 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorizing `identity:get_project(project_id=376ff1248cd54ba58a86f8946181a447)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.922405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d9869-1255-4bff-9e52-079c0058e726 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.924258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1030/2076] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:13:39 2022] GET /identity/v3/projects/376ff1248cd54ba58a86f8946181a447 => generated 395 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:39.925242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd2ec-66f0-4182-853b-b49f65c4873e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.925590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd2ec-66f0-4182-853b-b49f65c4873e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.925887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd2ec-66f0-4182-853b-b49f65c4873e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.940810 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1047/2077] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:39.945564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610147d-e0c5-417f-b815-6fc298a20b62 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.946858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7d5dd2ec-66f0-4182-853b-b49f65c4873e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:39.948129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d5dd2ec-66f0-4182-853b-b49f65c4873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.956405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610147d-e0c5-417f-b815-6fc298a20b62 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.964949 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1031/2078] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:39.966637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dcb2d-e146-41c7-9ddd-6c706e758ee5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.966917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dcb2d-e146-41c7-9ddd-6c706e758ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.967190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dcb2d-e146-41c7-9ddd-6c706e758ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.970478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.976091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.976091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.976091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.976091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:39.976091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.976091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.991370 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1048/2079] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:13:39.991599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f30dcb2d-e146-41c7-9ddd-6c706e758ee5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:39.991599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f30dcb2d-e146-41c7-9ddd-6c706e758ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.992925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.008255 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1032/2080] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:40.008346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c285fc-7721-4e50-9280-72ce62c0212a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.008988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dcb2d-e146-41c7-9ddd-6c706e758ee5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.014718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.015335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.015496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.015826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.016636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.018462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.019277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dcb2d-e146-41c7-9ddd-6c706e758ee5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.025696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.025696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.025696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.025696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.026500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:40.026866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.028564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.042642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1033/2081] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:40.050892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.061296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac1c50-3aa5-41d4-816b-762725b0f4e6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.066018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.069260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.069260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.069260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.069260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.070282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.184068 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1049/2082] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:39 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:13:40.185261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.218301 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1034/2083] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:40 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:13:40.218301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.220224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:40.268290 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:40.273841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708f678-e720-4bd0-acc1-d1bac20f0c09 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.310034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5c9b-fdee-4ffd-b2ec-70afed19d571 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.316504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.317284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.317449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.317686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.320831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:40.339530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.340145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.340427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.340708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.341350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.343360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.391081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.392609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.402347 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1035/2084] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:40.403001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.413531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16a9c3-3a3d-45f6-b0ba-7d5d3bc5f028 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.426463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.427083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.427388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.427634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.428979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.430995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.486888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1050/2085] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:40 2022] POST /identity/v3/users => generated 302 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:13:40.488321 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:40.496046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.513220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8515b2-7aff-4b77-9f1c-2c597b5585cf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.518584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.519206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.519489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.519959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.521326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.523168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.535983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1051/2086] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:40.539390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.550595 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1036/2087] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:40 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:40.554186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.556564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018c718-d087-4463-a909-5a84a1beed86 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.562009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.562626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.562904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.563177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.563992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.566705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d4f4c-011b-4b16-81b0-4ec5e5304128 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.567430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.574745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.575699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.576221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.576717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.577578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.580751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.591721 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1052/2088] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:13:40.593852 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1037/2089] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:13:40.597517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.608403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db917003-11df-4f34-b3cd-71ec1a6088f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.610194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.613160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.613894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.614161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.614437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.615074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.617530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.623221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86d97d-2b5c-4adc-a07c-39f54fc1ed8a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.629526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.629794 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1053/2090] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:40.633002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.634252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.634540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] PATH_INFO: `/v3/projects/919907f320654b2d8309ed317d593a61/users/28168bb528794be9920eb964fa37f5d8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.634772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.649247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1327fb-dce2-4ccc-8387-72d1f67c70da admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.660436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919907f320654b2d8309ed317d593a61, user_id=28168bb528794be9920eb964fa37f5d8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.660590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fd795-ceed-4b88-9af9-d1ac4880c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.660701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.660791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd795-ceed-4b88-9af9-d1ac4880c8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.660791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd795-ceed-4b88-9af9-d1ac4880c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.660791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fd795-ceed-4b88-9af9-d1ac4880c8e6 admin admin] PATH_INFO: `/v3/projects/3f8e551c837246f8b106e7978aa0c6b9/users/a4ff97cd945c428e8186c1f0c4e2566e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.675857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fd795-ceed-4b88-9af9-d1ac4880c8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8e551c837246f8b106e7978aa0c6b9, user_id=a4ff97cd945c428e8186c1f0c4e2566e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:40.681353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fd795-ceed-4b88-9af9-d1ac4880c8e6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:40.827503 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1038/2091] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:40 2022] PUT /identity/v3/projects/919907f320654b2d8309ed317d593a61/users/28168bb528794be9920eb964fa37f5d8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:40.828497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:40.877317 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1054/2092] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:40 2022] PUT /identity/v3/projects/3f8e551c837246f8b106e7978aa0c6b9/users/a4ff97cd945c428e8186c1f0c4e2566e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:40.878390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88461-bf69-47eb-abbd-da204a55e2a1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.878741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88461-bf69-47eb-abbd-da204a55e2a1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.879127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88461-bf69-47eb-abbd-da204a55e2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.913936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d523ef-5f8f-4cf4-bbc6-c32bf90b9cc6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:40.914488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4bf88461-bf69-47eb-abbd-da204a55e2a1 None None] MFA Rules not processed for user `28168bb528794be9920eb964fa37f5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:40.915799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4bf88461-bf69-47eb-abbd-da204a55e2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:40.984531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:40.985222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.985692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.986007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:40.987791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:40.990498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1055/2093] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:40.992173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e0125-4156-47fa-9255-dee1cb3674ae None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:40.992911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e0125-4156-47fa-9255-dee1cb3674ae None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:40.993631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e0125-4156-47fa-9255-dee1cb3674ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:41.026932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c93e0125-4156-47fa-9255-dee1cb3674ae None None] MFA Rules not processed for user `a4ff97cd945c428e8186c1f0c4e2566e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:41.027291 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:41.028196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c93e0125-4156-47fa-9255-dee1cb3674ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:41.081657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:41.083664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:41.096043 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1039/2094] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:41.097024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.123318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1056/2095] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:41.134961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e0125-4156-47fa-9255-dee1cb3674ae None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.214051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f7878-e12e-44cd-bcef-a8071a3895ff service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:41.220766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:41.221395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:41.221677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:41.221987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:41.222627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:41.224767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:41.230098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e0125-4156-47fa-9255-dee1cb3674ae None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:41.234027 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:41.242567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:41.244421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:41.244864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:41.246215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:41.246990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:41.249217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:41.326838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1040/2096] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:41 2022] POST /identity/v3/projects => generated 403 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:41.327760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.329458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:41.360839 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1057/2097] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:41 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:41.363272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.447696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f9c92-9fa0-4a73-971a-6784c0a4b43a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:41.469330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0d5df-d55e-4b15-bbb1-17d1034da494 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:41.475099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:41.475712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:41.475992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:41.476923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:41.477485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:41.479539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:41.511654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:41.512833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:41.512833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:41.513018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] PATH_INFO: `/v3/users/941b2e985c9f4385a20d72381424c900` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:41.514129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941b2e985c9f4385a20d72381424c900)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:41.516046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:41.643043 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1058/2098] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:41 2022] POST /identity/v3/users => generated 308 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:41.643043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.657998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f5cf1-b6a5-4adb-b2f1-ce6244159b3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:41.663197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:41.663824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:41.664773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:41.665059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:41.665920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:41.668030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:41.712958 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:41.777768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1059/2099] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:41 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:41.778722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.780641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:41.800217 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:41.815159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941b2e985c9f4385a20d72381424c900'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:41.828105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941b2e985c9f4385a20d72381424c900'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:41.835076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941b2e985c9f4385a20d72381424c900'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:41.836100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941b2e985c9f4385a20d72381424c900'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:41.858589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eeec0-b968-4306-8810-5b510572514d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:41.864749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:41.865426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:41.865642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:41.865944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:41.868434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:41.905538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941b2e985c9f4385a20d72381424c900'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:41.916691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1041/2100] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:41 2022] DELETE /identity/v3/users/941b2e985c9f4385a20d72381424c900 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:41.917914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.919481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:41.935326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:41.941004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:41.948086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1060/2101] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:41.949302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:41.951176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:41.972064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609819-aeef-4192-a0f0-93352a23963f service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:41.997092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331e8a-8361-445f-88cc-8faecd5a8972 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.002737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd563b-15b4-416c-aa7a-635d536b500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.003367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd563b-15b4-416c-aa7a-635d536b500f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.003654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd563b-15b4-416c-aa7a-635d536b500f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.005442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd563b-15b4-416c-aa7a-635d536b500f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.005442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd563b-15b4-416c-aa7a-635d536b500f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.006285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd563b-15b4-416c-aa7a-635d536b500f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.018121 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1042/2102] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:42.019346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd2a9-4610-4327-b5b6-387dfb403422 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.019644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd2a9-4610-4327-b5b6-387dfb403422 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.019917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd2a9-4610-4327-b5b6-387dfb403422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.041590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5e2fd2a9-4610-4327-b5b6-387dfb403422 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:42.042939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5e2fd2a9-4610-4327-b5b6-387dfb403422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:42.054085 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1043/2103] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:42.054085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd2a9-4610-4327-b5b6-387dfb403422 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.062862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd2a9-4610-4327-b5b6-387dfb403422 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.069921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.071278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.071919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.072045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.074464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.074601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.074698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] PATH_INFO: `/v3/projects/7531ce05aa6b4510a3d2c7acc05a0efc/users/5f0245da4877463380c68eecf83d74d6/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.074799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.074799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.075473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.077591 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:42.091125 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1061/2104] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:42.091125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.092996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:42.095958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7531ce05aa6b4510a3d2c7acc05a0efc, user_id=5f0245da4877463380c68eecf83d74d6, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.098709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.178071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21430d-eaa4-4e74-8454-3038ae487fbe admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.183212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.183828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.184108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.185849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.194072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.195555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.206106 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1062/2105] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:42.206965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.217883 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1044/2106] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:42 2022] PUT /identity/v3/projects/7531ce05aa6b4510a3d2c7acc05a0efc/users/5f0245da4877463380c68eecf83d74d6/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:42.222626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.232895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02428353-246f-4ea2-bd11-c0a18e7de7c0 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.322348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.322924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.323463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.324001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] PATH_INFO: `/v3/projects/69808dc942344347899e564543fc9dea/users/7b6ae95deee64341a8d9f6f82f96dde2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.343809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69808dc942344347899e564543fc9dea, user_id=7b6ae95deee64341a8d9f6f82f96dde2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.347040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.357995 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:42.364640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc38b5d-9f5d-4fb9-a2bd-540e0a1e6623 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.373560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5233-2674-4c75-abae-bba0ba6c654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.374372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5233-2674-4c75-abae-bba0ba6c654a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.374727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5233-2674-4c75-abae-bba0ba6c654a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.375642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5233-2674-4c75-abae-bba0ba6c654a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.376423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c5233-2674-4c75-abae-bba0ba6c654a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.378618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c5233-2674-4c75-abae-bba0ba6c654a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.395856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1045/2107] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:42.397345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fc2-4b6e-4dc8-8f83-95a08e96cfc6 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.398287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fc2-4b6e-4dc8-8f83-95a08e96cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.399225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fc2-4b6e-4dc8-8f83-95a08e96cfc6 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.400980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1046/2108] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:42.402009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fc2-4b6e-4dc8-8f83-95a08e96cfc6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.423808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fc2-4b6e-4dc8-8f83-95a08e96cfc6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.427709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1063/2109] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:42 2022] PUT /identity/v3/projects/69808dc942344347899e564543fc9dea/users/7b6ae95deee64341a8d9f6f82f96dde2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:42.427709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:13:42.430950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:42.452079 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:42.530809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.531819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.532206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.532548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] PATH_INFO: `/v3/projects/7531ce05aa6b4510a3d2c7acc05a0efc/users/5f0245da4877463380c68eecf83d74d6/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.536513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7531ce05aa6b4510a3d2c7acc05a0efc, user_id=5f0245da4877463380c68eecf83d74d6, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.539294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.558890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.560479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:42.563831 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1047/2110] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:42 2022] PUT /identity/v3/projects/7531ce05aa6b4510a3d2c7acc05a0efc/users/5f0245da4877463380c68eecf83d74d6/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:42.565089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.650740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493c759-1daf-47a8-bda0-e9323419fbc8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.655858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2dab0-354d-41ac-ab77-c3c43a3fbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.656740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2dab0-354d-41ac-ab77-c3c43a3fbaac admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.657025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2dab0-354d-41ac-ab77-c3c43a3fbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.657315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2dab0-354d-41ac-ab77-c3c43a3fbaac admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.657992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2dab0-354d-41ac-ab77-c3c43a3fbaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.659713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2dab0-354d-41ac-ab77-c3c43a3fbaac admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.673004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070da2d-7cab-4954-88a3-4c32e08a01f5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.674957 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1048/2111] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:42.676537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123da47a-3ca5-4dcb-8894-d89d32c870b0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.676868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123da47a-3ca5-4dcb-8894-d89d32c870b0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.677148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123da47a-3ca5-4dcb-8894-d89d32c870b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.722863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-123da47a-3ca5-4dcb-8894-d89d32c870b0 None None] MFA Rules not processed for user `5f0245da4877463380c68eecf83d74d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:42.722863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-123da47a-3ca5-4dcb-8894-d89d32c870b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:42.747452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8095f59a9934405b6b467180a1bc7fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3903ce1482364d0386f57e1da769d787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.748447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.749288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.749750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] PATH_INFO: `/v3/projects/376ff1248cd54ba58a86f8946181a447` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.751980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorizing `identity:get_project(project_id=376ff1248cd54ba58a86f8946181a447)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.754473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.764141 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1064/2112] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:13:42 2022] GET /identity/v3/projects/376ff1248cd54ba58a86f8946181a447 => generated 395 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:42.771225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.786972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8fd8b-ec8a-4962-a5bb-974bd1f8bc4e tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:42.792445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:42.793533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.794016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.794455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] PATH_INFO: `/v3/projects/69808dc942344347899e564543fc9dea/users/7b6ae95deee64341a8d9f6f82f96dde2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.798067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69808dc942344347899e564543fc9dea, user_id=7b6ae95deee64341a8d9f6f82f96dde2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:42.801485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:42.815904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1049/2113] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:42.817155 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1065/2114] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:42 2022] PUT /identity/v3/projects/69808dc942344347899e564543fc9dea/users/7b6ae95deee64341a8d9f6f82f96dde2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:42.828848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd16f2-9460-4756-880e-43f8ff737d13 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:42.828848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd16f2-9460-4756-880e-43f8ff737d13 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:42.828848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd16f2-9460-4756-880e-43f8ff737d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:42.859850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:42.864546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:42.876536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-81dd16f2-9460-4756-880e-43f8ff737d13 None None] MFA Rules not processed for user `7b6ae95deee64341a8d9f6f82f96dde2`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:42.878058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-81dd16f2-9460-4756-880e-43f8ff737d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:42.965305 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:43.004446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35748b2-2d71-4fb5-9515-8ca40123e172 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:43.012845 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1050/2115] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:43.013425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:43.013554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd16f2-9460-4756-880e-43f8ff737d13 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:43.013652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.013979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.014257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] PATH_INFO: `/v3/projects/240c39c7f0884642a2fe1b9f8922bf43` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.015425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=240c39c7f0884642a2fe1b9f8922bf43)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:43.017641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:43.090843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd16f2-9460-4756-880e-43f8ff737d13 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:43.097253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:43.097917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.098204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.098541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.158358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240c39c7f0884642a2fe1b9f8922bf43', 'request_id': 'req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.167263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240c39c7f0884642a2fe1b9f8922bf43', 'request_id': 'req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.216031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:43.217887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:43.228557 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1051/2116] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:43.229454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:43.231076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.239280 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:43.251070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fe620-9587-4c75-9945-f2da94cbba2b service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:43.261654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240c39c7f0884642a2fe1b9f8922bf43', 'request_id': 'req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.275503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] The token cache is being invalidate because project 240c39c7f0884642a2fe1b9f8922bf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:43.275797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.276477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.278336 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1066/2117] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:42 2022] DELETE /identity/v3/projects/240c39c7f0884642a2fe1b9f8922bf43 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:43.282221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:43.283647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.339171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb212fa-d0c1-4d24-9411-f84e38751f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:43.340877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb212fa-d0c1-4d24-9411-f84e38751f64 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.341246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb212fa-d0c1-4d24-9411-f84e38751f64 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.341955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb212fa-d0c1-4d24-9411-f84e38751f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.346414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fbb212fa-d0c1-4d24-9411-f84e38751f64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.375136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff2c7d-9489-4d6e-a00d-0c5f73c07e29 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:43.380284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:43.384372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.384372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.384372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] PATH_INFO: `/v3/users/eae3e2938ac0455ab56efd47fc7521f3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.384372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae3e2938ac0455ab56efd47fc7521f3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:43.385430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:43.431824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb212fa-d0c1-4d24-9411-f84e38751f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:43.436298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb212fa-d0c1-4d24-9411-f84e38751f64 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:43.448365 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1052/2118] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:43.450082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72890b-3599-4549-bd03-721d882e908b None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.450362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72890b-3599-4549-bd03-721d882e908b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.450648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72890b-3599-4549-bd03-721d882e908b None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.451983 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1053/2119] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:43.458020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72890b-3599-4549-bd03-721d882e908b None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:13:43.462923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ba72890b-3599-4549-bd03-721d882e908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.488042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72890b-3599-4549-bd03-721d882e908b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:43.489528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ba72890b-3599-4549-bd03-721d882e908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.590691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72890b-3599-4549-bd03-721d882e908b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:43.596360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8095f59a9934405b6b467180a1bc7fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3903ce1482364d0386f57e1da769d787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:43.597077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.597493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.597891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] PATH_INFO: `/v3/projects/376ff1248cd54ba58a86f8946181a447` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.598536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae3e2938ac0455ab56efd47fc7521f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.599167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorizing `identity:get_project(project_id=376ff1248cd54ba58a86f8946181a447)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:43.599442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae3e2938ac0455ab56efd47fc7521f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.601477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:43.603951 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1054/2120] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:13:43 2022] GET /identity/v3/projects/376ff1248cd54ba58a86f8946181a447 => generated 395 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:43.605007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:43.608690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.636286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1e255-cc13-4ea4-96b9-03e1094d3e65 tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:43.642741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:43.643528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.643908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.644294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.646309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.706107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae3e2938ac0455ab56efd47fc7521f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.710815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:43.712778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:43.715025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae3e2938ac0455ab56efd47fc7521f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.719753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3ee32a00-4c85-44e3-a207-dd267d517999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae3e2938ac0455ab56efd47fc7521f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:43.723538 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1055/2121] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:43.749669 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1067/2122] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:43 2022] DELETE /identity/v3/users/eae3e2938ac0455ab56efd47fc7521f3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:43.901951 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:43.981228 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:44.359813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:44.372409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3870b-a4cb-4c0a-8ef7-e089df232710 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:44.377398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:44.377934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:44.378310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:44.380286 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1068/2123] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:13:44.387742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:13:44.389676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:44.489131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:44.496506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:44.496506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:44.496506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] PATH_INFO: `/v3/projects/98b3966cd7fc470aba6ffc908ba0d0a0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:44.496506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b3966cd7fc470aba6ffc908ba0d0a0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:44.496506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:44.505636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:44.507014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:44.579657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cd987-e6ee-47c6-8a71-e7975c95c21c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:44.584546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8095f59a9934405b6b467180a1bc7fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3903ce1482364d0386f57e1da769d787', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:44.585213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:44.585494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:44.585773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] PATH_INFO: `/v3/projects/dd94cc1266b34c279f6396a2c1dd0aa7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:44.587550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd94cc1266b34c279f6396a2c1dd0aa7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:44.589619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:44.591379 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1069/2124] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:13:44 2022] GET /identity/v3/projects/dd94cc1266b34c279f6396a2c1dd0aa7 => generated 393 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:13:44.651469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b3966cd7fc470aba6ffc908ba0d0a0', 'request_id': 'req-776e7110-2517-496c-abc4-54628cf56aaf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:44.658875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b3966cd7fc470aba6ffc908ba0d0a0', 'request_id': 'req-776e7110-2517-496c-abc4-54628cf56aaf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:44.735856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b3966cd7fc470aba6ffc908ba0d0a0', 'request_id': 'req-776e7110-2517-496c-abc4-54628cf56aaf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:44.747963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] The token cache is being invalidate because project 98b3966cd7fc470aba6ffc908ba0d0a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:44.748194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:44.748840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-776e7110-2517-496c-abc4-54628cf56aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:44.752919 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1056/2125] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:44 2022] DELETE /identity/v3/projects/98b3966cd7fc470aba6ffc908ba0d0a0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:44.757303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:44.758642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:44.758919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:44.759258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:44.759800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:44.776457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7d84a-aa55-40a4-8401-2c05b2e2540c tempest-FlavorsAccessNegativeTestJSON-421561570 tempest-FlavorsAccessNegativeTestJSON-421561570-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:44.779926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:44.781142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:44.811763 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:44.859112 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1057/2126] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:44.859112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:44.859112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:44.860313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:44.861210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:44.861667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:44.862144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] PATH_INFO: `/v3/users/28168bb528794be9920eb964fa37f5d8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:44.863696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28168bb528794be9920eb964fa37f5d8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:44.867172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:44.868606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d883-a38a-4138-b339-bb70f90cb0ae None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:44.873630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:44.874304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:44.874805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:44.875085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] PATH_INFO: `/v3/users/e856d14e980d4a92909b3f6b3d330175` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:44.876289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e856d14e980d4a92909b3f6b3d330175)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:44.878355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:45.101114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28168bb528794be9920eb964fa37f5d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.105569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28168bb528794be9920eb964fa37f5d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.124124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e856d14e980d4a92909b3f6b3d330175'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.154671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e856d14e980d4a92909b3f6b3d330175'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.169268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e856d14e980d4a92909b3f6b3d330175'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.170391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e856d14e980d4a92909b3f6b3d330175'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.234698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28168bb528794be9920eb964fa37f5d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.251215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28168bb528794be9920eb964fa37f5d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.252127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d84e583-187a-48ec-8d63-7a1b3aa79110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28168bb528794be9920eb964fa37f5d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.277190 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1070/2127] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:44 2022] DELETE /identity/v3/users/28168bb528794be9920eb964fa37f5d8 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:45.279139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf082-e949-4c5d-9815-5ca7579f4060 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.279639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf082-e949-4c5d-9815-5ca7579f4060 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.280351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf082-e949-4c5d-9815-5ca7579f4060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.307204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ea1bf082-e949-4c5d-9815-5ca7579f4060 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:45.308510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ea1bf082-e949-4c5d-9815-5ca7579f4060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:45.358114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d45ab848-6cae-4cdb-80d1-b4a3b0227a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e856d14e980d4a92909b3f6b3d330175'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:45.366878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1058/2128] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:44 2022] DELETE /identity/v3/users/e856d14e980d4a92909b3f6b3d330175 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:45.369291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.369868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.370490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.396292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:45.398146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:45.398287 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1071/2129] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:45.400355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33eab0-ea17-470d-93c7-c0b18f4b40e5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.400648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33eab0-ea17-470d-93c7-c0b18f4b40e5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.400989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33eab0-ea17-470d-93c7-c0b18f4b40e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.428541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7e33eab0-ea17-470d-93c7-c0b18f4b40e5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:45.431403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7e33eab0-ea17-470d-93c7-c0b18f4b40e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:45.486298 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:45.532357 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:45.541787 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1072/2130] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:45.542830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33eab0-ea17-470d-93c7-c0b18f4b40e5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:45.558132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33eab0-ea17-470d-93c7-c0b18f4b40e5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:45.568136 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1059/2131] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:45.569034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:45.571571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:45.578811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:45.580343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.580666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.580989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.582072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:45.582377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:45.584017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:45.607487 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1073/2132] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:45.608377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:45.610286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:45.687568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803555-8344-4892-8eea-157b23501843 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:45.692114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:45.692933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.693193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.693462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.695647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b410be-f7a6-4f73-bc3b-117767334797 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:45.704832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:45.706946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:45.707233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:45.708032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.708466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.708910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.721761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:45.723641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:45.746302 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1074/2133] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:45.747530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:45.752213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1060/2134] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:45.753129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:45.755170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:45.766731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fedc1-31f2-4e72-93f4-e87f3c81c7cf service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:45.774426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:45.775725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.776606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.777072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.777929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:45.782933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:45.879164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11682a-86d9-4fc4-a8c8-7ae1adaea16c service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:45.886223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:45.887287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:45.887287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:45.887525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:45.890341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:45.933017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1075/2135] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:45 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:45.934267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:45.963027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:45.965060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:45.976512 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1061/2136] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:46.052095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c516f1d-0bfc-4892-92d9-80bd2d27dc29 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:46.060180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:46.061046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.061456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.061858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.062697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:46.065977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:46.174918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1076/2137] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:45 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:46.179735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:46.206215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70128f7-977a-4cb1-8e9a-ea99e297730c service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:46.219740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:46.220381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.220641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.221192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.222135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:46.224126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:46.240892 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1062/2138] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:13:46.245276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:46.256397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db94a2-26e2-4e94-94a1-dd8c016b61d9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:46.261637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:46.262379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.262662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.262942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.263599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:46.265197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:46.278306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1077/2139] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:46.286554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:46.315583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f48d81-210d-47f3-b987-dd05d73a5ab5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:46.322965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:46.325399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.325741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.329882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] PATH_INFO: `/v3/projects/f40e5d79873a4c11ae76b5cbb805178f/users/06982dfc91b943a193c47af05babf4cf/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.370137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40e5d79873a4c11ae76b5cbb805178f, user_id=06982dfc91b943a193c47af05babf4cf, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:46.373608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:46.413247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:46.423863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:46.433775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ba605-e908-4842-b1f4-03df5fd2b163 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:46.439680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:46.440460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.440841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.441361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] PATH_INFO: `/v3/projects/919907f320654b2d8309ed317d593a61` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.443831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=919907f320654b2d8309ed317d593a61)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:46.447295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:46.508162 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1063/2140] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:46 2022] PUT /identity/v3/projects/f40e5d79873a4c11ae76b5cbb805178f/users/06982dfc91b943a193c47af05babf4cf/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:46.510636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:46.513568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:46.576484 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:46.598848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919907f320654b2d8309ed317d593a61', 'request_id': 'req-e960fbc7-9975-4770-ba81-6300559e3e6e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:46.607851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919907f320654b2d8309ed317d593a61', 'request_id': 'req-e960fbc7-9975-4770-ba81-6300559e3e6e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:46.630839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dc29d-c505-471b-b4f4-9cae5454b7b4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:46.662096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919907f320654b2d8309ed317d593a61', 'request_id': 'req-e960fbc7-9975-4770-ba81-6300559e3e6e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:46.675853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] The token cache is being invalidate because project 919907f320654b2d8309ed317d593a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:46.686747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:46.686747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e960fbc7-9975-4770-ba81-6300559e3e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:46.686747 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1078/2141] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:46 2022] DELETE /identity/v3/projects/919907f320654b2d8309ed317d593a61 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:46.686747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.686747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.686747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.702591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:46.703699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:46.715771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:46.716409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.716691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.716972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] PATH_INFO: `/v3/projects/376ff1248cd54ba58a86f8946181a447` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.720632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376ff1248cd54ba58a86f8946181a447)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:46.722580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:46.774636 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1079/2142] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:46.775122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:46.776546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:46.797101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c556-8e1b-4d72-ade1-68daae2a27cd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:46.802999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:46.803641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:46.803920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:46.804196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] PATH_INFO: `/v3/users/05f818f18a30419d8ed94d42b7ba3771` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:46.806314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f818f18a30419d8ed94d42b7ba3771)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:46.808354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:46.848251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376ff1248cd54ba58a86f8946181a447', 'request_id': 'req-b611bf91-f2a0-4c6a-9407-154db08d3e19'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:46.862924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376ff1248cd54ba58a86f8946181a447', 'request_id': 'req-b611bf91-f2a0-4c6a-9407-154db08d3e19'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:46.987699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376ff1248cd54ba58a86f8946181a447', 'request_id': 'req-b611bf91-f2a0-4c6a-9407-154db08d3e19'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.002126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] The token cache is being invalidate because project 376ff1248cd54ba58a86f8946181a447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:47.002422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.002622 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:47.003588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.005318 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1064/2143] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:46 2022] DELETE /identity/v3/projects/376ff1248cd54ba58a86f8946181a447 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:47.009390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:47.010917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:47.016845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f818f18a30419d8ed94d42b7ba3771'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.017658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f818f18a30419d8ed94d42b7ba3771'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.085138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611bf91-f2a0-4c6a-9407-154db08d3e19 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:47.090339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:47.091143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:47.091496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:47.091864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] PATH_INFO: `/v3/users/5f0245da4877463380c68eecf83d74d6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:47.093141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0245da4877463380c68eecf83d74d6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:47.095274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:47.102763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f818f18a30419d8ed94d42b7ba3771'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.115165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f818f18a30419d8ed94d42b7ba3771'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.116126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f818f18a30419d8ed94d42b7ba3771'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.125212 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:47.136843 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1080/2144] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:46 2022] DELETE /identity/v3/users/05f818f18a30419d8ed94d42b7ba3771 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:47.137665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:47.139025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:47.198858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2445-b2c7-43b0-910c-0bd6f70b9fe0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:47.202500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:47.203132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:47.205408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:47.207616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:47.212898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:47.292518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0245da4877463380c68eecf83d74d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.293990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:47.297296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:47.306974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0245da4877463380c68eecf83d74d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.308463 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1081/2145] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:47.309582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:47.311102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:47.324581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dacca-ea34-4bb4-a41c-552fc1902b47 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:47.331763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:47.333088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:47.333471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:47.333869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] PATH_INFO: `/v3/users/f8095f59a9934405b6b467180a1bc7fa` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:47.336810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8095f59a9934405b6b467180a1bc7fa)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:47.339325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:47.345981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0245da4877463380c68eecf83d74d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.348959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0245da4877463380c68eecf83d74d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.409460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc2e7b42-52d3-439b-98dd-d9525908dc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0245da4877463380c68eecf83d74d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.416493 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1065/2146] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:47 2022] DELETE /identity/v3/users/5f0245da4877463380c68eecf83d74d6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:47.417886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:47.418179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:47.422875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:47.444878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:47.446311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:47.518219 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1066/2147] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:47.530083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:47.533118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:47.570430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8095f59a9934405b6b467180a1bc7fa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.572797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8095f59a9934405b6b467180a1bc7fa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.605682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2d13-4277-4efb-a2b9-ae54b74dcc5c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:47.609729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:47.610374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:47.613168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:47.613168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:47.621713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:47.623283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:47.633301 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1067/2148] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:47.655495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8095f59a9934405b6b467180a1bc7fa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.666784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8095f59a9934405b6b467180a1bc7fa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.667726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8095f59a9934405b6b467180a1bc7fa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:47.705840 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1082/2149] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:47 2022] DELETE /identity/v3/users/f8095f59a9934405b6b467180a1bc7fa => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:47.967109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:47.968623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:47.994276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8af9b-fc31-436c-b728-512378000967 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:48.069104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:48.070038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:48.070475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:48.070904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] PATH_INFO: `/v3/users/a4ff97cd945c428e8186c1f0c4e2566e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:48.073640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ff97cd945c428e8186c1f0c4e2566e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:48.076059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:48.174287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:48.175786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:48.192796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65594f9e-663c-4868-86f4-881c803703dd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:48.208205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:48.211544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:48.211999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:48.212414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] PATH_INFO: `/v3/projects/3903ce1482364d0386f57e1da769d787` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:48.214624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3903ce1482364d0386f57e1da769d787)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:48.216840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:48.319373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ff97cd945c428e8186c1f0c4e2566e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.333586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ff97cd945c428e8186c1f0c4e2566e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.341376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ff97cd945c428e8186c1f0c4e2566e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.342276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ff97cd945c428e8186c1f0c4e2566e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.391589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3903ce1482364d0386f57e1da769d787', 'request_id': 'req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.398214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3903ce1482364d0386f57e1da769d787', 'request_id': 'req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.474183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ff97cd945c428e8186c1f0c4e2566e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.481530 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1068/2150] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:47 2022] DELETE /identity/v3/users/a4ff97cd945c428e8186c1f0c4e2566e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:48.482571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:48.487347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:48.552070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3903ce1482364d0386f57e1da769d787', 'request_id': 'req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.559998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c558c-87e4-40b9-ad99-4e6ec010e4bf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:48.564875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:48.565062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] The token cache is being invalidate because project 3903ce1482364d0386f57e1da769d787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:48.565221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.565517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:48.565795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:48.566099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] PATH_INFO: `/v3/projects/cf86edb216d046ac938f57e420f22ff2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:48.566333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.567216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf86edb216d046ac938f57e420f22ff2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:48.568461 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1083/2151] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:48 2022] DELETE /identity/v3/projects/3903ce1482364d0386f57e1da769d787 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:48.569410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:48.569701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:48.572208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:48.641733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9e70c-7b2b-43dc-a5a9-bee3d7fdb4f6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:48.647048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:48.647687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:48.647971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:48.648574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] PATH_INFO: `/v3/projects/7531ce05aa6b4510a3d2c7acc05a0efc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:48.650410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7531ce05aa6b4510a3d2c7acc05a0efc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:48.652364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:48.696051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf86edb216d046ac938f57e420f22ff2', 'request_id': 'req-3484acbf-3b91-4d44-b172-c7dbbb15007f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.701707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf86edb216d046ac938f57e420f22ff2', 'request_id': 'req-3484acbf-3b91-4d44-b172-c7dbbb15007f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.764747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf86edb216d046ac938f57e420f22ff2', 'request_id': 'req-3484acbf-3b91-4d44-b172-c7dbbb15007f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.771008 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:48.778131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] The token cache is being invalidate because project cf86edb216d046ac938f57e420f22ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:48.778428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.779182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3484acbf-3b91-4d44-b172-c7dbbb15007f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.780614 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1069/2152] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:48 2022] DELETE /identity/v3/projects/cf86edb216d046ac938f57e420f22ff2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:48.781827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:48.782380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:48.782662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:48.790898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7531ce05aa6b4510a3d2c7acc05a0efc', 'request_id': 'req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.797582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7531ce05aa6b4510a3d2c7acc05a0efc', 'request_id': 'req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.803416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:48.804884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:48.865799 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1070/2153] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:48.866609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:48.868677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:48.879224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7531ce05aa6b4510a3d2c7acc05a0efc', 'request_id': 'req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.880609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025440-ac40-4e7d-bb80-b1ffb8f65db8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:48.886718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:48.887973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:48.887973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:48.887973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] PATH_INFO: `/v3/users/f4a4658e56bd49568a3075ca36a9f9ae` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:48.889442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a4658e56bd49568a3075ca36a9f9ae)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:48.891126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:48.900709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] The token cache is being invalidate because project 7531ce05aa6b4510a3d2c7acc05a0efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:48.901209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.904938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:48.908318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1084/2154] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:48 2022] DELETE /identity/v3/projects/7531ce05aa6b4510a3d2c7acc05a0efc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:48.909297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:48.912432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:48.934798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2dbf-5a1e-44a4-9905-7bafd3e7324a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:48.940820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:48.941685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:48.942006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:48.942277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] PATH_INFO: `/v3/users/fa6d75337cc64c1e9536896342fd0b7c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:48.944086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6d75337cc64c1e9536896342fd0b7c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:48.946227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:48.954269 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:49.124020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a4658e56bd49568a3075ca36a9f9ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.142983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a4658e56bd49568a3075ca36a9f9ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.152369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a4658e56bd49568a3075ca36a9f9ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.153514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a4658e56bd49568a3075ca36a9f9ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.205046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6d75337cc64c1e9536896342fd0b7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.205954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6d75337cc64c1e9536896342fd0b7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.217147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a4658e56bd49568a3075ca36a9f9ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.224434 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1071/2155] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:48 2022] DELETE /identity/v3/users/f4a4658e56bd49568a3075ca36a9f9ae => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:49.225536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:49.227020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:49.300709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478ab7c-cf60-45f8-a524-0983c49cf989 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:49.304911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b7eac-db7c-41b9-b092-57986ba99a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:49.305539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7eac-db7c-41b9-b092-57986ba99a42 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:49.306736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7eac-db7c-41b9-b092-57986ba99a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:49.307230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7eac-db7c-41b9-b092-57986ba99a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:49.309209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b6b7eac-db7c-41b9-b092-57986ba99a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:49.331565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6d75337cc64c1e9536896342fd0b7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.347866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6d75337cc64c1e9536896342fd0b7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.350764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0e075bd5-23e2-4efa-becd-41a3c15bccef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6d75337cc64c1e9536896342fd0b7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:49.381103 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1085/2156] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:48 2022] DELETE /identity/v3/users/fa6d75337cc64c1e9536896342fd0b7c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:49.383625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739b204-c048-4e1d-acbe-21abf641aee5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:49.384954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739b204-c048-4e1d-acbe-21abf641aee5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:49.385270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739b204-c048-4e1d-acbe-21abf641aee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:49.411728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1739b204-c048-4e1d-acbe-21abf641aee5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:49.413202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1739b204-c048-4e1d-acbe-21abf641aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:49.435448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b7eac-db7c-41b9-b092-57986ba99a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:49.436939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b7eac-db7c-41b9-b092-57986ba99a42 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:49.462758 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1072/2157] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:49.511982 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1086/2158] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:49.520676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237cad-a6d1-4fd1-8e51-c8be504d165a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:49.521655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237cad-a6d1-4fd1-8e51-c8be504d165a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:49.522107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11237cad-a6d1-4fd1-8e51-c8be504d165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:49.549134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-11237cad-a6d1-4fd1-8e51-c8be504d165a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:49.550347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-11237cad-a6d1-4fd1-8e51-c8be504d165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:49.565342 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1073/2159] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:49.566429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739b204-c048-4e1d-acbe-21abf641aee5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:49.582774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739b204-c048-4e1d-acbe-21abf641aee5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:49.601400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:49.605791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:49.608260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:49.609188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:49.610851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:49.612313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:49.623832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:49.673697 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1087/2160] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:49.677612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237cad-a6d1-4fd1-8e51-c8be504d165a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:49.691478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11237cad-a6d1-4fd1-8e51-c8be504d165a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:49.697313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:49.698218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:49.698645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:49.698941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:49.699582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:49.701561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:49.810864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1074/2161] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:49 2022] POST /identity/v3/projects => generated 395 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:13:49.814415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:49.827777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5986a-bb68-4efc-b0be-f9e36ca382e1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:49.902453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:49.903240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:49.903596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:49.903944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:49.904696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:49.906922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.033205 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1088/2162] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:49 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:50.037770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.059596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.059884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9c1a0-c8a9-400d-ae79-2196483b7ca7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.062990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:50.079063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.080391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.081374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.081374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.083180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.085293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.102350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217245f-2263-4e2e-8b36-804519e72dd1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.105139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1075/2163] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:50.108783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.109097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.109433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.109717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.111645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] PATH_INFO: `/v3/projects/dd94cc1266b34c279f6396a2c1dd0aa7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.112856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd94cc1266b34c279f6396a2c1dd0aa7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.121536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.124235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fee1e-45d8-4d95-a42d-3238661ee68e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.132746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.133389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.133665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.134856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.136015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.137222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.151783 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1076/2164] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:50.156339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.170050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510cd7b-5587-488b-b83f-1fa804763bb7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.175166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d62bdc-c865-47d2-923a-b56cb267242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.175893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d62bdc-c865-47d2-923a-b56cb267242f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.176324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d62bdc-c865-47d2-923a-b56cb267242f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.176718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d62bdc-c865-47d2-923a-b56cb267242f admin admin] PATH_INFO: `/v3/projects/4ef1181cac2c421b88448b0b7f80e5a7/users/acdc44d5fdd144a6805a4673c216ae01/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.218230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d62bdc-c865-47d2-923a-b56cb267242f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef1181cac2c421b88448b0b7f80e5a7, user_id=acdc44d5fdd144a6805a4673c216ae01, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.221106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d62bdc-c865-47d2-923a-b56cb267242f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.316861 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1077/2165] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:50 2022] PUT /identity/v3/projects/4ef1181cac2c421b88448b0b7f80e5a7/users/acdc44d5fdd144a6805a4673c216ae01/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:50.327574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd94cc1266b34c279f6396a2c1dd0aa7', 'request_id': 'req-ca28039e-4292-485a-b86f-85701dc0840e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:50.328122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.328594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.329090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.338792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd94cc1266b34c279f6396a2c1dd0aa7', 'request_id': 'req-ca28039e-4292-485a-b86f-85701dc0840e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:50.370563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] MFA Rules not processed for user `acdc44d5fdd144a6805a4673c216ae01`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:50.372368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:50.411854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd94cc1266b34c279f6396a2c1dd0aa7', 'request_id': 'req-ca28039e-4292-485a-b86f-85701dc0840e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:50.433101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] The token cache is being invalidate because project dd94cc1266b34c279f6396a2c1dd0aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:50.433589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:50.435558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca28039e-4292-485a-b86f-85701dc0840e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:50.449669 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:50.461301 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1089/2166] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:50 2022] DELETE /identity/v3/projects/dd94cc1266b34c279f6396a2c1dd0aa7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:50.463092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e02f5-827d-4140-8cd3-d10a8b981bf9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.463405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e02f5-827d-4140-8cd3-d10a8b981bf9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.463679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e02f5-827d-4140-8cd3-d10a8b981bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.492446 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1078/2167] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:50.493715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.496539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:50.502579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7c5e02f5-827d-4140-8cd3-d10a8b981bf9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:50.503945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c5e02f5-827d-4140-8cd3-d10a8b981bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:50.546360 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:50.585638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0971e-d2c3-4554-97ac-45bf84c65585 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.591860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.593162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.593450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.593756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.594439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.596361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.616335 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1090/2168] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:50.625209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.625570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.628349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.646628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:50.647872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:50.661640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1091/2169] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:50.662780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.664099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:50.677964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c40f9b-55df-4cd1-b4c0-af049bd5cfc9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.684331 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1079/2170] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:50 2022] POST /identity/v3/projects => generated 395 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:50.688818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.778453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.780794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.781360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.781905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] PATH_INFO: `/v3/projects/a9305346b98f497d9e9877c265affa39` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.783723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9305346b98f497d9e9877c265affa39)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.798520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.815677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cf7f5-9d44-46c0-9e96-6792ba517763 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.821176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.822914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.823273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.823682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.824626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:50.825067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.826723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.840467 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1080/2171] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:50.841328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.855449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47123d-dd93-45a1-8537-8c3a9ae3f52c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:50.865319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:50.866148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:50.866532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:50.867133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:50.867856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:50.870991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:50.928829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9305346b98f497d9e9877c265affa39', 'request_id': 'req-f09a1165-4b44-4fb8-a88a-6597ff73c23f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:50.938245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9305346b98f497d9e9877c265affa39', 'request_id': 'req-f09a1165-4b44-4fb8-a88a-6597ff73c23f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:50.995218 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1081/2172] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:50 2022] POST /identity/v3/users => generated 304 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:50.996567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:50.998457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.000447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9305346b98f497d9e9877c265affa39', 'request_id': 'req-f09a1165-4b44-4fb8-a88a-6597ff73c23f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.015240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38ca22-5590-40a0-89a8-0b9a3348718c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:51.018632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] The token cache is being invalidate because project a9305346b98f497d9e9877c265affa39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:51.019131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.020075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.025463 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1092/2173] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:50 2022] DELETE /identity/v3/projects/a9305346b98f497d9e9877c265affa39 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:51.029840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:51.029840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.112915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:51.114171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.114665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.115179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] PATH_INFO: `/v3/projects/3f8e551c837246f8b106e7978aa0c6b9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.118007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8e551c837246f8b106e7978aa0c6b9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:51.120703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:51.127798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a1165-4b44-4fb8-a88a-6597ff73c23f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:51.134398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:51.135763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.136256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.136987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.137776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:51.140134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:51.265838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8e551c837246f8b106e7978aa0c6b9', 'request_id': 'req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.274272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8e551c837246f8b106e7978aa0c6b9', 'request_id': 'req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.294739 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1093/2174] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:51 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:51.296013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:51.298100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.338948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8e551c837246f8b106e7978aa0c6b9', 'request_id': 'req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.356586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] The token cache is being invalidate because project 3f8e551c837246f8b106e7978aa0c6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:51.357164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.360273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6393fd9e-7bcb-498e-85b8-b241e9c3afa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.370502 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1082/2175] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:50 2022] DELETE /identity/v3/projects/3f8e551c837246f8b106e7978aa0c6b9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:51.373928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.374946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.375416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.383184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd593eb4-5c41-4c16-a09f-f27374211078 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:51.389203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:51.390122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.396067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.396067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.396067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:51.396067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:51.406592 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1094/2176] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:51.411319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:51.414858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.426525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:51.427777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.440175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6289db7-71ea-43ec-890e-723d974728c1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:51.442297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1083/2177] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:51.443214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:51.444973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.446400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:51.447346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.447779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.448206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.449021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:51.451580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:51.465683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b65e4e-9829-4cd7-a1cb-058954e24786 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:51.471785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:51.472467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.472750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.473192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] PATH_INFO: `/v3/users/7b6ae95deee64341a8d9f6f82f96dde2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.474464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6ae95deee64341a8d9f6f82f96dde2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:51.476407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:51.621910 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1095/2178] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:51 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:51.622970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:51.624731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.638084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2ede-66d7-40c5-8c21-75e75d603146 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:51.644561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a23fe5-2b84-4059-a4e1-1767e24d3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:51.645357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a23fe5-2b84-4059-a4e1-1767e24d3869 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.645651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a23fe5-2b84-4059-a4e1-1767e24d3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.645979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a23fe5-2b84-4059-a4e1-1767e24d3869 admin admin] PATH_INFO: `/v3/projects/403158d0c92f424c8e63117aac333a73/users/c09f38def07e4fb39cd75ca08fcf657c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.668969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a23fe5-2b84-4059-a4e1-1767e24d3869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403158d0c92f424c8e63117aac333a73, user_id=c09f38def07e4fb39cd75ca08fcf657c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:51.673929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a23fe5-2b84-4059-a4e1-1767e24d3869 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:51.745622 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:51.750601 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1096/2179] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:51 2022] PUT /identity/v3/projects/403158d0c92f424c8e63117aac333a73/users/c09f38def07e4fb39cd75ca08fcf657c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:51.752026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:51.752621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:51.752894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:51.753553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6ae95deee64341a8d9f6f82f96dde2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.773854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6ae95deee64341a8d9f6f82f96dde2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.779337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:51.781755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.791160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6ae95deee64341a8d9f6f82f96dde2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.793045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6ae95deee64341a8d9f6f82f96dde2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.882535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6ae95deee64341a8d9f6f82f96dde2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:51.890645 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1097/2180] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:51.891665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:51.892995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.898764 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1084/2181] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:51 2022] DELETE /identity/v3/users/7b6ae95deee64341a8d9f6f82f96dde2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:51.899867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:51.901961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:51.908679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edec286-c95e-4ffd-a136-590fef37d26f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.027261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.028052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.031826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.032205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.034710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.036944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.057993 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1098/2182] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:52.059265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.069881 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:52.077193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f9942-c9a4-443c-ba00-57d1c571bdcb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.084547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.085412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.085792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.086231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.087038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:52.088403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.090575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.092674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739972-abd4-486d-bcb9-9d2b22ece642 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.107319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.110806 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1099/2183] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:52.110953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.110953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.111123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.111209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.111209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.111438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.123689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d3d66-cce5-4fb6-8c0d-d9a714cec4b8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.133446 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1085/2184] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:52.134954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.143679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.144140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.144140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.144140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.144140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.144140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.154080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d82653-fedc-4c9e-a1d7-aa35cf92f576 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.158567 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1100/2185] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:52.163533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.163920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e8bfb-bd58-4930-ad28-60619931fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.164849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e8bfb-bd58-4930-ad28-60619931fca8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.164985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e8bfb-bd58-4930-ad28-60619931fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.165174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e8bfb-bd58-4930-ad28-60619931fca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.167104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e8bfb-bd58-4930-ad28-60619931fca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.170408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e8bfb-bd58-4930-ad28-60619931fca8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.178641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a62c-e696-4463-9899-b4839be22cef admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.186177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.186967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.187340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.187772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] PATH_INFO: `/v3/projects/403158d0c92f424c8e63117aac333a73/users/c09f38def07e4fb39cd75ca08fcf657c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.190018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403158d0c92f424c8e63117aac333a73, user_id=c09f38def07e4fb39cd75ca08fcf657c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.193704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.206364 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1101/2186] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:52 2022] PUT /identity/v3/projects/403158d0c92f424c8e63117aac333a73/users/c09f38def07e4fb39cd75ca08fcf657c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:52.211702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.305471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685acd00-0407-47cd-a616-b6effb6da0b9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.310702 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1086/2187] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:52 2022] POST /identity/v3/projects => generated 397 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:52.310702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9e88-47a5-439d-a50a-7fab747ca711 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.311008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9e88-47a5-439d-a50a-7fab747ca711 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.311247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9e88-47a5-439d-a50a-7fab747ca711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.356595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c3ba9e88-47a5-439d-a50a-7fab747ca711 None None] MFA Rules not processed for user `c09f38def07e4fb39cd75ca08fcf657c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:52.357970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c3ba9e88-47a5-439d-a50a-7fab747ca711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:52.395194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.395878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.396161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.396436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] PATH_INFO: `/v3/projects/7b4db212b3cc49bdb4642699c8882367/users/6fd06eec7eec41fa9e4476ee37ada16d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.419903 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:52.437288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4db212b3cc49bdb4642699c8882367, user_id=6fd06eec7eec41fa9e4476ee37ada16d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.441339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.485302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1087/2188] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:52.486541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9e88-47a5-439d-a50a-7fab747ca711 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.498888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9e88-47a5-439d-a50a-7fab747ca711 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.504153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625de42-4617-4e74-a10d-af20a72b37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.509629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625de42-4617-4e74-a10d-af20a72b37be admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.509629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625de42-4617-4e74-a10d-af20a72b37be admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.509629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625de42-4617-4e74-a10d-af20a72b37be admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.509629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625de42-4617-4e74-a10d-af20a72b37be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.509629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625de42-4617-4e74-a10d-af20a72b37be admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.534302 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1102/2189] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:52 2022] PUT /identity/v3/projects/7b4db212b3cc49bdb4642699c8882367/users/6fd06eec7eec41fa9e4476ee37ada16d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:52.535214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.537368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:52.625764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a38f5-b581-4868-baa4-c6989df95f2e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.632760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.633738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.634105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.634427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.651342 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1088/2190] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:52 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:52.652673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.652961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.653242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.696990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] MFA Rules not processed for user `6fd06eec7eec41fa9e4476ee37ada16d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:52.698427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:52.715493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.717403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.731971 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1103/2191] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:52.733398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.811450 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1089/2192] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:52.812686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.814336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:52.857318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d381257-26c5-4b3b-9330-d309c331a565 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.861858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.862742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.863182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.863461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.870942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.870942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.878676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1104/2193] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:52.879543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:52.892347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4ab36-2a73-4ad5-a0ea-91cd2955ab28 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.899635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.901180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.901711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.902030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.902817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.905122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:52.912562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29db7cd-8289-4e2d-8a7f-301d88336c11 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:52.917737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:52.918632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:52.919579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:52.919579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] PATH_INFO: `/v3/projects/69808dc942344347899e564543fc9dea` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:52.920635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69808dc942344347899e564543fc9dea)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:52.922755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:53.007508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1105/2194] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:52 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:53.014792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:53.066042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69808dc942344347899e564543fc9dea', 'request_id': 'req-a65f83bb-226d-4f5e-9214-9d457874ca3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.078774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69808dc942344347899e564543fc9dea', 'request_id': 'req-a65f83bb-226d-4f5e-9214-9d457874ca3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.098210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b05f39-2c7d-4be7-9563-dbdede4727a6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:53.154934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69808dc942344347899e564543fc9dea', 'request_id': 'req-a65f83bb-226d-4f5e-9214-9d457874ca3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.174741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:53.175735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.176025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.176305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] PATH_INFO: `/v3/users/acdc44d5fdd144a6805a4673c216ae01` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.177051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] The token cache is being invalidate because project 69808dc942344347899e564543fc9dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:53.177532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.177894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdc44d5fdd144a6805a4673c216ae01)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:53.178745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.180004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:53.185623 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1090/2195] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:52 2022] DELETE /identity/v3/projects/69808dc942344347899e564543fc9dea => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:53.186879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:53.191106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.215019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f83bb-226d-4f5e-9214-9d457874ca3c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:53.220649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:53.221572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.222141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.222686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.223448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:53.225124 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:53.227864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:53.240689 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1091/2196] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:53.241622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:53.244302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.262870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56881-39be-4233-bae4-c66b0a426b01 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:53.265352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2f84-79e3-4c2b-bebf-0cb8139cdbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:53.266790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2f84-79e3-4c2b-bebf-0cb8139cdbce admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.267129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2f84-79e3-4c2b-bebf-0cb8139cdbce admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.267414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2f84-79e3-4c2b-bebf-0cb8139cdbce admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.268073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2f84-79e3-4c2b-bebf-0cb8139cdbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:53.270120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2f84-79e3-4c2b-bebf-0cb8139cdbce admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:53.336987 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:53.377859 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1092/2197] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:53 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:53.385865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251b56-c9f0-4027-8cf0-990eff041de5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.385865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251b56-c9f0-4027-8cf0-990eff041de5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.385865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251b56-c9f0-4027-8cf0-990eff041de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.392950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdc44d5fdd144a6805a4673c216ae01'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.394629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdc44d5fdd144a6805a4673c216ae01'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.418670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a8251b56-c9f0-4027-8cf0-990eff041de5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:53.421719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8251b56-c9f0-4027-8cf0-990eff041de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.446440 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1093/2198] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:53.446440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8251b56-c9f0-4027-8cf0-990eff041de5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:53.460530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8251b56-c9f0-4027-8cf0-990eff041de5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:53.465909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053ba93-9398-4daa-b9d2-fad73707e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:53.467217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ba93-9398-4daa-b9d2-fad73707e6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.467499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ba93-9398-4daa-b9d2-fad73707e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.467774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ba93-9398-4daa-b9d2-fad73707e6fc admin admin] PATH_INFO: `/v3/projects/9c206a232165457cb9a9769b57b57aed/users/8a0e8617b4d94b10b6ac4ffaf414f313/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.480313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdc44d5fdd144a6805a4673c216ae01'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.487995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053ba93-9398-4daa-b9d2-fad73707e6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c206a232165457cb9a9769b57b57aed, user_id=8a0e8617b4d94b10b6ac4ffaf414f313, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:53.490030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053ba93-9398-4daa-b9d2-fad73707e6fc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:53.499336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdc44d5fdd144a6805a4673c216ae01'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.500178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdc44d5fdd144a6805a4673c216ae01'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:53.528188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1106/2199] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:53 2022] DELETE /identity/v3/users/acdc44d5fdd144a6805a4673c216ae01 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:53.528188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:53.528188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.580821 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1094/2200] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:53 2022] PUT /identity/v3/projects/9c206a232165457cb9a9769b57b57aed/users/8a0e8617b4d94b10b6ac4ffaf414f313/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:53.582409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e1d9-8b4d-4f0c-916b-812d828a9008 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.582759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e1d9-8b4d-4f0c-916b-812d828a9008 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.583081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846e1d9-8b4d-4f0c-916b-812d828a9008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.630861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2846e1d9-8b4d-4f0c-916b-812d828a9008 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:53.632844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2846e1d9-8b4d-4f0c-916b-812d828a9008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.653458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02e044-f6d8-45fc-a583-53f3cfcae4c4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:53.717851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1095/2201] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:53.719370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99754-867a-4782-a73e-6fffbf5a7c16 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.719686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99754-867a-4782-a73e-6fffbf5a7c16 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.720005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99754-867a-4782-a73e-6fffbf5a7c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.755433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:53.755667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.755953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.756222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.757281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:53.760927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:53.768665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-94d99754-867a-4782-a73e-6fffbf5a7c16 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:53.771785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-94d99754-867a-4782-a73e-6fffbf5a7c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.784035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1096/2202] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:53.786098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16949-8237-44f9-af9f-49c7f08a0585 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.786674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16949-8237-44f9-af9f-49c7f08a0585 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.787162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16949-8237-44f9-af9f-49c7f08a0585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.811938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1107/2203] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:53.812909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:53.836637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e9e16949-8237-44f9-af9f-49c7f08a0585 None None] MFA Rules not processed for user `8a0e8617b4d94b10b6ac4ffaf414f313`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:53.837199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5933a-f07f-4353-97a0-dd0f2cfb6aa2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:53.839791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e9e16949-8237-44f9-af9f-49c7f08a0585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.850715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:53.851399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:53.851685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:53.852625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:53.855172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:53.858049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:53.858362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:53.897839 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1108/2204] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:53.899152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:53.906136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:53.920324 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:53.987615 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1097/2205] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:53.988476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16949-8237-44f9-af9f-49c7f08a0585 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.006134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16949-8237-44f9-af9f-49c7f08a0585 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.007653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe783-41ed-4eef-9ecc-041d725fc202 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.008258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.009208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.010165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.010600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] PATH_INFO: `/v3/projects/21a2776a7d774aeea45eac602b41a610/users/ba05b35269d74130ab6c8645fc777af9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.018069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.018762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.019114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.019459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.039531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.041369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.054445 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1109/2206] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:54.055329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.068207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317396a-6998-4d95-8c84-0db9703be96c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.071329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a2776a7d774aeea45eac602b41a610, user_id=ba05b35269d74130ab6c8645fc777af9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.076022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.076852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.077336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.077949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.078252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.079040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.081289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.157041 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1098/2207] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:53 2022] PUT /identity/v3/projects/21a2776a7d774aeea45eac602b41a610/users/ba05b35269d74130ab6c8645fc777af9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:54.158499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.165256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:54.219025 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1110/2208] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:54 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:54.220781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.300316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217675da-e0cf-49ad-9fc4-5034fe15edce admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.426159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af47a-5d1a-4039-b15f-377ffb02b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.430324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ff2ca-1371-4e1d-8ddc-6f0be0e9522b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.431157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af47a-5d1a-4039-b15f-377ffb02b715 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.432285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af47a-5d1a-4039-b15f-377ffb02b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.432738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af47a-5d1a-4039-b15f-377ffb02b715 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.434278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af47a-5d1a-4039-b15f-377ffb02b715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.438121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af47a-5d1a-4039-b15f-377ffb02b715 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.451967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.451967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.452184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.452305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.452957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.454692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.472040 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1111/2209] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:54.472040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.483111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aecd-a6d1-4e38-bf7f-1e967919a8b3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.489503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.490975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.491258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.491534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.492627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.494688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.573637 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1099/2210] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:54 2022] POST /identity/v3/projects => generated 399 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:54.575388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1151-2188-421d-b182-26964a0b9e4d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.575707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1151-2188-421d-b182-26964a0b9e4d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.580244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e1151-2188-421d-b182-26964a0b9e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.601212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-831e1151-2188-421d-b182-26964a0b9e4d None None] MFA Rules not processed for user `e285fefe9cb44cadaec6e58a31ef3afe`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:54.602572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-831e1151-2188-421d-b182-26964a0b9e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:54.612138 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:54.644983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1112/2211] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:54 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:54.646148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.664390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed9c48-6395-4cb5-aa09-f6c3df5464fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.700912 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1100/2212] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:54.700912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e1151-2188-421d-b182-26964a0b9e4d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.763919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.764604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.767727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.767727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] PATH_INFO: `/v3/projects/21a2776a7d774aeea45eac602b41a610/users/ba05b35269d74130ab6c8645fc777af9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.767727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a2776a7d774aeea45eac602b41a610, user_id=ba05b35269d74130ab6c8645fc777af9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.770490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.801128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e1151-2188-421d-b182-26964a0b9e4d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.806130 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1113/2213] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:54 2022] PUT /identity/v3/projects/21a2776a7d774aeea45eac602b41a610/users/ba05b35269d74130ab6c8645fc777af9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:54.807845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.890003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a59a65-363b-4e4f-a95f-bd78f8db3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.890715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59a65-363b-4e4f-a95f-bd78f8db3c58 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.891086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59a65-363b-4e4f-a95f-bd78f8db3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.891475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59a65-363b-4e4f-a95f-bd78f8db3c58 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.892415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59a65-363b-4e4f-a95f-bd78f8db3c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.894476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59a65-363b-4e4f-a95f-bd78f8db3c58 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.900222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efea1d3-6b22-45bf-a6cb-a1cb4c66736c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.907299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.908346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.908639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.911488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.911488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.911488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:54.924245 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1114/2214] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:54.925128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:54.927106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:54.949004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823448c-6e3a-495e-b005-c214169907c4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:54.953746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:54.954663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:54.954966 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:54.955125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:54.955505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] PATH_INFO: `/v3/projects/4ef1181cac2c421b88448b0b7f80e5a7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:54.956884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef1181cac2c421b88448b0b7f80e5a7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:54.959207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:55.014249 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1101/2215] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:54 2022] POST /identity/v3/users => generated 306 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:55.017350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69db9c-4a72-4b43-9361-46b0713e20b1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.019368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69db9c-4a72-4b43-9361-46b0713e20b1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.020145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69db9c-4a72-4b43-9361-46b0713e20b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.078137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8f69db9c-4a72-4b43-9361-46b0713e20b1 None None] MFA Rules not processed for user `ba05b35269d74130ab6c8645fc777af9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:55.079275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8f69db9c-4a72-4b43-9361-46b0713e20b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:55.112958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef1181cac2c421b88448b0b7f80e5a7', 'request_id': 'req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.120866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef1181cac2c421b88448b0b7f80e5a7', 'request_id': 'req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.183682 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1102/2216] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:55.185506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69db9c-4a72-4b43-9361-46b0713e20b1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:55.202351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69db9c-4a72-4b43-9361-46b0713e20b1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:55.222433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef1181cac2c421b88448b0b7f80e5a7', 'request_id': 'req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.240959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] The token cache is being invalidate because project 4ef1181cac2c421b88448b0b7f80e5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:55.241371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.242683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.246046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1115/2217] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:54 2022] DELETE /identity/v3/projects/4ef1181cac2c421b88448b0b7f80e5a7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:55.249060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:55.251858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:55.300423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:55.301278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.301696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.302275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.303064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:55.305567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:55.322390 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1103/2218] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:55.326008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:55.328470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:55.374604 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:55.387085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d492d26-6a46-4b4d-bfa1-56f7f1d15a9b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:55.407851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:55.408747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.409028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.409302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.410049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:55.411751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:55.434644 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1116/2219] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:55.438651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:55.442962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:55.447249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b7d72-73b6-416d-a63e-de5ecc7287bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:55.456043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:55.456779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.457126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.457790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.459008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeb4b5-256a-427d-b58f-1f184989ec9a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:55.460747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:55.467436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:55.468295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.468737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.469164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] PATH_INFO: `/v3/users/c09f38def07e4fb39cd75ca08fcf657c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.470824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09f38def07e4fb39cd75ca08fcf657c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:55.474137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:55.577063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:55.579410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:55.592016 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1104/2220] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:55.610494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:55.612181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:55.631732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aab7d-000e-4df1-8204-c8af0d504f26 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:55.639670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:55.641421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.646477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.646477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] PATH_INFO: `/v3/projects/b7bebae05791499b80b08a78991dd235/users/53ea7060bdd44df193d244e7d1078919/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.660571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bebae05791499b80b08a78991dd235, user_id=53ea7060bdd44df193d244e7d1078919, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:55.663942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:55.751483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09f38def07e4fb39cd75ca08fcf657c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.757641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09f38def07e4fb39cd75ca08fcf657c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.787057 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1105/2221] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:55 2022] PUT /identity/v3/projects/b7bebae05791499b80b08a78991dd235/users/53ea7060bdd44df193d244e7d1078919/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:55.788876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:55.880568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09f38def07e4fb39cd75ca08fcf657c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.892759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09f38def07e4fb39cd75ca08fcf657c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.893623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1b78a9d-1a9d-4374-9cd6-89f31246828b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09f38def07e4fb39cd75ca08fcf657c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:55.922748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44e30-8140-465a-8aef-ae558f820e2b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:55.927688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458d330-ef40-4974-91ef-82545f4bd534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:55.928786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d330-ef40-4974-91ef-82545f4bd534 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.929347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d330-ef40-4974-91ef-82545f4bd534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.930965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458d330-ef40-4974-91ef-82545f4bd534 admin admin] PATH_INFO: `/v3/projects/8a26e1b3eef04d9fb06e4bcbd44d641f/users/841c91af08884c91a2992bd9147ec924/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.940523 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1117/2222] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:55 2022] DELETE /identity/v3/users/c09f38def07e4fb39cd75ca08fcf657c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:55.941235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:55.943380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:55.943380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:55.970093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458d330-ef40-4974-91ef-82545f4bd534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a26e1b3eef04d9fb06e4bcbd44d641f, user_id=841c91af08884c91a2992bd9147ec924, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:55.970093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458d330-ef40-4974-91ef-82545f4bd534 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:55.975199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] MFA Rules not processed for user `53ea7060bdd44df193d244e7d1078919`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:55.976914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.082813 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1106/2223] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:55 2022] PUT /identity/v3/projects/8a26e1b3eef04d9fb06e4bcbd44d641f/users/841c91af08884c91a2992bd9147ec924/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:56.084700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.088188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.088188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.089626 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1118/2224] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:56.095488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.097514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.127598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] MFA Rules not processed for user `06982dfc91b943a193c47af05babf4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:56.129329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.200840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61dc10-15d3-47a5-ae60-f1adde0958d5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:56.227874 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1107/2225] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:56.235339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.237157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.300494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:56.302213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.304844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.304844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.307323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.332743 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:56.361066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ccc79-4d3c-47e0-8f16-16827f25c8fb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:56.366925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:56.367741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.368026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.368301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.369073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:56.372015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:56.376342 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:56.383815 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1108/2226] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:56.384846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.387026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.399908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:56.401289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2af1f-0ec6-4216-aa14-6ee582962633 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:56.401782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:56.406625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:56.407820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.407820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.408163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.409493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:56.411509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:56.416909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1119/2227] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:56.423514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.425272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.446400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134200a5-a4dc-4878-9068-b08d1194157e service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:56.454113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:56.454784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.455060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.455332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.466837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:56.468538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:56.480417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1120/2228] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:56.484432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.498544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f96d6-5d1d-4c20-82a1-b065e5ff4098 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:56.504906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:56.506032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.506376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.506661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] PATH_INFO: `/v3/projects/8a26e1b3eef04d9fb06e4bcbd44d641f/users/841c91af08884c91a2992bd9147ec924/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.511257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a26e1b3eef04d9fb06e4bcbd44d641f, user_id=841c91af08884c91a2992bd9147ec924, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:56.514753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:56.516646 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1109/2229] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:56 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:56.521368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.534038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1121/2230] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:56 2022] PUT /identity/v3/projects/8a26e1b3eef04d9fb06e4bcbd44d641f/users/841c91af08884c91a2992bd9147ec924/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:56.545003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.547228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.627784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e047-7e63-404e-90bf-e01a9530acfc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:56.634475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:56.635921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.635921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.635921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] PATH_INFO: `/v3/projects/403158d0c92f424c8e63117aac333a73` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.637135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403158d0c92f424c8e63117aac333a73)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:56.639131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:56.681360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe9fe-afb1-415b-b207-fd6d7cf61c26 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:56.717412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8cc4d-ed07-428c-bd0b-8997f2d3e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:56.718059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8cc4d-ed07-428c-bd0b-8997f2d3e095 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.718312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8cc4d-ed07-428c-bd0b-8997f2d3e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.718599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8cc4d-ed07-428c-bd0b-8997f2d3e095 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.719239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8cc4d-ed07-428c-bd0b-8997f2d3e095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:56.721175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8cc4d-ed07-428c-bd0b-8997f2d3e095 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:56.778225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403158d0c92f424c8e63117aac333a73', 'request_id': 'req-b9243199-5b30-4e85-8d1a-ea868c31a957'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:56.790956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403158d0c92f424c8e63117aac333a73', 'request_id': 'req-b9243199-5b30-4e85-8d1a-ea868c31a957'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:56.835578 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1110/2231] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:56 2022] POST /identity/v3/users => generated 300 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:56.836686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295a347-ac22-49cf-b56f-ece8d84fc2af None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:56.836934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295a347-ac22-49cf-b56f-ece8d84fc2af None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:56.837410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295a347-ac22-49cf-b56f-ece8d84fc2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:56.884514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0295a347-ac22-49cf-b56f-ece8d84fc2af None None] MFA Rules not processed for user `841c91af08884c91a2992bd9147ec924`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:56.886911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0295a347-ac22-49cf-b56f-ece8d84fc2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:56.890472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403158d0c92f424c8e63117aac333a73', 'request_id': 'req-b9243199-5b30-4e85-8d1a-ea868c31a957'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:56.907818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] The token cache is being invalidate because project 403158d0c92f424c8e63117aac333a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:56.908955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:56.909780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:56.916888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1122/2232] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:56 2022] DELETE /identity/v3/projects/403158d0c92f424c8e63117aac333a73 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:56.917906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:56.921054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.032733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9243199-5b30-4e85-8d1a-ea868c31a957 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.043307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.043999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.045885 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1111/2233] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:56 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:57.048180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.048180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.048180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.048180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.051828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b71fb-f16e-417b-874a-45acecf0f16f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.052402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b71fb-f16e-417b-874a-45acecf0f16f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.052723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b71fb-f16e-417b-874a-45acecf0f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.060113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1123/2234] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:57.060113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.063426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.079384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d813-32ec-4947-9647-9a8b597d4e32 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.083425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bf4b71fb-f16e-417b-874a-45acecf0f16f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:57.084792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bf4b71fb-f16e-417b-874a-45acecf0f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.086998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.087584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.087860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.088236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] PATH_INFO: `/v3/users/6fd06eec7eec41fa9e4476ee37ada16d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.089599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd06eec7eec41fa9e4476ee37ada16d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.092210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.106237 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1112/2235] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:57.107442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b71fb-f16e-417b-874a-45acecf0f16f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.118814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b71fb-f16e-417b-874a-45acecf0f16f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.122434 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:57.129195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f88a4c-7cbf-45c5-92e5-c531f9131476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.130400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f88a4c-7cbf-45c5-92e5-c531f9131476 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.130779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f88a4c-7cbf-45c5-92e5-c531f9131476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.131182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f88a4c-7cbf-45c5-92e5-c531f9131476 admin admin] PATH_INFO: `/v3/projects/a906402160bb4d8db81a2ff5d4d47cd9/users/a3ac929b1f0448f4bca5528e06fe21d7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.149559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f88a4c-7cbf-45c5-92e5-c531f9131476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a906402160bb4d8db81a2ff5d4d47cd9, user_id=a3ac929b1f0448f4bca5528e06fe21d7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.154219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f88a4c-7cbf-45c5-92e5-c531f9131476 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.225915 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:57.252068 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1113/2236] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:57 2022] PUT /identity/v3/projects/a906402160bb4d8db81a2ff5d4d47cd9/users/a3ac929b1f0448f4bca5528e06fe21d7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:57.253262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.253697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.258555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.273319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:57.274587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.343065 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1114/2237] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:57.343065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.343065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.361603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd06eec7eec41fa9e4476ee37ada16d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:57.362651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd06eec7eec41fa9e4476ee37ada16d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:57.417047 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:57.443129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd06eec7eec41fa9e4476ee37ada16d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:57.453999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd06eec7eec41fa9e4476ee37ada16d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:57.456337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd06eec7eec41fa9e4476ee37ada16d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:57.479574 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1124/2238] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:57 2022] DELETE /identity/v3/users/6fd06eec7eec41fa9e4476ee37ada16d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:57.480578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.482182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.499200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67cec1-f4a8-4186-9fcf-44c17ade6c70 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.573945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2ad6-268b-4c53-84d4-f041a39dbe9d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.579440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.580054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.580333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.580607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.581304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.583139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.601968 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1125/2239] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:57.601968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.602215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.602215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.602376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.602458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.602458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.602794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.617184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab544-87b9-479b-be67-819f859d7603 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.636613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5801-4acb-4449-bdb2-04e692eb32b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.637242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5801-4acb-4449-bdb2-04e692eb32b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.637522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5801-4acb-4449-bdb2-04e692eb32b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.639768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5801-4acb-4449-bdb2-04e692eb32b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.642716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e5801-4acb-4449-bdb2-04e692eb32b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:13:57.643035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e5801-4acb-4449-bdb2-04e692eb32b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.644699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e5801-4acb-4449-bdb2-04e692eb32b3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.674423 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1126/2240] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:13:57.674423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17b4a-db96-4054-bd84-327a60e94e04 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.674423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17b4a-db96-4054-bd84-327a60e94e04 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.674423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17b4a-db96-4054-bd84-327a60e94e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.702698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3ba17b4a-db96-4054-bd84-327a60e94e04 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:57.703998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3ba17b4a-db96-4054-bd84-327a60e94e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.717055 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1127/2241] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:57.717442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba17b4a-db96-4054-bd84-327a60e94e04 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.730223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba17b4a-db96-4054-bd84-327a60e94e04 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.730428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.732930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.735780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.736727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.737004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.737424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] PATH_INFO: `/v3/projects/a906402160bb4d8db81a2ff5d4d47cd9/users/a3ac929b1f0448f4bca5528e06fe21d7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.740635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a906402160bb4d8db81a2ff5d4d47cd9, user_id=a3ac929b1f0448f4bca5528e06fe21d7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.740773 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:57.744098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.747791 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1115/2242] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:57.748098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.765172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1128/2243] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:57 2022] PUT /identity/v3/projects/a906402160bb4d8db81a2ff5d4d47cd9/users/a3ac929b1f0448f4bca5528e06fe21d7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:57.774824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:57.777977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:57.789031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92255273-47b3-400c-8065-8f51785e25ac service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.806698 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:57.874654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fcf15-0287-4e02-a47f-c4ff217b1a64 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:57.879095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddfa50-1d46-4426-a2f2-76d764f23765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.879717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfa50-1d46-4426-a2f2-76d764f23765 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.879998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfa50-1d46-4426-a2f2-76d764f23765 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.880274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfa50-1d46-4426-a2f2-76d764f23765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.885236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:57.886258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.886823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.887596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.888607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.891569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddfa50-1d46-4426-a2f2-76d764f23765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:57.891993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.893163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddfa50-1d46-4426-a2f2-76d764f23765 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:57.906401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1129/2244] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:57.908108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93076b98-cfcb-4a03-8fe6-2c4712178e3f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:57.908869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93076b98-cfcb-4a03-8fe6-2c4712178e3f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:57.909219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93076b98-cfcb-4a03-8fe6-2c4712178e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:57.991607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-93076b98-cfcb-4a03-8fe6-2c4712178e3f None None] MFA Rules not processed for user `a3ac929b1f0448f4bca5528e06fe21d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:57.992848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-93076b98-cfcb-4a03-8fe6-2c4712178e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:58.019648 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1116/2245] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:13:57 2022] POST /identity/v3/projects => generated 397 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:58.021104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:58.024384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:58.134262 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1130/2246] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:58.137334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93076b98-cfcb-4a03-8fe6-2c4712178e3f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:58.148186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93076b98-cfcb-4a03-8fe6-2c4712178e3f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:58.164171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6f42-9765-485f-a56b-4cfdeb0ed9fd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:58.174314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:58.175326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.175679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.175985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.178020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:58.254790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:58.258556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.261685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.262058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.264215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:58.274097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:58.310507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:58.312255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:58.335147 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1117/2247] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:58.437892 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1131/2248] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:13:58 2022] POST /identity/v3/users => generated 299 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:13:58.441922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:58.455801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55793b-5cb0-43ac-b96e-98d65916b728 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:58.470429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:58.471220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.471562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.471838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.473373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:58.476344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:58.499841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1118/2249] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:58.502721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:58.518632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df0093-0fef-47d3-9fbc-a83f8cfd3bd6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:58.524983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:58.526660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.526660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.526885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.527490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:58.529324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:58.543994 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1132/2250] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:13:58.548142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:58.562938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40364542-e9de-4eed-ad1d-68ae34f32ffd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:58.567436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:58.569846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807627d3-b91c-4bb6-b7f2-a91c143a1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:58.570207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:58.571736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807627d3-b91c-4bb6-b7f2-a91c143a1b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.571736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807627d3-b91c-4bb6-b7f2-a91c143a1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.571736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807627d3-b91c-4bb6-b7f2-a91c143a1b55 admin admin] PATH_INFO: `/v3/projects/10a28f315c8e4766bc5754524ddde678/users/29f68fba91f1433bb6d51e956ea19022/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.601839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807627d3-b91c-4bb6-b7f2-a91c143a1b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a28f315c8e4766bc5754524ddde678, user_id=29f68fba91f1433bb6d51e956ea19022, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:58.603527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02db9e-5a24-4a42-b672-1bb638b46af8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:58.610201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807627d3-b91c-4bb6-b7f2-a91c143a1b55 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:58.610430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:58.611387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.611770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.612143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] PATH_INFO: `/v3/projects/7b4db212b3cc49bdb4642699c8882367` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.614647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4db212b3cc49bdb4642699c8882367)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:58.616999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:58.768417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1119/2251] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:13:58 2022] PUT /identity/v3/projects/10a28f315c8e4766bc5754524ddde678/users/29f68fba91f1433bb6d51e956ea19022/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:58.773761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975f178-b365-446a-a382-79121c49fe86 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.774082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975f178-b365-446a-a382-79121c49fe86 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.774359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975f178-b365-446a-a382-79121c49fe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.785001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4db212b3cc49bdb4642699c8882367', 'request_id': 'req-7c5d8689-95b5-4e36-bf64-b0f052d528a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:58.794128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4db212b3cc49bdb4642699c8882367', 'request_id': 'req-7c5d8689-95b5-4e36-bf64-b0f052d528a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:58.797911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8975f178-b365-446a-a382-79121c49fe86 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:58.798775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8975f178-b365-446a-a382-79121c49fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:58.890198 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1120/2252] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:13:58.891367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:58.891773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:58.891959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:58.896944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4db212b3cc49bdb4642699c8882367', 'request_id': 'req-7c5d8689-95b5-4e36-bf64-b0f052d528a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:58.919229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] MFA Rules not processed for user `e3b41f02eca449e4ac13e3a36d65d57c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:58.921326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:58.924552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] The token cache is being invalidate because project 7b4db212b3cc49bdb4642699c8882367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:13:58.924988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:58.926422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:58.928542 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1133/2253] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:13:58 2022] DELETE /identity/v3/projects/7b4db212b3cc49bdb4642699c8882367 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:13:58.930677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:58.932069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:59.021305 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1121/2254] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:59.022750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:59.024914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:59.033246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d8689-95b5-4e36-bf64-b0f052d528a7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:59.045132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:59.046436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:59.046958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:59.047244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:59.049124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:59.105491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bb608-22db-493d-9c05-03f24739fbc7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:59.111088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:59.112025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:59.112809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:59.113090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:59.115687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:59.133281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:59.134845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:59.134968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:59.136491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:59.148588 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1122/2255] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:59.149661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:59.153179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:59.158154 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1134/2256] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:59.165859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed10cd-4cb4-4e3a-8c9d-4e8a81a31204 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:59.173210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:59.174377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:59.174667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:59.174944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] PATH_INFO: `/v3/users/ba05b35269d74130ab6c8645fc777af9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:59.176143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba05b35269d74130ab6c8645fc777af9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:59.179072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:59.183663 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:59.406358 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:59.451206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba05b35269d74130ab6c8645fc777af9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:59.469972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba05b35269d74130ab6c8645fc777af9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:59.478772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba05b35269d74130ab6c8645fc777af9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:59.487083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba05b35269d74130ab6c8645fc777af9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:59.561704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba05b35269d74130ab6c8645fc777af9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:13:59.574455 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1123/2257] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:13:59 2022] DELETE /identity/v3/users/ba05b35269d74130ab6c8645fc777af9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:13:59.660877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:59.662852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:59.686454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9093-2466-470f-848a-71fafb74864a service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:59.771476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbec97-ad72-4f4e-800c-5dfc2d0bc7c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:59.772113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbec97-ad72-4f4e-800c-5dfc2d0bc7c1 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:59.772398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbec97-ad72-4f4e-800c-5dfc2d0bc7c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:59.772677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbec97-ad72-4f4e-800c-5dfc2d0bc7c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:59.774544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35bbec97-ad72-4f4e-800c-5dfc2d0bc7c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:59.866894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbec97-ad72-4f4e-800c-5dfc2d0bc7c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:59.868599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbec97-ad72-4f4e-800c-5dfc2d0bc7c1 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:59.883944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1135/2258] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:00.620842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:00.625694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:00.741129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b14c5-1c36-4df1-904a-ec73a6374f37 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:00.748473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:00.749914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:00.750202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:00.750509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] PATH_INFO: `/v3/projects/21a2776a7d774aeea45eac602b41a610` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:00.751664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a2776a7d774aeea45eac602b41a610)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:00.753751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:00.924102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a2776a7d774aeea45eac602b41a610', 'request_id': 'req-205082b4-b16c-4af1-8286-b2cf1d796858'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:00.932242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a2776a7d774aeea45eac602b41a610', 'request_id': 'req-205082b4-b16c-4af1-8286-b2cf1d796858'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:01.019892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a2776a7d774aeea45eac602b41a610', 'request_id': 'req-205082b4-b16c-4af1-8286-b2cf1d796858'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:01.048504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] The token cache is being invalidate because project 21a2776a7d774aeea45eac602b41a610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:01.048797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:01.059232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-205082b4-b16c-4af1-8286-b2cf1d796858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:01.065851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1124/2259] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:00 2022] DELETE /identity/v3/projects/21a2776a7d774aeea45eac602b41a610 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:01.068260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ca77-15fe-448b-9006-16aa31972a4c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.068740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ca77-15fe-448b-9006-16aa31972a4c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.068863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ca77-15fe-448b-9006-16aa31972a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.114786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3fc7ca77-15fe-448b-9006-16aa31972a4c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:01.116461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3fc7ca77-15fe-448b-9006-16aa31972a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:01.228710 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1136/2260] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:01.237318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.237600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.237905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.293501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:01.298341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:01.333615 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1125/2261] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:01.337681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7ca77-15fe-448b-9006-16aa31972a4c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.344825 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:01.364493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7ca77-15fe-448b-9006-16aa31972a4c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.368045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.373313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:01.378328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.379297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.379703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.380100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.380927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:01.381344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:01.385300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:01.442317 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1137/2262] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:01.450087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.466949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478749-3f29-4984-a3af-22b1ffc94d7d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.470946 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:01.476310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.477840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.478227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.478563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.480169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:01.484698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:01.500513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7c79-4733-41f4-9b4c-1575f14ab77d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.508487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.509559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.513603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.513603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.515475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:01.609504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:01.611422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:01.613824 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1138/2263] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:01 2022] POST /identity/v3/projects => generated 411 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:01.614755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.628051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1126/2264] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:01.740399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b4ac-43b5-4048-9ea1-7cdfe6e0fd3b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.747082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.748155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.748718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.749144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.750514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:01.753953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:01.845200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.849906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:01.869450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1051f5-4306-4f62-a1ce-fa35f518d765 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.879033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.879999 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1139/2265] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:01 2022] POST /identity/v3/users => generated 306 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:01.880256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.880672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.881077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] PATH_INFO: `/v3/users/8a0e8617b4d94b10b6ac4ffaf414f313` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.882892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0e8617b4d94b10b6ac4ffaf414f313)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:01.883969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.885413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:01.896946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8657-9ecc-43c3-b866-a8c34efbc8c3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.904801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.905681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.906122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.906500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.907523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:01.910016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:01.925650 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1140/2266] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:01.929678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.945108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1ebe8-8058-4fb8-91f9-1aa4ad1461e5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.952278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.953196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.953847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.954626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:01.955342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:01.958097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:01.973574 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1141/2267] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:01.978427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:01.991660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161648-ee18-4c75-9808-49d094cd88c6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:01.998537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d27ef3-bedc-4089-9657-4da7031a0b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:01.999855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d27ef3-bedc-4089-9657-4da7031a0b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:01.999855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d27ef3-bedc-4089-9657-4da7031a0b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:01.999855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d27ef3-bedc-4089-9657-4da7031a0b48 admin admin] PATH_INFO: `/v3/projects/5dcf59d0a8c94813b0e4b7cd07817df9/users/685da16a735847038b2c661e26331c12/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.018916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d27ef3-bedc-4089-9657-4da7031a0b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dcf59d0a8c94813b0e4b7cd07817df9, user_id=685da16a735847038b2c661e26331c12, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:02.022260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d27ef3-bedc-4089-9657-4da7031a0b48 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:02.119091 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:02.124124 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1142/2268] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:01 2022] PUT /identity/v3/projects/5dcf59d0a8c94813b0e4b7cd07817df9/users/685da16a735847038b2c661e26331c12/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:02.137338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:02.139339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:02.140644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.150030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0e8617b4d94b10b6ac4ffaf414f313'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:02.171741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0e8617b4d94b10b6ac4ffaf414f313'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:02.173577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] MFA Rules not processed for user `685da16a735847038b2c661e26331c12`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:02.174940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:02.183603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0e8617b4d94b10b6ac4ffaf414f313'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:02.183603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0e8617b4d94b10b6ac4ffaf414f313'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:02.253312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-978dffb1-45d6-439b-8537-f229d43e773b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0e8617b4d94b10b6ac4ffaf414f313'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:02.267005 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1127/2269] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:01 2022] DELETE /identity/v3/users/8a0e8617b4d94b10b6ac4ffaf414f313 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:02.268781 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1143/2270] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:02.269232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:02.269595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:02.269715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:02.270011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.271127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:02.300883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:02.305099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:02.387543 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1128/2271] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:02.397677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:02.397899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295e1e9-a2ba-4c5f-9d0a-6bf2908ea02c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:02.400164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:02.410663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:02.411506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:02.411739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:02.412063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.413212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:02.415208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:02.489980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceeb70-3e23-4fd0-9596-5eab35a5fef1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:02.494308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:02.495342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:02.495728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:02.496370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.509866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:02.513193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:02.526184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1129/2272] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:02.560848 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1144/2273] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:02 2022] POST /identity/v3/projects => generated 409 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:02.565606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:02.595403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d541cc8-089f-4d89-9dea-98d93e80ed59 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:02.689341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:02.690706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:02.690987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:02.691258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.695018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:02.698502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:02.813525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:02.816552 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1130/2274] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:02 2022] POST /identity/v3/users => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:02.820111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:02.820461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:02.862181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7203-316e-45ac-86b8-e9c8237cd633 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:02.862329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176b3c8-0408-449a-a930-f39492e39628 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:02.880712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:02.881690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:02.882301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:02.882741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] PATH_INFO: `/v3/users/53ea7060bdd44df193d244e7d1078919` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.886957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:02.889769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:02.890089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:02.892110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:02.895019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ea7060bdd44df193d244e7d1078919)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:02.895654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:02.899687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:02.899932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:02.943523 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1131/2275] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:02.944687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:02.976963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134f4db-2b29-4530-896a-b4f5a92e9646 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:02.999557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:03.001563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:03.002515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:03.002515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] PATH_INFO: `/v3/projects/855fda4b5a0b423fa43e3d3138f77445/users/b24d63d6ac1f48b59032d8b1c14471da/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:03.019130 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:03.053385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855fda4b5a0b423fa43e3d3138f77445, user_id=b24d63d6ac1f48b59032d8b1c14471da, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:03.056742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:03.170435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1132/2276] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:02 2022] PUT /identity/v3/projects/855fda4b5a0b423fa43e3d3138f77445/users/b24d63d6ac1f48b59032d8b1c14471da/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:03.172461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:03.215171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ea7060bdd44df193d244e7d1078919'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:03.220214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ea7060bdd44df193d244e7d1078919'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:03.305763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ecfdb-627e-4b92-a7b6-59efc489d3e5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:03.315964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ea7060bdd44df193d244e7d1078919'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:03.328116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ea7060bdd44df193d244e7d1078919'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:03.329199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70fe5d93-0f75-4184-acbc-e4d765955e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ea7060bdd44df193d244e7d1078919'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:03.329707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:03.330580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:03.331492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:03.332149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:03.334055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:03.338881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:03.372574 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1145/2277] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:02 2022] DELETE /identity/v3/users/53ea7060bdd44df193d244e7d1078919 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:03.377907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:03.378500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:03.379575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:03.407429 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1133/2278] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:03.409135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:03.416666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:03.454941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:03.456356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:03.487799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d322c-0300-459a-a80c-03c24b948ad3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:03.581983 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:03.597038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1146/2279] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:03.598111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:03.602259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:03.631717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed795e1f-2c0b-4830-b7ec-e2db2131600a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:03.646848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:03.647517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:03.647802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:03.648081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] PATH_INFO: `/v3/projects/9c206a232165457cb9a9769b57b57aed` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:03.651294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c206a232165457cb9a9769b57b57aed)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:03.654187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:03.702228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea5d0a-3fdc-412d-bae4-f5e1cf5afb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:03.703026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5d0a-3fdc-412d-bae4-f5e1cf5afb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:03.703279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5d0a-3fdc-412d-bae4-f5e1cf5afb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:03.703569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5d0a-3fdc-412d-bae4-f5e1cf5afb81 admin admin] PATH_INFO: `/v3/projects/855fda4b5a0b423fa43e3d3138f77445/users/b24d63d6ac1f48b59032d8b1c14471da/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:03.706655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea5d0a-3fdc-412d-bae4-f5e1cf5afb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855fda4b5a0b423fa43e3d3138f77445, user_id=b24d63d6ac1f48b59032d8b1c14471da, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:03.714139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea5d0a-3fdc-412d-bae4-f5e1cf5afb81 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:03.783934 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1134/2280] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:03 2022] PUT /identity/v3/projects/855fda4b5a0b423fa43e3d3138f77445/users/b24d63d6ac1f48b59032d8b1c14471da/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:03.786650 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:03.798808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:03.799222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:03.799353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:03.835922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] MFA Rules not processed for user `b24d63d6ac1f48b59032d8b1c14471da`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:03.837464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:03.915708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c206a232165457cb9a9769b57b57aed', 'request_id': 'req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:03.930300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c206a232165457cb9a9769b57b57aed', 'request_id': 'req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:03.988086 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1135/2281] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:03 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:03.990033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:03.994760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:04.008650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c206a232165457cb9a9769b57b57aed', 'request_id': 'req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.029341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] The token cache is being invalidate because project 9c206a232165457cb9a9769b57b57aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:04.029928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.030891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.034444 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1147/2282] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:03 2022] DELETE /identity/v3/projects/9c206a232165457cb9a9769b57b57aed => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:04.036512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:04.043086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:04.147393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981e2f9-6b14-43ba-a367-371a7aef8973 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:04.217225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ee2a4-2bc1-496d-ad16-fd50cb8237bf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:04.237110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:04.237802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:04.238122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:04.239453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:04.243017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:04.285394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:04.286373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:04.286650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:04.286921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:04.289637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:04.376035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:04.377957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:04.390768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1148/2283] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:04.391847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:04.393453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:04.398139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:04.399902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:04.429779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1381a-828c-4477-88e3-1f0e5035ac58 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:04.435170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1136/2284] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:04.435502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:04.436251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:04.436554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:04.436831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] PATH_INFO: `/v3/users/841c91af08884c91a2992bd9147ec924` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:04.438045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841c91af08884c91a2992bd9147ec924)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:04.440037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:04.609670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:04.628113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f1e1a-6af9-4494-8a58-c8bade95cfac service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:04.640787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:04.641753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:04.642320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:04.642805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:04.647378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:04.669414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841c91af08884c91a2992bd9147ec924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.670452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841c91af08884c91a2992bd9147ec924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.774412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:04.776637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:04.790551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841c91af08884c91a2992bd9147ec924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.792022 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1137/2285] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:04.800411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841c91af08884c91a2992bd9147ec924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.801646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11c20ea5-2c21-4ce7-86d5-0fb2dc589bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841c91af08884c91a2992bd9147ec924'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:04.861782 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1149/2286] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:04 2022] DELETE /identity/v3/users/841c91af08884c91a2992bd9147ec924 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:05.266149 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:05.321709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:05.323251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:05.372281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590a5e-a620-4c5a-840b-11a23015eda6 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:05.548936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:05.550937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:05.551687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:05.552677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] PATH_INFO: `/v3/users/685da16a735847038b2c661e26331c12` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:05.564120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=685da16a735847038b2c661e26331c12)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:05.564120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:06.262898 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:06.285998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685da16a735847038b2c661e26331c12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:06.306723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685da16a735847038b2c661e26331c12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:06.317872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685da16a735847038b2c661e26331c12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:06.319452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685da16a735847038b2c661e26331c12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:06.412421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685da16a735847038b2c661e26331c12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:06.430794 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1138/2287] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:05 2022] DELETE /identity/v3/users/685da16a735847038b2c661e26331c12 => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:06.441353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:06.441353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:06.441353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:06.463163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:06.465277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:06.592544 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1150/2288] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:06.627346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:06.628939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:06.831089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1afd0-62b7-47f3-8da0-c0bf8be5e405 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:06.855918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:06.858382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:06.860567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:06.861297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:06.893958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:06.901270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:06.919688 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1139/2289] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:07.454663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:07.457079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:07.477717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ff4f0-d1b9-472b-8be3-f7754f69dc86 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:07.486057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:07.487362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:07.487882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:07.488887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] PATH_INFO: `/v3/projects/8a26e1b3eef04d9fb06e4bcbd44d641f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:07.490297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a26e1b3eef04d9fb06e4bcbd44d641f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:07.500254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:07.597032 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:07.678784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a26e1b3eef04d9fb06e4bcbd44d641f', 'request_id': 'req-a500f29f-a817-46ea-bda4-687bc6289d76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:07.688140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:07.691007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:07.705347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a26e1b3eef04d9fb06e4bcbd44d641f', 'request_id': 'req-a500f29f-a817-46ea-bda4-687bc6289d76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:07.719881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbe6e-e4c4-4081-8331-6167cfa7db88 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:07.800836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:07.801586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:07.802153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:07.805755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] PATH_INFO: `/v3/projects/b7bebae05791499b80b08a78991dd235` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:07.806756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bebae05791499b80b08a78991dd235)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:07.810417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:07.826853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a26e1b3eef04d9fb06e4bcbd44d641f', 'request_id': 'req-a500f29f-a817-46ea-bda4-687bc6289d76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:07.846888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] The token cache is being invalidate because project 8a26e1b3eef04d9fb06e4bcbd44d641f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:07.847328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:07.849599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a500f29f-a817-46ea-bda4-687bc6289d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:07.864781 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1151/2290] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:07 2022] DELETE /identity/v3/projects/8a26e1b3eef04d9fb06e4bcbd44d641f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:07.867708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae9b21-9e08-4a19-a23b-1eb240b04522 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:07.868254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae9b21-9e08-4a19-a23b-1eb240b04522 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:07.868721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae9b21-9e08-4a19-a23b-1eb240b04522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:07.903699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-91ae9b21-9e08-4a19-a23b-1eb240b04522 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:07.905273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-91ae9b21-9e08-4a19-a23b-1eb240b04522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:07.923587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1152/2291] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:07.925389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffc83-38aa-41d2-950a-9f87c0f5ad7e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:07.925874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffc83-38aa-41d2-950a-9f87c0f5ad7e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:07.926313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffc83-38aa-41d2-950a-9f87c0f5ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:07.952659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a16ffc83-38aa-41d2-950a-9f87c0f5ad7e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:07.954994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a16ffc83-38aa-41d2-950a-9f87c0f5ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:07.978064 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1153/2292] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:07.980107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffc83-38aa-41d2-950a-9f87c0f5ad7e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:07.999781 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:08.004513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffc83-38aa-41d2-950a-9f87c0f5ad7e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.007762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bebae05791499b80b08a78991dd235', 'request_id': 'req-d87363e5-09b0-49a9-a438-0f7ac870bca2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.017048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bebae05791499b80b08a78991dd235', 'request_id': 'req-d87363e5-09b0-49a9-a438-0f7ac870bca2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.088060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.088664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.088945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.089220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.090156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:08.090598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.092309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.094224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bebae05791499b80b08a78991dd235', 'request_id': 'req-d87363e5-09b0-49a9-a438-0f7ac870bca2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.108755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] The token cache is being invalidate because project b7bebae05791499b80b08a78991dd235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:08.110231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.111280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.115991 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1140/2293] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:07 2022] DELETE /identity/v3/projects/b7bebae05791499b80b08a78991dd235 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:08.120463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.124987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:08.132899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1154/2294] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:08.139665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.146974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:08.162167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87363e5-09b0-49a9-a438-0f7ac870bca2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.169267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.170074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.170198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a29261-dd80-463a-b68e-0f7865ccfdf6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.170359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.170646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] PATH_INFO: `/v3/users/a3ac929b1f0448f4bca5528e06fe21d7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.171863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ac929b1f0448f4bca5528e06fe21d7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.173837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.187397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.187397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.187397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.187397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.191806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.191806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.281252 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1155/2295] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:08 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:08.281252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.283806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:08.402015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bde76-f011-4a14-8669-09a67637dc81 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.409546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ac929b1f0448f4bca5528e06fe21d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.414664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.415606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.415814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.416184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] PATH_INFO: `/v3/projects/5dcf59d0a8c94813b0e4b7cd07817df9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.417477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dcf59d0a8c94813b0e4b7cd07817df9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.421597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.424558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ac929b1f0448f4bca5528e06fe21d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.431909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ac929b1f0448f4bca5528e06fe21d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.432654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ac929b1f0448f4bca5528e06fe21d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.529151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ac929b1f0448f4bca5528e06fe21d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.547259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1141/2296] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:08 2022] DELETE /identity/v3/users/a3ac929b1f0448f4bca5528e06fe21d7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:08.549441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.551111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:08.597639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dcf59d0a8c94813b0e4b7cd07817df9', 'request_id': 'req-58cca037-9677-4a02-800f-dee7e4cb83cc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.609695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dcf59d0a8c94813b0e4b7cd07817df9', 'request_id': 'req-58cca037-9677-4a02-800f-dee7e4cb83cc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.666829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6a7b-9a93-4479-b671-ab88248436f6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.688721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dcf59d0a8c94813b0e4b7cd07817df9', 'request_id': 'req-58cca037-9677-4a02-800f-dee7e4cb83cc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.704281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] The token cache is being invalidate because project 5dcf59d0a8c94813b0e4b7cd07817df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:08.704595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.706348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:08.709709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1156/2297] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:08 2022] DELETE /identity/v3/projects/5dcf59d0a8c94813b0e4b7cd07817df9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:08.714550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.718394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:08.749169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.750226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.750668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.751238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.752042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.754383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.822223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cca037-9677-4a02-800f-dee7e4cb83cc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.830322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.830983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.831265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.831540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] PATH_INFO: `/v3/users/b24d63d6ac1f48b59032d8b1c14471da` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.832874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24d63d6ac1f48b59032d8b1c14471da)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.834853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.860724 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1142/2298] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:08 2022] POST /identity/v3/users => generated 287 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:08.864919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.868046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:08.889371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd3ec9-addf-4362-982f-6d282b7c0b7e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.896513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.897380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.897862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.898304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.899585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.902159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.920901 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1143/2299] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:08.922052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.937507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b9c90-39ec-4f4d-bb8a-9cabdb27e792 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:08.943735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:08.945161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:08.945451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:08.945772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:08.946497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:08.948535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:08.963260 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1144/2300] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:08.981162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:08.993966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dbc7-6bc2-48ee-9ae3-28ab3e1be32e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:09.000652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59d9d8-756d-42b6-ac29-f08b3b3a6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:09.009253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59d9d8-756d-42b6-ac29-f08b3b3a6037 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:09.009253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59d9d8-756d-42b6-ac29-f08b3b3a6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:09.009253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59d9d8-756d-42b6-ac29-f08b3b3a6037 admin admin] PATH_INFO: `/v3/projects/f61189be458440b098258bdf09af344d/users/d3ee5c02cbb740bcab5009471ed98264/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:09.019850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59d9d8-756d-42b6-ac29-f08b3b3a6037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61189be458440b098258bdf09af344d, user_id=d3ee5c02cbb740bcab5009471ed98264, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:09.025008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59d9d8-756d-42b6-ac29-f08b3b3a6037 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:09.049081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24d63d6ac1f48b59032d8b1c14471da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:09.049767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24d63d6ac1f48b59032d8b1c14471da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:09.118772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1145/2301] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:08 2022] PUT /identity/v3/projects/f61189be458440b098258bdf09af344d/users/d3ee5c02cbb740bcab5009471ed98264/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:09.131106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:09.131508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:09.132051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:09.162218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] MFA Rules not processed for user `d3ee5c02cbb740bcab5009471ed98264`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:09.163723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:09.255217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24d63d6ac1f48b59032d8b1c14471da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:09.271043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24d63d6ac1f48b59032d8b1c14471da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:09.272643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24d63d6ac1f48b59032d8b1c14471da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:09.302928 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1146/2302] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:09.307508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:09.316851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:09.317591 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1157/2303] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:08 2022] DELETE /identity/v3/users/b24d63d6ac1f48b59032d8b1c14471da => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:09.414346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a35c-9e75-47c2-9e49-e3cc1c571234 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:09.500688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:09.501535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:09.501938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:09.502217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:09.503113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:09.506404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:09.542008 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:09.575520 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1147/2304] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:09 2022] POST /identity/v3/projects => generated 375 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:09.577380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:09.593233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7e67e-2b8d-4bb5-9956-17482206757a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:09.668104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:09.669021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:09.669531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:09.669983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:09.671343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:09.673553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:09.701570 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:09.799696 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1158/2305] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:09 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:09.804584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:09.835752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb32ab-653d-4661-b61b-2f54f35f155e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:09.851359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:09.852519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:09.852519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:09.852519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:09.853145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:09.855063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:09.868183 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1148/2306] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:09.874480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:09.886348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d544b2-f0dd-4e0d-97e5-8b3ee8a10df0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:09.895055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:09.896170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:09.896703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:09.897242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] PATH_INFO: `/v3/projects/daf27e7c2612442bbd662326f1e42ade/users/e5e36d25b05843e28eb5158f3c0d64f8/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:09.915342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf27e7c2612442bbd662326f1e42ade, user_id=e5e36d25b05843e28eb5158f3c0d64f8, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:09.919673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:10.015711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:10.016137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1159/2307] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:09 2022] PUT /identity/v3/projects/daf27e7c2612442bbd662326f1e42ade/users/e5e36d25b05843e28eb5158f3c0d64f8/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:10.027036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59a637-2bb7-445f-bd92-afbb4f9bbbb7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:10.100238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:10.102449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:10.133259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:10.134145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.134437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.134712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.135452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:10.137954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:10.158259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1149/2308] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:10.162652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:10.177100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722dc79-2bb4-44e2-8fd8-1cefa50c2c67 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:10.190063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31885-ff73-491c-ab52-7fe242ee1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:10.195309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31885-ff73-491c-ab52-7fe242ee1885 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.195309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31885-ff73-491c-ab52-7fe242ee1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.195309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31885-ff73-491c-ab52-7fe242ee1885 admin admin] PATH_INFO: `/v3/projects/daf27e7c2612442bbd662326f1e42ade/users/e5e36d25b05843e28eb5158f3c0d64f8/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.195309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31885-ff73-491c-ab52-7fe242ee1885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf27e7c2612442bbd662326f1e42ade, user_id=e5e36d25b05843e28eb5158f3c0d64f8, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:10.199258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31885-ff73-491c-ab52-7fe242ee1885 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:10.219817 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1150/2309] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:10 2022] PUT /identity/v3/projects/daf27e7c2612442bbd662326f1e42ade/users/e5e36d25b05843e28eb5158f3c0d64f8/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:10.233152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2a06-0610-4d79-8680-2c1e9709c0b3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.234800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2a06-0610-4d79-8680-2c1e9709c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.240172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2a06-0610-4d79-8680-2c1e9709c0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.281472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d90a2a06-0610-4d79-8680-2c1e9709c0b3 None None] MFA Rules not processed for user `e5e36d25b05843e28eb5158f3c0d64f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:10.282845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d90a2a06-0610-4d79-8680-2c1e9709c0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:10.288576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee546-b23b-4047-ba3d-0e2351443f2c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:10.401599 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1151/2310] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:10.408391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:10.413803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.413803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.413803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] PATH_INFO: `/v3/projects/a906402160bb4d8db81a2ff5d4d47cd9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.414717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473053-8935-4d92-9e39-71311c031ccb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.414816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a906402160bb4d8db81a2ff5d4d47cd9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:10.414905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473053-8935-4d92-9e39-71311c031ccb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.414905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473053-8935-4d92-9e39-71311c031ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.417766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:10.460361 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:10.465957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-24473053-8935-4d92-9e39-71311c031ccb None None] MFA Rules not processed for user `d3ee5c02cbb740bcab5009471ed98264`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:10.467587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-24473053-8935-4d92-9e39-71311c031ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:10.548104 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1152/2311] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:10.559858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24473053-8935-4d92-9e39-71311c031ccb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:10.562838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-24473053-8935-4d92-9e39-71311c031ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:10.571277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a906402160bb4d8db81a2ff5d4d47cd9', 'request_id': 'req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:10.586579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a906402160bb4d8db81a2ff5d4d47cd9', 'request_id': 'req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:10.678216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a906402160bb4d8db81a2ff5d4d47cd9', 'request_id': 'req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:10.678787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24473053-8935-4d92-9e39-71311c031ccb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:10.702495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] The token cache is being invalidate because project a906402160bb4d8db81a2ff5d4d47cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:10.703140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:10.704810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:10.709346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1160/2312] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:10 2022] DELETE /identity/v3/projects/a906402160bb4d8db81a2ff5d4d47cd9 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:10.710753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:10.712941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:10.813709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4ad1d-f45e-4709-8ded-8ca3e65c7f0b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:10.818540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6b75c-252d-4e4d-a8aa-a1201f99580f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:10.819494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:10.820183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b75c-252d-4e4d-a8aa-a1201f99580f service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.820326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.820712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.820921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b75c-252d-4e4d-a8aa-a1201f99580f service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.821175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] PATH_INFO: `/v3/projects/855fda4b5a0b423fa43e3d3138f77445` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.821654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6b75c-252d-4e4d-a8aa-a1201f99580f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.822688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=855fda4b5a0b423fa43e3d3138f77445)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:10.826811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:10.827065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fad6b75c-252d-4e4d-a8aa-a1201f99580f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:10.920059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6b75c-252d-4e4d-a8aa-a1201f99580f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:10.922023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6b75c-252d-4e4d-a8aa-a1201f99580f service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:10.960827 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1153/2313] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:10.962218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9fa0-bf47-4dae-8735-2a26fb6cd32b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:10.962380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9fa0-bf47-4dae-8735-2a26fb6cd32b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:10.962657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9fa0-bf47-4dae-8735-2a26fb6cd32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:10.988533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855fda4b5a0b423fa43e3d3138f77445', 'request_id': 'req-a50b2326-b3d4-41a7-9474-838d947974bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:11.002700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-edba9fa0-bf47-4dae-8735-2a26fb6cd32b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:11.006313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-edba9fa0-bf47-4dae-8735-2a26fb6cd32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:11.007081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855fda4b5a0b423fa43e3d3138f77445', 'request_id': 'req-a50b2326-b3d4-41a7-9474-838d947974bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:11.111779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855fda4b5a0b423fa43e3d3138f77445', 'request_id': 'req-a50b2326-b3d4-41a7-9474-838d947974bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:11.132866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] The token cache is being invalidate because project 855fda4b5a0b423fa43e3d3138f77445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:11.133361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:11.134178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a50b2326-b3d4-41a7-9474-838d947974bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:11.142788 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1161/2314] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:10 2022] DELETE /identity/v3/projects/855fda4b5a0b423fa43e3d3138f77445 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:11.147821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a314a-01a3-4ca8-84bd-567054db2c8f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.149938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a314a-01a3-4ca8-84bd-567054db2c8f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.149938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a314a-01a3-4ca8-84bd-567054db2c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.150146 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1154/2315] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:11.157391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2091-5bb3-4e14-97ec-299ac8564262 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.157733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2091-5bb3-4e14-97ec-299ac8564262 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.158036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2091-5bb3-4e14-97ec-299ac8564262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.182504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cdee2091-5bb3-4e14-97ec-299ac8564262 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:11.184594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cdee2091-5bb3-4e14-97ec-299ac8564262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:11.194509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-549a314a-01a3-4ca8-84bd-567054db2c8f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:11.195970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-549a314a-01a3-4ca8-84bd-567054db2c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:11.198802 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1155/2316] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:11.206410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2091-5bb3-4e14-97ec-299ac8564262 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.219569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2091-5bb3-4e14-97ec-299ac8564262 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.224049 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1162/2317] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:11.233997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481299d6-0a2d-45e9-8180-56da60decf5b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.234467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481299d6-0a2d-45e9-8180-56da60decf5b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.234847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481299d6-0a2d-45e9-8180-56da60decf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.239983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.241134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.241476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.243146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.243868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:11.244238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.248631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.273030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-481299d6-0a2d-45e9-8180-56da60decf5b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:11.279766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-481299d6-0a2d-45e9-8180-56da60decf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:11.287145 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1156/2318] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:11.297355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.310166 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1163/2319] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:11.310991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481299d6-0a2d-45e9-8180-56da60decf5b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.323536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481299d6-0a2d-45e9-8180-56da60decf5b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.327100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f159c0d-01a7-4448-b268-5659b96461be admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.346015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.347775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.348238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.348666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.349184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.349838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.350129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.350404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.350807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:11.351042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.351442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.353667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.357007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.396433 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1164/2320] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:11.397776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.439357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4ef3-b8e0-45ef-bd8d-e444e6623887 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.443999 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:11.447412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.448172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.448460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.448736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.450358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.452558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.585469 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1157/2321] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:11 2022] POST /identity/v3/projects => generated 375 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:11.605539 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1165/2322] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:11 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:11.608891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.610358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.729888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a1ad-bc1b-49bc-bb96-69199f75ce74 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.753575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.758772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.759311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.759744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.760576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.763169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0372d-5b0a-43ff-b5f5-3d37437fe16d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.763782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.769275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.770086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.772428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.772428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.772428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.773700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.861041 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1158/2323] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:11 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:11.862383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.863066 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1166/2324] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:11 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:11.867712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.878562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f5f77-72c3-4449-89d1-555f2730a46a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.880845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfe3d8-6589-463d-b772-5704fa4b98c5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.884559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.885276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.885654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.886193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.887008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.889273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.893048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.894135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.895297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.895724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.897527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.905656 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1159/2325] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:11.909750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.913699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.923334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ac5e7-ec7f-4403-914d-b8f10ea3bec1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.929522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.930743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.931355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.932527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.934278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.941474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.944384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1167/2326] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:11.949171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.958266 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1160/2327] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:11.962403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:11.972172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757c08-0930-4468-99a2-23a4363407f9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.975049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891f41-022d-4bfb-9bf5-b1e359e64047 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:11.978700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.979369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:11.979714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:11.980052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:11.980770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:11.984347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:11.991777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9aae0-ce2c-4d20-b73d-454932a7dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:11.992525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9aae0-ce2c-4d20-b73d-454932a7dcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:12.004440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9aae0-ce2c-4d20-b73d-454932a7dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:12.004440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9aae0-ce2c-4d20-b73d-454932a7dcf8 admin admin] PATH_INFO: `/v3/projects/68911ce3ec2b4058848bceddedcac592/users/3f3a142fdbba49fdb43ea4c8f8485462/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:12.004843 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1168/2328] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:12.007201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:12.016791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9aae0-ce2c-4d20-b73d-454932a7dcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68911ce3ec2b4058848bceddedcac592, user_id=3f3a142fdbba49fdb43ea4c8f8485462, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:12.032645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9aae0-ce2c-4d20-b73d-454932a7dcf8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:12.038288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a855-26be-4fea-9200-170db0aae936 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:12.048244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca32899-a7b9-48a6-8bf3-ea9c5a56541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:12.049129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca32899-a7b9-48a6-8bf3-ea9c5a56541a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:12.049509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca32899-a7b9-48a6-8bf3-ea9c5a56541a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:12.050075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca32899-a7b9-48a6-8bf3-ea9c5a56541a admin admin] PATH_INFO: `/v3/projects/702d01eac1f244669cbbcefc8f094a35/users/aace8ea2a4be499494047f3fe1049c99/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:12.072394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca32899-a7b9-48a6-8bf3-ea9c5a56541a admin admin] RBAC: Authorizing `identity:create_grant(project_id=702d01eac1f244669cbbcefc8f094a35, user_id=aace8ea2a4be499494047f3fe1049c99, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:12.076424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca32899-a7b9-48a6-8bf3-ea9c5a56541a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:12.129875 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1161/2329] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:11 2022] PUT /identity/v3/projects/68911ce3ec2b4058848bceddedcac592/users/3f3a142fdbba49fdb43ea4c8f8485462/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:12.141107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80301-04dd-447d-874e-1aef0af96308 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:12.141450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80301-04dd-447d-874e-1aef0af96308 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:12.141683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80301-04dd-447d-874e-1aef0af96308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:12.149021 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1169/2330] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:12 2022] PUT /identity/v3/projects/702d01eac1f244669cbbcefc8f094a35/users/aace8ea2a4be499494047f3fe1049c99/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:12.160372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448865-e7bf-494a-a2a9-7c8c6f966cc7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:12.163757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448865-e7bf-494a-a2a9-7c8c6f966cc7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:12.163757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448865-e7bf-494a-a2a9-7c8c6f966cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:12.201028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-70f80301-04dd-447d-874e-1aef0af96308 None None] MFA Rules not processed for user `3f3a142fdbba49fdb43ea4c8f8485462`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:12.201928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-70f80301-04dd-447d-874e-1aef0af96308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:12.219494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c7448865-e7bf-494a-a2a9-7c8c6f966cc7 None None] MFA Rules not processed for user `aace8ea2a4be499494047f3fe1049c99`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:12.221917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7448865-e7bf-494a-a2a9-7c8c6f966cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:12.393640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1170/2331] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:12.395131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448865-e7bf-494a-a2a9-7c8c6f966cc7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:12.455044 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:12.465205 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1162/2332] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:12.470719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80301-04dd-447d-874e-1aef0af96308 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:12.570421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448865-e7bf-494a-a2a9-7c8c6f966cc7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:12.595200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:12.597769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:12.598369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:12.598846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:12.599651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:12.601796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:12.625423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80301-04dd-447d-874e-1aef0af96308 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:12.644003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:12.644640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:12.644917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:12.645691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:12.645864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:12.648239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:12.751349 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1171/2333] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:12 2022] POST /identity/v3/projects => generated 375 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:12.757189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:12.794449 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1163/2334] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:12 2022] POST /identity/v3/projects => generated 375 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:12.795781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:12.919449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803e47-80e7-43ea-90a6-a3756fbf0cc4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:12.943047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df66dd9-6069-4e4c-a176-2d2ef3d576ef admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:12.948963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:12.950228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:12.950624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:12.951087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:12.952251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:12.954827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.030012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.032770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.032770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.032770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.034496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.038427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.080455 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1164/2335] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:12 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:13.084684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.097895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd47ada-4da5-4263-b4db-8672fdb17a27 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.106406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.107155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.107424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.107872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.108621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.111267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.126459 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1165/2336] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:13.130899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.139647 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1172/2337] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:12 2022] POST /identity/v3/users => generated 294 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:13.146560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc623a-91e4-4ffe-8d2e-9b21c782b6ef admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.151597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.152354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.152793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.153875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] PATH_INFO: `/v3/projects/aae9364a23d44efaa6197a581ecb6581/users/9690f99451a8466eabc3251e28782775/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.159026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.174953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f030fb6-bdbd-4ccc-afe3-2bdbd71c37b4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.187887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae9364a23d44efaa6197a581ecb6581, user_id=9690f99451a8466eabc3251e28782775, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.193413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.193856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.193856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.193856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.193856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.194345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.195777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.211018 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1173/2338] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:13.216695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.229032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f598-94aa-4e8d-bfda-c56affa05240 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.235385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c9029-3ccc-402f-b21e-bbfbd9adca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.236117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9029-3ccc-402f-b21e-bbfbd9adca04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.236403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9029-3ccc-402f-b21e-bbfbd9adca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.236679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c9029-3ccc-402f-b21e-bbfbd9adca04 admin admin] PATH_INFO: `/v3/projects/75c4ec6bb0ce4b969a801483255b2485/users/05ba195a774f476e94318fca71c36ea5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.254816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c9029-3ccc-402f-b21e-bbfbd9adca04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c4ec6bb0ce4b969a801483255b2485, user_id=05ba195a774f476e94318fca71c36ea5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.259546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c9029-3ccc-402f-b21e-bbfbd9adca04 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.271518 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1166/2339] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:13 2022] PUT /identity/v3/projects/aae9364a23d44efaa6197a581ecb6581/users/9690f99451a8466eabc3251e28782775/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:13.275963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.357422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1174/2340] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:13 2022] PUT /identity/v3/projects/75c4ec6bb0ce4b969a801483255b2485/users/05ba195a774f476e94318fca71c36ea5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:13.359209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800ed74-fed7-4be1-9559-78b59b171a76 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.359506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800ed74-fed7-4be1-9559-78b59b171a76 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.360820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800ed74-fed7-4be1-9559-78b59b171a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.378907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1b06-909f-4bae-8180-6a437885ae0f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.419821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f800ed74-fed7-4be1-9559-78b59b171a76 None None] MFA Rules not processed for user `29f68fba91f1433bb6d51e956ea19022`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:13.431385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f800ed74-fed7-4be1-9559-78b59b171a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:13.478839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.479361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.479651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.479928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.480683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.483400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.496366 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1167/2341] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:13.499816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.514713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8145f-bda3-456b-aaec-83e6756244cb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.528551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.529383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.529715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.532927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.533640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.537457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.540805 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1175/2342] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:13.544491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800ed74-fed7-4be1-9559-78b59b171a76 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.563942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800ed74-fed7-4be1-9559-78b59b171a76 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.564665 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1168/2343] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:13.565752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.573198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:13.577730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.579670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.580165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.580454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] PATH_INFO: `/v3/projects/aae9364a23d44efaa6197a581ecb6581/users/9690f99451a8466eabc3251e28782775/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.584266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae9364a23d44efaa6197a581ecb6581, user_id=9690f99451a8466eabc3251e28782775, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.584801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3f912-eee8-4339-b553-8f2f0e11c159 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.588076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.591775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8642a1-ab78-4615-b188-2738f5051f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.593317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8642a1-ab78-4615-b188-2738f5051f15 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.593968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8642a1-ab78-4615-b188-2738f5051f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.594316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8642a1-ab78-4615-b188-2738f5051f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.595034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8642a1-ab78-4615-b188-2738f5051f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.598145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8642a1-ab78-4615-b188-2738f5051f15 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.637762 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1176/2344] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:13 2022] PUT /identity/v3/projects/aae9364a23d44efaa6197a581ecb6581/users/9690f99451a8466eabc3251e28782775/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:13.637762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.719847 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1169/2345] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:13 2022] POST /identity/v3/projects => generated 395 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:13.721189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54536f8-0ee7-43a2-b771-b6436aa50543 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.721752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54536f8-0ee7-43a2-b771-b6436aa50543 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.742593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54536f8-0ee7-43a2-b771-b6436aa50543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.768682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8df6b-296a-4b95-9e37-b0be58c37f0c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:13.805227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c54536f8-0ee7-43a2-b771-b6436aa50543 None None] MFA Rules not processed for user `9690f99451a8466eabc3251e28782775`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:13.806512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c54536f8-0ee7-43a2-b771-b6436aa50543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:13.906669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:13.907769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.908057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.908330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] PATH_INFO: `/v3/projects/75c4ec6bb0ce4b969a801483255b2485/users/05ba195a774f476e94318fca71c36ea5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:13.910528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c4ec6bb0ce4b969a801483255b2485, user_id=05ba195a774f476e94318fca71c36ea5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:13.913776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:13.926069 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1177/2346] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:13 2022] PUT /identity/v3/projects/75c4ec6bb0ce4b969a801483255b2485/users/05ba195a774f476e94318fca71c36ea5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:13.939094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:13.995051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1170/2347] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:13.995051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:13.995051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:13.995051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.006313 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:14.060455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] MFA Rules not processed for user `05ba195a774f476e94318fca71c36ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:14.062635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:14.116181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f8a6-8827-4727-8c82-f4fc3fffdb7b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.130276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.130276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.132001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.132565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.134197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.139574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.191389 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1171/2348] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:14.191389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:14.201347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:14.281572 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1178/2349] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:13 2022] POST /identity/v3/users => generated 304 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:14.283801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:14.296815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d10ba-8f30-4875-aea2-88ac6753cf9f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.303428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.304101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.304389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.304755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.306092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.308615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.318541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d2f9d-716c-4b59-8b41-bc2e3a5dd5f0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.324344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.326162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.326447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.326722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.329146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1179/2350] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:14.330109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:14.350072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fea69-dd98-4604-b39f-5c6dda70c037 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.358773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.360173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.360477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.360757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] PATH_INFO: `/v3/projects/a5adbcacc529415e8c3f0a2962b6341f/users/ea83122847e746eab3398447e90d52fd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.395716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5adbcacc529415e8c3f0a2962b6341f, user_id=ea83122847e746eab3398447e90d52fd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.401148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.414403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.414403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.431037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1172/2351] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:14.506792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:14.508754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:14.522406 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1180/2352] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:14 2022] PUT /identity/v3/projects/a5adbcacc529415e8c3f0a2962b6341f/users/ea83122847e746eab3398447e90d52fd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:14.524572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:14.529526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4cc8-8795-41c6-ac27-7e4c0675ab82 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.651948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71502f7c-eb84-4992-89e0-f5a316b0a6a3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.659652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.663765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.663765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.663765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.664099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.664099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.664301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.664396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.664396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.665002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.681705 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1181/2353] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:14.687495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:14.704436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472536d1-ba11-4c3c-9787-b491e3f73ac3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.710260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.710851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.711480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.711480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.766127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.769463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.784459 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1173/2354] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:14.785483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:14.791948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.794782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.799467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1f2f-8c2d-4391-a2ae-47ab738ab574 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:14.806022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:14.806859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:14.807290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:14.807787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] PATH_INFO: `/v3/projects/a5adbcacc529415e8c3f0a2962b6341f/users/ea83122847e746eab3398447e90d52fd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:14.808887 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1182/2355] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:14.810831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5adbcacc529415e8c3f0a2962b6341f, user_id=ea83122847e746eab3398447e90d52fd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:14.813691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:14.830193 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1174/2356] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:14 2022] PUT /identity/v3/projects/a5adbcacc529415e8c3f0a2962b6341f/users/ea83122847e746eab3398447e90d52fd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:14.918077 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:15.844315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:15.879795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ca6ec-1260-41ea-948a-40d4ae61b58f service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:15.985410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:15.986544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:15.987093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:15.987583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] PATH_INFO: `/v3/users/3f3a142fdbba49fdb43ea4c8f8485462` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:15.989165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3a142fdbba49fdb43ea4c8f8485462)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:15.992004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:16.305881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:16.334759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0c07c-1db9-4686-9a40-82d0f609d770 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:16.339061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3a142fdbba49fdb43ea4c8f8485462'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.343615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3a142fdbba49fdb43ea4c8f8485462'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.353633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:16.355086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:16.356081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:16.356372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] PATH_INFO: `/v3/users/aace8ea2a4be499494047f3fe1049c99` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:16.361896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aace8ea2a4be499494047f3fe1049c99)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:16.365443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:16.443993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3a142fdbba49fdb43ea4c8f8485462'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.457771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3a142fdbba49fdb43ea4c8f8485462'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.457771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e96a9837-e85f-4aab-9854-3cf820d0b1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3a142fdbba49fdb43ea4c8f8485462'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.478410 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:16.491556 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1183/2357] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:15 2022] DELETE /identity/v3/users/3f3a142fdbba49fdb43ea4c8f8485462 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:16.493795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:16.494112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:16.495071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:16.542777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:16.544603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:16.679561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aace8ea2a4be499494047f3fe1049c99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.704008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aace8ea2a4be499494047f3fe1049c99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.713596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1184/2358] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:16.720268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aace8ea2a4be499494047f3fe1049c99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.721510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aace8ea2a4be499494047f3fe1049c99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.734298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:16.736560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:16.811284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-baa27faa-e355-4fb7-a5e5-a016e8b2111f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aace8ea2a4be499494047f3fe1049c99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:16.817968 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1175/2359] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:16 2022] DELETE /identity/v3/users/aace8ea2a4be499494047f3fe1049c99 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:16.827919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:16.828348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:16.828497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:16.854918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedb5a-ad04-4ab4-9062-c35726cfb02d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:16.860764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:16.862084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:16.951994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:16.953260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:16.953763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:16.954283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:16.957580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:17.011101 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1176/2360] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:17.034707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:17.041185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:17.099318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5387f-99d0-4dd0-bdc3-68cb0442a3e9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:17.104605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:17.105298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:17.105645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:17.105997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:17.114305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:17.116743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:17.120931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:17.125735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:17.137853 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1185/2361] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:17.171185 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1177/2362] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:17.336008 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:17.918263 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:18.160671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:18.172733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:18.210700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9e2a-6a6c-4920-a29c-7103aeb0f962 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:18.231982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:18.231982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:18.232251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:18.232527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] PATH_INFO: `/v3/projects/702d01eac1f244669cbbcefc8f094a35` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:18.235034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=702d01eac1f244669cbbcefc8f094a35)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:18.242641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:18.390987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:18.392453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:18.415235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391ad0c-0538-479f-9668-0f18a083ad1f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:18.474224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702d01eac1f244669cbbcefc8f094a35', 'request_id': 'req-80a3cab6-538e-40e5-bd61-631485fbf88a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.507003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702d01eac1f244669cbbcefc8f094a35', 'request_id': 'req-80a3cab6-538e-40e5-bd61-631485fbf88a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.555533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:18.556193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:18.556477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:18.556760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] PATH_INFO: `/v3/projects/68911ce3ec2b4058848bceddedcac592` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:18.557940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=68911ce3ec2b4058848bceddedcac592)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:18.561137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:18.608949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702d01eac1f244669cbbcefc8f094a35', 'request_id': 'req-80a3cab6-538e-40e5-bd61-631485fbf88a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.632961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] The token cache is being invalidate because project 702d01eac1f244669cbbcefc8f094a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:18.633267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.637972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.643252 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1186/2363] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:18 2022] DELETE /identity/v3/projects/702d01eac1f244669cbbcefc8f094a35 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:18.644718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:18.646542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:18.690287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3cab6-538e-40e5-bd61-631485fbf88a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:18.695667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68911ce3ec2b4058848bceddedcac592', 'request_id': 'req-15a2d37b-62df-433d-98e6-8b82ac7277ea'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.703229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68911ce3ec2b4058848bceddedcac592', 'request_id': 'req-15a2d37b-62df-433d-98e6-8b82ac7277ea'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.775676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68911ce3ec2b4058848bceddedcac592', 'request_id': 'req-15a2d37b-62df-433d-98e6-8b82ac7277ea'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.804543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:18.805983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] The token cache is being invalidate because project 68911ce3ec2b4058848bceddedcac592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:18.806135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:18.806554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:18.806930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.807044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] PATH_INFO: `/v3/users/05ba195a774f476e94318fca71c36ea5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:18.808681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:18.809216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ba195a774f476e94318fca71c36ea5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:18.813881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:18.816425 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1178/2364] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:18 2022] DELETE /identity/v3/projects/68911ce3ec2b4058848bceddedcac592 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:18.822689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:18.825710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:18.849691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2d37b-62df-433d-98e6-8b82ac7277ea admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:18.874664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:18.875341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:18.875632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:18.875915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] PATH_INFO: `/v3/users/9690f99451a8466eabc3251e28782775` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:18.880903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9690f99451a8466eabc3251e28782775)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:18.884369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:19.020548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ba195a774f476e94318fca71c36ea5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.022174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ba195a774f476e94318fca71c36ea5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.085451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9690f99451a8466eabc3251e28782775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.115908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9690f99451a8466eabc3251e28782775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.124393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ba195a774f476e94318fca71c36ea5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.147198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ba195a774f476e94318fca71c36ea5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.148228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ba195a774f476e94318fca71c36ea5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.170897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9690f99451a8466eabc3251e28782775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.172727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9690f99451a8466eabc3251e28782775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.190036 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1187/2365] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:18 2022] DELETE /identity/v3/users/05ba195a774f476e94318fca71c36ea5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:19.301361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9690f99451a8466eabc3251e28782775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:19.315304 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1179/2366] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:18 2022] DELETE /identity/v3/users/9690f99451a8466eabc3251e28782775 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:19.500158 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:19.566801 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:20.227459 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:20.426526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:20.428561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:20.485848 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:20.540391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ae887-adba-40fd-a6c1-f147bfcc6d52 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:20.647416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:20.648094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:20.649010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:20.649376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] PATH_INFO: `/v3/projects/75c4ec6bb0ce4b969a801483255b2485` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:20.651919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c4ec6bb0ce4b969a801483255b2485)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:20.654843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:20.815823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:20.818219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:20.844024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e4ab7-b836-419b-9e79-bef6a54993b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:20.846470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c4ec6bb0ce4b969a801483255b2485', 'request_id': 'req-71361a9e-956d-4db5-aba6-49b9eed19cde'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:20.870364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c4ec6bb0ce4b969a801483255b2485', 'request_id': 'req-71361a9e-956d-4db5-aba6-49b9eed19cde'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:20.953672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c4ec6bb0ce4b969a801483255b2485', 'request_id': 'req-71361a9e-956d-4db5-aba6-49b9eed19cde'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:20.975910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] The token cache is being invalidate because project 75c4ec6bb0ce4b969a801483255b2485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:20.976463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:20.977306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-71361a9e-956d-4db5-aba6-49b9eed19cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:20.979315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1188/2367] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:20 2022] DELETE /identity/v3/projects/75c4ec6bb0ce4b969a801483255b2485 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:20.985075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f2557-44b6-432e-9657-14e09638025d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:20.985573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f2557-44b6-432e-9657-14e09638025d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:20.986050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f2557-44b6-432e-9657-14e09638025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:20.993024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:20.993823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:20.994316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:20.994697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] PATH_INFO: `/v3/projects/aae9364a23d44efaa6197a581ecb6581` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:20.997535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae9364a23d44efaa6197a581ecb6581)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.012669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:21.049757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5c9f2557-44b6-432e-9657-14e09638025d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:21.051263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5c9f2557-44b6-432e-9657-14e09638025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:21.070729 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1189/2368] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:21.080159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1e11e-2536-497e-8b80-0a8c27b7a55b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.080416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1e11e-2536-497e-8b80-0a8c27b7a55b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.080767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1e11e-2536-497e-8b80-0a8c27b7a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.116961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-53e1e11e-2536-497e-8b80-0a8c27b7a55b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:21.116961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-53e1e11e-2536-497e-8b80-0a8c27b7a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:21.127714 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1190/2369] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:21.132955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1e11e-2536-497e-8b80-0a8c27b7a55b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.146314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1e11e-2536-497e-8b80-0a8c27b7a55b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.162442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:21.169390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.169390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.169390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.169390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:21.169390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.169390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:21.208547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1191/2370] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:21.218040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.236147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae9364a23d44efaa6197a581ecb6581', 'request_id': 'req-31efa75f-738e-4e0e-8d5a-aedf958c55e4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:21.247563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974dbd5-32af-45c9-b9c6-cef3ca7f39e2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.253365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae9364a23d44efaa6197a581ecb6581', 'request_id': 'req-31efa75f-738e-4e0e-8d5a-aedf958c55e4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:21.364641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:21.371104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.371104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.371104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.371104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.371104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:21.374176 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:21.376845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae9364a23d44efaa6197a581ecb6581', 'request_id': 'req-31efa75f-738e-4e0e-8d5a-aedf958c55e4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:21.397377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] The token cache is being invalidate because project aae9364a23d44efaa6197a581ecb6581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:21.398017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:21.398854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-31efa75f-738e-4e0e-8d5a-aedf958c55e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:21.401056 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1180/2371] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:20 2022] DELETE /identity/v3/projects/aae9364a23d44efaa6197a581ecb6581 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:21.408267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21988-5dc6-4de8-a358-24f2dac218f7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.408564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21988-5dc6-4de8-a358-24f2dac218f7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.408918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21988-5dc6-4de8-a358-24f2dac218f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.436082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aee21988-5dc6-4de8-a358-24f2dac218f7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:21.438081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aee21988-5dc6-4de8-a358-24f2dac218f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:21.448231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1181/2372] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:21.456309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c82da3-21f0-4837-aa05-e97f4fb29884 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.456586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c82da3-21f0-4837-aa05-e97f4fb29884 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.457016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c82da3-21f0-4837-aa05-e97f4fb29884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.481460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-37c82da3-21f0-4837-aa05-e97f4fb29884 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:21.483261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-37c82da3-21f0-4837-aa05-e97f4fb29884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:21.504534 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1182/2373] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:21.511202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c82da3-21f0-4837-aa05-e97f4fb29884 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.517433 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1192/2374] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:21 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:21.528254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c82da3-21f0-4837-aa05-e97f4fb29884 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.532652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.538041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:21.656092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:21.657327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.658384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.659393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.660248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:21.660651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.662780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:21.692124 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1183/2375] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:21.693218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.696987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90eba-579a-4f33-8898-42f583167880 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.705965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:21.705965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.705965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.705965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.706991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.712177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:21.716229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c1346-6d5d-4210-a94b-054ec78fd407 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.723390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:21.724184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.724548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.724888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.725907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.728938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:21.838113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1193/2376] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:21 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:21.840067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.843737 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1184/2377] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:21 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:21.845843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.860946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bf0c-97d7-4183-bd57-cb65a5fdd50d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.970753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dac4-94f4-4f44-ab6f-8d2d310bd2b0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.976315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:21.977026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.977373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.977914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.979253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.981990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.020655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.023361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.024069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.026058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.031646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.034464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.051587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1194/2378] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:22.057756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.070036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7be7-b140-45ad-9840-113b35c0b248 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:22.076937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.078042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.078412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.078802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.079732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.082238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.084929 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1185/2379] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:21 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:22.089350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.124529 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1195/2380] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:22.125676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.127677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d22cf9-807a-4a89-a013-04e396179209 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:22.153122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a6cf2-9013-4a04-b8dc-76b93e7ec37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.156544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6cf2-9013-4a04-b8dc-76b93e7ec37f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.157103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6cf2-9013-4a04-b8dc-76b93e7ec37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.157716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6cf2-9013-4a04-b8dc-76b93e7ec37f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.159093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a6cf2-9013-4a04-b8dc-76b93e7ec37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.165656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a6cf2-9013-4a04-b8dc-76b93e7ec37f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.173411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e84eef-170b-40dd-8208-53762d224603 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:22.179023 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1186/2381] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:22.180448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab86e51-ed0c-4ec4-9cc2-fefd4a257d74 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.180739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab86e51-ed0c-4ec4-9cc2-fefd4a257d74 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.181020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab86e51-ed0c-4ec4-9cc2-fefd4a257d74 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.183533 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1187/2382] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:22.183901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.184301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab86e51-ed0c-4ec4-9cc2-fefd4a257d74 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.184566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.184844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.185204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] PATH_INFO: `/v3/projects/f81ddc8b54ef43beb36bb4a5b56a9696/users/14538ff4bfdd4684a91b692f603e898f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.202440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab86e51-ed0c-4ec4-9cc2-fefd4a257d74 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:22.216142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379d87c-68bf-48ea-8e52-845dc7cc487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.216731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81ddc8b54ef43beb36bb4a5b56a9696, user_id=14538ff4bfdd4684a91b692f603e898f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.217023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379d87c-68bf-48ea-8e52-845dc7cc487d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.217730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379d87c-68bf-48ea-8e52-845dc7cc487d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.218070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379d87c-68bf-48ea-8e52-845dc7cc487d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.221129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379d87c-68bf-48ea-8e52-845dc7cc487d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.229596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379d87c-68bf-48ea-8e52-845dc7cc487d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.232886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.243093 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1188/2383] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:22.250184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.250603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.253594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.291248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:22.292889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:22.353631 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1196/2384] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:22 2022] PUT /identity/v3/projects/f81ddc8b54ef43beb36bb4a5b56a9696/users/14538ff4bfdd4684a91b692f603e898f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:22.354514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.397013 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1189/2385] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:22.399325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.400142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:22.430740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c67df-7dd6-415c-9984-fecf243f2065 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:22.509983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c59e-9f57-424c-b1dc-08844387bb6f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:22.520965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc22c0-498b-48b3-bd75-d6c170df30dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.521627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc22c0-498b-48b3-bd75-d6c170df30dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.521991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc22c0-498b-48b3-bd75-d6c170df30dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.522265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc22c0-498b-48b3-bd75-d6c170df30dc admin admin] PATH_INFO: `/v3/projects/91e1b5c48ca04909a7ed943d1b196698/users/2e16184b6d334e548f953846d0271f41/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.527938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.528819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.530596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.531390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] PATH_INFO: `/v3/users/06982dfc91b943a193c47af05babf4cf` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.533127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06982dfc91b943a193c47af05babf4cf)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.535214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.550893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc22c0-498b-48b3-bd75-d6c170df30dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e1b5c48ca04909a7ed943d1b196698, user_id=2e16184b6d334e548f953846d0271f41, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.553770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc22c0-498b-48b3-bd75-d6c170df30dc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.631187 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1197/2386] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:22 2022] PUT /identity/v3/projects/91e1b5c48ca04909a7ed943d1b196698/users/2e16184b6d334e548f953846d0271f41/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:22.633487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bbbed-4749-4c4e-ba12-fc0fbdf47217 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.634025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bbbed-4749-4c4e-ba12-fc0fbdf47217 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.634677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bbbed-4749-4c4e-ba12-fc0fbdf47217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.673077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6b2bbbed-4749-4c4e-ba12-fc0fbdf47217 None None] MFA Rules not processed for user `14538ff4bfdd4684a91b692f603e898f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:22.674809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b2bbbed-4749-4c4e-ba12-fc0fbdf47217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:22.758700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06982dfc91b943a193c47af05babf4cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:22.774885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06982dfc91b943a193c47af05babf4cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:22.775118 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1198/2387] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:22.776187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b416d-994c-4fad-b04a-38ae66c84fec None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.776474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b416d-994c-4fad-b04a-38ae66c84fec None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.777000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b416d-994c-4fad-b04a-38ae66c84fec None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.778415 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1199/2388] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:22.779459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b416d-994c-4fad-b04a-38ae66c84fec None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.781253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-895b416d-994c-4fad-b04a-38ae66c84fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:22.787728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06982dfc91b943a193c47af05babf4cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:22.788417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06982dfc91b943a193c47af05babf4cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:22.861563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b416d-994c-4fad-b04a-38ae66c84fec None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:22.868433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15c4e6-b7c1-4f51-8ab3-d2b64008fe98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:22.869120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15c4e6-b7c1-4f51-8ab3-d2b64008fe98 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.869409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15c4e6-b7c1-4f51-8ab3-d2b64008fe98 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.877668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15c4e6-b7c1-4f51-8ab3-d2b64008fe98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.877668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-de15c4e6-b7c1-4f51-8ab3-d2b64008fe98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:22.885253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15c4e6-b7c1-4f51-8ab3-d2b64008fe98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:22.887036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15c4e6-b7c1-4f51-8ab3-d2b64008fe98 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:22.901705 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:22.907578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06982dfc91b943a193c47af05babf4cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:22.912914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1200/2389] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:22.914844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975f4a-2964-49d3-befc-40fc96ac52f1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:22.917895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1190/2390] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:22 2022] DELETE /identity/v3/users/06982dfc91b943a193c47af05babf4cf => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:22.918337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975f4a-2964-49d3-befc-40fc96ac52f1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:22.918738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb975f4a-2964-49d3-befc-40fc96ac52f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:22.919421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:22.922777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:22.975588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cb975f4a-2964-49d3-befc-40fc96ac52f1 None None] MFA Rules not processed for user `2e16184b6d334e548f953846d0271f41`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:22.977001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cb975f4a-2964-49d3-befc-40fc96ac52f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:23.023073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a8e61-8fcb-451f-8d31-762eb54f355a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.036250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.036388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.037887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.037887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.038189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.040005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.086852 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1201/2391] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:23.086852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f893f-404c-4664-84ed-abbdd29bd03c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.086852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f893f-404c-4664-84ed-abbdd29bd03c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.086852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f893f-404c-4664-84ed-abbdd29bd03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.097661 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:23.109786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d24f893f-404c-4664-84ed-abbdd29bd03c None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:23.111192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d24f893f-404c-4664-84ed-abbdd29bd03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:23.135994 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1191/2392] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:22 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:23.135994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.136796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:23.209657 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1202/2393] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:23.216389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f893f-404c-4664-84ed-abbdd29bd03c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.230633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f893f-404c-4664-84ed-abbdd29bd03c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.239860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.240266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.240543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.240914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.241505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.244836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.255559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aff41-8cdc-4a75-a6d9-85bf47db13a3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.261460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.262340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.262467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.262699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.263346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.266372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.322340 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1203/2394] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:23 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:23.322340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.324058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:23.353609 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1192/2395] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:23 2022] POST /identity/v3/projects => generated 391 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:23.353609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.397670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7a74-1c60-4526-9bbb-778e80a251d6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.453181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fd8bd-a52f-4517-abc2-9c2f1e792c73 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.458947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.459384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.459670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.459947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.460605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.462306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.462438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.463223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.463571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.463853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.475759 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1193/2396] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:23.476843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.488456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56db5b-cc32-4e01-96ea-2af478e5d124 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.493956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4777d64-330d-438a-a16a-62fec848c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.494699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777d64-330d-438a-a16a-62fec848c2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.495019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777d64-330d-438a-a16a-62fec848c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.495241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777d64-330d-438a-a16a-62fec848c2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.495850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4777d64-330d-438a-a16a-62fec848c2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.498809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4777d64-330d-438a-a16a-62fec848c2d5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.547716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.549424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.561554 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1204/2397] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:23.566671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.578998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2087-e7d9-45bb-9415-ec5b8fe3103c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.588757 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1194/2398] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:23 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:23.590412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.590705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.591040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.614572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.616893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.619728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.619728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] PATH_INFO: `/v3/projects/bf8662417f6d41cc8dedc151d4f119b0/users/62ea8d2395724695a3fc6599ba8a7603/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.626021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:23.627508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:23.636552 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1195/2399] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:23.637888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.641307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:23.655269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8662417f6d41cc8dedc151d4f119b0, user_id=62ea8d2395724695a3fc6599ba8a7603, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.658107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.687016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81e0bf-c570-4c6f-86aa-51ad3082f9a7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.695105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:23.696062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:23.696062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:23.696293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] PATH_INFO: `/v3/projects/f40e5d79873a4c11ae76b5cbb805178f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:23.710024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40e5d79873a4c11ae76b5cbb805178f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:23.716806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:23.767524 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1205/2400] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:23 2022] PUT /identity/v3/projects/bf8662417f6d41cc8dedc151d4f119b0/users/62ea8d2395724695a3fc6599ba8a7603/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:23.768392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:23.931649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150af3-f669-45b5-a93e-d5fd7903a962 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:23.942560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40e5d79873a4c11ae76b5cbb805178f', 'request_id': 'req-76be956b-ad5c-4b56-a9d5-d56cadf496fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:23.970116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40e5d79873a4c11ae76b5cbb805178f', 'request_id': 'req-76be956b-ad5c-4b56-a9d5-d56cadf496fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:24.020551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:24.021277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.021864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.022023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.022779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:24.024486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:24.039942 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1206/2401] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:24.039942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:24.044704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40e5d79873a4c11ae76b5cbb805178f', 'request_id': 'req-76be956b-ad5c-4b56-a9d5-d56cadf496fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:24.060420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] The token cache is being invalidate because project f40e5d79873a4c11ae76b5cbb805178f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:24.061380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:24.063261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:24.064132 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1196/2402] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:23 2022] DELETE /identity/v3/projects/f40e5d79873a4c11ae76b5cbb805178f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:24.065041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:24.066601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:24.081989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be956b-ad5c-4b56-a9d5-d56cadf496fb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:24.091245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:24.091972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.092341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.103242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.103242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:24.103242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:24.119563 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1197/2403] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:24.122729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:24.127859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:24.129257 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:24.143166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d7d15-8997-4cde-918a-43254b9b5efe admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:24.149341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:24.150611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.150611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.150802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] PATH_INFO: `/v3/projects/1df260fc414746e98ad427fc5a6326df/users/24c4ab7bda9f43339142c97aca296e1b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.158159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1fc77-453e-4d82-8159-f154c1757ad8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:24.165307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1841e9c-e38c-4894-be7c-d580eb4e83cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:24.166995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df260fc414746e98ad427fc5a6326df, user_id=24c4ab7bda9f43339142c97aca296e1b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:24.167657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841e9c-e38c-4894-be7c-d580eb4e83cc service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.168160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841e9c-e38c-4894-be7c-d580eb4e83cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.168672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841e9c-e38c-4894-be7c-d580eb4e83cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.169721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:24.172294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1841e9c-e38c-4894-be7c-d580eb4e83cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:24.186508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1841e9c-e38c-4894-be7c-d580eb4e83cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:24.189447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1841e9c-e38c-4894-be7c-d580eb4e83cc service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:24.197698 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1207/2404] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:24.198890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ba9c7-22a3-4626-bf10-3b257aaeda24 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.199247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ba9c7-22a3-4626-bf10-3b257aaeda24 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.199621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ba9c7-22a3-4626-bf10-3b257aaeda24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.209401 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:24.240125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5a3ba9c7-22a3-4626-bf10-3b257aaeda24 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:24.253512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5a3ba9c7-22a3-4626-bf10-3b257aaeda24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:24.266772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1198/2405] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:24 2022] PUT /identity/v3/projects/1df260fc414746e98ad427fc5a6326df/users/24c4ab7bda9f43339142c97aca296e1b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:24.267889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:24.406801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1208/2406] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:24.407713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ba9c7-22a3-4626-bf10-3b257aaeda24 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:24.428400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29c5b-92c0-474f-9bbf-f7f56ffb13cd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:24.434002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ba9c7-22a3-4626-bf10-3b257aaeda24 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:24.439826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:24.440516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.440800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.441079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] PATH_INFO: `/v3/projects/bf8662417f6d41cc8dedc151d4f119b0/users/62ea8d2395724695a3fc6599ba8a7603/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.445183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8662417f6d41cc8dedc151d4f119b0, user_id=62ea8d2395724695a3fc6599ba8a7603, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:24.447552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28211d06-72a3-42c0-9682-ca1a3b3787f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:24.448177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211d06-72a3-42c0-9682-ca1a3b3787f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.448458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211d06-72a3-42c0-9682-ca1a3b3787f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.448732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211d06-72a3-42c0-9682-ca1a3b3787f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.449378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28211d06-72a3-42c0-9682-ca1a3b3787f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:24.451018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28211d06-72a3-42c0-9682-ca1a3b3787f8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:24.454138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:24.472179 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1209/2407] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:24.476636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bbbec-de99-44c0-843c-822eb2816031 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.476924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bbbec-de99-44c0-843c-822eb2816031 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.477204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bbbec-de99-44c0-843c-822eb2816031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.489687 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1199/2408] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:24 2022] PUT /identity/v3/projects/bf8662417f6d41cc8dedc151d4f119b0/users/62ea8d2395724695a3fc6599ba8a7603/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:24.500347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:24.522317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9b1bbbec-de99-44c0-843c-822eb2816031 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:24.523576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b1bbbec-de99-44c0-843c-822eb2816031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:24.627832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984d481-bc3e-4419-a913-8160a35ee71c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:24.633687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849cd5-3186-4f32-9351-c7a68102845e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:24.634786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849cd5-3186-4f32-9351-c7a68102845e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.635265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849cd5-3186-4f32-9351-c7a68102845e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.635957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849cd5-3186-4f32-9351-c7a68102845e admin admin] PATH_INFO: `/v3/projects/1df260fc414746e98ad427fc5a6326df/users/24c4ab7bda9f43339142c97aca296e1b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.639099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849cd5-3186-4f32-9351-c7a68102845e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df260fc414746e98ad427fc5a6326df, user_id=24c4ab7bda9f43339142c97aca296e1b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:24.642560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849cd5-3186-4f32-9351-c7a68102845e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:24.658496 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1200/2409] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:24 2022] PUT /identity/v3/projects/1df260fc414746e98ad427fc5a6326df/users/24c4ab7bda9f43339142c97aca296e1b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:24.658868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc831d-7196-4107-92e2-bc6a582b5ec6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.659308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc831d-7196-4107-92e2-bc6a582b5ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.659758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc831d-7196-4107-92e2-bc6a582b5ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.672999 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1210/2410] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:24.672999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1b03-db51-4afe-a998-ee45fb307c15 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:24.672999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1b03-db51-4afe-a998-ee45fb307c15 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:24.672999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1b03-db51-4afe-a998-ee45fb307c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:24.703536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2fdc831d-7196-4107-92e2-bc6a582b5ec6 None None] MFA Rules not processed for user `62ea8d2395724695a3fc6599ba8a7603`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:24.704044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2fdc831d-7196-4107-92e2-bc6a582b5ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:24.743085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8b8e1b03-db51-4afe-a998-ee45fb307c15 None None] MFA Rules not processed for user `24c4ab7bda9f43339142c97aca296e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:24.744657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8b8e1b03-db51-4afe-a998-ee45fb307c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:24.830592 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1201/2411] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:24.830592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc831d-7196-4107-92e2-bc6a582b5ec6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:24.851404 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:24.940154 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1211/2412] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:24.963696 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:24.983521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc831d-7196-4107-92e2-bc6a582b5ec6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.000823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.001495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.002939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.002939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.003426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:25.003744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.010258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.041173 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1202/2413] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:25.047910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1b03-db51-4afe-a998-ee45fb307c15 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.051032 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:25.060251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1b03-db51-4afe-a998-ee45fb307c15 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.071502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.074685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.075405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.075405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.075908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.082563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.208919 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1212/2414] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:25 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:25.213078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.236902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf797b7a-9238-4ad1-8156-39e87ef4d591 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.351808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.352467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.352748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.353023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.353671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.358283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.402699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.409889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:25.544126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2684d09-ca71-46ae-80e2-ef4ee2dfbd16 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.554170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1203/2415] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:25 2022] POST /identity/v3/users => generated 296 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:25.555442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.562623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.563288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.564056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.566568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.579047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6c219-2031-4146-838e-6483b72c3eb3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.585239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.585950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.586312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.586591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.587258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.601477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.616721 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1204/2416] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:25.620570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.643362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5c516-468b-4cf4-b654-7f867344679e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.661655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.663804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.664758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.666404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.667523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.670081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.691105 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1205/2417] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:25.696439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.710403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.724365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.725390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e947013-d8e9-46ba-8c4e-880267e397a4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.731724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b0edd-8813-4e4f-acb6-69f6b4a47e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.733210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0edd-8813-4e4f-acb6-69f6b4a47e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.733210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0edd-8813-4e4f-acb6-69f6b4a47e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.733210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b0edd-8813-4e4f-acb6-69f6b4a47e91 admin admin] PATH_INFO: `/v3/projects/c9a7670da79941ac9c0305dea9751fdb/users/dc3dcb6902a04681a54264d3743ed04a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.746076 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1213/2418] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:25.759012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b0edd-8813-4e4f-acb6-69f6b4a47e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a7670da79941ac9c0305dea9751fdb, user_id=dc3dcb6902a04681a54264d3743ed04a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.760079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.788324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da19e-d4cb-4acd-be87-0f3d1fef9ec8 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.788623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b0edd-8813-4e4f-acb6-69f6b4a47e91 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.821373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.821686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.827725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.828015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] PATH_INFO: `/v3/users/2e16184b6d334e548f953846d0271f41` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.830348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e16184b6d334e548f953846d0271f41)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.834079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.940282 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1206/2419] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:25 2022] PUT /identity/v3/projects/c9a7670da79941ac9c0305dea9751fdb/users/dc3dcb6902a04681a54264d3743ed04a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:25.945264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.945647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.946019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.980005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:25.981463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:26.110837 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1207/2420] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:26.126812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e16184b6d334e548f953846d0271f41'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:26.134060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e16184b6d334e548f953846d0271f41'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:26.169241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:26.171385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:26.239721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e16184b6d334e548f953846d0271f41'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:26.250431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e16184b6d334e548f953846d0271f41'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:26.252358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63b20b42-0068-43f5-a59f-a14e7893c15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e16184b6d334e548f953846d0271f41'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:26.287649 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1214/2421] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:25 2022] DELETE /identity/v3/users/2e16184b6d334e548f953846d0271f41 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:26.292391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:26.292727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:26.293017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:26.300430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85612a-f549-4cd8-a181-ce748b55c83c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:26.334064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:26.337930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:26.376945 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:26.448421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:26.453519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:26.456149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:26.458584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:26.469519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:26.546604 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1215/2422] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:26.594195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:26.595843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:26.601526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:26.603389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:26.610850 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1208/2423] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:26.624761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9811-b52d-469e-b788-b0afc36115b7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:26.635385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:26.636049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:26.636440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:26.638640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:26.662581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:26.665207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:26.694611 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1216/2424] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:26.789124 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:27.715714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:27.722832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:27.742532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28612-6631-4a10-88cb-f0768ed6c04a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:27.756704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:27.757431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:27.757743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:27.758841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] PATH_INFO: `/v3/users/14538ff4bfdd4684a91b692f603e898f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:27.765666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14538ff4bfdd4684a91b692f603e898f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:27.773013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:28.024305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:28.027053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:28.068945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf7efe-e56e-4442-9a4c-6d141a4e5643 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:28.070092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14538ff4bfdd4684a91b692f603e898f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.086613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:28.087268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:28.087555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:28.087838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] PATH_INFO: `/v3/projects/91e1b5c48ca04909a7ed943d1b196698` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:28.093130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e1b5c48ca04909a7ed943d1b196698)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:28.099275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:28.130987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14538ff4bfdd4684a91b692f603e898f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.144088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14538ff4bfdd4684a91b692f603e898f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.144825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14538ff4bfdd4684a91b692f603e898f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.245867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-634852ad-15d5-4317-9973-36208b7b6e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14538ff4bfdd4684a91b692f603e898f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.253931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1209/2425] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:27 2022] DELETE /identity/v3/users/14538ff4bfdd4684a91b692f603e898f => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:28.258602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:28.258895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:28.259175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:28.290332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:28.291580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:28.318613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e1b5c48ca04909a7ed943d1b196698', 'request_id': 'req-4f5f49b6-65c2-4374-8755-2772148d7a14'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.336401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e1b5c48ca04909a7ed943d1b196698', 'request_id': 'req-4f5f49b6-65c2-4374-8755-2772148d7a14'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.501708 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:28.502555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e1b5c48ca04909a7ed943d1b196698', 'request_id': 'req-4f5f49b6-65c2-4374-8755-2772148d7a14'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.521160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] The token cache is being invalidate because project 91e1b5c48ca04909a7ed943d1b196698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:28.522251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.524429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.527136 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1217/2426] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:28 2022] DELETE /identity/v3/projects/91e1b5c48ca04909a7ed943d1b196698 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:28.531850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:28.537548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:28.537752 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1210/2427] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:28.553567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f49b6-65c2-4374-8755-2772148d7a14 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:28.559480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:28.560269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:28.560613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:28.560964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] PATH_INFO: `/v3/users/24c4ab7bda9f43339142c97aca296e1b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:28.562733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c4ab7bda9f43339142c97aca296e1b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:28.569566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:28.593129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:28.594689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:28.735662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5f3c4-ceba-47ac-aed3-99a36fe33fff None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:28.740576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e2ea-efd7-4949-86ab-5c11919a3961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:28.741372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e2ea-efd7-4949-86ab-5c11919a3961 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:28.741760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e2ea-efd7-4949-86ab-5c11919a3961 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:28.742190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e2ea-efd7-4949-86ab-5c11919a3961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:28.744786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3237e2ea-efd7-4949-86ab-5c11919a3961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:28.762532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e2ea-efd7-4949-86ab-5c11919a3961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:28.764147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e2ea-efd7-4949-86ab-5c11919a3961 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:28.775375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1211/2428] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:28.797997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c4ab7bda9f43339142c97aca296e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.798740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c4ab7bda9f43339142c97aca296e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.868492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c4ab7bda9f43339142c97aca296e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.878704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c4ab7bda9f43339142c97aca296e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.879689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00b29e22-fb04-42cc-9538-2bca94014581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c4ab7bda9f43339142c97aca296e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:28.900255 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1218/2429] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:28 2022] DELETE /identity/v3/users/24c4ab7bda9f43339142c97aca296e1b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:29.084695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:29.084991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:29.085272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:29.115695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] MFA Rules not processed for user `ea83122847e746eab3398447e90d52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:29.117332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:29.202930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1212/2430] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:29.213593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:29.214174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:29.214257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:29.235676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] MFA Rules not processed for user `29f68fba91f1433bb6d51e956ea19022`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:29.237885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:29.272381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:29.274537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:29.352576 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1219/2431] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:29.363905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:29.365641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:29.383094 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:29.470320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149e17-750c-487f-a230-e3ccd12687cd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:29.475756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:29.476944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:29.476944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:29.477238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] PATH_INFO: `/v3/projects/f81ddc8b54ef43beb36bb4a5b56a9696` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:29.478598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81ddc8b54ef43beb36bb4a5b56a9696)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:29.484778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:29.566349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bcf74-9476-4bdd-9149-7c7a6e2b6c18 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:29.582986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:29.587330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:29.588569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:29.589065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:29.594877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:29.649580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:29.651003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81ddc8b54ef43beb36bb4a5b56a9696', 'request_id': 'req-b292cd25-008e-4174-9d87-02bea88cb21d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:29.655757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:29.666449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81ddc8b54ef43beb36bb4a5b56a9696', 'request_id': 'req-b292cd25-008e-4174-9d87-02bea88cb21d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:29.695185 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1220/2432] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:29.778366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:29.779903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:29.821059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8e796-89a1-44a8-a66e-fefa06256260 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:29.834104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81ddc8b54ef43beb36bb4a5b56a9696', 'request_id': 'req-b292cd25-008e-4174-9d87-02bea88cb21d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:29.853283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] The token cache is being invalidate because project f81ddc8b54ef43beb36bb4a5b56a9696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:29.853840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:29.854704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:29.861414 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1213/2433] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:29 2022] DELETE /identity/v3/projects/f81ddc8b54ef43beb36bb4a5b56a9696 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:29.865378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:29.866915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:29.934246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:29.950268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:29.950268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:29.950268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] PATH_INFO: `/v3/projects/1df260fc414746e98ad427fc5a6326df` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:29.950268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df260fc414746e98ad427fc5a6326df)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:29.950268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:30.047840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292cd25-008e-4174-9d87-02bea88cb21d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:30.054023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:30.054825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:30.055258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:30.055765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] PATH_INFO: `/v3/users/62ea8d2395724695a3fc6599ba8a7603` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:30.057048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ea8d2395724695a3fc6599ba8a7603)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:30.059601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:30.151801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df260fc414746e98ad427fc5a6326df', 'request_id': 'req-86e3e3de-7eed-4201-8431-d012d84cb7bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.164095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df260fc414746e98ad427fc5a6326df', 'request_id': 'req-86e3e3de-7eed-4201-8431-d012d84cb7bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.256762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df260fc414746e98ad427fc5a6326df', 'request_id': 'req-86e3e3de-7eed-4201-8431-d012d84cb7bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.275803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] The token cache is being invalidate because project 1df260fc414746e98ad427fc5a6326df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:30.278765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.281073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86e3e3de-7eed-4201-8431-d012d84cb7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.285482 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1221/2434] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:29 2022] DELETE /identity/v3/projects/1df260fc414746e98ad427fc5a6326df => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:30.291438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fafe4-70ab-4dcd-905d-50ee73863d3f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:30.291944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fafe4-70ab-4dcd-905d-50ee73863d3f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:30.292374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fafe4-70ab-4dcd-905d-50ee73863d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:30.331200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ea8d2395724695a3fc6599ba8a7603'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.348140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ea8d2395724695a3fc6599ba8a7603'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.359703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ea8d2395724695a3fc6599ba8a7603'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.360881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-720fafe4-70ab-4dcd-905d-50ee73863d3f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:30.362330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-720fafe4-70ab-4dcd-905d-50ee73863d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:30.362584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ea8d2395724695a3fc6599ba8a7603'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.455535 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1222/2435] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:30.464575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87735ad4-6e94-4a78-ae8e-ff4c4379f890 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:30.464968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87735ad4-6e94-4a78-ae8e-ff4c4379f890 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:30.465399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87735ad4-6e94-4a78-ae8e-ff4c4379f890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:30.468904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ea8d2395724695a3fc6599ba8a7603'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:30.488806 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1214/2436] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:29 2022] DELETE /identity/v3/users/62ea8d2395724695a3fc6599ba8a7603 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:30.488806 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:30.511524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-87735ad4-6e94-4a78-ae8e-ff4c4379f890 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:30.512843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-87735ad4-6e94-4a78-ae8e-ff4c4379f890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:30.615068 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1223/2437] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:30.618766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:30.633638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07134f7-c8e7-4fcc-ab3d-9cd3c99148da admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:30.644948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:30.647764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:30.648262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:30.649844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:30.652042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:30.653626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:30.656467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:30.685738 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1215/2438] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:30.686421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87735ad4-6e94-4a78-ae8e-ff4c4379f890 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:30.697589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87735ad4-6e94-4a78-ae8e-ff4c4379f890 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:30.703361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:30.704178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:30.704461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:30.704747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:30.705422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:30.707441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:30.812502 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1224/2439] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:30 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:30.817011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:30.831182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc9463-b9ed-4946-a8f0-e2dbf0b5f963 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:31.003020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:31.003817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:31.004058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:31.004339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:31.005043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:31.009338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:31.110951 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1216/2440] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:30 2022] POST /identity/v3/users => generated 286 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:31.115712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:31.151927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863625e-acd3-4543-9a59-1f699e260c05 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:31.179608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:31.182819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:31.183289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:31.184782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:31.186263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:31.189257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:31.203724 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1225/2441] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:31.209506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:31.225848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ae643-77d8-400a-8f55-eae91e3d62b7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:31.233011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:31.235306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:31.235761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:31.236205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:31.236949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:31.250298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:31.275641 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1217/2442] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:31.280301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:31.299033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ab91-dae5-4640-afc8-697fb9759de9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:31.314681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1400a9-d069-4a7b-8e5c-dd016b964e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:31.315503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1400a9-d069-4a7b-8e5c-dd016b964e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:31.316377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1400a9-d069-4a7b-8e5c-dd016b964e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:31.317058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1400a9-d069-4a7b-8e5c-dd016b964e77 admin admin] PATH_INFO: `/v3/projects/cfbae3a5d3de4c2f9070dd49e85d6270/users/af3e86f2b67b470caa342f6f98f59a11/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:31.346927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1400a9-d069-4a7b-8e5c-dd016b964e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbae3a5d3de4c2f9070dd49e85d6270, user_id=af3e86f2b67b470caa342f6f98f59a11, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:31.354201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1400a9-d069-4a7b-8e5c-dd016b964e77 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:31.424903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:31.426945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:31.435263 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:31.485830 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1226/2443] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:31 2022] PUT /identity/v3/projects/cfbae3a5d3de4c2f9070dd49e85d6270/users/af3e86f2b67b470caa342f6f98f59a11/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:31.486038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fd28d-e353-44bb-94c0-0d414500ce9c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:31.488961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:31.489356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:31.489840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:31.569060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] MFA Rules not processed for user `af3e86f2b67b470caa342f6f98f59a11`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:31.572546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:31.615216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:31.617607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:31.618748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:31.619239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] PATH_INFO: `/v3/projects/bf8662417f6d41cc8dedc151d4f119b0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:31.624238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf8662417f6d41cc8dedc151d4f119b0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:31.631522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:31.734734 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1227/2444] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:31.736625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:31.753723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:31.874975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf8662417f6d41cc8dedc151d4f119b0', 'request_id': 'req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:31.895861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf8662417f6d41cc8dedc151d4f119b0', 'request_id': 'req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:31.988715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf8662417f6d41cc8dedc151d4f119b0', 'request_id': 'req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:32.009451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] The token cache is being invalidate because project bf8662417f6d41cc8dedc151d4f119b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:32.010287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:32.013409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:32.019103 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1218/2445] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:31 2022] DELETE /identity/v3/projects/bf8662417f6d41cc8dedc151d4f119b0 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:32.019714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:32.028097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a44d3-18c7-4c9b-aef6-71c6b45d2071 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:32.029167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:32.159376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3351f1-980e-4ff0-b3d1-f849a83ded6c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:32.166485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca7399-402e-4d4e-8cc5-de3c00baa983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:32.167311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca7399-402e-4d4e-8cc5-de3c00baa983 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:32.167746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca7399-402e-4d4e-8cc5-de3c00baa983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:32.168216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca7399-402e-4d4e-8cc5-de3c00baa983 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:32.182125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca7399-402e-4d4e-8cc5-de3c00baa983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:32.188886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca7399-402e-4d4e-8cc5-de3c00baa983 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:32.194600 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:32.214932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:32.216580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:32.216949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:32.218433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:32.222673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:32.323334 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1219/2446] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:32 2022] POST /identity/v3/projects => generated 371 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:32.324919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1eae-07bd-4a52-ab27-81480314ef39 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:32.325202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1eae-07bd-4a52-ab27-81480314ef39 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:32.325460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1eae-07bd-4a52-ab27-81480314ef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:32.380319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-de5b1eae-07bd-4a52-ab27-81480314ef39 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:32.382891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de5b1eae-07bd-4a52-ab27-81480314ef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:32.388038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:32.390926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:32.435920 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1228/2447] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:32.436606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:32.488879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180af5-a8b5-4963-aa36-ba9fe4070abe service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:32.507643 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:32.638097 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1220/2448] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:32.650536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87741e69-250c-4df2-8f66-7c6b4cd7460c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:32.650859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87741e69-250c-4df2-8f66-7c6b4cd7460c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:32.651149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87741e69-250c-4df2-8f66-7c6b4cd7460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:32.696689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-87741e69-250c-4df2-8f66-7c6b4cd7460c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:32.697960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-87741e69-250c-4df2-8f66-7c6b4cd7460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:32.717131 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1221/2449] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:32.723583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87741e69-250c-4df2-8f66-7c6b4cd7460c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:32.738431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87741e69-250c-4df2-8f66-7c6b4cd7460c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:32.746023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:32.746651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:32.746931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:32.747206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:32.747851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:32.749897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:32.761548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:32.762330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:32.762610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:32.762881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:32.763598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:32.764168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:32.779591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:32.801905 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1222/2450] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:32.807219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:32.820958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebca41c-4e33-468c-b2d1-7dce5eb2f6a8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:32.826806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:32.828134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:32.828663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:32.828945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:32.829699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:32.832430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:32.909644 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1229/2451] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:32 2022] POST /identity/v3/users => generated 292 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:32.915484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:32.934772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7c02-a5b7-42dc-99d0-79e26f18ca86 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:32.936725 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1223/2452] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:32 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:32.943428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:33.082808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.084474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.084762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.085034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.087818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.089504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:33.147484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825fd15-46d5-4003-b03b-99a40e35dfb3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:33.149804 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1230/2453] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:33.154014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:33.167428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624b11-0793-40f1-b08d-1d8bc4d31493 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:33.173855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.174508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.177762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.177762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.177762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.177762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:33.193541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.194770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.195051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.199786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] PATH_INFO: `/v3/projects/d4e49359f70e4a298bb9687ac8eac600/users/06db1ce5f0574b68af8a8683d1fa4397/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.226212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e49359f70e4a298bb9687ac8eac600, user_id=06db1ce5f0574b68af8a8683d1fa4397, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.229916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:33.291636 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1224/2454] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:32 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:33.295190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:33.324182 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1231/2455] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:33 2022] PUT /identity/v3/projects/d4e49359f70e4a298bb9687ac8eac600/users/06db1ce5f0574b68af8a8683d1fa4397/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:33.326821 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:33.329349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:33.348228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798ed06-e636-4dbd-90c6-521d764e6324 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:33.464929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1760e-b994-4b26-a090-68434aa68f64 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:33.476245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.476873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.477154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.477453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.478168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.485473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:33.502643 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1232/2456] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:33.503764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:33.525491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6c0a0-8117-4f81-a2c6-0238812db565 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:33.528024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.528663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.528950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.529217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.529918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.532737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:33.541232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40df59-bbcb-4fb3-89b2-7b4e8b50eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.542550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40df59-bbcb-4fb3-89b2-7b4e8b50eec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.551612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40df59-bbcb-4fb3-89b2-7b4e8b50eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.551612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40df59-bbcb-4fb3-89b2-7b4e8b50eec9 admin admin] PATH_INFO: `/v3/projects/d4e49359f70e4a298bb9687ac8eac600/users/06db1ce5f0574b68af8a8683d1fa4397/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.551612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40df59-bbcb-4fb3-89b2-7b4e8b50eec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e49359f70e4a298bb9687ac8eac600, user_id=06db1ce5f0574b68af8a8683d1fa4397, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.563123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40df59-bbcb-4fb3-89b2-7b4e8b50eec9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:33.601159 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1233/2457] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:33 2022] PUT /identity/v3/projects/d4e49359f70e4a298bb9687ac8eac600/users/06db1ce5f0574b68af8a8683d1fa4397/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:33.612554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc01b-f3e5-458a-9ed0-12908c21f705 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.612845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc01b-f3e5-458a-9ed0-12908c21f705 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.613121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc01b-f3e5-458a-9ed0-12908c21f705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.615438 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1225/2458] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:33.622704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:33.661742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058b931-4625-4e34-aaed-e7188f31a10b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:33.668810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7bcdc01b-f3e5-458a-9ed0-12908c21f705 None None] MFA Rules not processed for user `06db1ce5f0574b68af8a8683d1fa4397`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:33.670180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7bcdc01b-f3e5-458a-9ed0-12908c21f705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:33.855709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1234/2459] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:33.860563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.862867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.864216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.865155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.866681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.870848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:33.888302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1226/2460] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:33.894477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdc01b-f3e5-458a-9ed0-12908c21f705 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:33.907798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdc01b-f3e5-458a-9ed0-12908c21f705 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:33.919301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788fa35-9dc0-49ce-870c-39e2ff472c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:33.920282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788fa35-9dc0-49ce-870c-39e2ff472c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:33.920769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788fa35-9dc0-49ce-870c-39e2ff472c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:33.921195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788fa35-9dc0-49ce-870c-39e2ff472c08 admin admin] PATH_INFO: `/v3/projects/d352b8744dcd403998b5ed22381bcb82/users/121ae4c052974c4bb1a887fba98b1919/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:33.972860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788fa35-9dc0-49ce-870c-39e2ff472c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d352b8744dcd403998b5ed22381bcb82, user_id=121ae4c052974c4bb1a887fba98b1919, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:33.978065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788fa35-9dc0-49ce-870c-39e2ff472c08 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:34.011472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:34.013455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:34.092709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1235/2461] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:33 2022] PUT /identity/v3/projects/d352b8744dcd403998b5ed22381bcb82/users/121ae4c052974c4bb1a887fba98b1919/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:34.104320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9b4fd-3f18-4dae-8306-609f1fd1572f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:34.104612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9b4fd-3f18-4dae-8306-609f1fd1572f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:34.104889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9b4fd-3f18-4dae-8306-609f1fd1572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:34.163519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e7e9b4fd-3f18-4dae-8306-609f1fd1572f None None] MFA Rules not processed for user `121ae4c052974c4bb1a887fba98b1919`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:34.165130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e7e9b4fd-3f18-4dae-8306-609f1fd1572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:34.226684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d4726-9b95-458b-92fb-02db449b859a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:34.295855 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:34.340982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:34.341614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:34.341945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:34.342216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:34.363429 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1236/2462] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:34.364560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9b4fd-3f18-4dae-8306-609f1fd1572f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:34.434005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:34.436091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:34.460302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1227/2463] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:34.517493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9b4fd-3f18-4dae-8306-609f1fd1572f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:34.550339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:34.550966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:34.551248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:34.551522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:34.552175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:34.554180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:34.724610 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:34.739286 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1237/2464] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:34 2022] POST /identity/v3/projects => generated 375 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:34.743236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:34.760667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9217a4b-c8c7-4d3d-af2b-7bc68cb2099e service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:34.892986 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:34.932230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:34.933548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:34.934303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:34.935117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:34.936526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:34.940624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.026263 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1228/2465] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:34 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:35.030545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.043786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7fbf3-c9dc-49c3-afaf-50561fa8e53a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:35.088396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:35.089043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.090522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.090819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.092350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:35.097718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.139037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1238/2466] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:35.143909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.162089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2186-11f0-4105-b492-d522a0c01070 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:35.168186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:35.169093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.169566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.170099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] PATH_INFO: `/v3/projects/b007bcec3c8e4e068443ab6114f77593/users/5dc4726033b343868edd28bcc40b7d40/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.220251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b007bcec3c8e4e068443ab6114f77593, user_id=5dc4726033b343868edd28bcc40b7d40, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:35.228555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.357525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1229/2467] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:35 2022] PUT /identity/v3/projects/b007bcec3c8e4e068443ab6114f77593/users/5dc4726033b343868edd28bcc40b7d40/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:35.362359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.381160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c28a97-d646-4e16-9118-54929b63b889 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:35.495518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0b898-5e58-4b99-80e6-16812085505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:35.496141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0b898-5e58-4b99-80e6-16812085505e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.496428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0b898-5e58-4b99-80e6-16812085505e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.496700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0b898-5e58-4b99-80e6-16812085505e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.497624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0b898-5e58-4b99-80e6-16812085505e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:35.499530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0b898-5e58-4b99-80e6-16812085505e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.512209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1239/2468] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:35.516476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.540130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122ab1-ab7d-4f7a-b8cb-5d8e7ffa2184 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:35.548970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ebb8-ef56-4d33-80c4-c0487ac373ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:35.549710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ebb8-ef56-4d33-80c4-c0487ac373ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.550029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ebb8-ef56-4d33-80c4-c0487ac373ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.550314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ebb8-ef56-4d33-80c4-c0487ac373ea admin admin] PATH_INFO: `/v3/projects/b007bcec3c8e4e068443ab6114f77593/users/5dc4726033b343868edd28bcc40b7d40/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.552296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ebb8-ef56-4d33-80c4-c0487ac373ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b007bcec3c8e4e068443ab6114f77593, user_id=5dc4726033b343868edd28bcc40b7d40, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:35.555392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ebb8-ef56-4d33-80c4-c0487ac373ea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.574618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743c1c-e0f5-4730-9584-0a6e0c0118cc None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.575136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743c1c-e0f5-4730-9584-0a6e0c0118cc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.575220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43743c1c-e0f5-4730-9584-0a6e0c0118cc None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.576748 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1240/2469] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:35.586206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.586487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.587017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.598282 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1230/2470] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:35 2022] PUT /identity/v3/projects/b007bcec3c8e4e068443ab6114f77593/users/5dc4726033b343868edd28bcc40b7d40/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:35.613961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:35.616427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988375e5-a94f-4179-a727-c13ad2e36d06 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.616790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988375e5-a94f-4179-a727-c13ad2e36d06 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.617075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988375e5-a94f-4179-a727-c13ad2e36d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.618216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:35.706548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-988375e5-a94f-4179-a727-c13ad2e36d06 None None] MFA Rules not processed for user `5dc4726033b343868edd28bcc40b7d40`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:35.707221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1241/2471] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:35.708330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-988375e5-a94f-4179-a727-c13ad2e36d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:35.770534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.772534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:35.855644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dca52-469c-4c10-804d-72b7b87023f4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:35.866901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:35.867576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.867801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.868075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.871617 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1231/2472] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:35.872700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988375e5-a94f-4179-a727-c13ad2e36d06 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.886405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:35.887988 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:35.888471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.900790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1242/2473] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:35.901530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.916181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b406b10-fc41-49ca-8ae1-98293765aab8 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:35.922762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:35.923378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.923659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.926518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.926518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:35.926518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:35.926809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.939363 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1243/2474] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:35.954929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:35.965364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988375e5-a94f-4179-a727-c13ad2e36d06 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:35.972536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:35.975091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:35.975091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:35.975091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] PATH_INFO: `/v3/users/af3e86f2b67b470caa342f6f98f59a11` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:35.976158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3e86f2b67b470caa342f6f98f59a11)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:35.977189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:35.987924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bbaf5-22ed-494e-9033-7f150dfef9fa tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:36.008112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:36.008733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:36.009024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:36.009287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:36.010284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:36.014873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:36.023915 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:36.125689 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1244/2475] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:35 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:36.129381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:36.256020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163df28-3882-41af-b0a0-edd1f9b6a7b3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:36.264040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:36.264989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:36.265435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:36.266110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:36.267092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:36.267513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:36.270369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:36.275864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3e86f2b67b470caa342f6f98f59a11'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:36.291072 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1245/2476] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:36.301182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3e86f2b67b470caa342f6f98f59a11'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:36.310155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3e86f2b67b470caa342f6f98f59a11'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:36.310926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3e86f2b67b470caa342f6f98f59a11'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:36.321187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:36.323272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:36.424251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9dbf11-87b0-4cbf-886a-d196c29c88a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3e86f2b67b470caa342f6f98f59a11'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:36.451789 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1232/2477] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:35 2022] DELETE /identity/v3/users/af3e86f2b67b470caa342f6f98f59a11 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:36.457031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:36.458687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:36.459948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:36.496092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bc289-cdea-4beb-afe4-d1f68121798f tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:36.607509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:36.607509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:36.696355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89aafa-974b-491b-a4f8-6fc34a3e49b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:36.696355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aafa-974b-491b-a4f8-6fc34a3e49b3 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:36.696355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aafa-974b-491b-a4f8-6fc34a3e49b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:36.696355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89aafa-974b-491b-a4f8-6fc34a3e49b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:36.703495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d89aafa-974b-491b-a4f8-6fc34a3e49b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:36.712249 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1233/2478] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:36.737601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:36.739791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:36.871181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89aafa-974b-491b-a4f8-6fc34a3e49b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:36.873329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89aafa-974b-491b-a4f8-6fc34a3e49b3 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:36.895145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c585-5094-4422-b63e-03aa0ec0d162 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:36.898902 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1246/2479] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:36.910352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:36.927846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:36.930074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:36.932441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:36.936466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a922-3eda-4ab0-a817-de7a0fd6b335 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:36.936889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a922-3eda-4ab0-a817-de7a0fd6b335 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:36.937112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a922-3eda-4ab0-a817-de7a0fd6b335 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:36.939698 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1247/2480] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:36.954865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a922-3eda-4ab0-a817-de7a0fd6b335 None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:36.979595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:36.981907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a922-3eda-4ab0-a817-de7a0fd6b335 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:36.982218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:36.992834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a922-3eda-4ab0-a817-de7a0fd6b335 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:37.001768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6f37c-a5b9-4f85-829e-c92c07a8fc7e tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:37.002411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f37c-a5b9-4f85-829e-c92c07a8fc7e tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:37.002795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f37c-a5b9-4f85-829e-c92c07a8fc7e tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:37.003174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f37c-a5b9-4f85-829e-c92c07a8fc7e tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f3f8bc84bb664870a03c45762d0a870c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:37.004714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6f37c-a5b9-4f85-829e-c92c07a8fc7e tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3f8bc84bb664870a03c45762d0a870c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:37.007322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6f37c-a5b9-4f85-829e-c92c07a8fc7e tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:37.010874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1248/2481] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:36 2022] GET /identity/v3/projects/f3f8bc84bb664870a03c45762d0a870c => generated 369 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:37.014996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1234/2482] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:37.138994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3600581-9e13-402e-a3bc-49178f0243f7 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:37.139496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3600581-9e13-402e-a3bc-49178f0243f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:37.139904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3600581-9e13-402e-a3bc-49178f0243f7 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:37.143118 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1249/2483] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:37.156247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:37.211280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:37.248326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505880a-fa75-43fe-810a-f74b451c70a1 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:37.267427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:37.268087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:37.268382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:37.271542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f3f8bc84bb664870a03c45762d0a870c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:37.276314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3f8bc84bb664870a03c45762d0a870c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:37.278448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:37.285284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1235/2484] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:37 2022] GET /identity/v3/projects/f3f8bc84bb664870a03c45762d0a870c => generated 369 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:37.906062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5638a-6b91-43b9-9cec-1c2f12c5841f None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:37.906816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5638a-6b91-43b9-9cec-1c2f12c5841f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:37.907046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5638a-6b91-43b9-9cec-1c2f12c5841f None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:37.908977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1250/2485] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:37.920064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:37.937303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:37.949693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daff2c-8861-489e-bfca-40cbe5ff750c tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:37.955711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdddc07-ffbc-4a30-8689-0f88219a54fd tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:37.956857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdddc07-ffbc-4a30-8689-0f88219a54fd tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:37.957270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdddc07-ffbc-4a30-8689-0f88219a54fd tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:37.957694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdddc07-ffbc-4a30-8689-0f88219a54fd tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f3f8bc84bb664870a03c45762d0a870c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:37.959922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdddc07-ffbc-4a30-8689-0f88219a54fd tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3f8bc84bb664870a03c45762d0a870c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:37.962421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdddc07-ffbc-4a30-8689-0f88219a54fd tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:37.976299 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1236/2486] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:37 2022] GET /identity/v3/projects/f3f8bc84bb664870a03c45762d0a870c => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:37.994688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5638a-6b91-43b9-9cec-1c2f12c5841f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:38.052953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5638a-6b91-43b9-9cec-1c2f12c5841f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:38.063307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:38.063990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:38.064386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:38.064666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f3f8bc84bb664870a03c45762d0a870c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:38.066016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3f8bc84bb664870a03c45762d0a870c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:38.082953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:38.344824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f8bc84bb664870a03c45762d0a870c', 'request_id': 'req-f1079248-9a84-420b-8d3a-bd4819f48ba3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:38.362058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f8bc84bb664870a03c45762d0a870c', 'request_id': 'req-f1079248-9a84-420b-8d3a-bd4819f48ba3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:38.469723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f8bc84bb664870a03c45762d0a870c', 'request_id': 'req-f1079248-9a84-420b-8d3a-bd4819f48ba3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:38.489439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] The token cache is being invalidate because project f3f8bc84bb664870a03c45762d0a870c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:38.489752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:38.491946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:38.494456 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1251/2487] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:37 2022] DELETE /identity/v3/projects/f3f8bc84bb664870a03c45762d0a870c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:38.518929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f742f4-de16-4e16-9877-87d215aa718f None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:38.519510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f742f4-de16-4e16-9877-87d215aa718f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:38.519774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f742f4-de16-4e16-9877-87d215aa718f None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:38.521991 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1237/2488] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:38.527716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:38.531287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:38.707294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:38.709404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:38.721945 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:38.789462 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:38.878004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1079248-9a84-420b-8d3a-bd4819f48ba3 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:38.886916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:38.887887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:38.888252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:38.888573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/d352b8744dcd403998b5ed22381bcb82` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:38.889936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=d352b8744dcd403998b5ed22381bcb82)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:38.893469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:38.909613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f742f4-de16-4e16-9877-87d215aa718f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:38.909613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-75f742f4-de16-4e16-9877-87d215aa718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:38.922643 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1252/2489] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:38 2022] GET /identity/v3/projects/d352b8744dcd403998b5ed22381bcb82 => generated 375 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:38.963513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:38.996956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32e4a1-e338-4b16-9df8-07102d4552d6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:39.009585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:39.010319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:39.010609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:39.011277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:39.011980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:39.012295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:39.014076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:39.033364 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1253/2490] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:39.036318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:39.049984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30153794-99c3-434d-a76d-ec10586fcb84 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:39.064152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:39.064786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:39.065244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:39.065524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:39.068533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:39.075150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:39.145050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f742f4-de16-4e16-9877-87d215aa718f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:39.159316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:39.160587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:39.164432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:39.164432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] PATH_INFO: `/v3/projects/cfbae3a5d3de4c2f9070dd49e85d6270` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:39.168634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfbae3a5d3de4c2f9070dd49e85d6270)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:39.173266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:39.201745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1254/2491] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:39 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:39.208603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:39.364834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfbae3a5d3de4c2f9070dd49e85d6270', 'request_id': 'req-a2752ca0-4173-4cac-8ba6-e55a52c97140'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.371269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfbae3a5d3de4c2f9070dd49e85d6270', 'request_id': 'req-a2752ca0-4173-4cac-8ba6-e55a52c97140'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.384495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8c2a-eae3-4d20-bcf2-63a785f0a313 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:39.501976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:39.501976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:39.502397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:39.502517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:39.503176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:39.503486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:39.505525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:39.532850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1255/2492] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:39.532850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:39.534444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:39.539235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfbae3a5d3de4c2f9070dd49e85d6270', 'request_id': 'req-a2752ca0-4173-4cac-8ba6-e55a52c97140'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.565284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] The token cache is being invalidate because project cfbae3a5d3de4c2f9070dd49e85d6270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:39.565579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.570263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2752ca0-4173-4cac-8ba6-e55a52c97140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.579025 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1238/2493] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:38 2022] DELETE /identity/v3/projects/cfbae3a5d3de4c2f9070dd49e85d6270 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:39.581148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba574-d2f1-46e3-be91-5e1c85247e69 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:39.581706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba574-d2f1-46e3-be91-5e1c85247e69 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:39.582045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bba574-d2f1-46e3-be91-5e1c85247e69 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:39.586375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1239/2494] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:39.587188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba574-d2f1-46e3-be91-5e1c85247e69 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:39.592988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-11bba574-d2f1-46e3-be91-5e1c85247e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:39.693363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c53230-30c0-481d-ab97-cabd82bd1274 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:39.706867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:39.707526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:39.707812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:39.708084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] PATH_INFO: `/v3/users/3a73f5d7c23e425ea4a3d97cde35e3ec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:39.709453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a73f5d7c23e425ea4a3d97cde35e3ec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:39.711931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:39.781087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bba574-d2f1-46e3-be91-5e1c85247e69 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:39.803211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:39.804059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:39.804351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:39.804797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] PATH_INFO: `/v3/users/06db1ce5f0574b68af8a8683d1fa4397` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:39.814573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06db1ce5f0574b68af8a8683d1fa4397)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:39.825677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:39.913855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a73f5d7c23e425ea4a3d97cde35e3ec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.919598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a73f5d7c23e425ea4a3d97cde35e3ec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.985528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a73f5d7c23e425ea4a3d97cde35e3ec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.997880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a73f5d7c23e425ea4a3d97cde35e3ec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:39.999875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a73f5d7c23e425ea4a3d97cde35e3ec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:40.033328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06db1ce5f0574b68af8a8683d1fa4397'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:40.048816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06db1ce5f0574b68af8a8683d1fa4397'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:40.054545 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1256/2495] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:39 2022] DELETE /identity/v3/users/3a73f5d7c23e425ea4a3d97cde35e3ec => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:40.057363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:40.059836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.060533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06db1ce5f0574b68af8a8683d1fa4397'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:40.061292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06db1ce5f0574b68af8a8683d1fa4397'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:40.127736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-544d64c9-bc04-4652-8023-ab7b70a4641a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06db1ce5f0574b68af8a8683d1fa4397'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:40.140528 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1240/2496] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:39 2022] DELETE /identity/v3/users/06db1ce5f0574b68af8a8683d1fa4397 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:40.142931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b28b-9612-4e4f-8396-71907cf97f11 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:40.143890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b28b-9612-4e4f-8396-71907cf97f11 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:40.144650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b28b-9612-4e4f-8396-71907cf97f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:40.182419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8d74b28b-9612-4e4f-8396-71907cf97f11 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:40.183911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8d74b28b-9612-4e4f-8396-71907cf97f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.201078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:40.206475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.306419 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1241/2497] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:40.308246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04407-149f-4536-8886-857f05a15f6d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:40.308767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04407-149f-4536-8886-857f05a15f6d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:40.309256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04407-149f-4536-8886-857f05a15f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:40.379893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-59f04407-149f-4536-8886-857f05a15f6d None None] MFA Rules not processed for user `dc3dcb6902a04681a54264d3743ed04a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:40.381632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-59f04407-149f-4536-8886-857f05a15f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.392735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30d81-81fd-4eb4-927c-4e30914aa719 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:40.487652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:40.488975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:40.489776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:40.489946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f2394f643c054bcc963eacb405b52f69` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:40.491355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=f2394f643c054bcc963eacb405b52f69)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:40.496326 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1242/2498] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:40.496326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f04407-149f-4536-8886-857f05a15f6d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:40.496596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:40.496711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-59f04407-149f-4536-8886-857f05a15f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.497068 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1257/2499] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:40 2022] GET /identity/v3/projects/f2394f643c054bcc963eacb405b52f69 => generated 371 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:40.642197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f04407-149f-4536-8886-857f05a15f6d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:40.647072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:40.647984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:40.648415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:40.648847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:40.661663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:40.663950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:40.690291 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1243/2500] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:40.767866 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:40.827157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:40.829980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.847713 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:40.851588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc9fb-b920-4de0-862d-0c5e4c8f1a27 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:40.861642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:40.864156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:40.864756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:40.865399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] PATH_INFO: `/v3/projects/d4e49359f70e4a298bb9687ac8eac600` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:40.868541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e49359f70e4a298bb9687ac8eac600)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:40.870889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.024687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.026142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:41.042053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e49359f70e4a298bb9687ac8eac600', 'request_id': 'req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:41.050893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e49359f70e4a298bb9687ac8eac600', 'request_id': 'req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:41.116256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6476084-d2d8-456f-adb0-63ece55154a0 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.150035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e49359f70e4a298bb9687ac8eac600', 'request_id': 'req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:41.165891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] The token cache is being invalidate because project d4e49359f70e4a298bb9687ac8eac600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:41.166252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:41.166990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a8ad4f1d-bfaf-4275-970f-02b7b2ada510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:41.168794 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1258/2501] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:40 2022] DELETE /identity/v3/projects/d4e49359f70e4a298bb9687ac8eac600 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:41.174684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421fc9c-3331-4e11-a9a1-286ae4ce3378 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.175235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421fc9c-3331-4e11-a9a1-286ae4ce3378 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.176090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421fc9c-3331-4e11-a9a1-286ae4ce3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.203749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d421fc9c-3331-4e11-a9a1-286ae4ce3378 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:41.211719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d421fc9c-3331-4e11-a9a1-286ae4ce3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:41.221919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.222868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.223324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.223944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.230907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:41.298222 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1259/2502] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:41.301713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.303530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.305848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e434a3-abe7-4720-aefa-dbe7819137a7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.306394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e434a3-abe7-4720-aefa-dbe7819137a7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.306770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e434a3-abe7-4720-aefa-dbe7819137a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.315646 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1244/2503] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:41.343402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-96e434a3-abe7-4720-aefa-dbe7819137a7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:41.346010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-96e434a3-abe7-4720-aefa-dbe7819137a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:41.372119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.372235 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1260/2504] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:41.377170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca924d0b-1c24-42c6-bdbf-11a9c4ccf63f service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.394581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.395209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.395626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.395986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.402282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.402282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.402282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.402282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:41.402282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.402744 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1261/2505] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:41.402831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.406005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:41.408909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:41.431044 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1245/2506] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:41.435084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.436375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.437659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:41.468663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed98ed-069c-4829-a17c-9a76ccf0d200 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.477156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.477789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.478204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.478474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.479152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.481247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.542889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c34fe-850a-4d78-904a-663b2c88f4af None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.549289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.550208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.551090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.551090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f2394f643c054bcc963eacb405b52f69` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.552692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=f2394f643c054bcc963eacb405b52f69)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.554928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.557190 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1262/2507] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:41 2022] GET /identity/v3/projects/f2394f643c054bcc963eacb405b52f69 => generated 371 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:41.591449 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1246/2508] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:41 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:41.596780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.618332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4ffc-af70-4591-9661-3ddf4f32dbc6 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.663222 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:41.709517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.754235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.757579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.757579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.757579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.758132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.760428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.847799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92906-784b-4477-86f3-780d11f03401 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.861065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.862050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.862793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.863233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.864057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:41.864520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.866155 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1263/2509] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:41 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:41.871886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.872032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.897919 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1247/2510] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:41.910322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.910481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c004738-4487-4267-938a-d1d54154b11f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.915374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.916132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.916626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.917007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.917849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.919249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946693d-867c-4835-8aa2-656c9c159391 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.920172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.928822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.929877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.930311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.930754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.931894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.935424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:41.935608 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1264/2511] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:41.939702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:41.972623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b945b-8eba-45ce-91a0-5e9412e1af68 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:41.995636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:41.996683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:41.996938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:41.997325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:41.998035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:41.999758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.015134 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1265/2512] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:42.023638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.057713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c022b6b-028a-461d-9d50-a7054267cd01 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:42.095404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdebac8-d4db-484c-9190-1d4070792fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:42.096108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdebac8-d4db-484c-9190-1d4070792fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.096390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdebac8-d4db-484c-9190-1d4070792fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.096669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdebac8-d4db-484c-9190-1d4070792fd7 admin admin] PATH_INFO: `/v3/projects/f02f1c37bcf340949dda97fbc96e18f3/users/5cd7e4b519ce4818be03e6b8050e0e3b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.098018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1248/2513] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:41 2022] POST /identity/v3/users => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:42.104084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.120832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cedd0f-887a-40cd-80a4-a15ad34ec6b9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:42.139568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:42.142193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.142193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.144012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.150218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:42.150610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:42.152300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.156514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdebac8-d4db-484c-9190-1d4070792fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02f1c37bcf340949dda97fbc96e18f3, user_id=5cd7e4b519ce4818be03e6b8050e0e3b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:42.163346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdebac8-d4db-484c-9190-1d4070792fd7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.163823 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:42.186867 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1249/2514] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:42.205002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.212363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:42.257696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4b67d-8e2d-4535-9ff0-d58c1c7e6b97 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:42.268684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:42.269727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.270049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.270330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] PATH_INFO: `/v3/projects/8756787b0d0c472693f831c8627fd395` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.275038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8756787b0d0c472693f831c8627fd395)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:42.277304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.324074 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1266/2515] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:42 2022] PUT /identity/v3/projects/f02f1c37bcf340949dda97fbc96e18f3/users/5cd7e4b519ce4818be03e6b8050e0e3b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:42.330596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b95a-8652-48cd-8cf5-7b3f18f3aa3c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.331030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b95a-8652-48cd-8cf5-7b3f18f3aa3c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.332454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b95a-8652-48cd-8cf5-7b3f18f3aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.393546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cbc2b95a-8652-48cd-8cf5-7b3f18f3aa3c None None] MFA Rules not processed for user `5cd7e4b519ce4818be03e6b8050e0e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:42.395124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cbc2b95a-8652-48cd-8cf5-7b3f18f3aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:42.462251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8756787b0d0c472693f831c8627fd395', 'request_id': 'req-a1e8d721-3d15-46ed-9bc3-07b24801f593'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:42.469197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8756787b0d0c472693f831c8627fd395', 'request_id': 'req-a1e8d721-3d15-46ed-9bc3-07b24801f593'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:42.529918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1267/2516] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:42.532357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c62b8-24c7-498f-bebb-4dbe05f94029 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.532849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c62b8-24c7-498f-bebb-4dbe05f94029 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.533675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c62b8-24c7-498f-bebb-4dbe05f94029 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.536264 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1268/2517] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:42.537163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c62b8-24c7-498f-bebb-4dbe05f94029 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.549224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8756787b0d0c472693f831c8627fd395', 'request_id': 'req-a1e8d721-3d15-46ed-9bc3-07b24801f593'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:42.566323 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:42.576854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] The token cache is being invalidate because project 8756787b0d0c472693f831c8627fd395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:42.577133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:42.581894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:42.583833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1250/2518] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:42 2022] DELETE /identity/v3/projects/8756787b0d0c472693f831c8627fd395 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:42.588163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:42.588163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:42.713713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c62b8-24c7-498f-bebb-4dbe05f94029 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:42.714715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.716691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:42.726299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:42.727065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.727536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.727881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.729021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:42.730959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.819956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8d721-3d15-46ed-9bc3-07b24801f593 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:42.825802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:42.826665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.827051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.828083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f2394f643c054bcc963eacb405b52f69` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.830479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=f2394f643c054bcc963eacb405b52f69)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:42.832782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.835579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1251/2519] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:42 2022] GET /identity/v3/projects/f2394f643c054bcc963eacb405b52f69 => generated 371 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:42.837118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.838769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:42.858592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc77328-7a62-4eea-804b-4b0e466e54d9 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:42.864634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:42.865336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:42.870906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:42.870906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] PATH_INFO: `/v3/users/55e15140f53d4e4f906d62752362441b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:42.872431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e15140f53d4e4f906d62752362441b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:42.874801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:42.897713 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1269/2520] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:42 2022] POST /identity/v3/projects => generated 387 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:42.902330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:42.909234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:43.037622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9f02-8e97-409f-a503-3c3ade7e02e7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:43.044603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:43.045535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.046012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.046440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.047245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:43.049707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:43.112755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e15140f53d4e4f906d62752362441b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:43.150994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e15140f53d4e4f906d62752362441b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:43.163746 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1270/2521] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:42 2022] POST /identity/v3/users => generated 300 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:43.166998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e15140f53d4e4f906d62752362441b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:43.168571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e15140f53d4e4f906d62752362441b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:43.169862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:43.174880 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:43.176893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:43.222677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03fe72-8510-4d70-a374-7a604ffd6253 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:43.232113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d8c45-1df8-40a4-ba2d-d27dbfd36816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:43.232737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d8c45-1df8-40a4-ba2d-d27dbfd36816 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.233124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d8c45-1df8-40a4-ba2d-d27dbfd36816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.233402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d8c45-1df8-40a4-ba2d-d27dbfd36816 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.234091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d8c45-1df8-40a4-ba2d-d27dbfd36816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:43.235823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d8c45-1df8-40a4-ba2d-d27dbfd36816 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:43.264823 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1271/2522] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:43.266353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354f9c-8553-49fe-92fd-3538bb374b0d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.266663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354f9c-8553-49fe-92fd-3538bb374b0d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.266994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354f9c-8553-49fe-92fd-3538bb374b0d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.268492 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1272/2523] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:43.269015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354f9c-8553-49fe-92fd-3538bb374b0d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:43.281550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e15140f53d4e4f906d62752362441b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:43.289616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354f9c-8553-49fe-92fd-3538bb374b0d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:43.293683 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1252/2524] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:42 2022] DELETE /identity/v3/users/55e15140f53d4e4f906d62752362441b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:43.294680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:43.303290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:43.388121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:43.388121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.388121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.388121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] PATH_INFO: `/v3/projects/19e2dda9add44b66993fb280f57695fb/users/19ea19eb6e1a4aa29abb10bc6d149450/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.426435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e2dda9add44b66993fb280f57695fb, user_id=19ea19eb6e1a4aa29abb10bc6d149450, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:43.429430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:43.458236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:43.460061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:43.495384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1273/2525] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:43 2022] PUT /identity/v3/projects/19e2dda9add44b66993fb280f57695fb/users/19ea19eb6e1a4aa29abb10bc6d149450/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:43.500057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:43.627689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f1e31-aef5-4f14-83e0-c230caf5f5d7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:43.720958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0146-a343-4134-9893-e292cd353071 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:43.736615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:43.737258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.739586 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:43.740200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.747702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.747702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:43.747702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:43.752963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:43.756819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.757361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.757882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f2394f643c054bcc963eacb405b52f69` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.759533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=f2394f643c054bcc963eacb405b52f69)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:43.762955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:43.765970 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1253/2526] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:43 2022] GET /identity/v3/projects/f2394f643c054bcc963eacb405b52f69 => generated 371 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:43.788418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:43.796264 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1274/2527] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:43.805208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5e8c1-8e54-4d10-adc1-984383c49764 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:43.823974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:43.835311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbda095-7b16-49a0-8383-b64380f9fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:43.836057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda095-7b16-49a0-8383-b64380f9fcd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.839013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda095-7b16-49a0-8383-b64380f9fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.839013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbda095-7b16-49a0-8383-b64380f9fcd2 admin admin] PATH_INFO: `/v3/projects/19e2dda9add44b66993fb280f57695fb/users/19ea19eb6e1a4aa29abb10bc6d149450/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.841614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4467a7-9ceb-4217-bc64-88ecebf0c3d6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:43.842632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbda095-7b16-49a0-8383-b64380f9fcd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e2dda9add44b66993fb280f57695fb, user_id=19ea19eb6e1a4aa29abb10bc6d149450, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:43.853748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbda095-7b16-49a0-8383-b64380f9fcd2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:43.861366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:43.862163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.862462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.864965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/users/9220fd02eb9742198e8de2a0c03e9d9f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:43.883384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9220fd02eb9742198e8de2a0c03e9d9f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:43.883702 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1254/2528] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:43 2022] PUT /identity/v3/projects/19e2dda9add44b66993fb280f57695fb/users/19ea19eb6e1a4aa29abb10bc6d149450/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:43.902312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:43.981339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab9c6-0e30-488f-a9dd-ccaab916e5e8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:43.982070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab9c6-0e30-488f-a9dd-ccaab916e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:43.982634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab9c6-0e30-488f-a9dd-ccaab916e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:44.005085 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:44.073973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6fbab9c6-0e30-488f-a9dd-ccaab916e5e8 None None] MFA Rules not processed for user `19ea19eb6e1a4aa29abb10bc6d149450`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:44.077016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6fbab9c6-0e30-488f-a9dd-ccaab916e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:44.083813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9220fd02eb9742198e8de2a0c03e9d9f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.084931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9220fd02eb9742198e8de2a0c03e9d9f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.180747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9220fd02eb9742198e8de2a0c03e9d9f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.192894 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1255/2529] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:44.193100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9220fd02eb9742198e8de2a0c03e9d9f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.194411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9220fd02eb9742198e8de2a0c03e9d9f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.260506 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1275/2530] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:43 2022] DELETE /identity/v3/users/9220fd02eb9742198e8de2a0c03e9d9f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:44.264495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbab9c6-0e30-488f-a9dd-ccaab916e5e8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:44.388538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:44.390210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:44.426867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbab9c6-0e30-488f-a9dd-ccaab916e5e8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:44.548753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63f8f-d833-481f-9dd4-e1c5199ef8ac tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:44.549195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:44.550328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:44.550786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:44.551150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/f2394f643c054bcc963eacb405b52f69` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:44.553268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2394f643c054bcc963eacb405b52f69)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:44.557607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:44.558811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:44.560597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:44.561137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:44.573256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:44.573256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:44.687880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:44.690045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:44.705797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2394f643c054bcc963eacb405b52f69', 'request_id': 'req-ea7e486c-e596-4a85-ba02-7cbca2028f8b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.712581 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1276/2531] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:44.723837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2394f643c054bcc963eacb405b52f69', 'request_id': 'req-ea7e486c-e596-4a85-ba02-7cbca2028f8b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.801726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:44.803313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:44.813170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2394f643c054bcc963eacb405b52f69', 'request_id': 'req-ea7e486c-e596-4a85-ba02-7cbca2028f8b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.841908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] The token cache is being invalidate because project f2394f643c054bcc963eacb405b52f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:44.842268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.843089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:44.846313 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1256/2532] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:44 2022] DELETE /identity/v3/projects/f2394f643c054bcc963eacb405b52f69 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:44.853599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:44.856409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d5a28-b906-4f8d-844b-af5f40db2aae service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:44.859091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:44.967382 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:44.997262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153b424-dd90-4de8-9f59-875bc418ae85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:44.997922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b424-dd90-4de8-9f59-875bc418ae85 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:44.998205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b424-dd90-4de8-9f59-875bc418ae85 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:44.998479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b424-dd90-4de8-9f59-875bc418ae85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.005187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c153b424-dd90-4de8-9f59-875bc418ae85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:45.038705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e486c-e596-4a85-ba02-7cbca2028f8b tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:45.045428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:45.047229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.047813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.048310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] PATH_INFO: `/v3/projects/2e29a6f85c3c40a58ae29bba11803984` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.052002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e29a6f85c3c40a58ae29bba11803984)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:45.055710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:45.060735 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:45.105902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153b424-dd90-4de8-9f59-875bc418ae85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:45.108511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153b424-dd90-4de8-9f59-875bc418ae85 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:45.122375 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1277/2533] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:45.167431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.167766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.168053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.169683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1278/2534] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:14:45.175673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:45.177635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:45.200506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:45.204448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:45.335406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e29a6f85c3c40a58ae29bba11803984', 'request_id': 'req-14544a1a-f0ea-41f2-8c5c-b84f75150daf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:45.350346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec3b16-36b9-43af-ad63-d374ffad5924 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:45.352622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e29a6f85c3c40a58ae29bba11803984', 'request_id': 'req-14544a1a-f0ea-41f2-8c5c-b84f75150daf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:45.418815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e29a6f85c3c40a58ae29bba11803984', 'request_id': 'req-14544a1a-f0ea-41f2-8c5c-b84f75150daf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:45.441682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] The token cache is being invalidate because project 2e29a6f85c3c40a58ae29bba11803984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:45.444511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:45.446276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14544a1a-f0ea-41f2-8c5c-b84f75150daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:45.452221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1257/2535] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:44 2022] DELETE /identity/v3/projects/2e29a6f85c3c40a58ae29bba11803984 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:45.457235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64403-b3f7-400a-a792-a3095834abf5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.458952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64403-b3f7-400a-a792-a3095834abf5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.459238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64403-b3f7-400a-a792-a3095834abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.499827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba840fa-6c46-4e58-b394-040058838f30 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:45.501329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba840fa-6c46-4e58-b394-040058838f30 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.502190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba840fa-6c46-4e58-b394-040058838f30 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.502716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba840fa-6c46-4e58-b394-040058838f30 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/d352b8744dcd403998b5ed22381bcb82` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.504764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba840fa-6c46-4e58-b394-040058838f30 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=d352b8744dcd403998b5ed22381bcb82)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:45.513471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba840fa-6c46-4e58-b394-040058838f30 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:45.514854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d5a64403-b3f7-400a-a792-a3095834abf5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:45.516149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5a64403-b3f7-400a-a792-a3095834abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:45.537226 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1279/2536] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:45 2022] GET /identity/v3/projects/d352b8744dcd403998b5ed22381bcb82 => generated 375 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:45.589423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.589709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.590045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.591627 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1280/2537] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:14:45.604604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:45.606499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:45.644367 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1258/2538] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:45.662403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0dbe6-ba16-4e5c-a65d-5658973c72d1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.662866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0dbe6-ba16-4e5c-a65d-5658973c72d1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.663149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0dbe6-ba16-4e5c-a65d-5658973c72d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.714005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4ba0dbe6-ba16-4e5c-a65d-5658973c72d1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:45.727252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4ba0dbe6-ba16-4e5c-a65d-5658973c72d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:45.727252 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1259/2539] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:45.739359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0dbe6-ba16-4e5c-a65d-5658973c72d1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:45.753327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0dbe6-ba16-4e5c-a65d-5658973c72d1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:45.759140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:45.760200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.760713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.761194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.762533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:45.763189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:45.765025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:45.783789 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1260/2540] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:45.790030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:45.797919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:45.802554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:45.806273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e46df-f244-4fec-aaa4-c5abe02d41f8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:45.823191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f911b6-b25f-4151-aea8-c00e0092d55c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:45.824945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:45.830504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.830504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.830504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.830504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:45.830856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:45.830976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:45.832108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:45.832733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:45.833402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/d352b8744dcd403998b5ed22381bcb82` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:45.835552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=d352b8744dcd403998b5ed22381bcb82)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:45.838963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:45.863861 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1281/2541] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:45 2022] GET /identity/v3/projects/d352b8744dcd403998b5ed22381bcb82 => generated 375 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:46.024890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:46.041693 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1261/2542] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:45 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:46.052847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349a065-38eb-4898-802e-ba545e292746 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:46.142226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:46.143488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:46.143992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:46.144604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:46.145379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:46.147821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:46.261201 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1282/2543] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:46 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:46.265882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:46.281251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b254b-e181-4a34-b15a-e32d20cd517b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:46.303110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:46.303110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:46.303110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:46.303110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:46.306624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:46.309257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:46.335665 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1262/2544] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:46.339461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:46.351785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c052d-5ae7-4270-9e51-5abda3f444f7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:46.356645 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:46.360126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260f22b-4419-4358-8b05-8096daeb1ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:46.361630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f22b-4419-4358-8b05-8096daeb1ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:46.362072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f22b-4419-4358-8b05-8096daeb1ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:46.370655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260f22b-4419-4358-8b05-8096daeb1ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:46.370655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260f22b-4419-4358-8b05-8096daeb1ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:46.370655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260f22b-4419-4358-8b05-8096daeb1ed2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:46.381627 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1283/2545] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:46.382557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:46.397120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089e40-84f0-4741-9afc-3739b918d4f5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:46.413458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:46.414508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:46.415011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:46.416340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] PATH_INFO: `/v3/projects/4c299a72b27e40498a73e2becaf30e89/users/a1286deaeee141a18e6207ca4bb7d3fe/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:46.457902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c299a72b27e40498a73e2becaf30e89, user_id=a1286deaeee141a18e6207ca4bb7d3fe, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:46.461798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:46.558980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1263/2546] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:46 2022] PUT /identity/v3/projects/4c299a72b27e40498a73e2becaf30e89/users/a1286deaeee141a18e6207ca4bb7d3fe/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:46.571242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe5a61-b50a-4acb-9a69-cd586efce08e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:46.571582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe5a61-b50a-4acb-9a69-cd586efce08e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:46.571936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe5a61-b50a-4acb-9a69-cd586efce08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:46.617110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2cbe5a61-b50a-4acb-9a69-cd586efce08e None None] MFA Rules not processed for user `a1286deaeee141a18e6207ca4bb7d3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:46.619810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2cbe5a61-b50a-4acb-9a69-cd586efce08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:46.627378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:46.629573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:46.754610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34871f6-5ab0-445b-a76f-db7928cb217e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:46.761900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:46.763404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:46.764270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:46.764822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] PATH_INFO: `/v3/users/5cd7e4b519ce4818be03e6b8050e0e3b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:46.767324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd7e4b519ce4818be03e6b8050e0e3b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:46.768850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1284/2547] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:46.770261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:46.773344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe5a61-b50a-4acb-9a69-cd586efce08e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:46.795483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe5a61-b50a-4acb-9a69-cd586efce08e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:46.808134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:46.808860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:46.809210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:46.809568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:46.810356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:46.812484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:46.933398 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1285/2548] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:46 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:46.938280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:47.069283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd7e4b519ce4818be03e6b8050e0e3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:47.087414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845b66-bbf9-429c-bb98-f1486fcd8e63 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:47.089620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd7e4b519ce4818be03e6b8050e0e3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:47.096101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:47.097332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.097977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.098283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.098417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd7e4b519ce4818be03e6b8050e0e3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:47.099175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd7e4b519ce4818be03e6b8050e0e3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:47.099401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:47.107963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:47.207055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-610aacf8-0c22-4c55-bfc6-0a750722f7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd7e4b519ce4818be03e6b8050e0e3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:47.209453 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:47.213685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1286/2549] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:46 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:47.218831 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1264/2550] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:46 2022] DELETE /identity/v3/users/5cd7e4b519ce4818be03e6b8050e0e3b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:47.222754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:47.223417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb73810-1765-4dec-bc20-d640a1313563 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.223703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb73810-1765-4dec-bc20-d640a1313563 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.224444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb73810-1765-4dec-bc20-d640a1313563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.225741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:47.249220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc4851-d7f4-4dcc-add5-8068d5e18e6f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:47.259158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9eb73810-1765-4dec-bc20-d640a1313563 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:47.260616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9eb73810-1765-4dec-bc20-d640a1313563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:47.329253 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:47.331068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:47.332476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.332890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.335451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.335911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:47.338191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:47.372331 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1287/2551] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:47.373782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:47.378123 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1265/2552] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:47.382999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.383428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.385755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.387745 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1266/2553] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:47.394353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:47.396254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489ba5c-e487-4944-9f16-8f6a549ae8bf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:47.397161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:47.403044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:47.403820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.404367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.404719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] PATH_INFO: `/v3/projects/9e98c5825f9c4ecb8d9ff371fb7cea23/users/8a08921ac1c44bd6bde88a1bf7e90785/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.444422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e98c5825f9c4ecb8d9ff371fb7cea23, user_id=8a08921ac1c44bd6bde88a1bf7e90785, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:47.447180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:47.554676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1288/2554] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:47 2022] PUT /identity/v3/projects/9e98c5825f9c4ecb8d9ff371fb7cea23/users/8a08921ac1c44bd6bde88a1bf7e90785/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:47.555630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:47.570709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:47.578894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:47.585366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:47.695755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ab1a-c1b1-4034-85a0-137c4fa9eb87 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:47.703677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:47.705658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.705958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.706232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.722771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a05529-5fdb-476d-9e2f-d080f558af5c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:47.789446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:47.791492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:47.807459 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1289/2555] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:47.808375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:47.810777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc4726033b343868edd28bcc40b7d40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b007bcec3c8e4e068443ab6114f77593', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:47.811626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.811987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.812384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] PATH_INFO: `/v3/projects/d352b8744dcd403998b5ed22381bcb82` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.814449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorizing `identity:get_project(project_id=d352b8744dcd403998b5ed22381bcb82)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:47.817595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:47.819645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99838fec-e32f-4a42-8102-7f193238823a service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:47.824748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1668-e1fd-4edc-a254-f85f5fc6f5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:47.825502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1668-e1fd-4edc-a254-f85f5fc6f5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.825792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1668-e1fd-4edc-a254-f85f5fc6f5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.826090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1668-e1fd-4edc-a254-f85f5fc6f5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.826736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1668-e1fd-4edc-a254-f85f5fc6f5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:47.828563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1668-e1fd-4edc-a254-f85f5fc6f5d6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:47.831541 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1267/2556] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:47 2022] GET /identity/v3/projects/d352b8744dcd403998b5ed22381bcb82 => generated 375 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:47.849627 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1290/2557] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:47.849751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:47.863588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0331125-b255-4603-93d5-dd092fac96a5 tempest-QuotasAdminTestJSON-1213037049 tempest-QuotasAdminTestJSON-1213037049-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:47.871056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b6e45-e66a-434b-ba6c-9d2fa00679b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:47.872973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b6e45-e66a-434b-ba6c-9d2fa00679b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.872973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b6e45-e66a-434b-ba6c-9d2fa00679b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.873804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b6e45-e66a-434b-ba6c-9d2fa00679b2 admin admin] PATH_INFO: `/v3/projects/9e98c5825f9c4ecb8d9ff371fb7cea23/users/8a08921ac1c44bd6bde88a1bf7e90785/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.878507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b6e45-e66a-434b-ba6c-9d2fa00679b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e98c5825f9c4ecb8d9ff371fb7cea23, user_id=8a08921ac1c44bd6bde88a1bf7e90785, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:47.882856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b6e45-e66a-434b-ba6c-9d2fa00679b2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:47.897761 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1268/2558] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:47 2022] PUT /identity/v3/projects/9e98c5825f9c4ecb8d9ff371fb7cea23/users/8a08921ac1c44bd6bde88a1bf7e90785/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:47.910434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.910689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.910995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.945678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] MFA Rules not processed for user `8a08921ac1c44bd6bde88a1bf7e90785`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:47.947485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:48.086495 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1291/2559] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:48.097844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264f96-59ae-4825-b9f5-b1fb9ad31f75 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:48.097844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264f96-59ae-4825-b9f5-b1fb9ad31f75 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:48.097844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264f96-59ae-4825-b9f5-b1fb9ad31f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:48.137215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-42264f96-59ae-4825-b9f5-b1fb9ad31f75 None None] MFA Rules not processed for user `a1286deaeee141a18e6207ca4bb7d3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:48.138839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-42264f96-59ae-4825-b9f5-b1fb9ad31f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:48.220231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1269/2560] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:48.227670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:48.229682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:48.333112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c762e55-6825-4409-9f77-c1b7b93187cc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:48.351832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:48.352645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:48.352937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:48.353318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:48.355718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:48.375138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:48.377886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:48.390890 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1292/2561] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:48.539980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851874c-755c-41a3-a6fc-e9f21a6b553b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:48.540340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851874c-755c-41a3-a6fc-e9f21a6b553b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:48.540621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851874c-755c-41a3-a6fc-e9f21a6b553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:48.581270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3851874c-755c-41a3-a6fc-e9f21a6b553b None None] MFA Rules not processed for user `e285fefe9cb44cadaec6e58a31ef3afe`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:48.583061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3851874c-755c-41a3-a6fc-e9f21a6b553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:48.603230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:48.605529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:48.696129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122188a-81f1-4846-b8ab-8fefaa97f106 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:48.701913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:48.702837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:48.703180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:48.703518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] PATH_INFO: `/v3/projects/f02f1c37bcf340949dda97fbc96e18f3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:48.706180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02f1c37bcf340949dda97fbc96e18f3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:48.709089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:48.886250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02f1c37bcf340949dda97fbc96e18f3', 'request_id': 'req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:48.895606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02f1c37bcf340949dda97fbc96e18f3', 'request_id': 'req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:48.905150 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1270/2562] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:49.035570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02f1c37bcf340949dda97fbc96e18f3', 'request_id': 'req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.050989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] The token cache is being invalidate because project f02f1c37bcf340949dda97fbc96e18f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:49.051259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.051917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d70a69ee-969a-4d6f-aab1-ecc888d8e41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.054319 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1293/2563] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:48 2022] DELETE /identity/v3/projects/f02f1c37bcf340949dda97fbc96e18f3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:49.057800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851874c-755c-41a3-a6fc-e9f21a6b553b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:49.078898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851874c-755c-41a3-a6fc-e9f21a6b553b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:49.143916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:49.144634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:49.144634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:49.179765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] MFA Rules not processed for user `a1286deaeee141a18e6207ca4bb7d3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:49.182241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:49.185784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:49.187441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:49.187853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:49.188236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] PATH_INFO: `/v3/users/19ea19eb6e1a4aa29abb10bc6d149450` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:49.191394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ea19eb6e1a4aa29abb10bc6d149450)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:49.193459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:49.249601 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1294/2564] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:49.328172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:49.331153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:49.351562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a8ba-995c-4441-bb61-32f255135cd5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:49.363910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:49.364422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:49.364766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:49.365046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] PATH_INFO: `/v3/users/dc3dcb6902a04681a54264d3743ed04a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:49.366414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3dcb6902a04681a54264d3743ed04a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:49.368586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:49.438493 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:49.452460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ea19eb6e1a4aa29abb10bc6d149450'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.467177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ea19eb6e1a4aa29abb10bc6d149450'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.474376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ea19eb6e1a4aa29abb10bc6d149450'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.475380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ea19eb6e1a4aa29abb10bc6d149450'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.554775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ea19eb6e1a4aa29abb10bc6d149450'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.561895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1271/2565] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:49 2022] DELETE /identity/v3/users/19ea19eb6e1a4aa29abb10bc6d149450 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:49.589226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3dcb6902a04681a54264d3743ed04a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.590199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3dcb6902a04681a54264d3743ed04a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.665482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3dcb6902a04681a54264d3743ed04a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.677939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3dcb6902a04681a54264d3743ed04a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.679272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3dcb6902a04681a54264d3743ed04a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:49.709567 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1295/2566] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:49 2022] DELETE /identity/v3/users/dc3dcb6902a04681a54264d3743ed04a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:49.732783 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:50.123512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:50.125303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:50.149599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:50.151317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:50.252399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabb1f7-4ad3-418e-8460-7288859f862d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:50.257799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:50.263142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:50.263634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:50.264334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] PATH_INFO: `/v3/projects/19e2dda9add44b66993fb280f57695fb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:50.266051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e2dda9add44b66993fb280f57695fb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:50.268423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:50.302641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c6485-000d-4a49-b6de-8486baa51005 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:50.310554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:50.311345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:50.311697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:50.312043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] PATH_INFO: `/v3/users/121ae4c052974c4bb1a887fba98b1919` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:50.313255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121ae4c052974c4bb1a887fba98b1919)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:50.316784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:50.451360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e2dda9add44b66993fb280f57695fb', 'request_id': 'req-4065a356-92df-4bfe-9d7a-de1f92c78516'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.465438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e2dda9add44b66993fb280f57695fb', 'request_id': 'req-4065a356-92df-4bfe-9d7a-de1f92c78516'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.534734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e2dda9add44b66993fb280f57695fb', 'request_id': 'req-4065a356-92df-4bfe-9d7a-de1f92c78516'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.552968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] The token cache is being invalidate because project 19e2dda9add44b66993fb280f57695fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:50.553273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.554030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.557983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1296/2567] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:50 2022] DELETE /identity/v3/projects/19e2dda9add44b66993fb280f57695fb => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:50.558987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:50.560790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:50.592791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121ae4c052974c4bb1a887fba98b1919'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.610566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121ae4c052974c4bb1a887fba98b1919'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.629306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121ae4c052974c4bb1a887fba98b1919'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.630482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121ae4c052974c4bb1a887fba98b1919'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.704102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a356-92df-4bfe-9d7a-de1f92c78516 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:50.712587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:50.712587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:50.712587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:50.712587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] PATH_INFO: `/v3/projects/c9a7670da79941ac9c0305dea9751fdb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:50.713921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a7670da79941ac9c0305dea9751fdb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:50.716429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:50.732806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-97acf293-2bbc-4ea0-b78a-dbe1ea8ebd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121ae4c052974c4bb1a887fba98b1919'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.741713 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1272/2568] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:50 2022] DELETE /identity/v3/users/121ae4c052974c4bb1a887fba98b1919 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:50.743225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792715-cd45-40db-b879-6c3ee54925f8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:50.743715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792715-cd45-40db-b879-6c3ee54925f8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:50.743987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35792715-cd45-40db-b879-6c3ee54925f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:50.770317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-35792715-cd45-40db-b879-6c3ee54925f8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:50.771856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-35792715-cd45-40db-b879-6c3ee54925f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:50.859204 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1273/2569] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:50.860859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281eb99-66fe-41f9-859a-27421a18970a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:50.861145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281eb99-66fe-41f9-859a-27421a18970a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:50.861411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281eb99-66fe-41f9-859a-27421a18970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:50.871750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a7670da79941ac9c0305dea9751fdb', 'request_id': 'req-fe8973dc-a190-473c-a6d2-ec2c80f02d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.885926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a7670da79941ac9c0305dea9751fdb', 'request_id': 'req-fe8973dc-a190-473c-a6d2-ec2c80f02d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.891302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3281eb99-66fe-41f9-859a-27421a18970a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:50.893412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3281eb99-66fe-41f9-859a-27421a18970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:50.966886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a7670da79941ac9c0305dea9751fdb', 'request_id': 'req-fe8973dc-a190-473c-a6d2-ec2c80f02d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.995467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] The token cache is being invalidate because project c9a7670da79941ac9c0305dea9751fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:50.995831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.996643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe8973dc-a190-473c-a6d2-ec2c80f02d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:50.998358 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1274/2570] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:50.999502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:50.999794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.000195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.006540 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1297/2571] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:50 2022] DELETE /identity/v3/projects/c9a7670da79941ac9c0305dea9751fdb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:51.008297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cf18b-55a5-43c0-bed5-261dad358081 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.008589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cf18b-55a5-43c0-bed5-261dad358081 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.009010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cf18b-55a5-43c0-bed5-261dad358081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.027771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:51.029439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:51.041618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-013cf18b-55a5-43c0-bed5-261dad358081 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:51.042474 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1275/2572] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:51.043333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-013cf18b-55a5-43c0-bed5-261dad358081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:51.043454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.045109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:51.055792 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1298/2573] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:51.064880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cf18b-55a5-43c0-bed5-261dad358081 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.077570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cf18b-55a5-43c0-bed5-261dad358081 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.088965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc44b6-3e8d-40eb-884b-f648851ca4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.089583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc44b6-3e8d-40eb-884b-f648851ca4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.090074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc44b6-3e8d-40eb-884b-f648851ca4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.090357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc44b6-3e8d-40eb-884b-f648851ca4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.091807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc44b6-3e8d-40eb-884b-f648851ca4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:51.091807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc44b6-3e8d-40eb-884b-f648851ca4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.092941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc44b6-3e8d-40eb-884b-f648851ca4d6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.109709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1299/2574] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:51.111429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a97e6-5a4b-4873-8058-86e7ac55d217 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.111998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a97e6-5a4b-4873-8058-86e7ac55d217 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.112268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a97e6-5a4b-4873-8058-86e7ac55d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.129229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca12ab-aa89-4842-b0ce-f70e32f86c56 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.133271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.133921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.134203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f73a97e6-5a4b-4873-8058-86e7ac55d217 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:51.134531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.134822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.135632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f73a97e6-5a4b-4873-8058-86e7ac55d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:51.136797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:51.141647 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:51.148748 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1300/2575] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:51.148748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a97e6-5a4b-4873-8058-86e7ac55d217 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.155249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.155249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.161194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a97e6-5a4b-4873-8058-86e7ac55d217 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.165528 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1276/2576] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:51.166570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.166708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.167820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.168407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.168842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.169623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.172135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.177603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd58678-a648-4de2-8200-f0a0c9f3f9af service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.183016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.183307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.183599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.184062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.184727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:51.185037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.186990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.200707 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1277/2577] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:51.205082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.228877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9f4f-f597-4a21-b4bb-0611d4b2a138 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.235385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.237079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.237471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.238127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.239102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.241231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.324201 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1301/2578] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:51 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:51.328295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.368251 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1278/2579] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:51 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:51.371154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.398377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b070f-e27e-4667-afaf-255a72a4083b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.460130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5340e4b-97d3-49fd-9a56-f76a2ad54587 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.467579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.469152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.469152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.469152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.469702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.473029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.485799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.486644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.486933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.487208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.488027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.490086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.600770 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1302/2580] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:51 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:51.602268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1279/2581] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:51 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:51.603446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.604538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.618268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaa3a0-51c8-4560-bdd8-2135fb7a61dc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.619663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858237-97b3-43a0-8b56-5b6b9d4a5696 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.624077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.627600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.627600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.627600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.627600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.628242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.628860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.629334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.629457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.629609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.630463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.632055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.642913 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1303/2582] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:51.644103 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1280/2583] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:51.647037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.653887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.665355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb174-b0af-4031-824b-6fa8bc46a0b2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.672831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436c586-7a56-4cdc-bd0d-bd85c2f57023 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.679647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.679647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.679647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.679647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.680496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.680496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.687419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.688046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.688332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.688608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.689543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.691176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.691682 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1281/2584] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:51.695811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.706033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f611d9-4d51-4943-8bbe-5baaa0c64722 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.715574 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1304/2585] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:51.720984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0300-83b1-4840-854a-614e2ee18126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.721670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0300-83b1-4840-854a-614e2ee18126 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.721966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0300-83b1-4840-854a-614e2ee18126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.722244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0300-83b1-4840-854a-614e2ee18126 admin admin] PATH_INFO: `/v3/projects/8eceaee383a748bd85cfdef64d2f731c/users/127cb41798b44f1882542df61a50317b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.723204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.739368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93a03-c89b-4720-99cf-473567541378 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:51.748434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:51.749694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.750323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.751088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] PATH_INFO: `/v3/projects/849e6c7163c341a49c76d8b4f22820d2/users/f996518bd6ef4e03a4ddcebee1eb44c7/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.771383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0300-83b1-4840-854a-614e2ee18126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eceaee383a748bd85cfdef64d2f731c, user_id=127cb41798b44f1882542df61a50317b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.771709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849e6c7163c341a49c76d8b4f22820d2, user_id=f996518bd6ef4e03a4ddcebee1eb44c7, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:51.774554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.775576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0300-83b1-4840-854a-614e2ee18126 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:51.866912 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:51.871579 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1305/2586] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:51 2022] PUT /identity/v3/projects/849e6c7163c341a49c76d8b4f22820d2/users/f996518bd6ef4e03a4ddcebee1eb44c7/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:51.872441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:51.873832 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1282/2587] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:51 2022] PUT /identity/v3/projects/8eceaee383a748bd85cfdef64d2f731c/users/127cb41798b44f1882542df61a50317b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:51.874098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:51.881682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a44e-d34e-4bdb-b0a5-09d960351b52 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:51.882003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a44e-d34e-4bdb-b0a5-09d960351b52 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:51.882697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a44e-d34e-4bdb-b0a5-09d960351b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:51.927473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7888a44e-d34e-4bdb-b0a5-09d960351b52 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:51.929074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7888a44e-d34e-4bdb-b0a5-09d960351b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:51.987899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987e75-395c-48d9-8ae2-837145255af8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.012829 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1283/2588] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:52.012829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239b7d-4eee-46de-ad20-783411407773 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.012829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239b7d-4eee-46de-ad20-783411407773 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.012829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239b7d-4eee-46de-ad20-783411407773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.039600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-99239b7d-4eee-46de-ad20-783411407773 None None] MFA Rules not processed for user `127cb41798b44f1882542df61a50317b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:52.040855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-99239b7d-4eee-46de-ad20-783411407773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:52.114582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.115532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.115832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.116124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] PATH_INFO: `/v3/projects/d352b8744dcd403998b5ed22381bcb82` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.117279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d352b8744dcd403998b5ed22381bcb82)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.121053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.133569 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1284/2589] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:52.133569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239b7d-4eee-46de-ad20-783411407773 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.133569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-99239b7d-4eee-46de-ad20-783411407773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:52.202608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239b7d-4eee-46de-ad20-783411407773 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.207984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.208609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.208890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.209208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.219448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.220934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.231560 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1285/2590] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:52.232442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.243390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ade7-4a83-4639-9cba-1127427d5d99 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.249038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.249787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.249946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.250821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.250957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.253930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.304628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd352b8744dcd403998b5ed22381bcb82', 'request_id': 'req-63dfd681-52a2-4120-8132-7d3fc593e4a4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.312334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd352b8744dcd403998b5ed22381bcb82', 'request_id': 'req-63dfd681-52a2-4120-8132-7d3fc593e4a4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.376366 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1286/2591] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:52 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:52.380552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.414778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd352b8744dcd403998b5ed22381bcb82', 'request_id': 'req-63dfd681-52a2-4120-8132-7d3fc593e4a4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.442432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] The token cache is being invalidate because project d352b8744dcd403998b5ed22381bcb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:52.442923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.443841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.445558 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1306/2592] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:51 2022] DELETE /identity/v3/projects/d352b8744dcd403998b5ed22381bcb82 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:52.450776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.453784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:52.500661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1b6b2-1888-4c0e-962b-6e931cc8f485 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.511891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.512750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.513039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.513319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.514012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.516692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.555736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfd681-52a2-4120-8132-7d3fc593e4a4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.561296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.562115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.571861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.571861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] PATH_INFO: `/v3/users/5dc4726033b343868edd28bcc40b7d40` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.571861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc4726033b343868edd28bcc40b7d40)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.571861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.642942 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1287/2593] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:52 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:52.645175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.647393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:52.663737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea09838-89d0-4a55-96f5-13f8db8fcb77 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.669890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.675021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.675021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.675021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.675021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.675021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.687916 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1288/2594] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:52.695470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.713179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5737a2e-06f9-4533-aebc-bb4364e9cd7e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.718264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.719017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.719593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.719880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] PATH_INFO: `/v3/projects/524acaeec298462f82c498779686b45f/users/caa8267520d64b19b6ab220ab2981c6b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.741513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=524acaeec298462f82c498779686b45f, user_id=caa8267520d64b19b6ab220ab2981c6b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.744573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.814996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc4726033b343868edd28bcc40b7d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.815648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc4726033b343868edd28bcc40b7d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.832088 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:52.838035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1289/2595] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:52 2022] PUT /identity/v3/projects/524acaeec298462f82c498779686b45f/users/caa8267520d64b19b6ab220ab2981c6b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:52.841913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.913187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e518-a2c6-4852-9804-7219c691dc2e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.918903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.919313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.919596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.919867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:52.920693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:52.923143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:52.927563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc4726033b343868edd28bcc40b7d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.943644 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1290/2596] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:52.945427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc4726033b343868edd28bcc40b7d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.947554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:52.950733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbea5c99-126c-4faf-a44f-2d659b8942f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc4726033b343868edd28bcc40b7d40'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:52.951314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:52.979329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95854d-b898-4898-a5fb-f1eccecc95de admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:52.993466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:52.994438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:52.994557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:52.994834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] PATH_INFO: `/v3/projects/524acaeec298462f82c498779686b45f/users/caa8267520d64b19b6ab220ab2981c6b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.000370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524acaeec298462f82c498779686b45f, user_id=caa8267520d64b19b6ab220ab2981c6b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:53.005702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:53.028153 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1307/2597] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:52 2022] DELETE /identity/v3/users/5dc4726033b343868edd28bcc40b7d40 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:53.035435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1291/2598] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:52 2022] PUT /identity/v3/projects/524acaeec298462f82c498779686b45f/users/caa8267520d64b19b6ab220ab2981c6b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:14:53.052446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2540a9-dac3-4eea-a961-396adc46d047 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.053109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2540a9-dac3-4eea-a961-396adc46d047 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.054622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2540a9-dac3-4eea-a961-396adc46d047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.139757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0b2540a9-dac3-4eea-a961-396adc46d047 None None] MFA Rules not processed for user `caa8267520d64b19b6ab220ab2981c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:53.141295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0b2540a9-dac3-4eea-a961-396adc46d047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:53.246873 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1308/2599] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:53.254264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:53.266775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb682e6-3501-4047-97c1-da97aa1d5103 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:53.276949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:53.282266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.282266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.282266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.282266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:53.282266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:53.282846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:53.302480 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1292/2600] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:53.312277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2540a9-dac3-4eea-a961-396adc46d047 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:53.325742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2540a9-dac3-4eea-a961-396adc46d047 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:53.331702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:53.333660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.333660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.333660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.334509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:53.336540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:53.371993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:53.374390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:53.470198 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1309/2601] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:53 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:53.474862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:53.483394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce1a92-a0aa-464b-b5a8-f0abd6bbef0b tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:53.584893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047ad5-3f81-4a0c-baea-f861c578c655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:53.585216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6828ff-8826-4fc2-a9be-09f51922fa66 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:53.594068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047ad5-3f81-4a0c-baea-f861c578c655 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.594513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047ad5-3f81-4a0c-baea-f861c578c655 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.597966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047ad5-3f81-4a0c-baea-f861c578c655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.604868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-08047ad5-3f81-4a0c-baea-f861c578c655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:53.611863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:53.614118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.614118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.614435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.616688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:53.617013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:53.620437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:53.644773 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1310/2602] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:53.694287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047ad5-3f81-4a0c-baea-f861c578c655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:53.695892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047ad5-3f81-4a0c-baea-f861c578c655 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:53.705839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:53.707780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:53.718471 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1293/2603] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:53.726948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3358-49f2-4b34-bae4-55526737f13e tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:53.734631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:53.735859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.736256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.737096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.750032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:53.751738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:53.779704 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1311/2604] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:53.800945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972f44-7824-4cf5-9d54-bead88cd984e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.801230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972f44-7824-4cf5-9d54-bead88cd984e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.801514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972f44-7824-4cf5-9d54-bead88cd984e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.803041 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1294/2605] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:53.808082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:53.822449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:53.833553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be677e-2ac7-46be-85b2-6954a3bf1523 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:53.840539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbe371-24e1-49f3-993c-f3e241d3d810 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:53.841336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe371-24e1-49f3-993c-f3e241d3d810 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:53.841534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe371-24e1-49f3-993c-f3e241d3d810 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:53.841903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbe371-24e1-49f3-993c-f3e241d3d810 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/projects/ddca7801edf64fc9857b70712fa73477` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:53.843183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbe371-24e1-49f3-993c-f3e241d3d810 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:get_project(project_id=ddca7801edf64fc9857b70712fa73477)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:53.846608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbe371-24e1-49f3-993c-f3e241d3d810 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:53.858783 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1312/2606] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:53 2022] GET /identity/v3/projects/ddca7801edf64fc9857b70712fa73477 => generated 369 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:53.937567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972f44-7824-4cf5-9d54-bead88cd984e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:53.939484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-88972f44-7824-4cf5-9d54-bead88cd984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:54.067806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972f44-7824-4cf5-9d54-bead88cd984e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.072124 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:54.096946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cdab5-d1e7-4deb-84d5-9deb159dda5d None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.097235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cdab5-d1e7-4deb-84d5-9deb159dda5d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.097560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cdab5-d1e7-4deb-84d5-9deb159dda5d None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.099382 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1313/2607] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:14:54.102121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.104346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.104752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.105105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] PATH_INFO: `/v3/projects/b007bcec3c8e4e068443ab6114f77593` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.105573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cdab5-d1e7-4deb-84d5-9deb159dda5d None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:54.108809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b007bcec3c8e4e068443ab6114f77593)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.113244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:54.128292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cdab5-d1e7-4deb-84d5-9deb159dda5d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:54.143057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cdab5-d1e7-4deb-84d5-9deb159dda5d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.160231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.161699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.163342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.164584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/projects/ddca7801edf64fc9857b70712fa73477` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.166196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:get_project(project_id=ddca7801edf64fc9857b70712fa73477)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.168993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:54.171409 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1314/2608] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:54 2022] GET /identity/v3/projects/ddca7801edf64fc9857b70712fa73477 => generated 369 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:54.214966 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:54.236161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:54.258894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a8411-c30a-4bad-952f-36cbc89bbc13 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.281954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.283882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.284395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.289923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.291078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:54.292620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.299789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b007bcec3c8e4e068443ab6114f77593', 'request_id': 'req-847c3005-2184-4b8f-9991-44ad82d0a631'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:54.302347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:54.314623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b007bcec3c8e4e068443ab6114f77593', 'request_id': 'req-847c3005-2184-4b8f-9991-44ad82d0a631'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:54.333428 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1315/2609] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:54.335029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:54.350958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665300-14d6-4a8e-9354-ced98e67bb7c tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.406915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b007bcec3c8e4e068443ab6114f77593', 'request_id': 'req-847c3005-2184-4b8f-9991-44ad82d0a631'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:54.449970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] The token cache is being invalidate because project b007bcec3c8e4e068443ab6114f77593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:54.451919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:54.454019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-847c3005-2184-4b8f-9991-44ad82d0a631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:54.471960 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1295/2610] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:53 2022] DELETE /identity/v3/projects/b007bcec3c8e4e068443ab6114f77593 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:54.490124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377da2-b173-4bf1-87de-d7261c9724ad None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.490124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377da2-b173-4bf1-87de-d7261c9724ad None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.490124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa377da2-b173-4bf1-87de-d7261c9724ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.539242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.540425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.542411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.545296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.545296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.547534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:54.551779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aa377da2-b173-4bf1-87de-d7261c9724ad None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:54.555265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aa377da2-b173-4bf1-87de-d7261c9724ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:54.633442 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1316/2611] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:54 2022] POST /identity/v3/users => generated 383 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:54.637019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:54.657837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:54.687156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5f97-84cd-40a6-8a6d-31129227b8e7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.692236 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1296/2612] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:54.702355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c57a-bf33-40dd-bc0c-546f12c1225d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.706842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c57a-bf33-40dd-bc0c-546f12c1225d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.706842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c57a-bf33-40dd-bc0c-546f12c1225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.707052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.707052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.707463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.709067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.709067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:54.709067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.712092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:54.753637 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1317/2613] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:54.753856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7830c57a-bf33-40dd-bc0c-546f12c1225d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:54.755233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7830c57a-bf33-40dd-bc0c-546f12c1225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:54.794230 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1297/2614] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:54.800028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:54.818843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e7440-53a1-43b4-a0f7-a4b5319a2a61 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.824772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.825391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.826093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.828677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.828677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:14:54.828677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.829291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:54.844847 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1318/2615] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:54.849931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c57a-bf33-40dd-bc0c-546f12c1225d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:54.859608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c57a-bf33-40dd-bc0c-546f12c1225d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.865794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91939ae7-bac6-45a8-94cb-50ceff2a3581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.866455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939ae7-bac6-45a8-94cb-50ceff2a3581 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.866790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939ae7-bac6-45a8-94cb-50ceff2a3581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.867064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91939ae7-bac6-45a8-94cb-50ceff2a3581 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.867724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91939ae7-bac6-45a8-94cb-50ceff2a3581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.869745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91939ae7-bac6-45a8-94cb-50ceff2a3581 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:55.012606 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1298/2616] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:54 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:14:55.014626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:55.030064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adfc20-615c-41a0-884a-e736f3667860 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:55.060738 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:55.120455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:55.121943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:55.122361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:55.122706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:55.123981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:55.125976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:55.192724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06da321-b028-457b-9b15-8ff0817cd045 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:55.193030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06da321-b028-457b-9b15-8ff0817cd045 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:55.193438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06da321-b028-457b-9b15-8ff0817cd045 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:55.195129 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1299/2617] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:14:55.200976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06da321-b028-457b-9b15-8ff0817cd045 None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:55.203455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e06da321-b028-457b-9b15-8ff0817cd045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:55.295976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06da321-b028-457b-9b15-8ff0817cd045 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:55.362950 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1319/2618] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:55 2022] POST /identity/v3/users => generated 295 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:55.364505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:55.379139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09fe1-e184-4a85-8447-0c81a5f167a1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:55.379696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06da321-b028-457b-9b15-8ff0817cd045 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:55.385913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:55.386713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:55.387143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:55.387521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:55.388282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:55.390099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:55.390835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:55.391921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:55.392362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:55.392852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/projects/ddca7801edf64fc9857b70712fa73477` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:55.394783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:get_project(project_id=ddca7801edf64fc9857b70712fa73477)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:55.398879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:55.405731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1300/2619] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:55 2022] GET /identity/v3/projects/ddca7801edf64fc9857b70712fa73477 => generated 369 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:14:55.409334 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1320/2620] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:55.409495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:55.425955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb134c6f-be91-49b3-9545-87d6675dacee tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:55.432390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266c913-eaae-4c2e-b57d-b813ceb97f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:55.433550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c913-eaae-4c2e-b57d-b813ceb97f5a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:55.434505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c913-eaae-4c2e-b57d-b813ceb97f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:55.434505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c913-eaae-4c2e-b57d-b813ceb97f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:55.435534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266c913-eaae-4c2e-b57d-b813ceb97f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:55.440262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266c913-eaae-4c2e-b57d-b813ceb97f5a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:55.460833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1301/2621] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:14:55.464733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:55.482263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcc40b-e05b-4115-b0fc-6692066ff430 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:55.496820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:55.497866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:55.498331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:55.498851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] PATH_INFO: `/v3/projects/a098435edc2c43718d3fd926637ce993/users/7a69664084964160a3eb6cf9692fa6e9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:55.529310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a098435edc2c43718d3fd926637ce993, user_id=7a69664084964160a3eb6cf9692fa6e9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:55.537424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:55.563556 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:55.665445 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1321/2622] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:55 2022] PUT /identity/v3/projects/a098435edc2c43718d3fd926637ce993/users/7a69664084964160a3eb6cf9692fa6e9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:55.679173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2901d-e87c-4cd1-a70b-995fbdef9944 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:55.679595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2901d-e87c-4cd1-a70b-995fbdef9944 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:55.679896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2901d-e87c-4cd1-a70b-995fbdef9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:55.746721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-97c2901d-e87c-4cd1-a70b-995fbdef9944 None None] MFA Rules not processed for user `7a69664084964160a3eb6cf9692fa6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:55.748272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-97c2901d-e87c-4cd1-a70b-995fbdef9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:55.885405 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1302/2623] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:55.895091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:56.075271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fde47d-ecf9-4ec3-bf6e-18650fb253d9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:56.082385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a55721-e0d7-4ade-a49b-03ec5095210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:56.083014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55721-e0d7-4ade-a49b-03ec5095210a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:56.083293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55721-e0d7-4ade-a49b-03ec5095210a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:56.083572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55721-e0d7-4ade-a49b-03ec5095210a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:56.084211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a55721-e0d7-4ade-a49b-03ec5095210a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:56.086798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a55721-e0d7-4ade-a49b-03ec5095210a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:56.245688 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1322/2624] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:14:55 2022] POST /identity/v3/projects => generated 389 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:56.249697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2901d-e87c-4cd1-a70b-995fbdef9944 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:56.267176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2901d-e87c-4cd1-a70b-995fbdef9944 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:56.387249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:56.387896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:56.388193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:56.388506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:56.389927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:56.391944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:56.469423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0bf4b-1f1b-45e8-9efa-a818f68910e5 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:56.469724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0bf4b-1f1b-45e8-9efa-a818f68910e5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:56.470022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0bf4b-1f1b-45e8-9efa-a818f68910e5 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:56.472909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1323/2625] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:14:56.479584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0bf4b-1f1b-45e8-9efa-a818f68910e5 None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:14:56.554189 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1303/2626] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:14:56 2022] POST /identity/v3/users => generated 301 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:14:56.569500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:56.602467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03cf21-186f-472d-9da3-99644e9084c2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:56.609643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:56.610420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:56.610920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:56.611219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:56.612715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:56.613759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0bf4b-1f1b-45e8-9efa-a818f68910e5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:56.614723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:56.631151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1304/2627] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:56.637580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:56.661076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e39eab-9c91-439c-8e84-ddfea69101c6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:56.676863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:56.677986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:56.678629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:56.679146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] PATH_INFO: `/v3/projects/538b6ce1a2de4d86ae0f828f49a8ac5f/users/66f617ec4dc64c619588b45d66231273/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:56.702436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538b6ce1a2de4d86ae0f828f49a8ac5f, user_id=66f617ec4dc64c619588b45d66231273, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:56.707934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:56.788829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0bf4b-1f1b-45e8-9efa-a818f68910e5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:56.798201 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1305/2628] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:56 2022] PUT /identity/v3/projects/538b6ce1a2de4d86ae0f828f49a8ac5f/users/66f617ec4dc64c619588b45d66231273/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:56.799320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:56.931964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4176a-58b8-4c5f-92b5-1e6b568291b7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:56.939262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:56.945327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:56.945327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:56.945327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:56.945327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:56.946079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:56.968442 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1306/2629] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:14:56.979226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:56.988990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611079f-2d63-4a1a-a1d9-8be16f8d681c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:57.004167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:57.006327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac256793-9d10-4385-976e-3bcf84ad1b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:57.008499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:57.008807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:57.009319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/projects/ddca7801edf64fc9857b70712fa73477` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:57.009728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256793-9d10-4385-976e-3bcf84ad1b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:57.010687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256793-9d10-4385-976e-3bcf84ad1b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:57.011385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac256793-9d10-4385-976e-3bcf84ad1b3a admin admin] PATH_INFO: `/v3/projects/538b6ce1a2de4d86ae0f828f49a8ac5f/users/66f617ec4dc64c619588b45d66231273/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:57.011978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:get_project(project_id=ddca7801edf64fc9857b70712fa73477)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:57.017020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac256793-9d10-4385-976e-3bcf84ad1b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=538b6ce1a2de4d86ae0f828f49a8ac5f, user_id=66f617ec4dc64c619588b45d66231273, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:57.017597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:57.023390 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1324/2630] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:14:56 2022] GET /identity/v3/projects/ddca7801edf64fc9857b70712fa73477 => generated 369 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:14:57.023711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac256793-9d10-4385-976e-3bcf84ad1b3a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:57.061264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1307/2631] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:14:56 2022] PUT /identity/v3/projects/538b6ce1a2de4d86ae0f828f49a8ac5f/users/66f617ec4dc64c619588b45d66231273/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:57.086065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:57.113360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a1154-cf65-4c29-a4dc-97ae748f9da1 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:57.147255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda8c7-02ec-4b1e-a574-1b1aa164a178 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:57.147255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda8c7-02ec-4b1e-a574-1b1aa164a178 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:57.147255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda8c7-02ec-4b1e-a574-1b1aa164a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:57.214157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-36bda8c7-02ec-4b1e-a574-1b1aa164a178 None None] MFA Rules not processed for user `66f617ec4dc64c619588b45d66231273`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:57.218408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-36bda8c7-02ec-4b1e-a574-1b1aa164a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:57.280742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:57.282800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:57.285012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:57.285012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/users/e5be6e5b03f940a5a41dac26e15fb241` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:57.330982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e5be6e5b03f940a5a41dac26e15fb241)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:57.333035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:57.422090 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1308/2632] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:57.499896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5be6e5b03f940a5a41dac26e15fb241'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:57.501478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5be6e5b03f940a5a41dac26e15fb241'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:57.568835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5be6e5b03f940a5a41dac26e15fb241'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:57.588357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5be6e5b03f940a5a41dac26e15fb241'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:57.595359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5be6e5b03f940a5a41dac26e15fb241'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:57.681367 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1325/2633] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:57 2022] DELETE /identity/v3/users/e5be6e5b03f940a5a41dac26e15fb241 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:57.683782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bda8c7-02ec-4b1e-a574-1b1aa164a178 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:57.703250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bda8c7-02ec-4b1e-a574-1b1aa164a178 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:57.814299 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:57.865521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa8267520d64b19b6ab220ab2981c6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '524acaeec298462f82c498779686b45f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:57.866647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:57.867856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:57.868408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] PATH_INFO: `/v3/projects/ddca7801edf64fc9857b70712fa73477` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:57.870656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ddca7801edf64fc9857b70712fa73477)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:57.883964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:58.009945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddca7801edf64fc9857b70712fa73477', 'request_id': 'req-efb7875a-3cb4-4982-87df-678a30c88764'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.020311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddca7801edf64fc9857b70712fa73477', 'request_id': 'req-efb7875a-3cb4-4982-87df-678a30c88764'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.117245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddca7801edf64fc9857b70712fa73477', 'request_id': 'req-efb7875a-3cb4-4982-87df-678a30c88764'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.139006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] The token cache is being invalidate because project ddca7801edf64fc9857b70712fa73477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:14:58.140141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.141093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.146793 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:58.152823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1309/2634] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:14:57 2022] DELETE /identity/v3/projects/ddca7801edf64fc9857b70712fa73477 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:58.159404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:58.161857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:58.280625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca64ec-bb7e-428f-b3d0-4f84d38d16a7 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:58.374924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:58.375812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:58.376781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:58.378871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] PATH_INFO: `/v3/users/127cb41798b44f1882542df61a50317b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:58.379720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=127cb41798b44f1882542df61a50317b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:58.388795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:58.580410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:58.584097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:58.692111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127cb41798b44f1882542df61a50317b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.694271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127cb41798b44f1882542df61a50317b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.716558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7875a-3cb4-4982-87df-678a30c88764 tempest-QuotasAdminTestV257-2145710559 tempest-QuotasAdminTestV257-2145710559-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:58.727912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:58.728684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:58.729040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:58.729481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:58.732942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:58.757584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127cb41798b44f1882542df61a50317b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.767624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127cb41798b44f1882542df61a50317b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.768940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05dcd3d7-727c-4d32-b50e-29e4913bfaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127cb41798b44f1882542df61a50317b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:14:58.813918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1326/2635] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:14:58 2022] DELETE /identity/v3/users/127cb41798b44f1882542df61a50317b => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:14:58.820220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741bc23-9716-4851-8937-95c479559cbe None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:58.821103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741bc23-9716-4851-8937-95c479559cbe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:58.821379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741bc23-9716-4851-8937-95c479559cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:58.848904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:58.850855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:58.858066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9741bc23-9716-4851-8937-95c479559cbe None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:58.859935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9741bc23-9716-4851-8937-95c479559cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:58.862552 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1310/2636] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:58.948719 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1327/2637] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:14:58.962346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:58.966805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:59.053561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bcb0e-de31-44c3-9f2b-b9e7d5d38c51 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:59.173056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:59.174048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:59.187029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:59.189280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:59.215107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:59.217144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:59.264776 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1311/2638] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:59.301297 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:00.055562 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:00.198801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741bc23-9716-4851-8937-95c479559cbe None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:00.201764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9741bc23-9716-4851-8937-95c479559cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:00.259595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741bc23-9716-4851-8937-95c479559cbe None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:00.279323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:00.280254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:00.280755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:00.281263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] PATH_INFO: `/v3/projects/8eceaee383a748bd85cfdef64d2f731c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:00.285547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eceaee383a748bd85cfdef64d2f731c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:00.293766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:00.457753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eceaee383a748bd85cfdef64d2f731c', 'request_id': 'req-f076aede-c20b-498e-bc97-4e49d4845af5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:00.465791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eceaee383a748bd85cfdef64d2f731c', 'request_id': 'req-f076aede-c20b-498e-bc97-4e49d4845af5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:00.528402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eceaee383a748bd85cfdef64d2f731c', 'request_id': 'req-f076aede-c20b-498e-bc97-4e49d4845af5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:00.544429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] The token cache is being invalidate because project 8eceaee383a748bd85cfdef64d2f731c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:00.544724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:00.546044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:00.548190 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1328/2639] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:00 2022] DELETE /identity/v3/projects/8eceaee383a748bd85cfdef64d2f731c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:00.552222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:00.563857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c370f-9662-42ad-8efd-8b11dfa1ddb0 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:00.657018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:00.660772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:00.660772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:00.660772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] PATH_INFO: `/v3/users/caa8267520d64b19b6ab220ab2981c6b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:00.660772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa8267520d64b19b6ab220ab2981c6b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:00.662599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:00.843760 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:00.957077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa8267520d64b19b6ab220ab2981c6b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:00.990277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa8267520d64b19b6ab220ab2981c6b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:01.006500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa8267520d64b19b6ab220ab2981c6b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:01.008253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa8267520d64b19b6ab220ab2981c6b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:01.072205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-41c35641-f3e0-4007-af1b-deacb82a8338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa8267520d64b19b6ab220ab2981c6b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:01.085360 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1312/2640] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:00 2022] DELETE /identity/v3/users/caa8267520d64b19b6ab220ab2981c6b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:01.629484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:01.631099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:01.772768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076aede-c20b-498e-bc97-4e49d4845af5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:01.937567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:01.938239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:01.938521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:01.939599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:01.944934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:02.072244 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:02.112996 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:02.121961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:02.126155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:02.151664 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1329/2641] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:01 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:02.824244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4317-76f8-4c2c-8665-5b7c9dbb2c15 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:02.824600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4317-76f8-4c2c-8665-5b7c9dbb2c15 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:02.824885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a4317-76f8-4c2c-8665-5b7c9dbb2c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:02.859412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ae3a4317-76f8-4c2c-8665-5b7c9dbb2c15 None None] MFA Rules not processed for user `f996518bd6ef4e03a4ddcebee1eb44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:02.860700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ae3a4317-76f8-4c2c-8665-5b7c9dbb2c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:02.974040 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1313/2642] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:03.146445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:03.150201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:03.226783 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:03.269675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14efb28-0ce6-402f-af78-c9b79859895c service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:03.275525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:03.276517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:03.277090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:03.277596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] PATH_INFO: `/v3/projects/524acaeec298462f82c498779686b45f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:03.279516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524acaeec298462f82c498779686b45f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:03.281748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:03.317829 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:03.453268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524acaeec298462f82c498779686b45f', 'request_id': 'req-eef2b8ac-7612-4043-9427-f48a9e64a788'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:03.483428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524acaeec298462f82c498779686b45f', 'request_id': 'req-eef2b8ac-7612-4043-9427-f48a9e64a788'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:03.560704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524acaeec298462f82c498779686b45f', 'request_id': 'req-eef2b8ac-7612-4043-9427-f48a9e64a788'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:03.576186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] The token cache is being invalidate because project 524acaeec298462f82c498779686b45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:03.577698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:03.579120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef2b8ac-7612-4043-9427-f48a9e64a788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:03.588384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1330/2643] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:03 2022] DELETE /identity/v3/projects/524acaeec298462f82c498779686b45f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:03.590343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:03.590343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:03.590621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:03.619128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:03.620624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:03.763448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ea5c-0e06-41bc-a683-76cf460ce112 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:03.764598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ea5c-0e06-41bc-a683-76cf460ce112 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:03.764977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ea5c-0e06-41bc-a683-76cf460ce112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:03.773382 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1314/2644] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:03.788537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:03.790871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:03.810868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a222ea5c-0e06-41bc-a683-76cf460ce112 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:03.812554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a222ea5c-0e06-41bc-a683-76cf460ce112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:03.829952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1331/2645] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:03.836058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ea5c-0e06-41bc-a683-76cf460ce112 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:03.850123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ea5c-0e06-41bc-a683-76cf460ce112 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:03.859545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:03.861190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:03.861617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:03.864075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:03.865652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:15:03.866238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:03.870474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:03.892538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1332/2646] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:15:03.896866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:03.902562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42e779-31c2-444f-80f8-8fa9705e5383 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:03.912135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:03.913061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:03.913684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:03.914190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:03.916361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:03.916533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13f1f0-04de-475a-940d-4267d486f6c8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:03.926600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:03.936594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:03.936594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:03.936594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:03.936594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:03.936594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:03.996044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:03.997674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:04.022356 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1315/2647] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:04.073975 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1333/2648] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:03 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:04.077845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:04.091611 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:04.100403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37de61-c10d-4776-b5ce-309e0d124c1d service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:04.192505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:04.193159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:04.193448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:04.193726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:04.194457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:04.196665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:04.306795 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1316/2649] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:04 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:04.308107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:04.320488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468183-c399-4608-ac5d-dc7f2a67cef2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:04.325593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:04.326250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:04.326536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:04.326811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:04.327459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:04.329470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:04.343333 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1334/2650] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:04.347336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:04.360786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfdd24-8cc7-48fa-9b98-a3b275241be7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:04.371124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aaec0-3de8-4136-8ae6-79b3698a9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:04.371891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aaec0-3de8-4136-8ae6-79b3698a9d7d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:04.372236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aaec0-3de8-4136-8ae6-79b3698a9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:04.372667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aaec0-3de8-4136-8ae6-79b3698a9d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:04.374214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88aaec0-3de8-4136-8ae6-79b3698a9d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:04.376492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88aaec0-3de8-4136-8ae6-79b3698a9d7d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:04.392643 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1317/2651] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:04.397596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:04.410628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36148-bb31-4eb4-9d5c-00a9137bdd83 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:04.434156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:04.436994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:04.436994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:04.436994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] PATH_INFO: `/v3/projects/74edcc8901844248b861c2ca3c5a8a2e/users/4b656391a4564f8aaca14726d52213d1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:04.458397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74edcc8901844248b861c2ca3c5a8a2e, user_id=4b656391a4564f8aaca14726d52213d1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:04.461757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:04.557948 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1335/2652] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:04 2022] PUT /identity/v3/projects/74edcc8901844248b861c2ca3c5a8a2e/users/4b656391a4564f8aaca14726d52213d1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:15:04.562795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22473d-8d51-4cf8-8eee-0086f951d89e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:04.563650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22473d-8d51-4cf8-8eee-0086f951d89e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:04.564424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22473d-8d51-4cf8-8eee-0086f951d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:04.569665 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:04.604290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2d22473d-8d51-4cf8-8eee-0086f951d89e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:04.606659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2d22473d-8d51-4cf8-8eee-0086f951d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:04.702345 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1318/2653] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:04.727482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:04.729038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:04.829415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57423143-a6e1-4a52-a5b6-c9e5c74da8c4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:04.839556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:04.839556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:04.839556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:04.839556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:04.848419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:04.850039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:04.882777 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1336/2654] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:04.924228 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:06.541750 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:06.599821 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:06.998838 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:09.016784 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:09.172766 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:11.485224 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:11.502572 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:12.115149 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:12.412538 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:12.434335 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:13.737437 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:14.353856 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:15.183738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c74b7-c634-4fe1-b01a-93036e9ec022 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:15.188857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c74b7-c634-4fe1-b01a-93036e9ec022 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:15.188857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c74b7-c634-4fe1-b01a-93036e9ec022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:15.226727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-360c74b7-c634-4fe1-b01a-93036e9ec022 None None] MFA Rules not processed for user `4b656391a4564f8aaca14726d52213d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:15.228000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-360c74b7-c634-4fe1-b01a-93036e9ec022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:15.337201 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:15.339451 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1319/2655] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:15.344962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:15.396425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29963ac-5c1a-4b3c-8d0e-facab9778fc9 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:15.410893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:15.411494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:15.411781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:15.412118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:15.423905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:15.423905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:15.451089 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:15.582755 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1337/2656] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:15 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:15.583504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c74b7-c634-4fe1-b01a-93036e9ec022 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:15.616013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c74b7-c634-4fe1-b01a-93036e9ec022 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:15.731504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:15.733335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:15.733791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:15.735163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:15.737274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:15.742179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:15.907383 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1320/2657] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:15 2022] POST /identity/v3/users => generated 298 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:15:15.908893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:15.929368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c94e8e-b7d8-4312-96f1-adb3df51eba3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:15.930722 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:15.946398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:15.947384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:15.947908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:15.948429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:15.949579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:15.951515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:15.970248 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1338/2658] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:15.973745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:15.988580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df775139-e4b6-4a74-a6d9-5bf93e1ef763 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:16.007152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:16.007940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:16.008324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:16.008705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] PATH_INFO: `/v3/projects/dd309c9f78ce497eb069e478877e7cf1/users/085bff1ef64745fc9785a2a8d131191f/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:16.029272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd309c9f78ce497eb069e478877e7cf1, user_id=085bff1ef64745fc9785a2a8d131191f, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:16.033052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:16.155199 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1321/2659] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:15 2022] PUT /identity/v3/projects/dd309c9f78ce497eb069e478877e7cf1/users/085bff1ef64745fc9785a2a8d131191f/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:16.157075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:16.180430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91973d-d3b8-4655-ac91-67b5f08b8ffe admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:16.294505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:16.295849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:16.296307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:16.296762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:16.297596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:16.299554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:16.326387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:16.327139 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1339/2660] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:16.339639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e8ddc-4eee-4898-b83a-4d5496aa9945 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:16.348859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a86b9-c59a-45d5-967d-4df0b615b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:16.350141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a86b9-c59a-45d5-967d-4df0b615b306 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:16.350672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a86b9-c59a-45d5-967d-4df0b615b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:16.351185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a86b9-c59a-45d5-967d-4df0b615b306 admin admin] PATH_INFO: `/v3/projects/dd309c9f78ce497eb069e478877e7cf1/users/085bff1ef64745fc9785a2a8d131191f/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:16.354191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a86b9-c59a-45d5-967d-4df0b615b306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd309c9f78ce497eb069e478877e7cf1, user_id=085bff1ef64745fc9785a2a8d131191f, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:16.380366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a86b9-c59a-45d5-967d-4df0b615b306 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:16.380366 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1322/2661] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:16 2022] PUT /identity/v3/projects/dd309c9f78ce497eb069e478877e7cf1/users/085bff1ef64745fc9785a2a8d131191f/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:15:17.154337 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:17.343025 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:18.619292 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:18.916498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:18.918667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:18.960882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b839f-9eaa-44d4-a474-54da373a2edb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:19.132257 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:19.153882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:19.154723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:19.155084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:19.155580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] PATH_INFO: `/v3/users/7a69664084964160a3eb6cf9692fa6e9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:19.157189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a69664084964160a3eb6cf9692fa6e9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:19.159449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:19.343501 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:19.436000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a69664084964160a3eb6cf9692fa6e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:19.442411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a69664084964160a3eb6cf9692fa6e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:19.562195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a69664084964160a3eb6cf9692fa6e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:19.577328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a69664084964160a3eb6cf9692fa6e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:19.578150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a69664084964160a3eb6cf9692fa6e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:19.613289 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1340/2662] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:18 2022] DELETE /identity/v3/users/7a69664084964160a3eb6cf9692fa6e9 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:19.615843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c7a7-060e-4ad1-b9ef-7041bd2c1f84 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:19.616169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c7a7-060e-4ad1-b9ef-7041bd2c1f84 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:19.616445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c7a7-060e-4ad1-b9ef-7041bd2c1f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:19.667387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8004c7a7-060e-4ad1-b9ef-7041bd2c1f84 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:19.669374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8004c7a7-060e-4ad1-b9ef-7041bd2c1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:19.837422 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1323/2663] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:19.905446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:19.907079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:19.942816 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:20.059335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b023b-ce05-4e24-a41a-d1eeaba47ff8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:20.064442 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:20.069287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:20.070356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:20.070858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:20.071395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:20.082574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:20.085216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:20.097744 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1341/2664] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:20.323591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dd1da-d44e-41d4-95f2-469f422a98a6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:20.323872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dd1da-d44e-41d4-95f2-469f422a98a6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:20.324608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dd1da-d44e-41d4-95f2-469f422a98a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:20.361793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b39dd1da-d44e-41d4-95f2-469f422a98a6 None None] MFA Rules not processed for user `a1286deaeee141a18e6207ca4bb7d3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:20.367077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b39dd1da-d44e-41d4-95f2-469f422a98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:20.559158 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1324/2665] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:20.840133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:20.841642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:20.886352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe45c-9a94-4fd7-8763-2160c60deaff service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:20.916783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:20.917537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:20.917801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:20.918102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] PATH_INFO: `/v3/projects/a098435edc2c43718d3fd926637ce993` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:20.923041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a098435edc2c43718d3fd926637ce993)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:20.931957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:21.180512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a098435edc2c43718d3fd926637ce993', 'request_id': 'req-a9318dab-c95c-4e82-8880-e9a61f9b79c0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.193727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a098435edc2c43718d3fd926637ce993', 'request_id': 'req-a9318dab-c95c-4e82-8880-e9a61f9b79c0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.302220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a098435edc2c43718d3fd926637ce993', 'request_id': 'req-a9318dab-c95c-4e82-8880-e9a61f9b79c0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.324828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] The token cache is being invalidate because project a098435edc2c43718d3fd926637ce993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:21.325443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.326431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9318dab-c95c-4e82-8880-e9a61f9b79c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.328801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1342/2666] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:20 2022] DELETE /identity/v3/projects/a098435edc2c43718d3fd926637ce993 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:21.333482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dd1da-d44e-41d4-95f2-469f422a98a6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:21.351362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39dd1da-d44e-41d4-95f2-469f422a98a6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:21.441442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:21.443661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:21.444088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:21.444516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] PATH_INFO: `/v3/users/66f617ec4dc64c619588b45d66231273` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:21.448910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f617ec4dc64c619588b45d66231273)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:21.451435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:21.769316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f617ec4dc64c619588b45d66231273'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.807973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f617ec4dc64c619588b45d66231273'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.840057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f617ec4dc64c619588b45d66231273'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.841144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f617ec4dc64c619588b45d66231273'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.960903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f617ec4dc64c619588b45d66231273'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:21.972572 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1325/2667] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:21 2022] DELETE /identity/v3/users/66f617ec4dc64c619588b45d66231273 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:22.184951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8002c56-b71e-427e-98e8-13116b4b0b9c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:22.186223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8002c56-b71e-427e-98e8-13116b4b0b9c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:22.186971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8002c56-b71e-427e-98e8-13116b4b0b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:22.195580 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:22.234388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c8002c56-b71e-427e-98e8-13116b4b0b9c None None] MFA Rules not processed for user `d3ee5c02cbb740bcab5009471ed98264`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:22.236311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c8002c56-b71e-427e-98e8-13116b4b0b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:22.372142 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:22.426286 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1343/2668] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:15:23.055454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:23.057007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:23.211750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020496-ed06-48e1-8aeb-238f73f8aced admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:23.220171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:23.241307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:23.241840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:23.242588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] PATH_INFO: `/v3/projects/538b6ce1a2de4d86ae0f828f49a8ac5f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:23.245976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=538b6ce1a2de4d86ae0f828f49a8ac5f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:23.250828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:23.450277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538b6ce1a2de4d86ae0f828f49a8ac5f', 'request_id': 'req-55afd014-e19d-459d-a004-7470afc30b4e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:23.459812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538b6ce1a2de4d86ae0f828f49a8ac5f', 'request_id': 'req-55afd014-e19d-459d-a004-7470afc30b4e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:23.464410 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:23.571917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538b6ce1a2de4d86ae0f828f49a8ac5f', 'request_id': 'req-55afd014-e19d-459d-a004-7470afc30b4e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:23.592603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] The token cache is being invalidate because project 538b6ce1a2de4d86ae0f828f49a8ac5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:23.593356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:23.594388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55afd014-e19d-459d-a004-7470afc30b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:23.598346 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1326/2669] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:23 2022] DELETE /identity/v3/projects/538b6ce1a2de4d86ae0f828f49a8ac5f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:23.603408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db0a0-1ad6-42ca-b05b-6d16edffa264 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:23.605508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db0a0-1ad6-42ca-b05b-6d16edffa264 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:23.606098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917db0a0-1ad6-42ca-b05b-6d16edffa264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:23.658969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-917db0a0-1ad6-42ca-b05b-6d16edffa264 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:23.659143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-917db0a0-1ad6-42ca-b05b-6d16edffa264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:23.799485 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1344/2670] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:15:23.808168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd8fc-4a9e-4a69-a840-bc483ad0ee9b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:23.808743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd8fc-4a9e-4a69-a840-bc483ad0ee9b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:23.809177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd8fc-4a9e-4a69-a840-bc483ad0ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:23.838854 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:23.867270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f96dd8fc-4a9e-4a69-a840-bc483ad0ee9b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:23.868346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f96dd8fc-4a9e-4a69-a840-bc483ad0ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:23.901359 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1327/2671] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:23.906265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917db0a0-1ad6-42ca-b05b-6d16edffa264 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:23.922068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917db0a0-1ad6-42ca-b05b-6d16edffa264 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:23.929654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:23.930714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:23.931212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:23.931773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:23.932793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:15:23.934326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:23.939845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d0248-8cd1-4560-ba9e-1b10537ed05f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:23.943902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d0248-8cd1-4560-ba9e-1b10537ed05f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:23.944373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:23.946210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d0248-8cd1-4560-ba9e-1b10537ed05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:24.006268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-837d0248-8cd1-4560-ba9e-1b10537ed05f None None] MFA Rules not processed for user `29f68fba91f1433bb6d51e956ea19022`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:24.006268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-837d0248-8cd1-4560-ba9e-1b10537ed05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:24.024230 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1345/2672] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:15:24.051882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:24.085598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3165aa-af61-43fb-80ec-57a8702a56ba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:24.106379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:24.109348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:24.112026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:24.116326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:24.120411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:24.125553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:24.227252 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1328/2673] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:24.384758 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1346/2674] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:24 2022] POST /identity/v3/projects => generated 375 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:24.391647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d0248-8cd1-4560-ba9e-1b10537ed05f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:24.452713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d0248-8cd1-4560-ba9e-1b10537ed05f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:24.566243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:24.566934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:24.567215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:24.567495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:24.568733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:24.571995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:24.698614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:24.699186 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1329/2675] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:24 2022] POST /identity/v3/users => generated 288 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:24.711797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1145e-6dd0-4a5d-923f-d90b091315cf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:24.721477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:24.723126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:24.723126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:24.723590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:24.725315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:24.727166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:24.742632 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1347/2676] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:24.747478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:24.762719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a888da-7105-4996-a10a-f970b211589b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:24.769804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccb986-2941-450b-ac26-38167b677294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:24.770460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb986-2941-450b-ac26-38167b677294 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:24.770817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb986-2941-450b-ac26-38167b677294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:24.771636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb986-2941-450b-ac26-38167b677294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:24.772424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccb986-2941-450b-ac26-38167b677294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:24.774116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccb986-2941-450b-ac26-38167b677294 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:24.801210 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1330/2677] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:24.803467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:24.817044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035a124-b6af-4fe0-9ee0-8c1dbb1ef82b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:24.838059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:24.839214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:24.840815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:24.841265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] PATH_INFO: `/v3/projects/96c68e355cc044799fa21801ba074e7b/users/6c184cbe1b0344be81596e0ee40ec1bd/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:24.870687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c68e355cc044799fa21801ba074e7b, user_id=6c184cbe1b0344be81596e0ee40ec1bd, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:24.874098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:24.967097 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1348/2678] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:24 2022] PUT /identity/v3/projects/96c68e355cc044799fa21801ba074e7b/users/6c184cbe1b0344be81596e0ee40ec1bd/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:24.978577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9657-a858-490d-9f42-b96b73b746ec None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:24.979043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9657-a858-490d-9f42-b96b73b746ec None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:24.979970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9657-a858-490d-9f42-b96b73b746ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:25.019806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-393d9657-a858-490d-9f42-b96b73b746ec None None] MFA Rules not processed for user `6c184cbe1b0344be81596e0ee40ec1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:25.023493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-393d9657-a858-490d-9f42-b96b73b746ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:25.144191 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1331/2679] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:25.149535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:25.345000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d201ce-f00d-41f3-9261-04ec379a11e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:25.362188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:25.362889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:25.363237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:25.363510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:25.364171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:25.366928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:25.535041 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1349/2680] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:25 2022] POST /identity/v3/projects => generated 377 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:25.539353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9657-a858-490d-9f42-b96b73b746ec None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:25.561917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9657-a858-490d-9f42-b96b73b746ec None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:25.726181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:25.727129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:25.727510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:25.728479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:25.729266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:25.731534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:25.766585 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:25.845845 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1332/2681] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:25 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:25.848311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:25.865606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bebfb-0e6e-408f-b142-c52cf43a05d8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:25.879685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:25.880451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:25.880724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:25.881191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:25.882101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:25.884254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:25.913986 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1350/2682] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:25.915904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:25.931093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed89c-d14b-486b-9689-ee7ef57124b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:25.944240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:25.944936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:25.945827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:25.946113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] PATH_INFO: `/v3/projects/be8951977cd84b8dbe7539a0c3e5991d/users/b3eb949a091f4ae08e8f7b5c70a24690/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:26.030126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8951977cd84b8dbe7539a0c3e5991d, user_id=b3eb949a091f4ae08e8f7b5c70a24690, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:26.034322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:26.042838 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:26.145524 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1333/2683] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:25 2022] PUT /identity/v3/projects/be8951977cd84b8dbe7539a0c3e5991d/users/b3eb949a091f4ae08e8f7b5c70a24690/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:26.148802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:26.165255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a132fda-f2c4-4334-981e-c6b70b7907f9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:26.332733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3bc57-9c1c-4aae-b0bf-a20b704b2c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:26.334984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3bc57-9c1c-4aae-b0bf-a20b704b2c44 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:26.336038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3bc57-9c1c-4aae-b0bf-a20b704b2c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:26.337254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3bc57-9c1c-4aae-b0bf-a20b704b2c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:26.338904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3bc57-9c1c-4aae-b0bf-a20b704b2c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:26.343008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3bc57-9c1c-4aae-b0bf-a20b704b2c44 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:26.368669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:26.379692 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1351/2684] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:15:26.392959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03631b5a-433a-4159-8650-2040f125eeed admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:26.400320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa108c-9814-401d-be4f-b26f71786ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:26.407176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa108c-9814-401d-be4f-b26f71786ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:26.407836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa108c-9814-401d-be4f-b26f71786ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:26.408350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa108c-9814-401d-be4f-b26f71786ae0 admin admin] PATH_INFO: `/v3/projects/be8951977cd84b8dbe7539a0c3e5991d/users/b3eb949a091f4ae08e8f7b5c70a24690/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:26.412311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa108c-9814-401d-be4f-b26f71786ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8951977cd84b8dbe7539a0c3e5991d, user_id=b3eb949a091f4ae08e8f7b5c70a24690, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:26.415331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa108c-9814-401d-be4f-b26f71786ae0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:26.455546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:26.455923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:26.456161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:26.463726 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1334/2685] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:26 2022] PUT /identity/v3/projects/be8951977cd84b8dbe7539a0c3e5991d/users/b3eb949a091f4ae08e8f7b5c70a24690/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:26.538567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] MFA Rules not processed for user `b3eb949a091f4ae08e8f7b5c70a24690`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:26.539943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:26.700670 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1352/2686] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:15:26.705914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062011f-198f-427c-a88b-91f66b033a38 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:26.706478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062011f-198f-427c-a88b-91f66b033a38 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:26.714110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062011f-198f-427c-a88b-91f66b033a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:26.761259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0062011f-198f-427c-a88b-91f66b033a38 None None] MFA Rules not processed for user `6c184cbe1b0344be81596e0ee40ec1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:26.763024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0062011f-198f-427c-a88b-91f66b033a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:26.862561 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1335/2687] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:26.869999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:26.871553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:27.003975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7696f-b2c6-475f-9762-27a98997b74b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:27.012090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:27.012771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:27.013140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:27.013333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:27.025417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:27.027267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:27.068918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1353/2688] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:27.427239 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:27.652314 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:28.932786 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:29.644626 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:30.784112 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:31.146894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925118-68d3-48fe-8dce-8833949be0b3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:31.147434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925118-68d3-48fe-8dce-8833949be0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:31.147434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925118-68d3-48fe-8dce-8833949be0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:31.231681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f1925118-68d3-48fe-8dce-8833949be0b3 None None] MFA Rules not processed for user `085bff1ef64745fc9785a2a8d131191f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:31.239133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1925118-68d3-48fe-8dce-8833949be0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:31.387774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1336/2689] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:31.401066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:31.402914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:31.836609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01f50f-c84f-46e2-88a3-db12fe96ff4e service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:31.844382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb92b3-eea2-43ab-bbb6-38368af7c2b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:31.845280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb92b3-eea2-43ab-bbb6-38368af7c2b1 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:31.845734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb92b3-eea2-43ab-bbb6-38368af7c2b1 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:31.851533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb92b3-eea2-43ab-bbb6-38368af7c2b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:31.869261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb92b3-eea2-43ab-bbb6-38368af7c2b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:31.871080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb92b3-eea2-43ab-bbb6-38368af7c2b1 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:31.893635 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1354/2690] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:32.117061 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:32.808944 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:33.019254 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:33.285222 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:33.875985 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:34.555234 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:34.704614 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:35.042576 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:35.080645 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:35.322025 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:35.442298 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:36.024940 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:36.160602 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:36.859620 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:37.757835 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:37.814316 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:39.521945 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:39.551102 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:39.613344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5b21-8299-470e-8598-8b3d8ca0abfe None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:39.614032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5b21-8299-470e-8598-8b3d8ca0abfe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:39.614537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e5b21-8299-470e-8598-8b3d8ca0abfe None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:39.617279 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1337/2691] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:15:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:15:39.664206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:39.666972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:39.667641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:39.734147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:39.735457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:39.853869 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1355/2692] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:15:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:39.895200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5b21-8299-470e-8598-8b3d8ca0abfe None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:39.898379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-211e5b21-8299-470e-8598-8b3d8ca0abfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:39.918484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e5b21-8299-470e-8598-8b3d8ca0abfe None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:39.924685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:39.926014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:39.926535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:39.935197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:39.947873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:39.957196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:39.977213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1338/2693] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:40.533608 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:40.962534 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:41.613341 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:42.213711 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:42.662037 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:42.677705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:42.680616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:42.895976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9bc6-e84a-4450-95a7-2e20e1445f56 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:42.901975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:42.903055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:42.903622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:42.904121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] PATH_INFO: `/v3/users/f996518bd6ef4e03a4ddcebee1eb44c7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:42.905512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f996518bd6ef4e03a4ddcebee1eb44c7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:42.908055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:42.912113 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:43.229983 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:43.289191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f996518bd6ef4e03a4ddcebee1eb44c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:43.289191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f996518bd6ef4e03a4ddcebee1eb44c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:43.424177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f996518bd6ef4e03a4ddcebee1eb44c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:43.437137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f996518bd6ef4e03a4ddcebee1eb44c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:43.438200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f05ad8d-321c-4c45-b64d-48080cc2d849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f996518bd6ef4e03a4ddcebee1eb44c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:43.493709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1356/2694] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:42 2022] DELETE /identity/v3/users/f996518bd6ef4e03a4ddcebee1eb44c7 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:43.729052 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:44.047415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:44.073120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f626f7-687e-4276-a4ec-fa5def324c87 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:44.178144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:44.178990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.179760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.180076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] PATH_INFO: `/v3/projects/849e6c7163c341a49c76d8b4f22820d2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.181264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849e6c7163c341a49c76d8b4f22820d2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:44.184072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:44.212658 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:44.364733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849e6c7163c341a49c76d8b4f22820d2', 'request_id': 'req-882d4c04-0d8e-458d-bfe8-c2a180448e38'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.373172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849e6c7163c341a49c76d8b4f22820d2', 'request_id': 'req-882d4c04-0d8e-458d-bfe8-c2a180448e38'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.458225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849e6c7163c341a49c76d8b4f22820d2', 'request_id': 'req-882d4c04-0d8e-458d-bfe8-c2a180448e38'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.499506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] The token cache is being invalidate because project 849e6c7163c341a49c76d8b4f22820d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:44.501768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.502742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-882d4c04-0d8e-458d-bfe8-c2a180448e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.516564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d95a2-04ea-4d16-bd5c-6d0ea4b944e4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.519469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d95a2-04ea-4d16-bd5c-6d0ea4b944e4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.520513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d95a2-04ea-4d16-bd5c-6d0ea4b944e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.523514 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:44.527088 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1339/2695] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:44 2022] DELETE /identity/v3/projects/849e6c7163c341a49c76d8b4f22820d2 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:44.572235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f60d95a2-04ea-4d16-bd5c-6d0ea4b944e4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:44.580692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f60d95a2-04ea-4d16-bd5c-6d0ea4b944e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:44.756121 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1357/2696] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:44.770551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175498db-a410-4f4a-aa35-2d9b6a27194e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.771140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175498db-a410-4f4a-aa35-2d9b6a27194e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.771639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175498db-a410-4f4a-aa35-2d9b6a27194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.825672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-175498db-a410-4f4a-aa35-2d9b6a27194e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:44.827366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-175498db-a410-4f4a-aa35-2d9b6a27194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:44.849851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1340/2697] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:44.855261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d95a2-04ea-4d16-bd5c-6d0ea4b944e4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:44.869021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d95a2-04ea-4d16-bd5c-6d0ea4b944e4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:44.871231 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:44.880506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:44.883377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.887244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.887626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.889857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:15:44.892263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:44.894778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:44.955547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175498db-a410-4f4a-aa35-2d9b6a27194e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:44.975361 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1358/2698] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:15:44.985212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175498db-a410-4f4a-aa35-2d9b6a27194e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.019419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.021899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.025543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.025543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.025543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.026728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.153855 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1341/2699] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:44 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:45.158620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.174723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cf279-41f3-45ef-993e-8f0039b715e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.235275 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:45.283560 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:45.357208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.358172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.360218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.360677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.361381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.365668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.548445 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1359/2700] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:45 2022] POST /identity/v3/users => generated 291 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:45.566699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.602569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4ad53-0891-4a12-b632-974353c102dd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.617708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.622904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.623789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.624393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.626606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.648328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.745408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.746053 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1342/2701] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:45.769979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bde7-56ff-44b8-94e8-8ce9ee0dcc5f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.792133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa34a67-fd7d-421a-bc56-f9d021e6e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.792866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa34a67-fd7d-421a-bc56-f9d021e6e183 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.793045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa34a67-fd7d-421a-bc56-f9d021e6e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.800443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa34a67-fd7d-421a-bc56-f9d021e6e183 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.801887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa34a67-fd7d-421a-bc56-f9d021e6e183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.803537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa34a67-fd7d-421a-bc56-f9d021e6e183 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.895825 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1360/2702] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:45.900237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.919262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aeef1-305d-4614-8953-00c602865047 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.935882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.936844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.937392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.937886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] PATH_INFO: `/v3/projects/320cdce6e042427e8ec89f9372f0313b/users/1a14ca17b84548f1848770236c4353d9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.970009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=320cdce6e042427e8ec89f9372f0313b, user_id=1a14ca17b84548f1848770236c4353d9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.970009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:46.082920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1343/2703] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:45 2022] PUT /identity/v3/projects/320cdce6e042427e8ec89f9372f0313b/users/1a14ca17b84548f1848770236c4353d9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:46.093947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1034c00-b82c-4679-b1a8-6da5cbdd38a5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.094364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1034c00-b82c-4679-b1a8-6da5cbdd38a5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.094800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1034c00-b82c-4679-b1a8-6da5cbdd38a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.130139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d1034c00-b82c-4679-b1a8-6da5cbdd38a5 None None] MFA Rules not processed for user `1a14ca17b84548f1848770236c4353d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:46.131718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d1034c00-b82c-4679-b1a8-6da5cbdd38a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:46.238328 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1361/2704] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:46.256959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:46.256959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:46.365315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb901c-6599-4a78-9769-931c288f1b2c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:46.371872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:46.373047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.373507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.373982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.385401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:46.387337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:46.403748 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1344/2705] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:46.492211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eac23-0c98-48d2-9cd4-8d349a494c41 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.492525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eac23-0c98-48d2-9cd4-8d349a494c41 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.492809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eac23-0c98-48d2-9cd4-8d349a494c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.514849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a74eac23-0c98-48d2-9cd4-8d349a494c41 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:46.516078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a74eac23-0c98-48d2-9cd4-8d349a494c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:46.631361 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1362/2706] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:15:46.712071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:46.714265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:46.790151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2ea7-64b6-4462-9a20-05c70487ea99 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.790950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2ea7-64b6-4462-9a20-05c70487ea99 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.791381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd2ea7-64b6-4462-9a20-05c70487ea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.819087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-17bd2ea7-64b6-4462-9a20-05c70487ea99 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:46.835455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17bd2ea7-64b6-4462-9a20-05c70487ea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:46.862324 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1363/2707] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:15:46.862539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b824-f977-4f79-8661-5fc316611c53 service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:46.863648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd2ea7-64b6-4462-9a20-05c70487ea99 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:46.871283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:46.871897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.872169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.873159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.891656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd2ea7-64b6-4462-9a20-05c70487ea99 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:46.898419 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:46.906185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:46.906796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:46.920212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:46.921358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.921644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.921964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.984527 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1345/2708] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:15:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:15:46.994774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:46.998668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:47.007781 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:47.054335 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1364/2709] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:15:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:15:47.814350 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:48.374388 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:48.495903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:48.498626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:48.668112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4550f8e-d2ad-4f84-84e0-fa66820d7e9c service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:48.678658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:48.682779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:48.683302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:48.683746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] PATH_INFO: `/v3/users/e3b41f02eca449e4ac13e3a36d65d57c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:48.685266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b41f02eca449e4ac13e3a36d65d57c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:48.687576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:48.768317 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:48.844807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:48.846863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:48.960009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6cc92-e3fb-43eb-be6f-9580ba354058 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:48.978654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:48.979648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:48.980475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:48.980889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:48.983415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:48.992639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b41f02eca449e4ac13e3a36d65d57c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:49.015762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b41f02eca449e4ac13e3a36d65d57c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:49.024835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b41f02eca449e4ac13e3a36d65d57c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:49.025823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b41f02eca449e4ac13e3a36d65d57c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:49.074366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:49.076334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:49.088512 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1365/2710] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:15:49.135885 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:49.137404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b41f02eca449e4ac13e3a36d65d57c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:49.145933 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1346/2711] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:48 2022] DELETE /identity/v3/users/e3b41f02eca449e4ac13e3a36d65d57c => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:49.741097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:49.757016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cb363-47e7-4c7d-8ccd-425f2f3ad5bc service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:49.863501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:49.864763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:49.864763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:49.864975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] PATH_INFO: `/v3/projects/67ab0dbe553e4ecda923545bdcd19e34` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:49.867612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ab0dbe553e4ecda923545bdcd19e34)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:49.869671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:50.012822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ab0dbe553e4ecda923545bdcd19e34', 'request_id': 'req-d6362b0b-1b04-4250-9531-38b44d136871'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.041540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ab0dbe553e4ecda923545bdcd19e34', 'request_id': 'req-d6362b0b-1b04-4250-9531-38b44d136871'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.140336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ab0dbe553e4ecda923545bdcd19e34', 'request_id': 'req-d6362b0b-1b04-4250-9531-38b44d136871'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.156427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] The token cache is being invalidate because project 67ab0dbe553e4ecda923545bdcd19e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:50.157277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.158684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.165725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:50.167561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:50.167790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1366/2712] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:49 2022] DELETE /identity/v3/projects/67ab0dbe553e4ecda923545bdcd19e34 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:50.180924 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:50.193721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4e813-df9e-4baf-9c6a-196ca8d2fb0c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:50.303734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:50.305078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:50.305576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:50.306109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] PATH_INFO: `/v3/users/2da7d01e0dea48d9b7bacd959928ff20` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:50.307444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da7d01e0dea48d9b7bacd959928ff20)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:50.309518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:50.332978 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:50.558444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da7d01e0dea48d9b7bacd959928ff20'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.588749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da7d01e0dea48d9b7bacd959928ff20'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.597891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da7d01e0dea48d9b7bacd959928ff20'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.599133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da7d01e0dea48d9b7bacd959928ff20'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.688323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90ae889e-a84c-482b-93f4-0aff18de1a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da7d01e0dea48d9b7bacd959928ff20'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:50.696583 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1347/2713] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:50 2022] DELETE /identity/v3/users/2da7d01e0dea48d9b7bacd959928ff20 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:15:51.197952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:51.199404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:51.224380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6362b0b-1b04-4250-9531-38b44d136871 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:51.313557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:51.314552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:51.315015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:51.315430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] PATH_INFO: `/v3/projects/b262b09d15ec442e9b09e7f5977da728` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:51.317569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b262b09d15ec442e9b09e7f5977da728)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:51.319738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:51.512543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b262b09d15ec442e9b09e7f5977da728', 'request_id': 'req-e4687f29-8508-43cf-b37d-c236472d78ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:51.520507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b262b09d15ec442e9b09e7f5977da728', 'request_id': 'req-e4687f29-8508-43cf-b37d-c236472d78ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:51.591158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b262b09d15ec442e9b09e7f5977da728', 'request_id': 'req-e4687f29-8508-43cf-b37d-c236472d78ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:51.614368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] The token cache is being invalidate because project b262b09d15ec442e9b09e7f5977da728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:51.614680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:51.618371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e4687f29-8508-43cf-b37d-c236472d78ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:51.624075 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1367/2714] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:51 2022] DELETE /identity/v3/projects/b262b09d15ec442e9b09e7f5977da728 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:51.629309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:51.630307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:51.630761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:51.660923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:51.664372 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:51.665999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:51.728978 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:51.750914 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1348/2715] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:51.760903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040de74-472d-4a99-8292-6bed88fff253 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:51.761339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040de74-472d-4a99-8292-6bed88fff253 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:51.761709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040de74-472d-4a99-8292-6bed88fff253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:51.805550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4040de74-472d-4a99-8292-6bed88fff253 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:51.807173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4040de74-472d-4a99-8292-6bed88fff253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:51.808281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:51.810438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:51.820084 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1368/2716] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:51.832548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040de74-472d-4a99-8292-6bed88fff253 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:51.857760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040de74-472d-4a99-8292-6bed88fff253 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:51.861890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:51.862745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:51.863033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:51.863307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:51.863979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:15:51.864499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:51.867432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:51.905352 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1369/2717] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:15:51.924950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:51.945453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e73826-e7f4-4867-87b0-776a53f42fec admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:51.959574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:51.966047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:51.966047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:51.966047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:51.966047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:51.966047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:51.972160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a22ff5-89b0-4c95-ab99-77a20b2bfcfa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:51.981429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:51.982687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:51.983870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:51.986313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:51.990057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:52.145925 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1370/2718] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:51 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:52.146679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:52.146787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:52.146892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:52.146892 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1349/2719] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:15:52.190968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033f27a-4788-4b1f-92e1-a5b7361d7778 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:52.196675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:52.197290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:52.197569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:52.197866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:52.198504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:52.200541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:52.601244 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1371/2720] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:52 2022] POST /identity/v3/users => generated 294 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:15:52.608485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:52.620698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a3cf-cc7e-4ee8-a188-b9bd7150af58 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:52.632481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:52.632481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:52.632481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:52.633590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:52.634500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:52.644088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:52.671709 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1350/2721] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:52.673251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:52.689356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29198d-5fcb-469b-b5af-872c7c77414a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:52.695568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d6893-30ad-4338-b893-5e07606f5455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:52.701030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d6893-30ad-4338-b893-5e07606f5455 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:52.701550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d6893-30ad-4338-b893-5e07606f5455 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:52.702103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d6893-30ad-4338-b893-5e07606f5455 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:52.702957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d6893-30ad-4338-b893-5e07606f5455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:52.704874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d6893-30ad-4338-b893-5e07606f5455 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:52.718337 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:52.733671 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1372/2722] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:52.737596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:52.752508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd8b0d-faeb-423f-bebc-aa8147bc0a4d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:52.758090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:52.759059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:52.759613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:52.760054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] PATH_INFO: `/v3/projects/32b75fc8893a4ae49df7f9a2e6a5a88b/users/7a84f3f822974b80aee34172f6edbc64/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:52.780491 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:52.784501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b75fc8893a4ae49df7f9a2e6a5a88b, user_id=7a84f3f822974b80aee34172f6edbc64, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:52.787516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:52.894787 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1351/2723] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:52 2022] PUT /identity/v3/projects/32b75fc8893a4ae49df7f9a2e6a5a88b/users/7a84f3f822974b80aee34172f6edbc64/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:52.903551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6ff9-bf08-43c3-af52-25478d0120a1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:52.903551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6ff9-bf08-43c3-af52-25478d0120a1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:52.903844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6ff9-bf08-43c3-af52-25478d0120a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:52.957198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3e6a6ff9-bf08-43c3-af52-25478d0120a1 None None] MFA Rules not processed for user `7a84f3f822974b80aee34172f6edbc64`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:52.958515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3e6a6ff9-bf08-43c3-af52-25478d0120a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:53.054271 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:53.100789 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1373/2724] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:53.104695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:53.231006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a80e-f462-484d-a0dc-20374bb40d5b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:53.241357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:53.242174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:53.242459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:53.243340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:53.244491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:53.246973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:53.377911 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1352/2725] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:53 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:15:53.382305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6ff9-bf08-43c3-af52-25478d0120a1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:53.398905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6ff9-bf08-43c3-af52-25478d0120a1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:53.502812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:53.503454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:53.503713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:53.503986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:53.504825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:53.506625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:53.604381 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1374/2726] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:53 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:53.608698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:53.620682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95896ce-6cce-4126-8e3b-1e7ed851b977 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:53.658870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:53.660479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:53.661199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:53.661709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:53.662678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:53.665539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:53.682890 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1353/2727] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:53.686785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:53.707344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea531c-95dc-43f9-952c-0db92a2002f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:53.714108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:53.715455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:53.717577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:53.717577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] PATH_INFO: `/v3/projects/c300c68ea05c475d8ac183bbf523b086/users/f6a19e7e80c544b3b920a187f281e4a7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:53.738699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c300c68ea05c475d8ac183bbf523b086, user_id=f6a19e7e80c544b3b920a187f281e4a7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:53.741767 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:53.744290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:53.866795 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1375/2728] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:53 2022] PUT /identity/v3/projects/c300c68ea05c475d8ac183bbf523b086/users/f6a19e7e80c544b3b920a187f281e4a7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:15:53.871175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:53.899480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f8dfc-3fc1-4334-95e6-fb54afcb6cbd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:53.998121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc6fe6-0129-4f4a-b54b-ec86e7dbf48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:53.998968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc6fe6-0129-4f4a-b54b-ec86e7dbf48e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:53.999249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc6fe6-0129-4f4a-b54b-ec86e7dbf48e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:53.999526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc6fe6-0129-4f4a-b54b-ec86e7dbf48e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:54.000312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc6fe6-0129-4f4a-b54b-ec86e7dbf48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:54.002368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc6fe6-0129-4f4a-b54b-ec86e7dbf48e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:54.016756 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1354/2729] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:15:54.026057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:54.033950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157a7f-882e-4904-8de2-c8c993772f62 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:54.039546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af73c36-cc5e-4b15-a072-b723d38b09aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:54.040517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af73c36-cc5e-4b15-a072-b723d38b09aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:54.040875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af73c36-cc5e-4b15-a072-b723d38b09aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:54.041441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af73c36-cc5e-4b15-a072-b723d38b09aa admin admin] PATH_INFO: `/v3/projects/c300c68ea05c475d8ac183bbf523b086/users/f6a19e7e80c544b3b920a187f281e4a7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:54.043733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af73c36-cc5e-4b15-a072-b723d38b09aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c300c68ea05c475d8ac183bbf523b086, user_id=f6a19e7e80c544b3b920a187f281e4a7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:54.047629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af73c36-cc5e-4b15-a072-b723d38b09aa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:54.076728 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1376/2730] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:54 2022] PUT /identity/v3/projects/c300c68ea05c475d8ac183bbf523b086/users/f6a19e7e80c544b3b920a187f281e4a7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:54.095349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:54.095349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:54.095349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:54.148134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] MFA Rules not processed for user `f6a19e7e80c544b3b920a187f281e4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:54.150290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:54.248566 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1355/2731] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:54.259538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762fc90-c54b-464f-9841-356c900b09d1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:54.259860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762fc90-c54b-464f-9841-356c900b09d1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:54.260141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762fc90-c54b-464f-9841-356c900b09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:54.301003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3762fc90-c54b-464f-9841-356c900b09d1 None None] MFA Rules not processed for user `7a84f3f822974b80aee34172f6edbc64`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:54.302570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3762fc90-c54b-464f-9841-356c900b09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:54.358097 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:54.415260 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1377/2732] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:54.715205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:54.716889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:54.788420 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:54.806027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf96f6-6129-42f5-bf44-611a932a638b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:54.823156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f97c13-3dba-4beb-b5ec-83bfc57cc358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:54.823156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97c13-3dba-4beb-b5ec-83bfc57cc358 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:54.823156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97c13-3dba-4beb-b5ec-83bfc57cc358 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:54.823156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f97c13-3dba-4beb-b5ec-83bfc57cc358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:54.829446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f97c13-3dba-4beb-b5ec-83bfc57cc358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:54.831534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f97c13-3dba-4beb-b5ec-83bfc57cc358 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:54.846299 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1356/2733] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:55.018836 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:55.540040 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:56.068575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbc84-c749-438e-baaf-927502dd94b4 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:56.069111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbc84-c749-438e-baaf-927502dd94b4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:56.069554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbc84-c749-438e-baaf-927502dd94b4 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:56.071269 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1378/2734] 10.222.0.59 () {54 vars in 921 bytes} [Sun Aug 28 01:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:15:56.077488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:56.080594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:56.080594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:56.120762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:56.125206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:56.143961 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1357/2735] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:56.162088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fbc84-c749-438e-baaf-927502dd94b4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:56.162088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2d4fbc84-c749-438e-baaf-927502dd94b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:56.239437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fbc84-c749-438e-baaf-927502dd94b4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:56.245231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:56.246153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:56.246606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:56.247054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:56.259805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:56.261882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:56.275473 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1379/2736] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:57.552696 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:57.807547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:57.809534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:57.923793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7524-33c3-447d-b229-6c51f5d8c78b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:57.935518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea452042-770d-4cfa-aa0e-52bf9833c962 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:57.941309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452042-770d-4cfa-aa0e-52bf9833c962 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:57.941309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452042-770d-4cfa-aa0e-52bf9833c962 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:57.941309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452042-770d-4cfa-aa0e-52bf9833c962 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:57.941309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea452042-770d-4cfa-aa0e-52bf9833c962 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:57.954245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea452042-770d-4cfa-aa0e-52bf9833c962 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:57.956415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea452042-770d-4cfa-aa0e-52bf9833c962 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:57.998206 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1358/2737] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:58.042451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:58.044194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:58.071510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f610262-ac68-44aa-b7e1-141c485dff21 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:58.095836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:58.097793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:58.098362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:58.098786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:58.106041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:58.156656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:58.158320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:58.192104 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1380/2738] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:58.765323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:58.766202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:58.766480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:58.790749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:58.792273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:58.896840 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1359/2739] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:58.904335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:58.905947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:58.972836 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:59.082454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a591-5247-4e54-ab6e-614eb0ee31e9 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:59.107825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:59.108881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:59.109358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:59.110551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:59.131205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:59.145543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:59.170478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1381/2740] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:15:59.718001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:59.719928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:59.824906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:59.826384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:59.872949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bab17-0b65-46a4-8a92-d196ed5745c1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:59.878834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:59.879720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:59.880159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:59.880916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] PATH_INFO: `/v3/users/1a14ca17b84548f1848770236c4353d9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:59.882386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a14ca17b84548f1848770236c4353d9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:59.885244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:59.905874 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:59.921415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a340a-10eb-4fbe-8cd7-0df581b00bd5 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:59.928114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:59.929008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:59.929474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:59.930066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] PATH_INFO: `/v3/users/6c184cbe1b0344be81596e0ee40ec1bd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:59.935153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c184cbe1b0344be81596e0ee40ec1bd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:59.937186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:00.169200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a14ca17b84548f1848770236c4353d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.208743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a14ca17b84548f1848770236c4353d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.217956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a14ca17b84548f1848770236c4353d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.220923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a14ca17b84548f1848770236c4353d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.304683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c184cbe1b0344be81596e0ee40ec1bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.307060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c184cbe1b0344be81596e0ee40ec1bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.412007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33b0b7e5-13af-43a3-b6b0-9e6dd511d898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a14ca17b84548f1848770236c4353d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.440106 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1360/2741] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:59 2022] DELETE /identity/v3/users/1a14ca17b84548f1848770236c4353d9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:00.458253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:00.458794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:00.459239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:00.500741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c184cbe1b0344be81596e0ee40ec1bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.506726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:00.509918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:00.510660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c184cbe1b0344be81596e0ee40ec1bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.515569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-55ef4c85-233e-427a-b9f6-00727660553e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c184cbe1b0344be81596e0ee40ec1bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:00.612042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1382/2742] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:59 2022] DELETE /identity/v3/users/6c184cbe1b0344be81596e0ee40ec1bd => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:00.622033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45a93-aaed-4e92-8bff-02b50d57ff76 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:00.623480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45a93-aaed-4e92-8bff-02b50d57ff76 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:00.625274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45a93-aaed-4e92-8bff-02b50d57ff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:00.679080 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1361/2743] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:00.690304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:00.693965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:00.710679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-33a45a93-aaed-4e92-8bff-02b50d57ff76 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:00.725647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33a45a93-aaed-4e92-8bff-02b50d57ff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:00.805538 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:00.893250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a61a7-480a-4e3a-9a57-b03ee5c2ff20 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:00.895228 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1383/2744] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:00.908819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45a93-aaed-4e92-8bff-02b50d57ff76 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:01.026820 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:01.036057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:01.036057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:01.036057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:01.036057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:01.073523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:01.078994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:01.093900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45a93-aaed-4e92-8bff-02b50d57ff76 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:01.117247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:01.123292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:01.124384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:01.125454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:01.141124 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1362/2745] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:01.158400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:01.162060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:01.196912 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1384/2746] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:01.945039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:01.945604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:01.984213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab5ccc-8597-4cec-b003-bff9dd498073 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:01.990017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:01.992281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:01.993612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:01.994117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] PATH_INFO: `/v3/projects/96c68e355cc044799fa21801ba074e7b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:02.018954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c68e355cc044799fa21801ba074e7b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:02.021258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:02.036127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:02.041137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:02.061335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392360c-a371-4855-af35-1e35adf26cc3 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:02.075568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:02.076421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:02.077360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:02.077789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] PATH_INFO: `/v3/projects/320cdce6e042427e8ec89f9372f0313b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:02.079119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] RBAC: Authorizing `identity:delete_project(project_id=320cdce6e042427e8ec89f9372f0313b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:02.081253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:02.216477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c68e355cc044799fa21801ba074e7b', 'request_id': 'req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.225976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c68e355cc044799fa21801ba074e7b', 'request_id': 'req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.282680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '320cdce6e042427e8ec89f9372f0313b', 'request_id': 'req-7418fac4-9712-4e64-8fab-327b48ad201a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.295621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '320cdce6e042427e8ec89f9372f0313b', 'request_id': 'req-7418fac4-9712-4e64-8fab-327b48ad201a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.335461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c68e355cc044799fa21801ba074e7b', 'request_id': 'req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.353625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] The token cache is being invalidate because project 96c68e355cc044799fa21801ba074e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:02.353957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.355262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.360943 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1363/2747] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:01 2022] DELETE /identity/v3/projects/96c68e355cc044799fa21801ba074e7b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:02.362125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:02.365475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:02.426540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '320cdce6e042427e8ec89f9372f0313b', 'request_id': 'req-7418fac4-9712-4e64-8fab-327b48ad201a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.448153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] The token cache is being invalidate because project 320cdce6e042427e8ec89f9372f0313b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:02.448763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.453835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7418fac4-9712-4e64-8fab-327b48ad201a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.455765 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1385/2748] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:02 2022] DELETE /identity/v3/projects/320cdce6e042427e8ec89f9372f0313b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:02.464135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91f20-d7a0-4c3e-9b79-a96275a4b57b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:02.464135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91f20-d7a0-4c3e-9b79-a96275a4b57b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:02.464135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91f20-d7a0-4c3e-9b79-a96275a4b57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:02.495867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-53d91f20-d7a0-4c3e-9b79-a96275a4b57b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:02.497662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-53d91f20-d7a0-4c3e-9b79-a96275a4b57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:02.518298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5dce9-8a46-4b15-98fa-89edfdbc5376 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:02.569297 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:02.582289 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1386/2749] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:16:02.601665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf30bbf-0dde-4516-a2a3-3d9696875985 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:02.602868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf30bbf-0dde-4516-a2a3-3d9696875985 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:02.603436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf30bbf-0dde-4516-a2a3-3d9696875985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:02.641092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:02.641766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:02.642076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:02.645288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0bf30bbf-0dde-4516-a2a3-3d9696875985 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:02.647076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0bf30bbf-0dde-4516-a2a3-3d9696875985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:02.648182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] PATH_INFO: `/v3/users/b3eb949a091f4ae08e8f7b5c70a24690` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:02.652112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3eb949a091f4ae08e8f7b5c70a24690)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:02.656393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:02.675808 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1387/2750] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:02.681530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf30bbf-0dde-4516-a2a3-3d9696875985 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:02.695019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf30bbf-0dde-4516-a2a3-3d9696875985 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:02.698509 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:02.702733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:02.705011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:02.705011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:02.705011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:02.705011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:16:02.706223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:02.707929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:02.723990 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1388/2751] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:16:02.733111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:02.751716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5b5d5-f318-4e1e-9b4a-3c7521f8fb8b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:02.757214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:02.758042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:02.758591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:02.759501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:02.760535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:02.762969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:02.899605 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1389/2752] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:16:02 2022] POST /identity/v3/projects => generated 397 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:02.907757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:02.938841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3eb949a091f4ae08e8f7b5c70a24690'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.959486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3eb949a091f4ae08e8f7b5c70a24690'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.969187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3eb949a091f4ae08e8f7b5c70a24690'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:02.970054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3eb949a091f4ae08e8f7b5c70a24690'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:03.047404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9d41b-41a0-42da-a14e-3139d890c96e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:03.058135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:03.058790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:03.059225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:03.059566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:03.060354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:03.064245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:03.136112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3eb949a091f4ae08e8f7b5c70a24690'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:03.145986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1364/2753] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:16:02 2022] DELETE /identity/v3/users/b3eb949a091f4ae08e8f7b5c70a24690 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:03.709590 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1390/2754] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:16:02 2022] POST /identity/v3/users => generated 299 bytes in 803 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:03.714263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:03.716090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:03.820035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3a92-c8c4-45fe-973e-786a2a741317 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:03.827258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:03.827976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:03.828269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:03.828547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:03.829656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:03.844186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:03.865617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:03.866514 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1365/2755] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:03.879730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e93cbb-a15d-4486-99f8-5c7cbc589b96 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:03.887714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e4985-bdf1-403a-8495-517e0087955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:03.891212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e4985-bdf1-403a-8495-517e0087955a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:03.891801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e4985-bdf1-403a-8495-517e0087955a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:03.892369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e4985-bdf1-403a-8495-517e0087955a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:03.893352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e4985-bdf1-403a-8495-517e0087955a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:03.901886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e4985-bdf1-403a-8495-517e0087955a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:03.926517 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1391/2756] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:03.931685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:03.950959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab382a-cf44-4ca8-98f9-e68f65fef59f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:03.958792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:03.960362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:03.960915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:03.961521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] PATH_INFO: `/v3/projects/f51ef9c1865f42c1abb648ca904e152c/users/0121d38e79a04f1c9281c911fbfa4dfe/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:03.989685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51ef9c1865f42c1abb648ca904e152c, user_id=0121d38e79a04f1c9281c911fbfa4dfe, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:03.993551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:04.120251 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1366/2757] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:16:03 2022] PUT /identity/v3/projects/f51ef9c1865f42c1abb648ca904e152c/users/0121d38e79a04f1c9281c911fbfa4dfe/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:04.131545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:04.132959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:04.133517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:04.178040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] MFA Rules not processed for user `0121d38e79a04f1c9281c911fbfa4dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:04.179344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:04.250167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:04.251957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:04.307922 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1392/2758] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:04.421778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebfeba-a358-4100-9428-7f3c4a803d96 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:04.435585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:04.436255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:04.436613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:04.436891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] PATH_INFO: `/v3/projects/be8951977cd84b8dbe7539a0c3e5991d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:04.440702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8951977cd84b8dbe7539a0c3e5991d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:04.443273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:04.491075 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:04.781851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:04.783350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:04.827552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8951977cd84b8dbe7539a0c3e5991d', 'request_id': 'req-ff66adba-feaa-4cde-bb91-51e8ef4ee449'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:04.837472 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:04.838697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8951977cd84b8dbe7539a0c3e5991d', 'request_id': 'req-ff66adba-feaa-4cde-bb91-51e8ef4ee449'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:04.888573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15d61-94fa-4ea2-a284-7bea54ecd9d1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:04.906480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8951977cd84b8dbe7539a0c3e5991d', 'request_id': 'req-ff66adba-feaa-4cde-bb91-51e8ef4ee449'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:04.922546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] The token cache is being invalidate because project be8951977cd84b8dbe7539a0c3e5991d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:04.922912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:04.923666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ff66adba-feaa-4cde-bb91-51e8ef4ee449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:04.931460 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1367/2759] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:04 2022] DELETE /identity/v3/projects/be8951977cd84b8dbe7539a0c3e5991d => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:04.933356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef71c36-b554-4e12-b341-2586e29c5922 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:04.934514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef71c36-b554-4e12-b341-2586e29c5922 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:04.934943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef71c36-b554-4e12-b341-2586e29c5922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:04.958666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aef71c36-b554-4e12-b341-2586e29c5922 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:04.960216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aef71c36-b554-4e12-b341-2586e29c5922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:04.973559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:04.974263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:04.978465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:04.978465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:04.978465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:05.029220 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1368/2760] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:05.039778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.039969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.040116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.058590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.061260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.069191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:05.071808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:05.076694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1393/2761] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:16:05.099833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1369/2762] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:05.106866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.120635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c286-ec96-4129-a0a8-acac88de66cf service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.123802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.125351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:05.126679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.127400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.127770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.128208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.128879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:16:05.129276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.131513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.146720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be5686-c230-484d-89f5-744ebb99a1e9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.146961 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1394/2763] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:16:05.151636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.154174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.155042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.155391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.155736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.158469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:05.161823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee61b-c6bb-4c4a-ad3d-b7016d06abb9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.176954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.176954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.176954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.176954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.177953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.180068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.267853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.269653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.280978 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1370/2764] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:16:05.297752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1395/2765] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:16:05 2022] POST /identity/v3/projects => generated 411 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:05.302063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.314087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b4f36-6403-4e0c-bbf0-7305257010ac service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.381545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.382658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.382658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.382873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.384349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.386529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.495169 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:05.503519 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1371/2766] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:16:05 2022] POST /identity/v3/users => generated 306 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:16:05.507485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.520289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc43693-1017-4ed6-86d7-04050a9ad67a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.544851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.545797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.547173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.547659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.548671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.551282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.580273 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1396/2767] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:05.584771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.605522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acea7c-c771-4945-85d3-204e3925872b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.616506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.617139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.617421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.617693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.619145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.621070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.650204 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1372/2768] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:05.652815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.667045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38c20e-5cc5-4c84-abe4-31708865ccd9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.674382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:05.676224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:05.685731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d138f-e746-4afe-9fa1-8031d6ea76ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.686778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d138f-e746-4afe-9fa1-8031d6ea76ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.687054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d138f-e746-4afe-9fa1-8031d6ea76ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.687324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d138f-e746-4afe-9fa1-8031d6ea76ef admin admin] PATH_INFO: `/v3/projects/e27928e9b4c34c04838c48f8510a949e/users/d1d952cf28734803a9081d6c237816d4/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.704521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0041f9-6f35-4240-88c7-ddc884d4df94 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:05.724799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:05.726462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.726761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.727047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] PATH_INFO: `/v3/users/0121d38e79a04f1c9281c911fbfa4dfe` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.727199 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:05.732382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0121d38e79a04f1c9281c911fbfa4dfe)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.735868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d138f-e746-4afe-9fa1-8031d6ea76ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27928e9b4c34c04838c48f8510a949e, user_id=d1d952cf28734803a9081d6c237816d4, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:05.738282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.741220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d138f-e746-4afe-9fa1-8031d6ea76ef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:05.854321 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1397/2769] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:16:05 2022] PUT /identity/v3/projects/e27928e9b4c34c04838c48f8510a949e/users/d1d952cf28734803a9081d6c237816d4/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:05.868002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:05.868595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:05.873288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:05.898894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:05.901626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:05.987193 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1398/2770] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:05.998468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:06.000882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:06.007044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0121d38e79a04f1c9281c911fbfa4dfe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:06.022374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0121d38e79a04f1c9281c911fbfa4dfe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:06.033174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0121d38e79a04f1c9281c911fbfa4dfe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:06.041688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0121d38e79a04f1c9281c911fbfa4dfe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:06.082665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39980023-0b18-4c5a-a12c-3fd3f1a9a5a0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:06.090467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724309-e5ff-412f-8b07-dce219c323c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:06.091484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724309-e5ff-412f-8b07-dce219c323c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:06.091944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724309-e5ff-412f-8b07-dce219c323c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:06.093013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724309-e5ff-412f-8b07-dce219c323c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:06.095737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd724309-e5ff-412f-8b07-dce219c323c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:06.110091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724309-e5ff-412f-8b07-dce219c323c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:06.111799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724309-e5ff-412f-8b07-dce219c323c8 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:06.124944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1399/2771] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:16:06.128680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0121d38e79a04f1c9281c911fbfa4dfe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:06.144064 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1373/2772] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:16:05 2022] DELETE /identity/v3/users/0121d38e79a04f1c9281c911fbfa4dfe => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:06.145696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:06.146113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:06.146536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:06.219028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:06.222351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:06.316383 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1400/2773] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:06.337607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:06.339562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:06.458192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb4898-992c-48f4-a2ed-9036773e306b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:06.470376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714fe4-c3b2-41e5-a01f-7122155b6963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:06.472760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714fe4-c3b2-41e5-a01f-7122155b6963 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:06.473368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714fe4-c3b2-41e5-a01f-7122155b6963 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:06.474334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714fe4-c3b2-41e5-a01f-7122155b6963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:06.499428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714fe4-c3b2-41e5-a01f-7122155b6963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:06.505388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714fe4-c3b2-41e5-a01f-7122155b6963 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:06.534897 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1374/2774] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:07.498976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:07.502170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:07.525251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83665ba-db15-4cc6-9d30-c1a4126dc8a1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:07.547832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:07.548553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:07.548836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:07.549380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] PATH_INFO: `/v3/projects/f51ef9c1865f42c1abb648ca904e152c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:07.550955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51ef9c1865f42c1abb648ca904e152c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:07.560216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:07.713382 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:07.738830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51ef9c1865f42c1abb648ca904e152c', 'request_id': 'req-db7128a1-ef18-4fd7-8f02-465225a55ce6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:07.753643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51ef9c1865f42c1abb648ca904e152c', 'request_id': 'req-db7128a1-ef18-4fd7-8f02-465225a55ce6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:07.821085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51ef9c1865f42c1abb648ca904e152c', 'request_id': 'req-db7128a1-ef18-4fd7-8f02-465225a55ce6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:07.844479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] The token cache is being invalidate because project f51ef9c1865f42c1abb648ca904e152c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:07.844918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:07.845703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db7128a1-ef18-4fd7-8f02-465225a55ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:07.847579 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1401/2775] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:07 2022] DELETE /identity/v3/projects/f51ef9c1865f42c1abb648ca904e152c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:07.854582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7273e-f236-4273-82f7-441749e69934 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:07.855086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7273e-f236-4273-82f7-441749e69934 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:07.858322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7273e-f236-4273-82f7-441749e69934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:07.906670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-19f7273e-f236-4273-82f7-441749e69934 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:07.908219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-19f7273e-f236-4273-82f7-441749e69934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:07.960161 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:08.009644 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1375/2776] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:08.018260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b21a-4f7c-4fcc-a0e8-581c3dd63733 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.018597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b21a-4f7c-4fcc-a0e8-581c3dd63733 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.018880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b21a-4f7c-4fcc-a0e8-581c3dd63733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.078809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ebd5b21a-4f7c-4fcc-a0e8-581c3dd63733 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:08.080325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ebd5b21a-4f7c-4fcc-a0e8-581c3dd63733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:08.109435 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1402/2777] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:08.110829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7273e-f236-4273-82f7-441749e69934 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:08.124204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7273e-f236-4273-82f7-441749e69934 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:08.131881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:08.132536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.136684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.136684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.136684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:16:08.136684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:08.136684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:08.154056 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1376/2778] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:16:08.159378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5b21a-4f7c-4fcc-a0e8-581c3dd63733 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:08.170896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5b21a-4f7c-4fcc-a0e8-581c3dd63733 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:08.177010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:08.178177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.178633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.179018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.179670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:08.182459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:08.314246 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1403/2779] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:16:08 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:08.317338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:08.331434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89c8a-e362-4d1f-a071-4e66fbfacaa5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:08.437412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:08.438003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.438425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.438703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.439668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:08.442382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:08.583418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1377/2780] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:16:08 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:08.587542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:08.599578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ce9e1-547e-4f9d-8773-baff62e4a15b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:08.604888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:08.605507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.605783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.606083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.608688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:08.608688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:08.624475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:08.639089 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1404/2781] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:08.650070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcc2de-2c46-4655-bc84-be32b6d8cdc8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:08.662588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314e58b-b09a-49fe-8396-68669725ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:08.663232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e58b-b09a-49fe-8396-68669725ac0c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.663524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e58b-b09a-49fe-8396-68669725ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.663804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e58b-b09a-49fe-8396-68669725ac0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.664541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314e58b-b09a-49fe-8396-68669725ac0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:08.667326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314e58b-b09a-49fe-8396-68669725ac0c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:08.701524 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1378/2782] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:08.702294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:08.717407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742109e-d010-4426-ad9b-820d507eeaed admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:08.735292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:08.735292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.735292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.735292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] PATH_INFO: `/v3/projects/7a4379dfb3c142b4bd56159811fd7f47/users/1ef9ced1581c4375ab34ed0430a7213f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.773649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4379dfb3c142b4bd56159811fd7f47, user_id=1ef9ced1581c4375ab34ed0430a7213f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:08.780737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:08.933059 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1405/2783] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:16:08 2022] PUT /identity/v3/projects/7a4379dfb3c142b4bd56159811fd7f47/users/1ef9ced1581c4375ab34ed0430a7213f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:16:08.939191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272dbcd-363b-4bf3-bd9c-f024eccc0e86 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:08.939721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272dbcd-363b-4bf3-bd9c-f024eccc0e86 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:08.939721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272dbcd-363b-4bf3-bd9c-f024eccc0e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:08.983075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0272dbcd-363b-4bf3-bd9c-f024eccc0e86 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:08.984406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0272dbcd-363b-4bf3-bd9c-f024eccc0e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:09.120935 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1379/2784] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:09.130311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:09.135842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:09.244173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1872f-c113-47e0-b9e5-ffdff8be5b65 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:09.248126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb90df-321a-4ecc-9b1e-50124c06c886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:09.248835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb90df-321a-4ecc-9b1e-50124c06c886 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:09.249186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb90df-321a-4ecc-9b1e-50124c06c886 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:09.262054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb90df-321a-4ecc-9b1e-50124c06c886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:09.263225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb90df-321a-4ecc-9b1e-50124c06c886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:09.264761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb90df-321a-4ecc-9b1e-50124c06c886 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:09.276580 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1406/2785] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:09.313746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:09.314070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:09.314353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:09.338886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] MFA Rules not processed for user `4b656391a4564f8aaca14726d52213d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:09.340790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:09.454153 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1380/2786] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 01:16:09.753494 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:15.172264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7c84-b81f-43a8-b2e6-46baa1192247 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:15.174489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7c84-b81f-43a8-b2e6-46baa1192247 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:15.175287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7c84-b81f-43a8-b2e6-46baa1192247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:15.201079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ed2d7c84-b81f-43a8-b2e6-46baa1192247 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:15.204227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ed2d7c84-b81f-43a8-b2e6-46baa1192247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:15.317069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:15.320131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1407/2787] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:15.321943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:15.464576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3883062-57ea-43c7-ae51-1430c1a606c2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:15.473216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56feedd-b315-4e92-a1c5-b5162ce1cf7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:15.475470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56feedd-b315-4e92-a1c5-b5162ce1cf7b service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:15.475966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56feedd-b315-4e92-a1c5-b5162ce1cf7b service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:15.476488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56feedd-b315-4e92-a1c5-b5162ce1cf7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:15.525796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56feedd-b315-4e92-a1c5-b5162ce1cf7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:15.542807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56feedd-b315-4e92-a1c5-b5162ce1cf7b service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:15.589339 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1381/2788] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:16:21.501402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.501983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.501983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.515826 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:21.583805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] MFA Rules not processed for user `d1d952cf28734803a9081d6c237816d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:21.585152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:21.847948 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1408/2789] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:21.849650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.850208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.850208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.907401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] MFA Rules not processed for user `d1d952cf28734803a9081d6c237816d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:21.908969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:21.928404 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1382/2790] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:22.678967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:22.680800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:22.830434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2668b0-ccbe-4dca-82a1-0c0cf42aebe4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:22.841321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81514b84-c0f8-4e65-a15f-aec2638c1e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:22.841574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514b84-c0f8-4e65-a15f-aec2638c1e66 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:22.841839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514b84-c0f8-4e65-a15f-aec2638c1e66 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:22.842973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514b84-c0f8-4e65-a15f-aec2638c1e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:22.866783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81514b84-c0f8-4e65-a15f-aec2638c1e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:22.868704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81514b84-c0f8-4e65-a15f-aec2638c1e66 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:22.884160 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1409/2791] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:22 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:23.732438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:23.732438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:23.732438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7765a-6220-4055-903a-e3d6b0a0caab None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:23.733650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:23.733650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:23.733650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:23.733650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:23.734602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:23.917671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:23.919673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:23.955011 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1383/2792] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:24.095190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c3609-c99c-4ae7-905e-ba4fa7675918 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:24.096510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c3609-c99c-4ae7-905e-ba4fa7675918 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:24.096998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c3609-c99c-4ae7-905e-ba4fa7675918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:24.160117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-aa0c3609-c99c-4ae7-905e-ba4fa7675918 None None] MFA Rules not processed for user `1ef9ced1581c4375ab34ed0430a7213f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:24.165674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aa0c3609-c99c-4ae7-905e-ba4fa7675918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:24.295729 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1410/2793] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:24.310171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:24.326084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc63e2-525c-4dfb-9e71-ece18e5eacdb service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:24.332923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925690c0-35c5-4fcc-9f4e-0733a6aa6fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:24.334107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925690c0-35c5-4fcc-9f4e-0733a6aa6fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:24.334554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925690c0-35c5-4fcc-9f4e-0733a6aa6fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:24.335417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925690c0-35c5-4fcc-9f4e-0733a6aa6fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:24.361312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925690c0-35c5-4fcc-9f4e-0733a6aa6fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:24.378485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925690c0-35c5-4fcc-9f4e-0733a6aa6fb8 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:24.402746 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1384/2794] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:16:25.602527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae4f9b-8a8a-4c49-aa7e-fa5b5f544fe8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:25.603001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae4f9b-8a8a-4c49-aa7e-fa5b5f544fe8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:25.603111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae4f9b-8a8a-4c49-aa7e-fa5b5f544fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:25.671718 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:25.699890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3fae4f9b-8a8a-4c49-aa7e-fa5b5f544fe8 None None] MFA Rules not processed for user `7a84f3f822974b80aee34172f6edbc64`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:25.701487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3fae4f9b-8a8a-4c49-aa7e-fa5b5f544fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:25.878583 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1411/2795] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:32.554240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a584e83-eb4e-4891-9dce-7732e5a42975 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:32.555461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a584e83-eb4e-4891-9dce-7732e5a42975 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:32.555913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a584e83-eb4e-4891-9dce-7732e5a42975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:32.584953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8a584e83-eb4e-4891-9dce-7732e5a42975 None None] MFA Rules not processed for user `1ef9ced1581c4375ab34ed0430a7213f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:32.587249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8a584e83-eb4e-4891-9dce-7732e5a42975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:32.603626 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1385/2796] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:35.958547 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=22 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:40.006047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f78e9-b131-4bc5-950a-6462f4ddb0e1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:40.007162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f78e9-b131-4bc5-950a-6462f4ddb0e1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:40.007675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f78e9-b131-4bc5-950a-6462f4ddb0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:40.046176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-186f78e9-b131-4bc5-950a-6462f4ddb0e1 None None] MFA Rules not processed for user `29f68fba91f1433bb6d51e956ea19022`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:40.047683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-186f78e9-b131-4bc5-950a-6462f4ddb0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:40.160111 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1412/2797] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:42.576293 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:48.703912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:48.703912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:48.703912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:48.723505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] MFA Rules not processed for user `d3ee5c02cbb740bcab5009471ed98264`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:48.724742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:48.793191 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1386/2798] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:16:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:16:50.146455 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=25 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:58.783964 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=25 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:15.355321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d63bb-2a50-4a71-be24-584015756556 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:15.355888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d63bb-2a50-4a71-be24-584015756556 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:15.356006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d63bb-2a50-4a71-be24-584015756556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:15.403119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a93d63bb-2a50-4a71-be24-584015756556 None None] MFA Rules not processed for user `e285fefe9cb44cadaec6e58a31ef3afe`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:15.404452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a93d63bb-2a50-4a71-be24-584015756556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:15.471694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1413/2799] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:18.222444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:18.224161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:18.249568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744572d-6c7c-43a5-bd0b-7b0f81a449c4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:18.261578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:18.265171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:18.265171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:18.265171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] PATH_INFO: `/v3/users/7a84f3f822974b80aee34172f6edbc64` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:18.265171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a84f3f822974b80aee34172f6edbc64)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:18.266778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:18.563829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a84f3f822974b80aee34172f6edbc64'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:18.627868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a84f3f822974b80aee34172f6edbc64'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:18.659032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a84f3f822974b80aee34172f6edbc64'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:18.661700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a84f3f822974b80aee34172f6edbc64'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:18.739325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a84f3f822974b80aee34172f6edbc64'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:18.746664 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1387/2800] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:18 2022] DELETE /identity/v3/users/7a84f3f822974b80aee34172f6edbc64 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:18.751630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:18.753836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:18.753836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:18.799961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:18.801435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:18.910422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1414/2801] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:18.936887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:18.938491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:19.046417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f80875-fa99-4133-bb58-f5de5e56061e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:19.050249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:19.050866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:19.051144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:19.051415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:19.071990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:19.074603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:19.109361 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1388/2802] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:19.491311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:19.492998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:19.510900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0471fb-3d6d-46b6-aecd-d76aa9d4c519 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:19.516597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:19.517267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:19.519242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:19.519242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] PATH_INFO: `/v3/projects/32b75fc8893a4ae49df7f9a2e6a5a88b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:19.519242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b75fc8893a4ae49df7f9a2e6a5a88b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:19.521234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:19.650660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b75fc8893a4ae49df7f9a2e6a5a88b', 'request_id': 'req-6c684b92-285b-49d7-9c79-d9d89b5a9e33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:19.664256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b75fc8893a4ae49df7f9a2e6a5a88b', 'request_id': 'req-6c684b92-285b-49d7-9c79-d9d89b5a9e33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:19.735596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b75fc8893a4ae49df7f9a2e6a5a88b', 'request_id': 'req-6c684b92-285b-49d7-9c79-d9d89b5a9e33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:19.773575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] The token cache is being invalidate because project 32b75fc8893a4ae49df7f9a2e6a5a88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:19.774930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:19.775808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:19.777662 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1415/2803] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:19 2022] DELETE /identity/v3/projects/32b75fc8893a4ae49df7f9a2e6a5a88b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:19.782832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:19.807131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140abe0b-2eb3-42b8-927f-a12589ab96fb service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:19.949800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:19.950509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:19.950794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:19.951074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] PATH_INFO: `/v3/users/f6a19e7e80c544b3b920a187f281e4a7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:19.962017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a19e7e80c544b3b920a187f281e4a7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:19.970299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:20.039334 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:20.307133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a19e7e80c544b3b920a187f281e4a7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:20.327682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a19e7e80c544b3b920a187f281e4a7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:20.343764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a19e7e80c544b3b920a187f281e4a7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:20.344585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a19e7e80c544b3b920a187f281e4a7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:20.411857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69e8c1dc-b769-4267-b01c-2bae372d1727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a19e7e80c544b3b920a187f281e4a7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:20.426499 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1389/2804] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:19 2022] DELETE /identity/v3/users/f6a19e7e80c544b3b920a187f281e4a7 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:17:20.835797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:20.838201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:20.883046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684b92-285b-49d7-9c79-d9d89b5a9e33 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:20.937714 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:20.973924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:20.977930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:20.977930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:20.977930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] PATH_INFO: `/v3/projects/c300c68ea05c475d8ac183bbf523b086` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:20.977930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c300c68ea05c475d8ac183bbf523b086)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:20.979166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:21.122389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c300c68ea05c475d8ac183bbf523b086', 'request_id': 'req-f3bafab8-a4a8-4a88-9dd1-47def955b47a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:21.134080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c300c68ea05c475d8ac183bbf523b086', 'request_id': 'req-f3bafab8-a4a8-4a88-9dd1-47def955b47a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:21.248938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c300c68ea05c475d8ac183bbf523b086', 'request_id': 'req-f3bafab8-a4a8-4a88-9dd1-47def955b47a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:21.263259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] The token cache is being invalidate because project c300c68ea05c475d8ac183bbf523b086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:21.263704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:21.264692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3bafab8-a4a8-4a88-9dd1-47def955b47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:21.266595 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1416/2805] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:20 2022] DELETE /identity/v3/projects/c300c68ea05c475d8ac183bbf523b086 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:17:21.271823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3d21-16e0-424f-a5f9-e9daac6d1e29 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:21.282332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3d21-16e0-424f-a5f9-e9daac6d1e29 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:21.282332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3d21-16e0-424f-a5f9-e9daac6d1e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:21.294663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5b5e3d21-16e0-424f-a5f9-e9daac6d1e29 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:21.296511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5b5e3d21-16e0-424f-a5f9-e9daac6d1e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:21.371523 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1390/2806] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:21.379519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3416086-4090-4efe-b99a-6a5734cc181a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:21.391417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3416086-4090-4efe-b99a-6a5734cc181a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:21.391417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3416086-4090-4efe-b99a-6a5734cc181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:21.407764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a3416086-4090-4efe-b99a-6a5734cc181a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:21.412642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a3416086-4090-4efe-b99a-6a5734cc181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:21.431815 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1417/2807] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:21.433183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e3d21-16e0-424f-a5f9-e9daac6d1e29 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:21.444903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e3d21-16e0-424f-a5f9-e9daac6d1e29 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:21.452436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:21.456576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:21.456952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:21.457239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:21.458852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:17:21.459172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:21.461104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:21.477959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1391/2808] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:17:21.482148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3416086-4090-4efe-b99a-6a5734cc181a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:21.502057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3416086-4090-4efe-b99a-6a5734cc181a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:21.509316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:21.510203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:21.510585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:21.510953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:21.511687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:21.514026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:21.618131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1418/2809] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:21 2022] POST /identity/v3/projects => generated 359 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:17:21.622524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:21.634984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad7b3b-cba4-4a00-8ab3-7fea8edfa538 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:21.710185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:21.710896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:21.711361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:21.711704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:21.712640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:21.714813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:21.833297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1392/2810] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:21 2022] POST /identity/v3/users => generated 280 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:21.835046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:21.855444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0c47-ee28-4c66-b387-807e19b88d89 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:21.867732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:21.868362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:21.869954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:21.870066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:21.870945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:21.883060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:21.917512 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1419/2811] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:21.918423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:21.949507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f02683-c50e-4d41-9317-0aec5f42d9f8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:21.958574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabfd3e-2ac8-42d3-a58d-1d9933e4f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:21.959184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabfd3e-2ac8-42d3-a58d-1d9933e4f858 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:21.961628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabfd3e-2ac8-42d3-a58d-1d9933e4f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:21.961628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabfd3e-2ac8-42d3-a58d-1d9933e4f858 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:21.961628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabfd3e-2ac8-42d3-a58d-1d9933e4f858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:21.962040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabfd3e-2ac8-42d3-a58d-1d9933e4f858 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:21.969517 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:21.976641 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1393/2812] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:21.980794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:21.996987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff62c4a-8347-44b2-87f2-f5c192fe2dab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:22.009038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:22.009852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:22.010026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:22.016834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] PATH_INFO: `/v3/projects/01fc238ac8ec401a8ee8f518c6edffce/users/2f478706aa3d42a982cd11dce88224d5/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:22.038075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fc238ac8ec401a8ee8f518c6edffce, user_id=2f478706aa3d42a982cd11dce88224d5, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:22.059057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:22.135585 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1420/2813] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:21 2022] PUT /identity/v3/projects/01fc238ac8ec401a8ee8f518c6edffce/users/2f478706aa3d42a982cd11dce88224d5/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:22.146813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6e3e-2f53-4af6-b4d7-6e47c796d4fb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:22.147491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6e3e-2f53-4af6-b4d7-6e47c796d4fb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:22.148562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6e3e-2f53-4af6-b4d7-6e47c796d4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:22.189797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-902a6e3e-2f53-4af6-b4d7-6e47c796d4fb None None] MFA Rules not processed for user `2f478706aa3d42a982cd11dce88224d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:22.191123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-902a6e3e-2f53-4af6-b4d7-6e47c796d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:22.309973 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1394/2814] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:22.312759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:22.398932 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:22.404551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da922add-c6c2-4801-9081-99c3378cd9cf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:22.410335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:22.410963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:22.411248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:22.411879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:22.412211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:22.414178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:22.525724 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1421/2815] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:22 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:22.532970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a6e3e-2f53-4af6-b4d7-6e47c796d4fb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:22.566984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a6e3e-2f53-4af6-b4d7-6e47c796d4fb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:22.669402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:22.671062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:22.671613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:22.671999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:22.673150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:22.676000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:22.761459 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1395/2816] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:22 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:17:22.765408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:22.779377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239168-d8fc-4a72-9e50-998abf8f7266 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:22.793981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:22.794532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:22.794810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:22.795080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:22.796417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:22.798234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:22.827888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1422/2817] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:22.831933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:22.863183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611851-c9e5-4fee-9a5e-d771fcce3266 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:22.887301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:22.888411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:22.888698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:22.888983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] PATH_INFO: `/v3/projects/6bfcd0b1364e418bafd7a0330bacd460/users/f4474c02a96d44288ebf6d2ec66b627a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:22.939348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfcd0b1364e418bafd7a0330bacd460, user_id=f4474c02a96d44288ebf6d2ec66b627a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:22.943400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:23.039683 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1396/2818] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:22 2022] PUT /identity/v3/projects/6bfcd0b1364e418bafd7a0330bacd460/users/f4474c02a96d44288ebf6d2ec66b627a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:23.043442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:23.054958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae0491-bec0-47a4-b0b4-83c56742e87e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:23.133230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6143744-0928-4a92-8fd6-9fb44b0b84ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:23.134199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143744-0928-4a92-8fd6-9fb44b0b84ce admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:23.135578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143744-0928-4a92-8fd6-9fb44b0b84ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:23.136100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143744-0928-4a92-8fd6-9fb44b0b84ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:23.137482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6143744-0928-4a92-8fd6-9fb44b0b84ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:23.140473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6143744-0928-4a92-8fd6-9fb44b0b84ce admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:23.153664 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1423/2819] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:23.161417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:23.173654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b431151-7ba6-4934-8ae8-a0f173021375 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:23.180079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:23.180883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:23.181267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:23.182194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] PATH_INFO: `/v3/projects/6bfcd0b1364e418bafd7a0330bacd460/users/f4474c02a96d44288ebf6d2ec66b627a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:23.184339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfcd0b1364e418bafd7a0330bacd460, user_id=f4474c02a96d44288ebf6d2ec66b627a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:23.190828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:23.223068 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1397/2820] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:23 2022] PUT /identity/v3/projects/6bfcd0b1364e418bafd7a0330bacd460/users/f4474c02a96d44288ebf6d2ec66b627a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:23.230264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f8ba-6c1e-4358-8c74-a37d04bdae01 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:23.230264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f8ba-6c1e-4358-8c74-a37d04bdae01 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:23.230264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f8ba-6c1e-4358-8c74-a37d04bdae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:23.272273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a813f8ba-6c1e-4358-8c74-a37d04bdae01 None None] MFA Rules not processed for user `f4474c02a96d44288ebf6d2ec66b627a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:23.273901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a813f8ba-6c1e-4358-8c74-a37d04bdae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:23.383133 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1424/2821] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:23.444873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:23.447057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:23.545267 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:23.615922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58914d-94d1-4621-a4fe-6acc359a06a9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:23.633169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:23.634442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:23.634923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:23.635155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:23.662019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:23.663860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:23.700395 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1398/2822] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:24.539903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813f8ba-6c1e-4358-8c74-a37d04bdae01 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:24.613663 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:24.628006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813f8ba-6c1e-4358-8c74-a37d04bdae01 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:24.637069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:24.637069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:24.637069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:24.637069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] PATH_INFO: `/v3/users/2f478706aa3d42a982cd11dce88224d5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:24.637621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f478706aa3d42a982cd11dce88224d5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:24.638274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:24.725399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:24.727608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:24.760046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43b4e-02cb-4048-8a29-92ff8cf8e52d service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:24.760046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:24.760046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:24.760046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:24.760428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] PATH_INFO: `/v3/users/d1d952cf28734803a9081d6c237816d4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:24.760428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d952cf28734803a9081d6c237816d4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:24.760428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:24.976949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f478706aa3d42a982cd11dce88224d5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:24.977728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f478706aa3d42a982cd11dce88224d5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.005848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d952cf28734803a9081d6c237816d4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.022051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d952cf28734803a9081d6c237816d4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.030860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d952cf28734803a9081d6c237816d4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.031982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d952cf28734803a9081d6c237816d4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.112057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f478706aa3d42a982cd11dce88224d5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.119949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f478706aa3d42a982cd11dce88224d5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.120610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc1e2aff-e11a-4ebe-be6f-28d6ff0be531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f478706aa3d42a982cd11dce88224d5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.155577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1425/2823] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:24 2022] DELETE /identity/v3/users/2f478706aa3d42a982cd11dce88224d5 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:25.155577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:25.155577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:25.155577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:25.167838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d952cf28734803a9081d6c237816d4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.171803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:25.173204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:25.183028 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1399/2824] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:24 2022] DELETE /identity/v3/users/d1d952cf28734803a9081d6c237816d4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:17:25.279550 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1426/2825] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:25.288950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:25.290446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:25.322775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:25.323269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:25.339456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e4038-26c0-426a-be3a-274e014ef898 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:25.439466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51acc6d-9f44-4c4b-a3ac-108fb506764d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:25.443684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:25.444664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:25.444927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:25.445309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:25.466014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:25.466994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:25.478837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:25.478837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] PATH_INFO: `/v3/users/a1286deaeee141a18e6207ca4bb7d3fe` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:25.478837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1286deaeee141a18e6207ca4bb7d3fe)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:25.478837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:25.489103 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:25.523048 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:25.535796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:25.537401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:25.549417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1400/2826] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:17:25.588518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:25.590159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:25.629603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4210b-725d-4cff-8bfb-b1f46873f24f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:25.654092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:25.654092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:25.654092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:25.654092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] PATH_INFO: `/v3/projects/e27928e9b4c34c04838c48f8510a949e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:25.657272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27928e9b4c34c04838c48f8510a949e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:25.659303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:25.711720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1286deaeee141a18e6207ca4bb7d3fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.712969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1286deaeee141a18e6207ca4bb7d3fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.798447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1286deaeee141a18e6207ca4bb7d3fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.808289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1286deaeee141a18e6207ca4bb7d3fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.808662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49462a54-d365-42d5-b30d-dfd5c24bf97f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1286deaeee141a18e6207ca4bb7d3fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.820533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27928e9b4c34c04838c48f8510a949e', 'request_id': 'req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.831046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27928e9b4c34c04838c48f8510a949e', 'request_id': 'req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.853418 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1427/2827] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:25 2022] DELETE /identity/v3/users/a1286deaeee141a18e6207ca4bb7d3fe => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:25.859027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:25.859507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:25.859818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:25.888366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:25.891469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:25.927693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27928e9b4c34c04838c48f8510a949e', 'request_id': 'req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.946224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] The token cache is being invalidate because project e27928e9b4c34c04838c48f8510a949e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:25.946512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.947529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f0313d8-eb37-4a8c-a3f2-ce6d2f1236d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:25.950175 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1401/2828] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:25 2022] DELETE /identity/v3/projects/e27928e9b4c34c04838c48f8510a949e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:25.955395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dff0a-3a5a-42ee-867c-73dc87312c81 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:25.960350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dff0a-3a5a-42ee-867c-73dc87312c81 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:25.960350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dff0a-3a5a-42ee-867c-73dc87312c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:25.987516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e32dff0a-3a5a-42ee-867c-73dc87312c81 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:25.989073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e32dff0a-3a5a-42ee-867c-73dc87312c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.035091 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1428/2829] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:26.054058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.056030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.102346 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1402/2830] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:26.115430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a9b2-1abe-4484-b66a-03e096c22670 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.115430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a9b2-1abe-4484-b66a-03e096c22670 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.115430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a9b2-1abe-4484-b66a-03e096c22670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.148252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8c96a9b2-1abe-4484-b66a-03e096c22670 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:26.156585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8c96a9b2-1abe-4484-b66a-03e096c22670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.164635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72084fb-8f21-4ed9-99fa-28006a930ec9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.170548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.172942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.173617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.173915 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1403/2831] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:26.174035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.179287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a9b2-1abe-4484-b66a-03e096c22670 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.193601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.195985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.199113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a9b2-1abe-4484-b66a-03e096c22670 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.209409 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1429/2832] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:17:26.211017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.211597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.213046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.213377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.213771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.214367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.215526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:17:26.215859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.219477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.253616 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1404/2833] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:17:26.254888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.266669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53d6fd-5f44-4cf6-a2cf-617861f46c71 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.269133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56af11-911d-4b76-9eec-30dc15090548 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.274891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.286049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.286608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.287423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.287789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] PATH_INFO: `/v3/projects/01fc238ac8ec401a8ee8f518c6edffce` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.289126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fc238ac8ec401a8ee8f518c6edffce)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.291080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.293979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.296443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.296737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.297432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.299410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.403554 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1405/2834] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:26 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:26.406398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.431188 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:26.447601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fc238ac8ec401a8ee8f518c6edffce', 'request_id': 'req-2a2c8bb7-2e80-409c-b197-a672335a85f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.455012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fc238ac8ec401a8ee8f518c6edffce', 'request_id': 'req-2a2c8bb7-2e80-409c-b197-a672335a85f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.480779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f0895-c899-4a16-8029-024175120ebc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.508315 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:26.544474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fc238ac8ec401a8ee8f518c6edffce', 'request_id': 'req-2a2c8bb7-2e80-409c-b197-a672335a85f3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.563610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.564400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.564762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.565187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.566025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.568860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.576208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] The token cache is being invalidate because project 01fc238ac8ec401a8ee8f518c6edffce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:26.576783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.580431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.584021 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1430/2835] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:26 2022] DELETE /identity/v3/projects/01fc238ac8ec401a8ee8f518c6edffce => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:26.584911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.586325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.603806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c8bb7-2e80-409c-b197-a672335a85f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.610446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.611089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.611389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.611671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] PATH_INFO: `/v3/projects/4c299a72b27e40498a73e2becaf30e89` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.613125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c299a72b27e40498a73e2becaf30e89)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.615087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.656930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1406/2836] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:26 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:26.658412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.661903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.676039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e484a53-18e9-47c7-a59e-53aae068a995 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.681397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.682158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.686968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.686968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] PATH_INFO: `/v3/users/f4474c02a96d44288ebf6d2ec66b627a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.686968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4474c02a96d44288ebf6d2ec66b627a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.686968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.726045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c299a72b27e40498a73e2becaf30e89', 'request_id': 'req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.735676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c299a72b27e40498a73e2becaf30e89', 'request_id': 'req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.804854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c299a72b27e40498a73e2becaf30e89', 'request_id': 'req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.826648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] The token cache is being invalidate because project 4c299a72b27e40498a73e2becaf30e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:26.827552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.829108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.830904 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1431/2837] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:26 2022] DELETE /identity/v3/projects/4c299a72b27e40498a73e2becaf30e89 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:26.831699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.833024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.899204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4474c02a96d44288ebf6d2ec66b627a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.924732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ca18-7cfe-48a5-b2cb-6b09b47691d7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.932100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.932100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.932541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.932807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.933447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.934627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4474c02a96d44288ebf6d2ec66b627a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.935085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:26.953829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4474c02a96d44288ebf6d2ec66b627a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.954821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4474c02a96d44288ebf6d2ec66b627a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:26.960849 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1432/2838] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:26.960849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:26.960849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:26.975864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d06f4-ebbb-4b63-8b46-72cb5fdf34ea admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:26.982503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:26.983186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:26.983469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:26.983738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] PATH_INFO: `/v3/users/8a08921ac1c44bd6bde88a1bf7e90785` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:26.985558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a08921ac1c44bd6bde88a1bf7e90785)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:26.987516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:27.037103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4474c02a96d44288ebf6d2ec66b627a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:27.044889 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1407/2839] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:26 2022] DELETE /identity/v3/users/f4474c02a96d44288ebf6d2ec66b627a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:27.045572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:27.048435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:27.143180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab6298-155a-436f-8772-84259e2d4fdf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:27.149903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:27.150831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:27.151310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:27.151775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:27.152617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:27.154466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:27.170615 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1408/2840] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:27.175397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:27.187553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831862db-6500-4e5a-a122-1ad30d9cd709 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:27.196472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf09902-c5df-4933-9628-41c757dfca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:27.197302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf09902-c5df-4933-9628-41c757dfca91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:27.197655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf09902-c5df-4933-9628-41c757dfca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:27.198029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf09902-c5df-4933-9628-41c757dfca91 admin admin] PATH_INFO: `/v3/projects/40a5fe33aa044db98cc4fb6f5d70466e/users/ec67c1528a73482881996bfca70e722d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:27.239348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf09902-c5df-4933-9628-41c757dfca91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a5fe33aa044db98cc4fb6f5d70466e, user_id=ec67c1528a73482881996bfca70e722d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:27.242472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf09902-c5df-4933-9628-41c757dfca91 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:27.271348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a08921ac1c44bd6bde88a1bf7e90785'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:27.281537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a08921ac1c44bd6bde88a1bf7e90785'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:27.360130 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:27.367373 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1409/2841] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:27 2022] PUT /identity/v3/projects/40a5fe33aa044db98cc4fb6f5d70466e/users/ec67c1528a73482881996bfca70e722d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:27.378516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:27.378803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:27.379079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:27.414733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a08921ac1c44bd6bde88a1bf7e90785'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:27.423233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] MFA Rules not processed for user `ec67c1528a73482881996bfca70e722d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:27.424784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:27.436322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a08921ac1c44bd6bde88a1bf7e90785'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:27.437930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a08921ac1c44bd6bde88a1bf7e90785'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:27.451047 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:27.479091 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1433/2842] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:26 2022] DELETE /identity/v3/users/8a08921ac1c44bd6bde88a1bf7e90785 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:27.591431 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1410/2843] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:27.607171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:27.609339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:27.721241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039d98b-72e3-41fd-9714-cfe84ca153cb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:27.730256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:27.732012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:27.732012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:27.732012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:27.819641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:27.821359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:27.835165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:27.837372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:27.868558 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1434/2844] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:28.028644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff5a29-0036-4888-b0ad-41ee7887294d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.095221 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:28.125387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.126664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.127183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.127621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] PATH_INFO: `/v3/projects/9e98c5825f9c4ecb8d9ff371fb7cea23` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.128912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e98c5825f9c4ecb8d9ff371fb7cea23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.130880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:28.210767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:28.212962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:28.253020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2d0e-48ac-45aa-a08b-3b9d443f7c46 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.274764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.275309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.275576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.275859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] PATH_INFO: `/v3/projects/6bfcd0b1364e418bafd7a0330bacd460` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.277134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfcd0b1364e418bafd7a0330bacd460)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.279379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:28.310923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e98c5825f9c4ecb8d9ff371fb7cea23', 'request_id': 'req-875968ca-2100-4968-a207-874f208faf4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.329406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e98c5825f9c4ecb8d9ff371fb7cea23', 'request_id': 'req-875968ca-2100-4968-a207-874f208faf4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.386380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e98c5825f9c4ecb8d9ff371fb7cea23', 'request_id': 'req-875968ca-2100-4968-a207-874f208faf4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.425965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfcd0b1364e418bafd7a0330bacd460', 'request_id': 'req-e2290025-2b08-42fc-b8fb-9035d2935232'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.429017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] The token cache is being invalidate because project 9e98c5825f9c4ecb8d9ff371fb7cea23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:28.430259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.431960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-875968ca-2100-4968-a207-874f208faf4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.444173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfcd0b1364e418bafd7a0330bacd460', 'request_id': 'req-e2290025-2b08-42fc-b8fb-9035d2935232'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.444344 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1411/2845] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:27 2022] DELETE /identity/v3/projects/9e98c5825f9c4ecb8d9ff371fb7cea23 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:17:28.444440 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:28.450875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb89fb-1152-407c-8c7b-8ec14d69df8d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.451005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb89fb-1152-407c-8c7b-8ec14d69df8d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.451220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb89fb-1152-407c-8c7b-8ec14d69df8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.487483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5deb89fb-1152-407c-8c7b-8ec14d69df8d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:28.488712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5deb89fb-1152-407c-8c7b-8ec14d69df8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:28.535018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfcd0b1364e418bafd7a0330bacd460', 'request_id': 'req-e2290025-2b08-42fc-b8fb-9035d2935232'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.553367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] The token cache is being invalidate because project 6bfcd0b1364e418bafd7a0330bacd460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:28.553716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.555592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e2290025-2b08-42fc-b8fb-9035d2935232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:28.557434 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1435/2846] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:28 2022] DELETE /identity/v3/projects/6bfcd0b1364e418bafd7a0330bacd460 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:28.564864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20474-e615-4d4b-8f9f-9fa3a4588411 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.565212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20474-e615-4d4b-8f9f-9fa3a4588411 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.565494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20474-e615-4d4b-8f9f-9fa3a4588411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.589509 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1412/2847] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:28.596633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b9c20474-e615-4d4b-8f9f-9fa3a4588411 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:28.598021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9c20474-e615-4d4b-8f9f-9fa3a4588411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:28.614680 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1436/2848] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:28.619689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c375a-54b9-4b59-925e-1960c94d3d73 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.619978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c375a-54b9-4b59-925e-1960c94d3d73 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.620317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c375a-54b9-4b59-925e-1960c94d3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.650740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c28c375a-54b9-4b59-925e-1960c94d3d73 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:28.651965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c28c375a-54b9-4b59-925e-1960c94d3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:28.667133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4533-8c98-402e-8e2a-aff5fc9c9ba1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.667881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4533-8c98-402e-8e2a-aff5fc9c9ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.668261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4533-8c98-402e-8e2a-aff5fc9c9ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.668795 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1413/2849] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:28.669729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c375a-54b9-4b59-925e-1960c94d3d73 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:28.681083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c375a-54b9-4b59-925e-1960c94d3d73 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.686345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.688014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.694064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.694064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.694064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:17:28.694064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.694064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:28.698044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-628c4533-8c98-402e-8e2a-aff5fc9c9ba1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:28.700038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-628c4533-8c98-402e-8e2a-aff5fc9c9ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:28.708890 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1437/2850] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:28.713305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4533-8c98-402e-8e2a-aff5fc9c9ba1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:28.715968 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1414/2851] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:17:28.724208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4533-8c98-402e-8e2a-aff5fc9c9ba1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.725789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:28.729877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.730568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.731125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.731242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.731973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:17:28.732352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.734684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:28.737859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8ce4-6271-437e-860b-84a5c3309ec1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.743507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.744276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.744597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.744878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.745517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.747478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:28.748293 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1438/2852] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:17:28.754536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:28.765791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88193-1230-4f1f-8e4d-04d911f2b6fe admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.770893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.774058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.774058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.774058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.774058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.774741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:28.849027 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1415/2853] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/projects => generated 407 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:17:28.850196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:28.869962 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1439/2854] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:28.873377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:28.908386 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:28.946868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12e94c-b085-4a30-9258-8d637c26eccc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.954551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.955184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.955528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.955807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.956524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.956642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fdafb-94a8-43ff-b488-bfea3b602b07 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:28.958499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:28.961932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:28.962481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:28.962764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:28.963039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:28.964198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:28.965648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.088917 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1416/2855] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/users => generated 304 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:17:29.090743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.111617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd938368-74ab-4281-90d6-15084057f948 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:29.115673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1440/2856] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:28 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:29.119184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:29.119409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.119896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.120195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.120472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.121161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:29.122821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.137746 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1417/2857] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:29.146431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b27e3-c673-47c5-ab88-c7a9823427e5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:29.148325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.160928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:29.161558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.162036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.162936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.167680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc50ba3-d1b0-4901-8b81-4612041f8523 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:29.167808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:29.167923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.170219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:29.171723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.172155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.172600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.173393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:29.175665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.193038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1441/2858] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:17:29.193368 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1418/2859] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:17:29.199117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.199394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.219391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ca45-d91f-4d5d-9d84-a216b30218f9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:29.219888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f50e2-8ef4-4395-8265-ecc9ed614a9e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:29.228150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cef98-82f0-49cd-a753-d120d26c0b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:29.229291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cef98-82f0-49cd-a753-d120d26c0b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.229793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cef98-82f0-49cd-a753-d120d26c0b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.230325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cef98-82f0-49cd-a753-d120d26c0b67 admin admin] PATH_INFO: `/v3/projects/957a43388b6647468652e44ec609b973/users/18d19671266541ea87955195bd75ae93/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.236626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:29.239120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.240320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.240693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.243900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:29.244496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.263050 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1442/2860] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:29.288515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.301181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cef98-82f0-49cd-a753-d120d26c0b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957a43388b6647468652e44ec609b973, user_id=18d19671266541ea87955195bd75ae93, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:29.317628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cef98-82f0-49cd-a753-d120d26c0b67 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.322400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27234-59fa-4620-a4b5-b4c9c9b620c9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:29.339577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdd424-2481-4373-a917-7a8fd6840057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:29.340686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdd424-2481-4373-a917-7a8fd6840057 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.341727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdd424-2481-4373-a917-7a8fd6840057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.343332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdd424-2481-4373-a917-7a8fd6840057 admin admin] PATH_INFO: `/v3/projects/6f0dbd1455a34a12abebdf3358e52a42/users/065432e001ed421b9ac1fd19a8f35783/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.365221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdd424-2481-4373-a917-7a8fd6840057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0dbd1455a34a12abebdf3358e52a42, user_id=065432e001ed421b9ac1fd19a8f35783, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:29.368261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdd424-2481-4373-a917-7a8fd6840057 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.479387 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1419/2861] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:29 2022] PUT /identity/v3/projects/957a43388b6647468652e44ec609b973/users/18d19671266541ea87955195bd75ae93/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:29.501337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f02168-2831-4d60-ae74-10b8f4885c7f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.501709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f02168-2831-4d60-ae74-10b8f4885c7f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.501958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f02168-2831-4d60-ae74-10b8f4885c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.508590 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1443/2862] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:29 2022] PUT /identity/v3/projects/6f0dbd1455a34a12abebdf3358e52a42/users/065432e001ed421b9ac1fd19a8f35783/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:17:29.509844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.510139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.510412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.550080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-15f02168-2831-4d60-ae74-10b8f4885c7f None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:29.552241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15f02168-2831-4d60-ae74-10b8f4885c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:29.617460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] MFA Rules not processed for user `18d19671266541ea87955195bd75ae93`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:29.619019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:29.671376 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1420/2863] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:29.673031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59eda-4322-45cb-8e4d-c43170b38eb9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.673410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59eda-4322-45cb-8e4d-c43170b38eb9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.674156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59eda-4322-45cb-8e4d-c43170b38eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.752804 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1444/2864] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:29.754410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.756478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:29.775476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f1c59eda-4322-45cb-8e4d-c43170b38eb9 None None] MFA Rules not processed for user `065432e001ed421b9ac1fd19a8f35783`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:29.778390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1c59eda-4322-45cb-8e4d-c43170b38eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:29.869206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d8b95-8c89-4a8e-bf59-5554d497c0e3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:29.893603 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1421/2865] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:29.899949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59eda-4322-45cb-8e4d-c43170b38eb9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:29.901125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:29.903137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:29.903425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:29.903700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:29.935209 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:29.945524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:29.947255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:29.999824 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1445/2866] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:17:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:17:30.000085 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:30.000790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.006046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59eda-4322-45cb-8e4d-c43170b38eb9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.013435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.014370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.015837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.016354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.017564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.019780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.029665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8355d-2835-4db3-9932-731af751afe6 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.039613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.040236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.040573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.040905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.041658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.043660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.217121 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1446/2867] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:29 2022] POST /identity/v3/projects => generated 391 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:30.218788 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1422/2868] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:29 2022] POST /identity/v3/projects => generated 409 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:30.224814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.225469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.391044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b317e8c-1c5b-4ada-a0ea-eaef7e8c951c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.407552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.408177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.408457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.409516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.410238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.412695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.415936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd35d4-311c-4bcd-a0b1-e750a851e431 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.427784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.431571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.432129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.432576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.439390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.446994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.538308 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1447/2869] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:30 2022] POST /identity/v3/users => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:30.542112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.559247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1423/2870] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:30 2022] POST /identity/v3/users => generated 311 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:30.567113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.586057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5a717-df69-43bd-bef7-e56a9471a0a2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.596224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2d79-62cf-483d-997d-c2b765baa7c7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.602038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.603204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.603204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.603204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.603690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.605263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.614713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.615328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.615935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.616213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.617123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.621341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.642071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1448/2871] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:30.643270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.662062 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1424/2872] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:30.665460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0c49e-7e62-4323-b343-8c6ed63a8842 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.670596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.675843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.676577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.676860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.677140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] PATH_INFO: `/v3/projects/943c1a6c3aa243458b9f4a9549e7188e/users/2d6ab910dbbe4af485657719efbd9022/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.699426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe08a6-adec-492f-bfb0-c039e6fea647 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.711320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:30.715388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:30.715388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:30.715388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] PATH_INFO: `/v3/projects/089dd6d5d8f942dd81ba70e6a3237f27/users/478fdb3eba154191ba04ecc40bb01d7e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:30.744096 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:30.747215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943c1a6c3aa243458b9f4a9549e7188e, user_id=2d6ab910dbbe4af485657719efbd9022, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.753269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.755526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089dd6d5d8f942dd81ba70e6a3237f27, user_id=478fdb3eba154191ba04ecc40bb01d7e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:30.758468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:30.877338 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1449/2873] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:30 2022] PUT /identity/v3/projects/943c1a6c3aa243458b9f4a9549e7188e/users/2d6ab910dbbe4af485657719efbd9022/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:30.879049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.907946 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1425/2874] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:30 2022] PUT /identity/v3/projects/089dd6d5d8f942dd81ba70e6a3237f27/users/478fdb3eba154191ba04ecc40bb01d7e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:30.911032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:30.983013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab301c5a-261c-40d8-b24e-dabce1668475 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:30.998444 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:31.003918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998b8a-3d71-410b-b1c9-4686d4c5aca1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:31.044053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:31.044692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.044975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.045240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.051260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:31.057163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:31.076491 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1426/2875] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:31.080210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:31.082313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:31.083074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.083579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.083870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.084707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:31.086665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:31.093270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009739a-fbcf-4329-a7e6-c7ac93b39515 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:31.099440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c1f9-b99f-476e-873f-dbe5c95551ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:31.100538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c1f9-b99f-476e-873f-dbe5c95551ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.101428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c1f9-b99f-476e-873f-dbe5c95551ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.101956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c1f9-b99f-476e-873f-dbe5c95551ad admin admin] PATH_INFO: `/v3/projects/089dd6d5d8f942dd81ba70e6a3237f27/users/478fdb3eba154191ba04ecc40bb01d7e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.105855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c1f9-b99f-476e-873f-dbe5c95551ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=089dd6d5d8f942dd81ba70e6a3237f27, user_id=478fdb3eba154191ba04ecc40bb01d7e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:31.109238 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1450/2876] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:31.109405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c1f9-b99f-476e-873f-dbe5c95551ad admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:31.110241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:31.122948 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1427/2877] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:31 2022] PUT /identity/v3/projects/089dd6d5d8f942dd81ba70e6a3237f27/users/478fdb3eba154191ba04ecc40bb01d7e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:31.129562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20647c-dc3e-4e78-8e6f-d1222294c0f0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:31.133524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd08b5-4f9a-4810-a8cd-aba9ebb2cbb5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.133835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd08b5-4f9a-4810-a8cd-aba9ebb2cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.134121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd08b5-4f9a-4810-a8cd-aba9ebb2cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.168197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a9dd08b5-4f9a-4810-a8cd-aba9ebb2cbb5 None None] MFA Rules not processed for user `478fdb3eba154191ba04ecc40bb01d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:31.169437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a9dd08b5-4f9a-4810-a8cd-aba9ebb2cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:31.211314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb61a0-bafe-4f80-9778-f295f65f83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:31.212481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb61a0-bafe-4f80-9778-f295f65f83ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.212773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb61a0-bafe-4f80-9778-f295f65f83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.213176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb61a0-bafe-4f80-9778-f295f65f83ec admin admin] PATH_INFO: `/v3/projects/943c1a6c3aa243458b9f4a9549e7188e/users/2d6ab910dbbe4af485657719efbd9022/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.216784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb61a0-bafe-4f80-9778-f295f65f83ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=943c1a6c3aa243458b9f4a9549e7188e, user_id=2d6ab910dbbe4af485657719efbd9022, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:31.220439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb61a0-bafe-4f80-9778-f295f65f83ec admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:31.252448 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1451/2878] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:31 2022] PUT /identity/v3/projects/943c1a6c3aa243458b9f4a9549e7188e/users/2d6ab910dbbe4af485657719efbd9022/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:31.255230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f903-089a-4da8-aac2-579ad0d0a417 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.255555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f903-089a-4da8-aac2-579ad0d0a417 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.255802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f903-089a-4da8-aac2-579ad0d0a417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.286133 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1428/2879] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:31.289944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd08b5-4f9a-4810-a8cd-aba9ebb2cbb5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:31.298210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1a59f903-089a-4da8-aac2-579ad0d0a417 None None] MFA Rules not processed for user `2d6ab910dbbe4af485657719efbd9022`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:31.300264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1a59f903-089a-4da8-aac2-579ad0d0a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:31.312486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd08b5-4f9a-4810-a8cd-aba9ebb2cbb5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:31.325881 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:31.395021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:31.395682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.396037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.396325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] PATH_INFO: `/v3/users/18d19671266541ea87955195bd75ae93` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.397485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d19671266541ea87955195bd75ae93)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:31.399736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:31.459391 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1452/2880] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:31.464897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.465248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.465858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.497210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] MFA Rules not processed for user `065432e001ed421b9ac1fd19a8f35783`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:31.499854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:31.584670 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1453/2881] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:31.594662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:31.598217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:31.610376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d19671266541ea87955195bd75ae93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:31.623871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d19671266541ea87955195bd75ae93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:31.625771 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:31.635867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d19671266541ea87955195bd75ae93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:31.635867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d19671266541ea87955195bd75ae93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:31.723120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9d76516-bdff-4a49-812f-1d173d9a0d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d19671266541ea87955195bd75ae93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:31.733654 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1429/2882] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:31 2022] DELETE /identity/v3/users/18d19671266541ea87955195bd75ae93 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:31.735719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcaa2c-fe05-4057-96a5-bc2b77d31fe4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:31.736323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.736616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.736893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.777666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:31.779448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:31.819017 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:31.832122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f5574-3b91-4b4b-a64c-7fe379b475e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:31.832760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5574-3b91-4b4b-a64c-7fe379b475e2 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:31.833047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5574-3b91-4b4b-a64c-7fe379b475e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:31.833319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5574-3b91-4b4b-a64c-7fe379b475e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:31.835399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ed2f5574-3b91-4b4b-a64c-7fe379b475e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:31.908196 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1430/2883] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:31.918498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:31.920224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:31.947834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f5574-3b91-4b4b-a64c-7fe379b475e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:31.949960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f5574-3b91-4b4b-a64c-7fe379b475e2 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:31.980561 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1454/2884] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:32.006557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa3335-d53f-4b08-b75d-6c503e15d6f8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:32.011671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:32.012299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:32.012575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:32.012840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:32.026770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:32.028191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:32.041410 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1431/2885] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:17:32.107358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b517-3718-4d26-a997-6a802901250d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:32.107358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b517-3718-4d26-a997-6a802901250d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:32.107358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b517-3718-4d26-a997-6a802901250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:32.144996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0a27b517-3718-4d26-a997-6a802901250d None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:32.149340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a27b517-3718-4d26-a997-6a802901250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:32.269246 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1455/2886] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:17:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:32.282430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:32.283981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:32.441639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0963471-9685-4859-9477-43565b3081aa service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:32.447835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:32.448589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:32.449012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:32.449383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:32.465063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:32.467607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:32.479108 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1432/2887] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:17:32.777584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27b517-3718-4d26-a997-6a802901250d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:32.782619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a27b517-3718-4d26-a997-6a802901250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:32.811084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27b517-3718-4d26-a997-6a802901250d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:32.818867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:32.821293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:32.821293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:32.824901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] PATH_INFO: `/v3/projects/957a43388b6647468652e44ec609b973` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:32.824901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=957a43388b6647468652e44ec609b973)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:32.826694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:32.972959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957a43388b6647468652e44ec609b973', 'request_id': 'req-2a841015-7016-4b1e-9c74-1de6f25fda9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:32.984053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957a43388b6647468652e44ec609b973', 'request_id': 'req-2a841015-7016-4b1e-9c74-1de6f25fda9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:33.254808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:33.271132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fc96-2a76-43a0-8450-e35b0ea380ef service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:33.289089 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:33.391697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:33.392470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:33.392856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:33.393265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:33.400569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:33.425001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957a43388b6647468652e44ec609b973', 'request_id': 'req-2a841015-7016-4b1e-9c74-1de6f25fda9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:33.427914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] The token cache is being invalidate because project 957a43388b6647468652e44ec609b973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:33.428223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:33.429041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:33.433848 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1456/2888] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:32 2022] DELETE /identity/v3/projects/957a43388b6647468652e44ec609b973 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:33.438991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:33.443074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:33.502595 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:33.575509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:33.578679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:33.592269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841015-7016-4b1e-9c74-1de6f25fda9e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:33.601999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:33.602850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:33.603379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:33.603660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] PATH_INFO: `/v3/users/478fdb3eba154191ba04ecc40bb01d7e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:33.604982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478fdb3eba154191ba04ecc40bb01d7e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:33.606976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:33.612068 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1433/2889] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:17:33.895989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478fdb3eba154191ba04ecc40bb01d7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:33.897187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478fdb3eba154191ba04ecc40bb01d7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:34.026893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478fdb3eba154191ba04ecc40bb01d7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:34.040656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478fdb3eba154191ba04ecc40bb01d7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:34.041603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478fdb3eba154191ba04ecc40bb01d7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:34.138875 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1457/2890] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:33 2022] DELETE /identity/v3/users/478fdb3eba154191ba04ecc40bb01d7e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:34.316447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:34.319264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:34.468043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef55ed-19d0-4ef5-bf23-5dc69cbb0037 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:34.576393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d514-fb07-4d9d-a669-248fe8b46b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:34.576393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d514-fb07-4d9d-a669-248fe8b46b5e service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:34.576949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d514-fb07-4d9d-a669-248fe8b46b5e service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:34.576949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d514-fb07-4d9d-a669-248fe8b46b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:34.586781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1817d514-fb07-4d9d-a669-248fe8b46b5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:34.610010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d514-fb07-4d9d-a669-248fe8b46b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:34.611641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d514-fb07-4d9d-a669-248fe8b46b5e service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:34.624063 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1434/2891] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:34.861927 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:34.982365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:34.984163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:35.194274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1343-c187-415d-8a80-72410e7fbbf5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:35.200054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:35.201278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:35.201711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:35.202089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] PATH_INFO: `/v3/projects/089dd6d5d8f942dd81ba70e6a3237f27` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:35.205640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=089dd6d5d8f942dd81ba70e6a3237f27)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:35.221871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:35.263231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f11087-64d0-4223-b068-9992e27e3303 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:35.263521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f11087-64d0-4223-b068-9992e27e3303 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:35.263803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f11087-64d0-4223-b068-9992e27e3303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:35.303516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-69f11087-64d0-4223-b068-9992e27e3303 None None] MFA Rules not processed for user `1ef9ced1581c4375ab34ed0430a7213f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:35.304804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69f11087-64d0-4223-b068-9992e27e3303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:35.391035 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:35.409110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089dd6d5d8f942dd81ba70e6a3237f27', 'request_id': 'req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:35.419472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089dd6d5d8f942dd81ba70e6a3237f27', 'request_id': 'req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:35.490074 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1435/2892] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:35.552501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089dd6d5d8f942dd81ba70e6a3237f27', 'request_id': 'req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:35.599315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] The token cache is being invalidate because project 089dd6d5d8f942dd81ba70e6a3237f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:35.599628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:35.600277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af0b8883-3bc1-44e8-a94e-df3fbb2c9757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:35.602496 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1458/2893] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:34 2022] DELETE /identity/v3/projects/089dd6d5d8f942dd81ba70e6a3237f27 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:35.611651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839dd0-4254-4a04-af3a-47e89ad0c697 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:35.613273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839dd0-4254-4a04-af3a-47e89ad0c697 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:35.614905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839dd0-4254-4a04-af3a-47e89ad0c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:35.648600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:35.648880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:35.649034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:35.683204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4a839dd0-4254-4a04-af3a-47e89ad0c697 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:35.684800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a839dd0-4254-4a04-af3a-47e89ad0c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:35.710152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:35.711413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:35.820566 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1459/2894] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:35.829719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:35.831929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:35.878326 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1436/2895] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:35.894261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894eec0-ab62-4525-a99f-f039991f05ad None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:35.899099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894eec0-ab62-4525-a99f-f039991f05ad None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:35.900502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894eec0-ab62-4525-a99f-f039991f05ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:35.982490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8894eec0-ab62-4525-a99f-f039991f05ad None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:35.991734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8894eec0-ab62-4525-a99f-f039991f05ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:36.013377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbd2d9-09e3-43c2-b699-cb825b53a7c5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:36.019602 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1437/2896] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:36.020944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894eec0-ab62-4525-a99f-f039991f05ad None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:36.029015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:36.037031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:36.037610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:36.142778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:36.143218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894eec0-ab62-4525-a99f-f039991f05ad None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:36.143423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:36.143423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:36.143908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:36.143908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:36.143908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:36.143908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:36.144364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:17:36.144364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:36.144364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:36.144726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1460/2897] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:17:36.146138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:36.154380 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1438/2898] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:17:36.162356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c2d6d-70a6-4052-8241-bc92aca2b61f service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:36.169089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:36.169713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:36.171694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:36.171926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:36.172837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:36.174956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.139485 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1461/2899] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:36 2022] POST /identity/v3/projects => generated 363 bytes in 994 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:37.140233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.154738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae0dd8-2aab-4d6b-bad2-da634675e8db admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.378396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.379424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.387392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.388247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.389209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.401659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.568325 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1439/2900] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:37 2022] POST /identity/v3/users => generated 282 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:17:37.572526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.588062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4549-f2e8-4448-babe-0216fe98f008 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.599467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.610634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.612877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.612877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.613624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.616422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.633878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1462/2901] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:37.638195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.649041 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:37.654712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942d25-0705-423f-9e62-4984fa207f63 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.666861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ce99a-5491-4a27-9f03-ba95eb6b9cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.668163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce99a-5491-4a27-9f03-ba95eb6b9cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.668611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce99a-5491-4a27-9f03-ba95eb6b9cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.669062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ce99a-5491-4a27-9f03-ba95eb6b9cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.669928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce99a-5491-4a27-9f03-ba95eb6b9cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.672318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ce99a-5491-4a27-9f03-ba95eb6b9cf5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.688245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1440/2902] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:37.692306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.705912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edc83d-e0c2-4882-b49a-b0a02d622504 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.711442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a5a6d-8a8c-43c6-b968-0c877eda6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.712258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5a6d-8a8c-43c6-b968-0c877eda6bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.712643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5a6d-8a8c-43c6-b968-0c877eda6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.713847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5a6d-8a8c-43c6-b968-0c877eda6bc9 admin admin] PATH_INFO: `/v3/projects/71566602401d421e8ba90e1c079c9314/users/38a38185ccdc4f1693d93aeed92c93fd/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.752587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a5a6d-8a8c-43c6-b968-0c877eda6bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71566602401d421e8ba90e1c079c9314, user_id=38a38185ccdc4f1693d93aeed92c93fd, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.758176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a5a6d-8a8c-43c6-b968-0c877eda6bc9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.847378 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1463/2903] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:37 2022] PUT /identity/v3/projects/71566602401d421e8ba90e1c079c9314/users/38a38185ccdc4f1693d93aeed92c93fd/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:37.852676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.863009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.863009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.895401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:37.895401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:38.020529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accf032-7426-4833-af9f-073d4fa3575b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:38.020816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accf032-7426-4833-af9f-073d4fa3575b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:38.021093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accf032-7426-4833-af9f-073d4fa3575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:38.059118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2accf032-7426-4833-af9f-073d4fa3575b None None] MFA Rules not processed for user `ec67c1528a73482881996bfca70e722d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:38.067793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2accf032-7426-4833-af9f-073d4fa3575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:38.086740 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1441/2904] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:38.103075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:38.121867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:38.239537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305f62-44cd-41a2-b26e-cb1344fbd28e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:38.244600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:38.245555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:38.246195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:38.246681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:38.266814 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1464/2905] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:38.269135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:38.271443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:38.285538 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1442/2906] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:17:38.705409 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:39.464831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:39.466100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:39.466728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:39.559206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] MFA Rules not processed for user `ec67c1528a73482881996bfca70e722d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:39.563001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:39.600685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1465/2907] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:39.992117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:39.994641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:40.177458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af6e6c-8a2b-4ad6-aeee-70ec32611d3f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:40.192967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:40.197167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:40.197167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:40.197167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:40.197167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:40.302174 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:40.389664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:40.392455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:40.435778 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1443/2908] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:42.509686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:42.511443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:42.545680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd4ea9-4526-4cd0-92b4-93bb2f9e9613 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:42.552963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:42.553695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:42.555830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:42.556287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:42.558355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:42.585252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:42.587744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:42.627938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1466/2909] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:51.261413 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=10 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:52.597218 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=30 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:52.778773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:52.780259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:52.812035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aa228-c8b2-42e3-98c1-2aef0b4e0f69 service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:52.822771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e828a-37ac-49a6-b763-82fea50998b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:52.823464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e828a-37ac-49a6-b763-82fea50998b1 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:52.823746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e828a-37ac-49a6-b763-82fea50998b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:52.824019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e828a-37ac-49a6-b763-82fea50998b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:52.827248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b60e828a-37ac-49a6-b763-82fea50998b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:52.851673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e828a-37ac-49a6-b763-82fea50998b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:52.853290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e828a-37ac-49a6-b763-82fea50998b1 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:52.885216 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1444/2910] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:53.420022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:53.425029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:53.450381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392fb0-49bf-490e-ba32-b6fa0cf8fef3 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:53.458057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571803b-64a0-4b5d-8825-d5f580450d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:53.458874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571803b-64a0-4b5d-8825-d5f580450d38 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:53.459317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571803b-64a0-4b5d-8825-d5f580450d38 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:53.460065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571803b-64a0-4b5d-8825-d5f580450d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:53.463161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9571803b-64a0-4b5d-8825-d5f580450d38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:53.480933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571803b-64a0-4b5d-8825-d5f580450d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:53.482622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571803b-64a0-4b5d-8825-d5f580450d38 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:53.495400 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1467/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:54.245744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399acf-2e2a-46d3-8d99-fbdfcb766d38 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:54.246681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399acf-2e2a-46d3-8d99-fbdfcb766d38 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:54.246681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399acf-2e2a-46d3-8d99-fbdfcb766d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:54.294440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-56399acf-2e2a-46d3-8d99-fbdfcb766d38 None None] MFA Rules not processed for user `38a38185ccdc4f1693d93aeed92c93fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:54.295937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-56399acf-2e2a-46d3-8d99-fbdfcb766d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:54.453624 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1445/2912] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:54.455265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a91cd8-e932-425f-9e2f-d683b6c5d310 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:54.455788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a91cd8-e932-425f-9e2f-d683b6c5d310 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:54.455930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a91cd8-e932-425f-9e2f-d683b6c5d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:54.509981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b7a91cd8-e932-425f-9e2f-d683b6c5d310 None None] MFA Rules not processed for user `38a38185ccdc4f1693d93aeed92c93fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:54.514053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b7a91cd8-e932-425f-9e2f-d683b6c5d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:54.535672 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1468/2913] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:17:54.782573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399acf-2e2a-46d3-8d99-fbdfcb766d38 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:54.801311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399acf-2e2a-46d3-8d99-fbdfcb766d38 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:54.809701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:54.810854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:54.810854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:54.811740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:54.829766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:54.832541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:54.868098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1446/2914] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:56.074459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a91cd8-e932-425f-9e2f-d683b6c5d310 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:56.097854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a91cd8-e932-425f-9e2f-d683b6c5d310 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:56.113757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9958358-0c40-424d-86fb-bc77b0df62cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:56.115062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958358-0c40-424d-86fb-bc77b0df62cb service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:56.115715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958358-0c40-424d-86fb-bc77b0df62cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:56.116665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958358-0c40-424d-86fb-bc77b0df62cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:56.120892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f9958358-0c40-424d-86fb-bc77b0df62cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:56.163011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9958358-0c40-424d-86fb-bc77b0df62cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:56.178209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9958358-0c40-424d-86fb-bc77b0df62cb service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:56.216616 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1469/2915] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:57.494206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:57.514290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a1c3-9dc7-4f4f-b0ea-df06d74a49be service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:57.532141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:57.534436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:57.534727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:57.535134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:57.539834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:57.675273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:57.681561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:57.719829 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1447/2916] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:57.759701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc317e-d922-4665-bf70-01a3a0315e3c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:57.760261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc317e-d922-4665-bf70-01a3a0315e3c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:57.760366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc317e-d922-4665-bf70-01a3a0315e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:57.798909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fccc317e-d922-4665-bf70-01a3a0315e3c None None] MFA Rules not processed for user `065432e001ed421b9ac1fd19a8f35783`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:57.804241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fccc317e-d922-4665-bf70-01a3a0315e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:57.943363 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1470/2917] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:17:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:05.702481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:05.715743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643df45-4ec9-4a1a-b83c-2548f4c5ed2e service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:05.729006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:05.729699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:05.730684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:05.733205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:05.733483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:05.756090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:05.758226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:05.782347 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1448/2918] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:07.937269 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=40 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:08.187287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5410-3cfd-4938-99b6-4bbdb6b04515 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:08.187287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5410-3cfd-4938-99b6-4bbdb6b04515 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:08.187287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5410-3cfd-4938-99b6-4bbdb6b04515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:08.220872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9f5b5410-3cfd-4938-99b6-4bbdb6b04515 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:08.222505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9f5b5410-3cfd-4938-99b6-4bbdb6b04515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:08.300728 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1471/2919] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:08.317788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:08.520474 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:08.579493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a321-ebb4-41c5-82db-d9f92c525c9d service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:08.587450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:08.588110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:08.588394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:08.588668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:08.599713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:08.604795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:08.654409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1449/2920] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:18:18.293400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9aba-eb84-42e0-a6ee-4b76556a76a5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:18.294564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9aba-eb84-42e0-a6ee-4b76556a76a5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:18.295000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed9aba-eb84-42e0-a6ee-4b76556a76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:18.338198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-43ed9aba-eb84-42e0-a6ee-4b76556a76a5 None None] MFA Rules not processed for user `d3ee5c02cbb740bcab5009471ed98264`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:18.341943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-43ed9aba-eb84-42e0-a6ee-4b76556a76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:18.461534 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1472/2921] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:18.725155 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=12 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:18.976238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:18.991561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65cb1d-cc66-4178-bd1d-42d0048a4ce6 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:19.014481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:19.015474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:19.017507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:19.018058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:19.021258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:19.111246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:19.113247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:19.125051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1450/2922] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:23.674670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:23.675243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:23.675243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:23.722599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:23.725665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:23.742878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1473/2923] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:23.755797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:23.772613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c2d46-c402-4cf5-bc11-8005138375f5 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:23.783190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd754b89-ba15-455a-8a77-3c5563592b3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:23.784240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754b89-ba15-455a-8a77-3c5563592b3c service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:23.784677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754b89-ba15-455a-8a77-3c5563592b3c service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:23.785098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754b89-ba15-455a-8a77-3c5563592b3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:23.812409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd754b89-ba15-455a-8a77-3c5563592b3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:23.815000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd754b89-ba15-455a-8a77-3c5563592b3c service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:23.838195 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1451/2924] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:18:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:18:33.082405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:33.085175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:33.125033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55e858-5f92-407c-942f-3dcfb776fd24 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:33.136483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:33.137304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:33.137711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:33.138146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] PATH_INFO: `/v3/users/4b656391a4564f8aaca14726d52213d1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:33.139632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b656391a4564f8aaca14726d52213d1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:33.142426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:33.374691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b656391a4564f8aaca14726d52213d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:33.379374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b656391a4564f8aaca14726d52213d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:33.474504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b656391a4564f8aaca14726d52213d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:33.487156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b656391a4564f8aaca14726d52213d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:33.488564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b656391a4564f8aaca14726d52213d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:33.496112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:33.497434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:33.497973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:33.539591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:33.540691 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1474/2925] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:18:33 2022] DELETE /identity/v3/users/4b656391a4564f8aaca14726d52213d1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:33.551077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:33.740457 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1452/2926] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:33.759309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:33.760881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:33.801603 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:33.905068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20f596-cb7f-45a6-ba17-8515e1ee9fbd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:33.914324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:33.915130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:33.915562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:33.924227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:33.939500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:33.943305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:33.959051 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1475/2927] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:18:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:18:34.431687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:34.434711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:34.643750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8645d17-40a8-4cd0-83c6-6fef46013747 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:34.669909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:34.671085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:34.682617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:34.684455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] PATH_INFO: `/v3/projects/74edcc8901844248b861c2ca3c5a8a2e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:34.687601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74edcc8901844248b861c2ca3c5a8a2e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:34.692228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:34.887983 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:34.961426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74edcc8901844248b861c2ca3c5a8a2e', 'request_id': 'req-84ab7b6e-7342-4191-a07e-60892669abb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:34.983744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74edcc8901844248b861c2ca3c5a8a2e', 'request_id': 'req-84ab7b6e-7342-4191-a07e-60892669abb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.098212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74edcc8901844248b861c2ca3c5a8a2e', 'request_id': 'req-84ab7b6e-7342-4191-a07e-60892669abb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.138194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] The token cache is being invalidate because project 74edcc8901844248b861c2ca3c5a8a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:18:35.141051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.142845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.150831 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1453/2928] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:18:34 2022] DELETE /identity/v3/projects/74edcc8901844248b861c2ca3c5a8a2e => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:35.151420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:35.180197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e60af8-dbae-4a4c-b848-5eebdf34dd8b service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:35.506951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:35.509586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:35.512319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:35.512718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] PATH_INFO: `/v3/users/085bff1ef64745fc9785a2a8d131191f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:35.518399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085bff1ef64745fc9785a2a8d131191f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:35.529311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:35.863586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085bff1ef64745fc9785a2a8d131191f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.864826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085bff1ef64745fc9785a2a8d131191f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.964721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085bff1ef64745fc9785a2a8d131191f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.977854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085bff1ef64745fc9785a2a8d131191f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:35.980743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75094afe-b123-4a65-a18a-db0fb266f3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085bff1ef64745fc9785a2a8d131191f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:36.086684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1476/2929] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:18:35 2022] DELETE /identity/v3/users/085bff1ef64745fc9785a2a8d131191f => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:18:37.305751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:37.308797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:37.331824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab7b6e-7342-4191-a07e-60892669abb2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:37.611212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:37.611972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:37.612257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:37.612527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] PATH_INFO: `/v3/projects/dd309c9f78ce497eb069e478877e7cf1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:37.613832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd309c9f78ce497eb069e478877e7cf1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:37.616049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:37.860434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd309c9f78ce497eb069e478877e7cf1', 'request_id': 'req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:37.878268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd309c9f78ce497eb069e478877e7cf1', 'request_id': 'req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:37.994102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd309c9f78ce497eb069e478877e7cf1', 'request_id': 'req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:38.021252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] The token cache is being invalidate because project dd309c9f78ce497eb069e478877e7cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:18:38.021591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:38.025634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-84ed41c4-2809-4db0-bdfc-decb1ab59a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:38.029154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1454/2930] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:18:37 2022] DELETE /identity/v3/projects/dd309c9f78ce497eb069e478877e7cf1 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:38.034544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2a810-6196-4900-80eb-4f5843e61b1e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:38.035069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2a810-6196-4900-80eb-4f5843e61b1e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:38.035301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2a810-6196-4900-80eb-4f5843e61b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:38.086310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a1d2a810-6196-4900-80eb-4f5843e61b1e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:38.088374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1d2a810-6196-4900-80eb-4f5843e61b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:38.140554 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:38.293858 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1477/2931] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:38.296165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43535ee-0e2a-4cdb-8cf5-71b6e891b669 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:38.296565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43535ee-0e2a-4cdb-8cf5-71b6e891b669 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:38.296938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43535ee-0e2a-4cdb-8cf5-71b6e891b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:38.343797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b43535ee-0e2a-4cdb-8cf5-71b6e891b669 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:38.349980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b43535ee-0e2a-4cdb-8cf5-71b6e891b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:38.380305 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1455/2932] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:38.384413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2a810-6196-4900-80eb-4f5843e61b1e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:38.395719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2a810-6196-4900-80eb-4f5843e61b1e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:38.413419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:38.414280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:38.414753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:38.415199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:38.416010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:18:38.416476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:38.419589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:38.452463 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1478/2933] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:18:38.461686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43535ee-0e2a-4cdb-8cf5-71b6e891b669 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:38.477066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43535ee-0e2a-4cdb-8cf5-71b6e891b669 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:38.500230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:38.500230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:38.500604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:38.500604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:38.501942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:38.503977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:38.837922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1456/2934] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:18:38 2022] POST /identity/v3/projects => generated 397 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:38.842186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:38.862067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbaff-3721-4ba2-b2e9-d32aa6ee1c51 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:39.066925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:39.068383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:39.068844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:39.070430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:39.071325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:39.082127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:39.489367 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1479/2935] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:18:38 2022] POST /identity/v3/users => generated 299 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:39.489639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:39.508346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb69fbe-03ef-4e9a-834c-d62f811d85c6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:39.530333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:39.531493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:39.531969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:39.533163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:39.534130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:39.539688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:39.570002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:39.571884 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1457/2936] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:18:39.583783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2db15-51a0-4688-a62a-340208eb1cbc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:39.613063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:39.615750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:39.616198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:39.616559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:39.617346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:39.621902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:39.659380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:39.660947 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1480/2937] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:18:39.680639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b106c5-0e3e-4b1c-889c-0090bb5b171d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:39.687094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3785b1-f8cc-4684-a358-137caee001f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:39.687908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3785b1-f8cc-4684-a358-137caee001f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:39.688289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3785b1-f8cc-4684-a358-137caee001f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:39.688759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3785b1-f8cc-4684-a358-137caee001f8 admin admin] PATH_INFO: `/v3/projects/b8a38d6df6144105beefd8b8d84d753c/users/5869d5ecd50247229b6903332837b954/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:39.707293 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:39.737881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:39.744121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:39.770629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3785b1-f8cc-4684-a358-137caee001f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a38d6df6144105beefd8b8d84d753c, user_id=5869d5ecd50247229b6903332837b954, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:39.777293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e856d8-2b9c-4e12-8245-77a48696c803 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:39.788090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3785b1-f8cc-4684-a358-137caee001f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:39.830673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:39.831507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:39.832146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:39.832691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] PATH_INFO: `/v3/users/1ef9ced1581c4375ab34ed0430a7213f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:39.835330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef9ced1581c4375ab34ed0430a7213f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:39.842984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:39.858477 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1458/2938] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:18:39 2022] PUT /identity/v3/projects/b8a38d6df6144105beefd8b8d84d753c/users/5869d5ecd50247229b6903332837b954/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:18:39.870836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae38985-9367-4185-a65d-ade89a14623d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:39.871215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae38985-9367-4185-a65d-ade89a14623d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:39.871563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae38985-9367-4185-a65d-ade89a14623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:39.966798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3ae38985-9367-4185-a65d-ade89a14623d None None] MFA Rules not processed for user `5869d5ecd50247229b6903332837b954`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:39.968222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3ae38985-9367-4185-a65d-ade89a14623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:40.089664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef9ced1581c4375ab34ed0430a7213f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:40.092646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef9ced1581c4375ab34ed0430a7213f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:40.135542 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1459/2939] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:40.214718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef9ced1581c4375ab34ed0430a7213f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:40.238843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef9ced1581c4375ab34ed0430a7213f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:40.244920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9cba099-cde1-4402-a95d-7c31b82dd2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef9ced1581c4375ab34ed0430a7213f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:40.296432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1481/2940] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:18:39 2022] DELETE /identity/v3/users/1ef9ced1581c4375ab34ed0430a7213f => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:41.053654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae38985-9367-4185-a65d-ade89a14623d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:41.143042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae38985-9367-4185-a65d-ade89a14623d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:41.225026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:41.242274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:41.242641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:41.243198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] PATH_INFO: `/v3/projects/7a4379dfb3c142b4bd56159811fd7f47` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:41.245411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4379dfb3c142b4bd56159811fd7f47)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:41.247695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:41.414725 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:41.486787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4379dfb3c142b4bd56159811fd7f47', 'request_id': 'req-d696c398-e00c-4348-8cb8-95497349f055'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:41.510176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4379dfb3c142b4bd56159811fd7f47', 'request_id': 'req-d696c398-e00c-4348-8cb8-95497349f055'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:41.577968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4379dfb3c142b4bd56159811fd7f47', 'request_id': 'req-d696c398-e00c-4348-8cb8-95497349f055'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:41.605621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] The token cache is being invalidate because project 7a4379dfb3c142b4bd56159811fd7f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:18:41.605998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:41.607132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d696c398-e00c-4348-8cb8-95497349f055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:41.612258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1460/2941] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:18:41 2022] DELETE /identity/v3/projects/7a4379dfb3c142b4bd56159811fd7f47 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:41.614424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf759f-169a-41a7-b197-2df9f67c9231 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:41.614951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf759f-169a-41a7-b197-2df9f67c9231 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:41.615049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf759f-169a-41a7-b197-2df9f67c9231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:41.624390 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:41.645072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1ccf759f-169a-41a7-b197-2df9f67c9231 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:41.648475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ccf759f-169a-41a7-b197-2df9f67c9231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:41.824534 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1482/2942] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:41.833034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e45bd9-55c2-4df3-85ae-d6e8fa524076 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:41.833652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e45bd9-55c2-4df3-85ae-d6e8fa524076 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:41.834175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e45bd9-55c2-4df3-85ae-d6e8fa524076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:41.867386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-64e45bd9-55c2-4df3-85ae-d6e8fa524076 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:41.874761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-64e45bd9-55c2-4df3-85ae-d6e8fa524076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:41.888151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1461/2943] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:41.892840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf759f-169a-41a7-b197-2df9f67c9231 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:41.924399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf759f-169a-41a7-b197-2df9f67c9231 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:41.934783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:41.935642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:41.936000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:41.936284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:41.941710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:18:41.942218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:41.943935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:41.990662 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1483/2944] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:18:41.991575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e45bd9-55c2-4df3-85ae-d6e8fa524076 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:42.004746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e45bd9-55c2-4df3-85ae-d6e8fa524076 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:42.019785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:42.020509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:42.021066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:42.021265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:42.022065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:42.024182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:42.147252 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1462/2945] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:18:41 2022] POST /identity/v3/projects => generated 397 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:42.152283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:42.188652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647df96-2380-457c-bbdd-c9e9000358cb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:42.338998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:42.339906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:42.340372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:42.341107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:42.341930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:42.344387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:42.460962 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1484/2946] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:18:42 2022] POST /identity/v3/users => generated 299 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:42.462188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:42.478182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbc77e-a326-4999-aedb-83b7a958758f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:42.498361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:42.499274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:42.505130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:42.505130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:42.505130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:42.505130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:42.539028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:42.539261 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1463/2947] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:18:42.556331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7c64e-675e-44d8-83df-965bb3a09aeb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:42.568586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b783c-e6f5-4c08-8fc0-0dde36cf8ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:42.569226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b783c-e6f5-4c08-8fc0-0dde36cf8ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:42.569505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b783c-e6f5-4c08-8fc0-0dde36cf8ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:42.569774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b783c-e6f5-4c08-8fc0-0dde36cf8ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:42.570470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b783c-e6f5-4c08-8fc0-0dde36cf8ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:42.573046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b783c-e6f5-4c08-8fc0-0dde36cf8ae3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:42.598384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:42.613279 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1485/2948] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:42.616388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7955f8-a906-43f3-96d5-d8fa859684c7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:42.630973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348ba8e-1595-44fa-871a-e5d75e42b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:42.632512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348ba8e-1595-44fa-871a-e5d75e42b9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:42.633021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348ba8e-1595-44fa-871a-e5d75e42b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:42.633345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348ba8e-1595-44fa-871a-e5d75e42b9ee admin admin] PATH_INFO: `/v3/projects/223b82a688f144928e0d6f45d23a1bce/users/aaacd060f9714ced84be4b9920b9fa59/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:42.654896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348ba8e-1595-44fa-871a-e5d75e42b9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=223b82a688f144928e0d6f45d23a1bce, user_id=aaacd060f9714ced84be4b9920b9fa59, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:42.657694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348ba8e-1595-44fa-871a-e5d75e42b9ee admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:42.790763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1464/2949] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:18:42 2022] PUT /identity/v3/projects/223b82a688f144928e0d6f45d23a1bce/users/aaacd060f9714ced84be4b9920b9fa59/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:42.818077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:42.818687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:42.818687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:42.864371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] MFA Rules not processed for user `aaacd060f9714ced84be4b9920b9fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:42.867288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:42.980485 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:42.988708 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1486/2950] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:43.008217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:43.008217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:43.008217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:43.041039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] MFA Rules not processed for user `aaacd060f9714ced84be4b9920b9fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:43.046612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:43.061490 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1465/2951] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:45.874752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:45.877857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:45.955758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:45.958061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.054875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1cd3-1c94-442f-b0de-fb7644e86802 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:46.066922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:46.067893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.068348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.068778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:46.071871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.149914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9edf01-c971-4f51-9ea0-d9420abd3575 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:46.164238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:46.165077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:46.165758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.169664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:46.169795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.169795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] PATH_INFO: `/v3/users/065432e001ed421b9ac1fd19a8f35783` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:46.169795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065432e001ed421b9ac1fd19a8f35783)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:46.172839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:46.179188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1487/2952] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:46.180082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:46.181412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.202595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f502815-c6d8-42aa-b8b9-63d3f5e52ddc service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:46.211844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d3c69-b656-4020-b422-c119abc54ca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:46.212463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d3c69-b656-4020-b422-c119abc54ca4 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.212737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d3c69-b656-4020-b422-c119abc54ca4 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.213062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d3c69-b656-4020-b422-c119abc54ca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:46.215311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-291d3c69-b656-4020-b422-c119abc54ca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.308518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d3c69-b656-4020-b422-c119abc54ca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:46.310433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d3c69-b656-4020-b422-c119abc54ca4 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:46.321570 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1488/2953] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:46.397073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b4f95-5105-49b3-96b7-cf23fd43e3df None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.397319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b4f95-5105-49b3-96b7-cf23fd43e3df None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.397673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b4f95-5105-49b3-96b7-cf23fd43e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:46.434328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e67b4f95-5105-49b3-96b7-cf23fd43e3df None None] MFA Rules not processed for user `5869d5ecd50247229b6903332837b954`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:46.435947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e67b4f95-5105-49b3-96b7-cf23fd43e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.453531 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1489/2954] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:46.456250 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:46.459034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065432e001ed421b9ac1fd19a8f35783'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:46.460372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b4f95-5105-49b3-96b7-cf23fd43e3df None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:46.483670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065432e001ed421b9ac1fd19a8f35783'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:46.495346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b4f95-5105-49b3-96b7-cf23fd43e3df None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:46.500324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065432e001ed421b9ac1fd19a8f35783'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:46.501068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065432e001ed421b9ac1fd19a8f35783'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:46.510577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75126-1395-4dee-9a7d-0a792b85cb22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:46.511563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75126-1395-4dee-9a7d-0a792b85cb22 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.512905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75126-1395-4dee-9a7d-0a792b85cb22 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.513303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75126-1395-4dee-9a7d-0a792b85cb22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:46.520581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aac75126-1395-4dee-9a7d-0a792b85cb22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.545693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75126-1395-4dee-9a7d-0a792b85cb22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:46.552177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75126-1395-4dee-9a7d-0a792b85cb22 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:46.560474 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1490/2955] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:46.571430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb3d3ff4-546a-4002-a098-4555ac16baa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065432e001ed421b9ac1fd19a8f35783'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:46.597759 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1466/2956] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:18:45 2022] DELETE /identity/v3/users/065432e001ed421b9ac1fd19a8f35783 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:46.605567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.606062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.606445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:46.633628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.639131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.642766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:46.678286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:46.679921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.700189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] MFA Rules not processed for user `aaacd060f9714ced84be4b9920b9fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:46.701695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.724681 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:46.800683 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1467/2957] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:46.808472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:46.811091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:46.817161 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1491/2958] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:46.977908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4cd83-c8f5-490a-958a-3d7904a7cdd5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:46.982081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:46.982852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:46.983290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:46.983665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:47.002455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:47.004221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:47.020541 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1468/2959] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:18:47.465020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:47.466528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:47.475054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:47.477313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:47.510995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3293-c422-4214-bc7e-edd80137c444 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:47.511168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e561ea4-7b54-442c-b892-cba23aeff5e9 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:47.523383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:47.524034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:47.524322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:47.529445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] PATH_INFO: `/v3/projects/6f0dbd1455a34a12abebdf3358e52a42` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:47.529445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0dbd1455a34a12abebdf3358e52a42)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:47.530280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:47.530475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:47.531294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:47.531796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:47.532221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] PATH_INFO: `/v3/users/5869d5ecd50247229b6903332837b954` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:47.546217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5869d5ecd50247229b6903332837b954)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:47.548888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:47.704303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0dbd1455a34a12abebdf3358e52a42', 'request_id': 'req-23fffd43-0233-44c7-98bd-40698533dbea'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.717305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0dbd1455a34a12abebdf3358e52a42', 'request_id': 'req-23fffd43-0233-44c7-98bd-40698533dbea'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.805787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0dbd1455a34a12abebdf3358e52a42', 'request_id': 'req-23fffd43-0233-44c7-98bd-40698533dbea'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.815395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5869d5ecd50247229b6903332837b954'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.837651 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:47.844072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5869d5ecd50247229b6903332837b954'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.854605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] The token cache is being invalidate because project 6f0dbd1455a34a12abebdf3358e52a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:18:47.854924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.858880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23fffd43-0233-44c7-98bd-40698533dbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.861157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5869d5ecd50247229b6903332837b954'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.863008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5869d5ecd50247229b6903332837b954'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.867706 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1492/2960] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:18:47 2022] DELETE /identity/v3/projects/6f0dbd1455a34a12abebdf3358e52a42 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:47.878258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ae31-25d3-4b28-991f-07d5ea7e643a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:47.878588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ae31-25d3-4b28-991f-07d5ea7e643a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:47.878873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3ae31-25d3-4b28-991f-07d5ea7e643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:47.945748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-58f3ae31-25d3-4b28-991f-07d5ea7e643a None None] MFA Rules not processed for user `aaacd060f9714ced84be4b9920b9fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:47.955591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5869d5ecd50247229b6903332837b954'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:47.966425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-58f3ae31-25d3-4b28-991f-07d5ea7e643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:47.966579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1469/2961] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:18:47 2022] DELETE /identity/v3/users/5869d5ecd50247229b6903332837b954 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:47.966579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:47.967411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:48.189960 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1493/2962] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:48.191234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:48.191517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:48.191984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:48.211170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114940fe-84cd-4d11-8a84-3786ce5bca78 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:48.223001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:48.223677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:48.224345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:48.224627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:48.225277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:48.226227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] PATH_INFO: `/v3/users/2d6ab910dbbe4af485657719efbd9022` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:48.228773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6ab910dbbe4af485657719efbd9022)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:48.234705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:48.240126 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1494/2963] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:48.249948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:48.261208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:48.394906 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:48.440423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b947391-4d6b-4ccb-a253-fd7d3111a862 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:48.449052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:48.449694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:48.450091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:48.451997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:48.471799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:48.478761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:48.488970 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1495/2964] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:18:48.522113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6ab910dbbe4af485657719efbd9022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:48.541737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6ab910dbbe4af485657719efbd9022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:48.553135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6ab910dbbe4af485657719efbd9022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:48.553981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6ab910dbbe4af485657719efbd9022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:48.679331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2bacb4-aa54-467f-aac4-ae650453df3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6ab910dbbe4af485657719efbd9022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:48.687950 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1470/2965] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:18:47 2022] DELETE /identity/v3/users/2d6ab910dbbe4af485657719efbd9022 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:48.824266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:48.825872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:48.925626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:48.926321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:48.926779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:49.016917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5783b22-133a-40df-8bff-4c83ac3f5ed7 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:49.021446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] MFA Rules not processed for user `aaacd060f9714ced84be4b9920b9fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:49.027933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:49.134321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:49.135324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:49.137110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:49.137581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:49.143286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:49.177108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:49.181201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:49.184580 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1471/2966] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:49.209415 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1496/2967] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:49.242510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:49.244090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:49.249787 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:49.253781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:49.255424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:49.462635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2755dee-32b0-4bbf-b5f0-6738691b081b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:49.468738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:49.472485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:49.472485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:49.472485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] PATH_INFO: `/v3/projects/b8a38d6df6144105beefd8b8d84d753c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:49.472485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a38d6df6144105beefd8b8d84d753c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:49.475356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:49.490062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073461-082b-4a05-86e9-63818895a6e8 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:49.497341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:49.498271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:49.499445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:49.499922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] PATH_INFO: `/v3/projects/943c1a6c3aa243458b9f4a9549e7188e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:49.503903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=943c1a6c3aa243458b9f4a9549e7188e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:49.506869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:49.521914 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:49.586322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a38d6df6144105beefd8b8d84d753c', 'request_id': 'req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.595652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a38d6df6144105beefd8b8d84d753c', 'request_id': 'req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.677607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943c1a6c3aa243458b9f4a9549e7188e', 'request_id': 'req-b2bdb380-657a-4130-9dc1-c8f028782680'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.686014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943c1a6c3aa243458b9f4a9549e7188e', 'request_id': 'req-b2bdb380-657a-4130-9dc1-c8f028782680'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.709191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a38d6df6144105beefd8b8d84d753c', 'request_id': 'req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.726524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] The token cache is being invalidate because project b8a38d6df6144105beefd8b8d84d753c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:18:49.726828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.727557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-81c01b7e-c1d6-4c45-ae8e-d0a79f3b2727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.729582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1472/2968] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:18:49 2022] DELETE /identity/v3/projects/b8a38d6df6144105beefd8b8d84d753c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:49.734783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad36fe-d576-4615-8d2e-2f3ccdd4d4c9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:49.735160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad36fe-d576-4615-8d2e-2f3ccdd4d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:49.735608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad36fe-d576-4615-8d2e-2f3ccdd4d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:49.778409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-33ad36fe-d576-4615-8d2e-2f3ccdd4d4c9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:49.779728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-33ad36fe-d576-4615-8d2e-2f3ccdd4d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:49.818357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943c1a6c3aa243458b9f4a9549e7188e', 'request_id': 'req-b2bdb380-657a-4130-9dc1-c8f028782680'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.852375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] The token cache is being invalidate because project 943c1a6c3aa243458b9f4a9549e7188e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:18:49.855320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.856305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2bdb380-657a-4130-9dc1-c8f028782680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:49.867775 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1497/2969] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:18:49 2022] DELETE /identity/v3/projects/943c1a6c3aa243458b9f4a9549e7188e => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:49.869403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992452b6-e6d6-4527-ae1b-7fe6ef88d2f1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:49.869782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992452b6-e6d6-4527-ae1b-7fe6ef88d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:49.876588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992452b6-e6d6-4527-ae1b-7fe6ef88d2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:49.900843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-992452b6-e6d6-4527-ae1b-7fe6ef88d2f1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:49.904056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-992452b6-e6d6-4527-ae1b-7fe6ef88d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:49.946799 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1473/2970] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:49.954224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b0188-6481-45d4-bd19-238b1ea316be None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:49.955451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b0188-6481-45d4-bd19-238b1ea316be None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:49.955795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b0188-6481-45d4-bd19-238b1ea316be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:49.980202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e94b0188-6481-45d4-bd19-238b1ea316be None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:49.982345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e94b0188-6481-45d4-bd19-238b1ea316be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:49.998222 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1474/2971] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:50.000181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b0188-6481-45d4-bd19-238b1ea316be None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.015034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b0188-6481-45d4-bd19-238b1ea316be None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:50.021428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:50.022534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.023289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.023666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.024533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:18:50.024938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:50.026767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:50.045858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1475/2972] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:18:50.047726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.065895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1498/2973] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:50.073710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474fa74-0e8e-4273-958c-1392be2fbdb7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.074274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474fa74-0e8e-4273-958c-1392be2fbdb7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.074747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474fa74-0e8e-4273-958c-1392be2fbdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.076751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35634f9b-56b5-4bf0-97cd-ea060399a0a8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:50.090410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:50.091317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.092255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.094352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.100715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:50.100715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:50.118677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5474fa74-0e8e-4273-958c-1392be2fbdb7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:50.124638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5474fa74-0e8e-4273-958c-1392be2fbdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:50.132252 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:50.155940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1499/2974] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:50.166767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474fa74-0e8e-4273-958c-1392be2fbdb7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.184911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474fa74-0e8e-4273-958c-1392be2fbdb7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:50.197858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:50.198769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.201770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.201770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.201770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:18:50.201770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:50.203813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:50.239601 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1476/2975] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:18:50 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:50.244082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.245100 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1500/2976] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:18:50.246190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.274621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498bb2-ccf3-4bfc-8978-610e66257321 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:50.394167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05311ca-49d5-4fc4-b1e6-ef862adecb92 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:50.402989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddca5a-5ef8-4726-bbaa-3776a93b8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:50.404523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddca5a-5ef8-4726-bbaa-3776a93b8f7e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.404953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddca5a-5ef8-4726-bbaa-3776a93b8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.405250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddca5a-5ef8-4726-bbaa-3776a93b8f7e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.406106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddca5a-5ef8-4726-bbaa-3776a93b8f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:50.408290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddca5a-5ef8-4726-bbaa-3776a93b8f7e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:50.419871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:50.420988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.425426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.425426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.425426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:50.429456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:50.553256 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1477/2977] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:18:50 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:50.555012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69e85-8a27-4bc0-a21a-43bb84b5cf6e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.555370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69e85-8a27-4bc0-a21a-43bb84b5cf6e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.555659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69e85-8a27-4bc0-a21a-43bb84b5cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.567124 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1501/2978] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:18:50 2022] POST /identity/v3/projects => generated 383 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:50.569846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.606507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6fc69e85-8a27-4bc0-a21a-43bb84b5cf6e None None] MFA Rules not processed for user `aaacd060f9714ced84be4b9920b9fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:50.612012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6fc69e85-8a27-4bc0-a21a-43bb84b5cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:50.616103 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:50.732907 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1478/2979] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:50.732907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc69e85-8a27-4bc0-a21a-43bb84b5cf6e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.819345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98f600-60f9-462e-833e-31b05919c037 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:50.825727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:50.826402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.826682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.826951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.827601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:50.829223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:50.846996 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1502/2980] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:50.847760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:50.854448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc69e85-8a27-4bc0-a21a-43bb84b5cf6e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:50.859449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:50.861236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:50.862094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:50.862494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:50.862868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:50.863624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:50.865879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:50.986738 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1479/2981] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:18:50 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:50.988866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:51.003600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b68d01-4d6e-44f4-a603-59ad21c0f2a3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:51.009711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5625e38-44f5-4345-837f-c862ceddd284 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:51.013403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:51.014220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.014496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.014779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:51.016702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:51.036505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:51.039280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.040041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.042544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:51.043310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:51.044968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:51.072299 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1480/2982] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:51.073624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:51.075422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:51.087298 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:51.092270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fe4d3-6093-47fd-9313-f0e0fec30cd6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:51.169432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:51.169432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.169432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.169432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] PATH_INFO: `/v3/users/aaacd060f9714ced84be4b9920b9fa59` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:51.171174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaacd060f9714ced84be4b9920b9fa59)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:51.171174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:51.171904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:51.171904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:51.171904 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1503/2983] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:51.171904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:51.171904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777685a-c306-49d4-9676-58f00069e38c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:51.177428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:51.178498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.178994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.179514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:51.180342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:51.182191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:51.193694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1504/2984] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:51.194617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:51.205802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a90fc-6fcc-41db-b628-8a2ea6287af4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:51.214020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:51.214685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.215001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.215283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] PATH_INFO: `/v3/projects/bc488ecc9b0f4f9dbc46a54d982e2e34/users/448684b1bbe546398989daf12dbba7cd/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:51.231723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc488ecc9b0f4f9dbc46a54d982e2e34, user_id=448684b1bbe546398989daf12dbba7cd, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:51.234489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:51.659603 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1505/2985] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:18:51 2022] PUT /identity/v3/projects/bc488ecc9b0f4f9dbc46a54d982e2e34/users/448684b1bbe546398989daf12dbba7cd/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:51.660513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:51.662097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:51.673209 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:51.736261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95cd98-7e01-4108-91cf-9eb6f6539e02 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:51.741771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:51.742411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.742695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.742970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:51.744703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:51.758689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:51.760151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:51.772196 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1506/2986] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:51.773006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:51.806926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaacd060f9714ced84be4b9920b9fa59'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:51.834684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaacd060f9714ced84be4b9920b9fa59'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:51.844584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaacd060f9714ced84be4b9920b9fa59'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:51.846338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaacd060f9714ced84be4b9920b9fa59'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:51.854871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae42e00-7b64-44b1-8d93-435996158cc7 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:51.858832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:51.859498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.859769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.860190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:51.863066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:51.874192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:51.875654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:51.887026 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1507/2987] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:51.898481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:51.901213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:51.943431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-536a891a-7500-48ae-8d35-08ec376b83e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaacd060f9714ced84be4b9920b9fa59'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:51.955285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1481/2988] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:18:51 2022] DELETE /identity/v3/users/aaacd060f9714ced84be4b9920b9fa59 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:51.957058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1807f4-12d2-4586-b21f-7398dce4b643 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:51.957448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1807f4-12d2-4586-b21f-7398dce4b643 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:51.957838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1807f4-12d2-4586-b21f-7398dce4b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.005232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6d1807f4-12d2-4586-b21f-7398dce4b643 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:52.007199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6d1807f4-12d2-4586-b21f-7398dce4b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:52.029024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ace150-0fcc-4fc1-ac78-0e986b8f9c19 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:52.197184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1482/2989] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:52.197184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3704c-dcb6-466a-a471-6217f4a1ed7d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:52.197184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3704c-dcb6-466a-a471-6217f4a1ed7d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:52.197184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3704c-dcb6-466a-a471-6217f4a1ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.210167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:52.210798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:52.211081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:52.211781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.212000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:52.213853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:52.238673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1508/2990] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:52.239621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:52.241480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dba3704c-dcb6-466a-a471-6217f4a1ed7d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:52.242918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dba3704c-dcb6-466a-a471-6217f4a1ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:52.249381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:52.251564 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1483/2991] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:52.252408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3704c-dcb6-466a-a471-6217f4a1ed7d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:52.275507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3704c-dcb6-466a-a471-6217f4a1ed7d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:52.287545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c05353-daab-4fdb-8cce-6a37e490ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:52.289333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c05353-daab-4fdb-8cce-6a37e490ddf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:52.290634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c05353-daab-4fdb-8cce-6a37e490ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:52.291035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c05353-daab-4fdb-8cce-6a37e490ddf3 admin admin] PATH_INFO: `/v3/projects/ec8225f796ab433b9260b0af5874025b/users/81c50e66203b49cbb601370e2b0555ef/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.324309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c05353-daab-4fdb-8cce-6a37e490ddf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8225f796ab433b9260b0af5874025b, user_id=81c50e66203b49cbb601370e2b0555ef, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:52.332507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c05353-daab-4fdb-8cce-6a37e490ddf3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:52.372413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6e99-9fa3-4ab2-97fb-178a328b3414 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:52.378982 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:52.385710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:52.386410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:52.386729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:52.387142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.400083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:52.409132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:52.424037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1509/2992] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:52.425375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:52.437109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d84e-1203-4c5a-9f64-e654d7238c56 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:52.442789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:52.443508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:52.444150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:52.444443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.459803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:52.461432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:52.486642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1484/2993] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:18:52 2022] PUT /identity/v3/projects/ec8225f796ab433b9260b0af5874025b/users/81c50e66203b49cbb601370e2b0555ef/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:52.498504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be6a7-3bd1-46ff-8ca2-b97d5d1cc0c1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:52.499485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be6a7-3bd1-46ff-8ca2-b97d5d1cc0c1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:52.499951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be6a7-3bd1-46ff-8ca2-b97d5d1cc0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.542395 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1510/2994] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:52.565023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8d5be6a7-3bd1-46ff-8ca2-b97d5d1cc0c1 None None] MFA Rules not processed for user `81c50e66203b49cbb601370e2b0555ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:52.599622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8d5be6a7-3bd1-46ff-8ca2-b97d5d1cc0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:52.606884 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:52.653675 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1485/2995] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:52.654036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:52.664846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7030261-4f55-4808-acdc-de3cb39c5f4f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:52.749691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:52.751153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:52.751546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:52.752324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:52.752698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:52.754807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:52.881619 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1511/2996] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:18:52 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:18:52.885460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be6a7-3bd1-46ff-8ca2-b97d5d1cc0c1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:52.911045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be6a7-3bd1-46ff-8ca2-b97d5d1cc0c1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:53.047044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:53.051612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.051612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.051612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.051612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:53.052384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:53.229731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1486/2997] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:18:52 2022] POST /identity/v3/users => generated 298 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:18:53.234014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:53.259813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37291832-dc72-4021-a399-f02fad0f9e64 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:53.278239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:53.278962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.279311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.279649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.280374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:53.282088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:53.302179 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1512/2998] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:53.306837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:53.322863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:53.324732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791f25d-c333-41f6-b477-30c994a88c8e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:53.325608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:53.332690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:53.333415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.333701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.334025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] PATH_INFO: `/v3/projects/11c547b190cb479888e1b74db1436149/users/ff924d0a34394f8280bfcda1d656ffb6/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.358962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c547b190cb479888e1b74db1436149, user_id=ff924d0a34394f8280bfcda1d656ffb6, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:53.363422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228b816-3abd-4242-bf61-a6f6bf236b36 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:53.377507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:53.377507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.377507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.377507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] PATH_INFO: `/v3/projects/223b82a688f144928e0d6f45d23a1bce` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.378710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223b82a688f144928e0d6f45d23a1bce)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:53.386528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:53.388331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:53.458866 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1487/2999] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:18:53 2022] PUT /identity/v3/projects/11c547b190cb479888e1b74db1436149/users/ff924d0a34394f8280bfcda1d656ffb6/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:18:53.465908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:53.539441 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:53.544358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223b82a688f144928e0d6f45d23a1bce', 'request_id': 'req-6edd9281-48d9-4fe7-81c7-a45c24918a47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:53.553661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223b82a688f144928e0d6f45d23a1bce', 'request_id': 'req-6edd9281-48d9-4fe7-81c7-a45c24918a47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:53.561593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71db4d9-8911-4d18-baad-e7c136c9cfe8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:53.611944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223b82a688f144928e0d6f45d23a1bce', 'request_id': 'req-6edd9281-48d9-4fe7-81c7-a45c24918a47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:53.630951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] The token cache is being invalidate because project 223b82a688f144928e0d6f45d23a1bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:18:53.631243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:53.632343 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:53.633336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6edd9281-48d9-4fe7-81c7-a45c24918a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:18:53.634963 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1513/3000] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:18:53 2022] DELETE /identity/v3/projects/223b82a688f144928e0d6f45d23a1bce => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:18:53.639761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af98f-286d-463e-9027-302d5032d8c9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.640042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af98f-286d-463e-9027-302d5032d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.640313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af98f-286d-463e-9027-302d5032d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.651708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:53.651708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.651708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.651708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.652304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:53.652304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:53.666021 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1488/3001] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:18:53.669966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:53.672678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:53.689641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1b6af98f-286d-463e-9027-302d5032d8c9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:53.691085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b6af98f-286d-463e-9027-302d5032d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:53.691898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb61a-ed2d-4536-9bd9-40223269d6eb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:53.698619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73299187-54eb-4c99-92fd-93f2a9857ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:53.703096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299187-54eb-4c99-92fd-93f2a9857ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.703096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299187-54eb-4c99-92fd-93f2a9857ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.703096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73299187-54eb-4c99-92fd-93f2a9857ce5 admin admin] PATH_INFO: `/v3/projects/11c547b190cb479888e1b74db1436149/users/ff924d0a34394f8280bfcda1d656ffb6/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.704474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73299187-54eb-4c99-92fd-93f2a9857ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c547b190cb479888e1b74db1436149, user_id=ff924d0a34394f8280bfcda1d656ffb6, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:53.706674 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1514/3002] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:53.708405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73299187-54eb-4c99-92fd-93f2a9857ce5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:53.713790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4fdb-9f0f-4642-a1fb-0e47192a5166 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.714426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4fdb-9f0f-4642-a1fb-0e47192a5166 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.714941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c4fdb-9f0f-4642-a1fb-0e47192a5166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.722111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1489/3003] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:18:53 2022] PUT /identity/v3/projects/11c547b190cb479888e1b74db1436149/users/ff924d0a34394f8280bfcda1d656ffb6/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:18:53.738136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8f11-8545-413d-bd85-9a9d2d130c88 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.739125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8f11-8545-413d-bd85-9a9d2d130c88 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.739677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8f11-8545-413d-bd85-9a9d2d130c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.747928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a26c4fdb-9f0f-4642-a1fb-0e47192a5166 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:53.749122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a26c4fdb-9f0f-4642-a1fb-0e47192a5166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:53.783254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a11d8f11-8545-413d-bd85-9a9d2d130c88 None None] MFA Rules not processed for user `ff924d0a34394f8280bfcda1d656ffb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:53.785001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a11d8f11-8545-413d-bd85-9a9d2d130c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:53.911329 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1515/3004] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:53.915145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4fdb-9f0f-4642-a1fb-0e47192a5166 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:53.935040 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1490/3005] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:53.940479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c4fdb-9f0f-4642-a1fb-0e47192a5166 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:53.940637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7e3fa-452e-4a38-92fc-d48a37ad9a74 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.940637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7e3fa-452e-4a38-92fc-d48a37ad9a74 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.940637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7e3fa-452e-4a38-92fc-d48a37ad9a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.967971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:53.967971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:53.967971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:53.967971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:53.968547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:18:53.968547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:53.968871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.010641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bad7e3fa-452e-4a38-92fc-d48a37ad9a74 None None] MFA Rules not processed for user `81c50e66203b49cbb601370e2b0555ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:54.011866 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1516/3006] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:18:54.012382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bad7e3fa-452e-4a38-92fc-d48a37ad9a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:54.016896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:54.075700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fc123-9818-466d-99ee-75dc935ce6ed admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:54.088321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:54.088934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.089531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.092513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.093416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:54.099172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.160755 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1491/3007] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:54.162537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.163216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.163506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.187018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:54.188448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:54.258256 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1517/3008] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:18:54 2022] POST /identity/v3/projects => generated 399 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:54.262524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:54.299422 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1492/3009] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:54.321262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:54.323181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:54.336964 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:54.401485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bd0ff-464c-4ad2-9360-720b0e23c957 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:54.415609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:54.416466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.416755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.417390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.418435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:54.420559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.461018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d08e7-8c57-477b-be0a-6f4f517df2e4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:54.530871 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1518/3010] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:18:54 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:18:54.536189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:54.547042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df885-4c96-4163-a1f8-4de11ac1c222 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:54.553231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:54.553886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.554169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.554465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.555469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:54.558647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.565299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:54.565961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.566402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.566690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.574057 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1519/3011] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:54.578547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:54.594873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c476e-0161-48d7-ad15-81a729563f3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:54.601342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:54.602765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.603252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.605843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.606936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:54.609587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.612339 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:54.625437 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1520/3012] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:18:54.629320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:54.638508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:54.646048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.646196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c66fa-2bbb-47d8-9f4a-5524b691a959 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:54.651131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734df71-5d71-4fd4-94ed-99e57e153df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:54.651778 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1493/3013] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:18:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:18:54.652735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:54.654786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:54.662182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734df71-5d71-4fd4-94ed-99e57e153df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.662470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734df71-5d71-4fd4-94ed-99e57e153df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.662837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734df71-5d71-4fd4-94ed-99e57e153df5 admin admin] PATH_INFO: `/v3/projects/b782348bd6a446e68b576085029cd72d/users/fe427bb50de042acbdcff23ab0efbfc9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.686492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734df71-5d71-4fd4-94ed-99e57e153df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b782348bd6a446e68b576085029cd72d, user_id=fe427bb50de042acbdcff23ab0efbfc9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:54.689358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734df71-5d71-4fd4-94ed-99e57e153df5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.754143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb7d0-1956-4a59-a5ea-297512ba9884 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:54.761607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf015f-5463-4c63-aa8c-8a4b929b37d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:54.762181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf015f-5463-4c63-aa8c-8a4b929b37d3 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.762509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf015f-5463-4c63-aa8c-8a4b929b37d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.762736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf015f-5463-4c63-aa8c-8a4b929b37d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.764637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cacf015f-5463-4c63-aa8c-8a4b929b37d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:54.824611 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1521/3014] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:18:54 2022] PUT /identity/v3/projects/b782348bd6a446e68b576085029cd72d/users/fe427bb50de042acbdcff23ab0efbfc9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:18:54.832323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.833351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.833773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf015f-5463-4c63-aa8c-8a4b929b37d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:54.834294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.835481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf015f-5463-4c63-aa8c-8a4b929b37d3 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:54.853626 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1494/3015] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:54.892027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:54.893594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:54.917715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c698b4-6c38-4b03-aec7-012ef6612c7d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:54.918049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c698b4-6c38-4b03-aec7-012ef6612c7d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:54.918928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c698b4-6c38-4b03-aec7-012ef6612c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:54.952084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-78c698b4-6c38-4b03-aec7-012ef6612c7d None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:54.953462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-78c698b4-6c38-4b03-aec7-012ef6612c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:55.003710 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1522/3016] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:55.021196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:55.022616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:55.067617 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1495/3017] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:18:55.084982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c698b4-6c38-4b03-aec7-012ef6612c7d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:55.114092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d5b2-208b-4884-9369-14d318b97803 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:55.118795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71aea-0f4f-4fa7-b282-e66026400605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:55.119418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71aea-0f4f-4fa7-b282-e66026400605 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:55.119749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71aea-0f4f-4fa7-b282-e66026400605 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:55.120024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71aea-0f4f-4fa7-b282-e66026400605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:55.144829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71aea-0f4f-4fa7-b282-e66026400605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:55.144829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71aea-0f4f-4fa7-b282-e66026400605 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:55.151258 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1523/3018] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:55.185598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c698b4-6c38-4b03-aec7-012ef6612c7d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:55.192332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:55.193072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:55.193479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:55.193900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:55.203369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:55.211658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:55.217632 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:55.223141 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1496/3019] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:18:58.055145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7b9d6-221b-44e0-820d-fa29f339f4f7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:58.056123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7b9d6-221b-44e0-820d-fa29f339f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:58.056567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7b9d6-221b-44e0-820d-fa29f339f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:58.091856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a2a7b9d6-221b-44e0-820d-fa29f339f4f7 None None] MFA Rules not processed for user `38a38185ccdc4f1693d93aeed92c93fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:58.095987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a2a7b9d6-221b-44e0-820d-fa29f339f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:58.253560 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1524/3020] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:00.618096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:00.619627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:00.641475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be90144-c7c5-4e24-aae5-5fe89d977138 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:00.655303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e087de-802d-4c55-af00-a93961951331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:00.655303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e087de-802d-4c55-af00-a93961951331 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:00.655303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e087de-802d-4c55-af00-a93961951331 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:00.655303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e087de-802d-4c55-af00-a93961951331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:00.666556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-85e087de-802d-4c55-af00-a93961951331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:00.682442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e087de-802d-4c55-af00-a93961951331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:00.684432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e087de-802d-4c55-af00-a93961951331 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:00.705828 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1497/3021] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:19:08.229064 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:10.698723 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:11.024445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7b9d6-221b-44e0-820d-fa29f339f4f7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:11.044304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7b9d6-221b-44e0-820d-fa29f339f4f7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:11.059253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b3882-6f85-4bc8-99e8-c994ef2a0066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:11.060066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3882-6f85-4bc8-99e8-c994ef2a0066 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:11.062535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3882-6f85-4bc8-99e8-c994ef2a0066 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:11.063240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3882-6f85-4bc8-99e8-c994ef2a0066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:11.077502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cc3b3882-6f85-4bc8-99e8-c994ef2a0066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:11.148975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:11.149344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:11.149719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:11.215582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] MFA Rules not processed for user `fe427bb50de042acbdcff23ab0efbfc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:11.218584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:11.259127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b3882-6f85-4bc8-99e8-c994ef2a0066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:11.260950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b3882-6f85-4bc8-99e8-c994ef2a0066 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:11.308898 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1525/3022] 10.222.0.59 () {60 vars in 1396 bytes} [Sun Aug 28 01:19:11 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:19:11.463525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1498/3023] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:11.474770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fa62-7edd-44c2-b7cb-52c824343323 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:11.479436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fa62-7edd-44c2-b7cb-52c824343323 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:11.479436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77fa62-7edd-44c2-b7cb-52c824343323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:11.516117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1a77fa62-7edd-44c2-b7cb-52c824343323 None None] MFA Rules not processed for user `fe427bb50de042acbdcff23ab0efbfc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:11.539373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1a77fa62-7edd-44c2-b7cb-52c824343323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:11.561957 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1526/3024] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:11.824172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:11.825621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:12.008141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b785-8f36-4582-b45f-9a27a0166c2f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:12.008717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b785-8f36-4582-b45f-9a27a0166c2f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:12.009357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b785-8f36-4582-b45f-9a27a0166c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:12.019559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0e7e5-11cd-40e7-9a37-a310c2625b99 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:12.037909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:12.040370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:12.042567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:12.043402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:12.075031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:12.076818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:12.107164 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1499/3025] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:19:12.186397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eaa9b785-8f36-4582-b45f-9a27a0166c2f None None] MFA Rules not processed for user `448684b1bbe546398989daf12dbba7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:12.187654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eaa9b785-8f36-4582-b45f-9a27a0166c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:12.487652 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1527/3026] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:19:12.851650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:12.869915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3386-4ca3-4636-8d14-5af774226524 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:12.891400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca9366-40fb-454a-88ff-f545f3662a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:12.892041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca9366-40fb-454a-88ff-f545f3662a8c service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:12.892325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca9366-40fb-454a-88ff-f545f3662a8c service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:12.892795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca9366-40fb-454a-88ff-f545f3662a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:12.921659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca9366-40fb-454a-88ff-f545f3662a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:12.923364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca9366-40fb-454a-88ff-f545f3662a8c service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:12.972182 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1500/3027] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:19:15.023585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:15.024526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:15.024986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:15.085552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] MFA Rules not processed for user `29f68fba91f1433bb6d51e956ea19022`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:15.087275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:15.296122 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1528/3028] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:21.247666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff419e8-f455-42f9-a571-e4b55b917c3a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:21.248269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff419e8-f455-42f9-a571-e4b55b917c3a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:21.248556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff419e8-f455-42f9-a571-e4b55b917c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:21.281238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cff419e8-f455-42f9-a571-e4b55b917c3a None None] MFA Rules not processed for user `448684b1bbe546398989daf12dbba7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:21.283830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cff419e8-f455-42f9-a571-e4b55b917c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:21.297430 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1501/3029] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:25.259966 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:29.976275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:29.977745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:30.068332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed54c-c851-4297-9a1e-5f8c51b35605 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:30.081983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29204cec-ec89-4f8a-b295-8ec6f2c1d665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:30.081983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204cec-ec89-4f8a-b295-8ec6f2c1d665 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:30.081983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204cec-ec89-4f8a-b295-8ec6f2c1d665 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:30.081983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204cec-ec89-4f8a-b295-8ec6f2c1d665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:30.083910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-29204cec-ec89-4f8a-b295-8ec6f2c1d665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:30.097426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29204cec-ec89-4f8a-b295-8ec6f2c1d665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:30.098909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29204cec-ec89-4f8a-b295-8ec6f2c1d665 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:30.113733 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1529/3030] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:19:31.218082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff419e8-f455-42f9-a571-e4b55b917c3a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:31.245247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff419e8-f455-42f9-a571-e4b55b917c3a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:31.260780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ac5fe-e1d7-4694-b883-8b574d022491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:31.262847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac5fe-e1d7-4694-b883-8b574d022491 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:31.263393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac5fe-e1d7-4694-b883-8b574d022491 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:31.263828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac5fe-e1d7-4694-b883-8b574d022491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:31.379319 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:31.416456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ac5fe-e1d7-4694-b883-8b574d022491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:31.422282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ac5fe-e1d7-4694-b883-8b574d022491 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:31.461424 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1502/3031] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:19:32.715232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e0bd-64c4-41e8-90e5-5870b5311c55 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:32.715765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e0bd-64c4-41e8-90e5-5870b5311c55 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:32.715765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e0bd-64c4-41e8-90e5-5870b5311c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:32.740822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bda0e0bd-64c4-41e8-90e5-5870b5311c55 None None] MFA Rules not processed for user `81c50e66203b49cbb601370e2b0555ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:32.744126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bda0e0bd-64c4-41e8-90e5-5870b5311c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:32.879972 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1530/3032] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:34.800313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d67c2-89a0-4d5d-bbf3-8ccd39a92bdc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:34.800845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d67c2-89a0-4d5d-bbf3-8ccd39a92bdc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:34.800845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d67c2-89a0-4d5d-bbf3-8ccd39a92bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:34.843358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6a0d67c2-89a0-4d5d-bbf3-8ccd39a92bdc None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:34.844598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6a0d67c2-89a0-4d5d-bbf3-8ccd39a92bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:34.862197 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1503/3033] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:34.890756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e0bd-64c4-41e8-90e5-5870b5311c55 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:34.906743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e0bd-64c4-41e8-90e5-5870b5311c55 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:34.912734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:34.913350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:34.921993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:34.921993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:34.923205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:34.925721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:34.935630 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1531/3034] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:19:44.822296 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:44.932447 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=66 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:49.891052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d67c2-89a0-4d5d-bbf3-8ccd39a92bdc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:49.914889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d67c2-89a0-4d5d-bbf3-8ccd39a92bdc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:49.935862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:49.940763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:49.940763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:49.941550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:49.949948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:50.176641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:50.180241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:50.219235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1504/3035] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:00.195176 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=30 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:00.245286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:00.249692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:00.439397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93c4e6-267a-4f89-a120-d8319fee563f service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:00.451743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72b08c-c487-40a4-8c9b-3fe7b19e8170 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:00.452624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72b08c-c487-40a4-8c9b-3fe7b19e8170 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:00.453085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72b08c-c487-40a4-8c9b-3fe7b19e8170 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:00.453539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72b08c-c487-40a4-8c9b-3fe7b19e8170 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:00.460180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cc72b08c-c487-40a4-8c9b-3fe7b19e8170 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:00.492129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72b08c-c487-40a4-8c9b-3fe7b19e8170 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:00.497383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:00.505227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72b08c-c487-40a4-8c9b-3fe7b19e8170 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:00.511000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb8187-2a3c-4771-8914-6f3e63bf12a7 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:00.524564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:00.525482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:00.526223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:00.526729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] PATH_INFO: `/v3/users/fe427bb50de042acbdcff23ab0efbfc9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:00.542240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe427bb50de042acbdcff23ab0efbfc9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:00.546204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:00.548804 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1532/3036] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:00.828221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe427bb50de042acbdcff23ab0efbfc9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:00.859061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe427bb50de042acbdcff23ab0efbfc9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:00.871118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe427bb50de042acbdcff23ab0efbfc9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:00.871881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe427bb50de042acbdcff23ab0efbfc9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:00.967347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe427bb50de042acbdcff23ab0efbfc9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:00.986418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1505/3037] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:00 2022] DELETE /identity/v3/users/fe427bb50de042acbdcff23ab0efbfc9 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:01.039960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:01.041162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:01.041444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:01.079031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:01.086192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:01.248921 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1533/3038] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:01.267506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:01.270034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:01.401560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f89428-327b-414f-8f09-21852e69750f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:01.417744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee605e-6da4-40c9-9d2d-499e3f326163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:01.421958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee605e-6da4-40c9-9d2d-499e3f326163 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:01.421958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee605e-6da4-40c9-9d2d-499e3f326163 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:01.421958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee605e-6da4-40c9-9d2d-499e3f326163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:01.440891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee605e-6da4-40c9-9d2d-499e3f326163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:01.442565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee605e-6da4-40c9-9d2d-499e3f326163 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:01.453914 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1506/3039] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:20:01.510491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:01.513698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:01.670473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60e29-6339-4581-93d5-3620eddf5ceb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:01.682658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:01.685267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:01.686700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:01.687530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] PATH_INFO: `/v3/projects/b782348bd6a446e68b576085029cd72d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:01.690844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b782348bd6a446e68b576085029cd72d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:01.696564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:01.847127 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:01.863663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b782348bd6a446e68b576085029cd72d', 'request_id': 'req-00a52da2-8129-42a7-a32c-7aefdb233f77'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:01.873761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b782348bd6a446e68b576085029cd72d', 'request_id': 'req-00a52da2-8129-42a7-a32c-7aefdb233f77'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:02.020012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b782348bd6a446e68b576085029cd72d', 'request_id': 'req-00a52da2-8129-42a7-a32c-7aefdb233f77'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:02.043149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] The token cache is being invalidate because project b782348bd6a446e68b576085029cd72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:02.043727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:02.044456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00a52da2-8129-42a7-a32c-7aefdb233f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:02.049685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1534/3040] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:01 2022] DELETE /identity/v3/projects/b782348bd6a446e68b576085029cd72d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:02.051831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5deb56-9a0d-4401-9059-7530caa17650 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.052119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5deb56-9a0d-4401-9059-7530caa17650 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.052398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5deb56-9a0d-4401-9059-7530caa17650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.074824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2b5deb56-9a0d-4401-9059-7530caa17650 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:02.076253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2b5deb56-9a0d-4401-9059-7530caa17650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:02.140932 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1507/3041] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:02.150039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a963c-507a-4093-9e89-843ace3e6b08 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.150328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a963c-507a-4093-9e89-843ace3e6b08 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.150607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a963c-507a-4093-9e89-843ace3e6b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.179315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8c6a963c-507a-4093-9e89-843ace3e6b08 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:02.180612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8c6a963c-507a-4093-9e89-843ace3e6b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:02.192212 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1535/3042] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:02.195515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5deb56-9a0d-4401-9059-7530caa17650 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:02.202027 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:02.208654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5deb56-9a0d-4401-9059-7530caa17650 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:02.225740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:02.225740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.225740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.225740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.226408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:20:02.226408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:02.226408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:02.244570 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1508/3043] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:20:02.249218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a963c-507a-4093-9e89-843ace3e6b08 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:02.260190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a963c-507a-4093-9e89-843ace3e6b08 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:02.265464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:02.266207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.266561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.267000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.268470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:02.271811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:02.382160 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1536/3044] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:02 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:02.382485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:02.395407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034de55-c437-482c-a335-58e25e2b803d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:02.481024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:02.481725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.482162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.482527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.483503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:02.485899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:02.574851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1509/3045] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:02 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:20:02.579151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:02.590411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dfbca-5445-4128-8b49-725e09c180e1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:02.595911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:02.597342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.597804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.598353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.599177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:02.600960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:02.614063 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1537/3046] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:20:02.617804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:02.630765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aac78-4dd9-426e-82b1-c8ae4a6d8d30 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:02.636818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0e722-1f44-4cf2-a37a-8ada5187ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:02.637668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e722-1f44-4cf2-a37a-8ada5187ad65 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.638147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e722-1f44-4cf2-a37a-8ada5187ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.638689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e722-1f44-4cf2-a37a-8ada5187ad65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.639721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0e722-1f44-4cf2-a37a-8ada5187ad65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:02.641829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0e722-1f44-4cf2-a37a-8ada5187ad65 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:02.657389 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1510/3047] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:02.661716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:02.675716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de1186-ceb2-4d6c-99d3-85dfa9ab9821 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:02.681266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:02.682090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.682373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.682646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] PATH_INFO: `/v3/projects/09bbd7da71d44fe2bd4ae516dc578da6/users/ca7c543aa0e04fbd9eaa1fa04378accc/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.701711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bbd7da71d44fe2bd4ae516dc578da6, user_id=ca7c543aa0e04fbd9eaa1fa04378accc, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:02.705095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:02.814783 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1538/3048] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:02 2022] PUT /identity/v3/projects/09bbd7da71d44fe2bd4ae516dc578da6/users/ca7c543aa0e04fbd9eaa1fa04378accc/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:02.827340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcaa63-11ec-4f41-a8f0-f755ef695b66 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:02.835466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcaa63-11ec-4f41-a8f0-f755ef695b66 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:02.836339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcaa63-11ec-4f41-a8f0-f755ef695b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:02.858332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-07dcaa63-11ec-4f41-a8f0-f755ef695b66 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:02.859903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-07dcaa63-11ec-4f41-a8f0-f755ef695b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:02.947852 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1511/3049] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:02.958320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:02.960177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:03.107607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117453-4531-4578-a252-41a683af96f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:03.122466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:03.123810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:03.126344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:03.126757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:03.150966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:03.153692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:03.181097 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1539/3050] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:03.689238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085207c-ca30-4d4c-982a-96def11a1cf2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:03.691105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085207c-ca30-4d4c-982a-96def11a1cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:03.691590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085207c-ca30-4d4c-982a-96def11a1cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:03.715397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5085207c-ca30-4d4c-982a-96def11a1cf2 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:03.724026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5085207c-ca30-4d4c-982a-96def11a1cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:03.813111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1512/3051] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:03.826981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:03.828424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:03.908398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7a504-26f0-42db-a843-d80eb368fe4d service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:03.914807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:03.917310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:03.917310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:03.917310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:03.921804 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:03.926611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:03.928340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:03.940929 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1540/3052] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:20:05.845016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4e7d-b4d6-49b7-a88c-409f40c1f5b1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:05.845604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4e7d-b4d6-49b7-a88c-409f40c1f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:05.845604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4e7d-b4d6-49b7-a88c-409f40c1f5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:05.884031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-857d4e7d-b4d6-49b7-a88c-409f40c1f5b1 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:05.889696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-857d4e7d-b4d6-49b7-a88c-409f40c1f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:05.899690 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1513/3053] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:05.918213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:05.939033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3f2e-d5e1-47c9-9603-a95b6b57ae30 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:05.952464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:05.953695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:05.954283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:05.954782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:05.983410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:05.987769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:06.009001 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1541/3054] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:20:12.580043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2fb9-8217-439f-8917-d86bca0fe1b5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:12.580733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2fb9-8217-439f-8917-d86bca0fe1b5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:12.580733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2fb9-8217-439f-8917-d86bca0fe1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:12.599217 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:12.621519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1e1d2fb9-8217-439f-8917-d86bca0fe1b5 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:12.622929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1e1d2fb9-8217-439f-8917-d86bca0fe1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:12.638268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1514/3055] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:12.655499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:12.676815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b99b2-1a12-4c6a-aec9-89bfd744b90f service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:12.686153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd83e3-da58-42ae-a186-1b94bad260e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:12.687047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd83e3-da58-42ae-a186-1b94bad260e3 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:12.687498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd83e3-da58-42ae-a186-1b94bad260e3 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:12.687974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd83e3-da58-42ae-a186-1b94bad260e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:12.700930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd83e3-da58-42ae-a186-1b94bad260e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:12.703146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd83e3-da58-42ae-a186-1b94bad260e3 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:12.725014 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1542/3056] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:20:14.456626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:14.457146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:14.457268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:14.554391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] MFA Rules not processed for user `ca7c543aa0e04fbd9eaa1fa04378accc`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:14.559120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:14.719996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1515/3057] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:14.724040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230d11f-0452-4875-8b65-36e0038d1cf9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:14.727531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230d11f-0452-4875-8b65-36e0038d1cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:14.727916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230d11f-0452-4875-8b65-36e0038d1cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:14.826680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d230d11f-0452-4875-8b65-36e0038d1cf9 None None] MFA Rules not processed for user `ca7c543aa0e04fbd9eaa1fa04378accc`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:14.832467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d230d11f-0452-4875-8b65-36e0038d1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:14.863768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1543/3058] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:15.314080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:15.316156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:15.540500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4ad40-d2f6-4f5f-8ebb-fbef491bee0a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:15.565894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda76c9-e464-4fc7-90a5-d2626415dfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:15.566868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda76c9-e464-4fc7-90a5-d2626415dfbc service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:15.567360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda76c9-e464-4fc7-90a5-d2626415dfbc service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:15.568376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda76c9-e464-4fc7-90a5-d2626415dfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:15.591818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda76c9-e464-4fc7-90a5-d2626415dfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:15.593738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda76c9-e464-4fc7-90a5-d2626415dfbc service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:15.605859 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1516/3059] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:18.583025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec070-6ca4-4274-a1dd-2e5eb7fddfa7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:18.584180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec070-6ca4-4274-a1dd-2e5eb7fddfa7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:18.584940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec070-6ca4-4274-a1dd-2e5eb7fddfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:18.631305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ceaec070-6ca4-4274-a1dd-2e5eb7fddfa7 None None] MFA Rules not processed for user `81c50e66203b49cbb601370e2b0555ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:18.632739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ceaec070-6ca4-4274-a1dd-2e5eb7fddfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:18.794116 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1544/3060] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:25.203360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:25.203921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:25.204023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:25.253921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:25.261404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:25.284125 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1517/3061] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:25.297412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec070-6ca4-4274-a1dd-2e5eb7fddfa7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:25.318219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec070-6ca4-4274-a1dd-2e5eb7fddfa7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:25.332222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f5f73-9f2a-42ad-a41f-ada3c74d2c5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:25.332938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f5f73-9f2a-42ad-a41f-ada3c74d2c5b service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:25.333395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f5f73-9f2a-42ad-a41f-ada3c74d2c5b service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:25.333680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f5f73-9f2a-42ad-a41f-ada3c74d2c5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:25.356939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f5f73-9f2a-42ad-a41f-ada3c74d2c5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:25.358566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f5f73-9f2a-42ad-a41f-ada3c74d2c5b service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:25.392001 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1545/3062] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:20:26.218281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:26.219866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:26.251373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6923ed-bd6f-4e7e-9bc0-4eaad9655b3a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:26.261627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:26.262403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:26.268579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:26.269340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] PATH_INFO: `/v3/users/d3ee5c02cbb740bcab5009471ed98264` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:26.273221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ee5c02cbb740bcab5009471ed98264)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:26.279156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:26.619639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ee5c02cbb740bcab5009471ed98264'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:26.628695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:26.629354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:26.629354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:26.640064 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:26.642409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ee5c02cbb740bcab5009471ed98264'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:26.661957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:26.662501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ee5c02cbb740bcab5009471ed98264'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:26.663920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ee5c02cbb740bcab5009471ed98264'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:26.666768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:26.682898 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1546/3063] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:26.701094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:26.703113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:26.722038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa5d0a-3bd3-401d-b7f1-0121543d07bc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:26.727984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5899e-3f5a-4979-8d22-72b0620e1470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:26.728799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5899e-3f5a-4979-8d22-72b0620e1470 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:26.729193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5899e-3f5a-4979-8d22-72b0620e1470 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:26.729553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5899e-3f5a-4979-8d22-72b0620e1470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:26.740929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5899e-3f5a-4979-8d22-72b0620e1470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:26.743331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5899e-3f5a-4979-8d22-72b0620e1470 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:26.756796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1547/3064] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:20:27.080054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ee5c02cbb740bcab5009471ed98264'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:27.096214 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1518/3065] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:26 2022] DELETE /identity/v3/users/d3ee5c02cbb740bcab5009471ed98264 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:27.096427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:27.096427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:27.096427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:27.133485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:27.133485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:27.201977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1548/3066] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:27.213685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:27.219504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:27.281877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f69ce-9140-411f-9ff8-3b8377ae886a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:27.288202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ec73e-ef81-4edd-9424-45dfaa56f566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:27.288202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec73e-ef81-4edd-9424-45dfaa56f566 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:27.288202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec73e-ef81-4edd-9424-45dfaa56f566 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:27.288202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ec73e-ef81-4edd-9424-45dfaa56f566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:27.296819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ec73e-ef81-4edd-9424-45dfaa56f566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:27.298424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ec73e-ef81-4edd-9424-45dfaa56f566 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:27.312970 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1519/3067] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:27.828226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:27.829792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:27.843783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e807c-ce3f-43a5-8f3b-195ff79d692e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:27.857782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:27.858643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:27.858997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:27.859369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] PATH_INFO: `/v3/projects/f61189be458440b098258bdf09af344d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:27.861147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61189be458440b098258bdf09af344d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:27.864067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:28.044555 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:28.092366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61189be458440b098258bdf09af344d', 'request_id': 'req-17a582a3-074f-4dc9-9897-818890bd63e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.110566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61189be458440b098258bdf09af344d', 'request_id': 'req-17a582a3-074f-4dc9-9897-818890bd63e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.201153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:28.202134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:28.202623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:28.235030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:28.237744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:28.247226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61189be458440b098258bdf09af344d', 'request_id': 'req-17a582a3-074f-4dc9-9897-818890bd63e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.267414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] The token cache is being invalidate because project f61189be458440b098258bdf09af344d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:28.268928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.270235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.273305 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1549/3068] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:27 2022] DELETE /identity/v3/projects/f61189be458440b098258bdf09af344d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:28.281885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:28.283736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:28.352719 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1520/3069] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:28.390766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:28.392290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:28.419772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a582a3-074f-4dc9-9897-818890bd63e3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:28.419772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:28.419772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:28.419772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:28.420699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] PATH_INFO: `/v3/users/e5e36d25b05843e28eb5158f3c0d64f8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:28.426021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e36d25b05843e28eb5158f3c0d64f8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:28.429308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:28.512120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bd4de-2080-42a8-b9ef-35973b3011c9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:28.517456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:28.519062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:28.519344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:28.519636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:28.535583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:28.537378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:28.547582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1521/3070] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:20:28.724530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e36d25b05843e28eb5158f3c0d64f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.725269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e36d25b05843e28eb5158f3c0d64f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.853542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e36d25b05843e28eb5158f3c0d64f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.865696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e36d25b05843e28eb5158f3c0d64f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.867157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e36d25b05843e28eb5158f3c0d64f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:28.913882 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1550/3071] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:28 2022] DELETE /identity/v3/users/e5e36d25b05843e28eb5158f3c0d64f8 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:29.176923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:29.178433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:29.226307 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:29.291025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85c476-b7b4-4ac8-b6b5-3ee7a74fd124 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:29.396380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:29.398305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:29.398305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:29.398305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] PATH_INFO: `/v3/users/ec67c1528a73482881996bfca70e722d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:29.400957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec67c1528a73482881996bfca70e722d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:29.404326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:29.514768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:29.516900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:29.611819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5a3d-0e07-40e2-af4e-accefd3e94cd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:29.619183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:29.619956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:29.620606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:29.620991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] PATH_INFO: `/v3/projects/daf27e7c2612442bbd662326f1e42ade` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:29.622997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf27e7c2612442bbd662326f1e42ade)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:29.626126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:29.639639 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:29.681427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec67c1528a73482881996bfca70e722d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.713444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec67c1528a73482881996bfca70e722d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.726058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec67c1528a73482881996bfca70e722d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.727165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec67c1528a73482881996bfca70e722d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.825984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa7746e4-dcef-4a87-b2c3-3613005793ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec67c1528a73482881996bfca70e722d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.836850 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1522/3072] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:29 2022] DELETE /identity/v3/users/ec67c1528a73482881996bfca70e722d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:29.847316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:29.847928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:29.848539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:29.873142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf27e7c2612442bbd662326f1e42ade', 'request_id': 'req-94f0c078-58cc-489e-923d-d8127cf11eff'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.886596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:29.888253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:29.893924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf27e7c2612442bbd662326f1e42ade', 'request_id': 'req-94f0c078-58cc-489e-923d-d8127cf11eff'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.986411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf27e7c2612442bbd662326f1e42ade', 'request_id': 'req-94f0c078-58cc-489e-923d-d8127cf11eff'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:29.998652 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1523/3073] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:29.999678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:30.006334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:30.008112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] The token cache is being invalidate because project daf27e7c2612442bbd662326f1e42ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:30.008424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:30.009696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-94f0c078-58cc-489e-923d-d8127cf11eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:30.016629 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1551/3074] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:29 2022] DELETE /identity/v3/projects/daf27e7c2612442bbd662326f1e42ade => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:20:30.021397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b87b2-74e5-44ab-a045-7dbe7f3282a2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.021681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b87b2-74e5-44ab-a045-7dbe7f3282a2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.022176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b87b2-74e5-44ab-a045-7dbe7f3282a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.111031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7a2b87b2-74e5-44ab-a045-7dbe7f3282a2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:30.113146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7a2b87b2-74e5-44ab-a045-7dbe7f3282a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:30.125011 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1552/3075] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:30.205463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1079ea-7d59-4013-b479-1b705918a7f1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.205780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1079ea-7d59-4013-b479-1b705918a7f1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.206104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1079ea-7d59-4013-b479-1b705918a7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.235808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2f1079ea-7d59-4013-b479-1b705918a7f1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:30.237394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f1079ea-7d59-4013-b479-1b705918a7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:30.241834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849d1e8-886c-4f1f-a396-d334ac21c644 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:30.257614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:30.260446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.260446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.260446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.261065 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1553/3076] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:30.261894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1079ea-7d59-4013-b479-1b705918a7f1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:30.262181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:30.272554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1079ea-7d59-4013-b479-1b705918a7f1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:30.278575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:30.279307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.279599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.279862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.280582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:20:30.280858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:30.281544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:30.282497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:30.284567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:30.308717 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1524/3077] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:30.311547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1554/3078] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:20:30.323087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:30.347886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418398ff-e4ee-4e22-8960-5a174852472a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:30.369245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:30.370406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.371546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.371839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.372678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:30.376011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:30.546949 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1525/3079] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:30 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:30.551357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:30.579796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559fb98-e9ba-4d54-8f81-cf1cde36b529 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:30.723582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:30.726003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:30.740409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:30.741040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.741320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.742128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.748246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:30.756143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:30.779750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03ab16-71e9-4c49-836b-fad5d7044a39 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:30.801085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:30.802209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.802884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.803388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] PATH_INFO: `/v3/projects/40a5fe33aa044db98cc4fb6f5d70466e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.805625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a5fe33aa044db98cc4fb6f5d70466e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:30.810409 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:30.813490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:30.906364 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1555/3080] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:30 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:30.911284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:30.941762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00508-978f-478a-9ff9-15312e65ffd8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:30.971861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:30.972806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:30.973883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:30.977068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:30.977068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:30.977068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:30.994384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1556/3081] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:31.002865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:31.026096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92acfa-7c7f-4c61-99c8-2bfd913c3ad5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:31.028042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a5fe33aa044db98cc4fb6f5d70466e', 'request_id': 'req-f402b908-983a-434b-adbf-1a165f299e44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:31.043974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a5fe33aa044db98cc4fb6f5d70466e', 'request_id': 'req-f402b908-983a-434b-adbf-1a165f299e44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:31.132874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a5fe33aa044db98cc4fb6f5d70466e', 'request_id': 'req-f402b908-983a-434b-adbf-1a165f299e44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:31.151109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] The token cache is being invalidate because project 40a5fe33aa044db98cc4fb6f5d70466e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:31.151541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:31.152944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f402b908-983a-434b-adbf-1a165f299e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:31.160670 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1526/3082] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:30 2022] DELETE /identity/v3/projects/40a5fe33aa044db98cc4fb6f5d70466e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:31.163461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747741f-e14b-4797-9375-9fcb11f7d45f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.164173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747741f-e14b-4797-9375-9fcb11f7d45f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.165225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747741f-e14b-4797-9375-9fcb11f7d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.168925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:31.169649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.173283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.173283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.173283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:31.173283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:31.208427 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1557/3083] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:31.209665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:31.214298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:31.230661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d747741f-e14b-4797-9375-9fcb11f7d45f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:31.233192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d747741f-e14b-4797-9375-9fcb11f7d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:31.272181 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1527/3084] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:31.274422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aa946-491b-42fa-8482-e21369a53fd9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:31.275611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41341-f28c-4e02-9c15-b0e4c829c604 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.276154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41341-f28c-4e02-9c15-b0e4c829c604 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.277254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41341-f28c-4e02-9c15-b0e4c829c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.289411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6d7c2-ffe1-4f59-88b7-763f65f1682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:31.290649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d7c2-ffe1-4f59-88b7-763f65f1682c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.291172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d7c2-ffe1-4f59-88b7-763f65f1682c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.291737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d7c2-ffe1-4f59-88b7-763f65f1682c admin admin] PATH_INFO: `/v3/projects/ee6ea2c650d046729876692930727c16/users/13cbbf15045b448798dcbb42d8049a59/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.365616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6d7c2-ffe1-4f59-88b7-763f65f1682c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6ea2c650d046729876692930727c16, user_id=13cbbf15045b448798dcbb42d8049a59, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:31.368443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-30e41341-f28c-4e02-9c15-b0e4c829c604 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:31.372130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6d7c2-ffe1-4f59-88b7-763f65f1682c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:31.373578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-30e41341-f28c-4e02-9c15-b0e4c829c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:31.402802 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1528/3085] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:31.403849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41341-f28c-4e02-9c15-b0e4c829c604 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:31.427593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e41341-f28c-4e02-9c15-b0e4c829c604 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:31.441230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:31.442314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.448932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.448932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.448932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:20:31.448932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:31.448932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:31.485916 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1529/3086] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:20:31.487681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:31.511945 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1558/3087] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:31 2022] PUT /identity/v3/projects/ee6ea2c650d046729876692930727c16/users/13cbbf15045b448798dcbb42d8049a59/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:31.529577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80fc0-31ad-4321-8db3-24cc3f353ba5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:31.531289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5349fd-4f25-4ca8-b60f-627f58355532 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.531671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5349fd-4f25-4ca8-b60f-627f58355532 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.532047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5349fd-4f25-4ca8-b60f-627f58355532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.544616 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:31.579208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2c5349fd-4f25-4ca8-b60f-627f58355532 None None] MFA Rules not processed for user `13cbbf15045b448798dcbb42d8049a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:31.581044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c5349fd-4f25-4ca8-b60f-627f58355532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:31.648116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:31.654347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.654347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.654347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.654347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:31.654347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:31.775936 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1530/3088] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:31 2022] POST /identity/v3/projects => generated 387 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:31.777676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:31.781617 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1559/3089] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:31.785729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5349fd-4f25-4ca8-b60f-627f58355532 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:31.812015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5349fd-4f25-4ca8-b60f-627f58355532 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:31.931886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729ede-1b76-47bb-a152-aa6aef124b10 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:31.942731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:31.945278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.945278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.945278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.945278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:31.949466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:31.982499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:31.983656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:31.983656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:31.983656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:31.999535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.007491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.067288 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1531/3090] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:31 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:32.072442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:32.100299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8218b-b931-41ec-aa81-9fa1e8c7320b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:32.128629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:32.130384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.130669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.134289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.138340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.140858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.166022 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1532/3091] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:32.169337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:32.190988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11134c20-574e-40bc-84f3-7a86de665d04 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:32.197220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:32.198133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.198602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.199059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.199929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.202067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.234138 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1560/3092] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:31 2022] POST /identity/v3/projects => generated 385 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:32.235093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:32.246111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1533/3093] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:32.247328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:32.273388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf14dbc-c0a2-48d0-848d-1aa5499d7abf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:32.406046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b4d2-6ced-42a4-9b4b-882a436579e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:32.407445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b4d2-6ced-42a4-9b4b-882a436579e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.407725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b4d2-6ced-42a4-9b4b-882a436579e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.408115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b4d2-6ced-42a4-9b4b-882a436579e0 admin admin] PATH_INFO: `/v3/projects/c67e0618a3af4ccb920a9b832cd6245d/users/47367935d94f408691a9448e06d8fdfd/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.448573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661b4d2-6ced-42a4-9b4b-882a436579e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67e0618a3af4ccb920a9b832cd6245d, user_id=47367935d94f408691a9448e06d8fdfd, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.452778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661b4d2-6ced-42a4-9b4b-882a436579e0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.454901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d3a7b-4e3f-4597-9f6a-b61b56ad50e2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:32.463203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:32.463851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.464184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.464436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.465066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.467303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.533468 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1534/3094] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:32 2022] PUT /identity/v3/projects/c67e0618a3af4ccb920a9b832cd6245d/users/47367935d94f408691a9448e06d8fdfd/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:32.539620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.540109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.540511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.567680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:32.569131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:32.594081 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1561/3095] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:32 2022] POST /identity/v3/users => generated 299 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:32.596006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:32.630870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca7dfa-51cc-49b7-b726-30cc15dbda37 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:32.641262 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:32.764260 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1535/3096] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:32.766841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:32.771218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:32.773934 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:32.793185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:32.794448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.795400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.795708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.796385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.802008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.823782 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1562/3097] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:32.824766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:32.826884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:32.931539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b2489-b6a6-480d-82ea-204e71378580 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:32.932849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c46efe-a33a-4ba6-b3b8-979b67ba1935 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:32.942030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:32.942805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.943100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.943379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.945358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:32.945903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:32.947495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:32.947732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:32.948143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:32.962697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.966167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.980985 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1536/3098] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:32.981217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:32.984577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:32.995237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:33.016602 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1563/3099] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:33.022069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40cf4-5fae-4551-8d8b-3f2856b0be67 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:33.055184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:33.055931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:33.056224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:33.056501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] PATH_INFO: `/v3/projects/4a96c6ddad354b0dae6d6b7b0ad3f209/users/c2b66ab13a2346988beb6a679dfd257e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:33.094806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a96c6ddad354b0dae6d6b7b0ad3f209, user_id=c2b66ab13a2346988beb6a679dfd257e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:33.099335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:33.201003 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1537/3100] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:32 2022] PUT /identity/v3/projects/4a96c6ddad354b0dae6d6b7b0ad3f209/users/c2b66ab13a2346988beb6a679dfd257e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:33.201115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:33.218276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb098d-cfdf-48e8-8640-c8c92089917f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:33.327255 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:33.341429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35a0f8-8e27-4523-ab40-8b1cce533fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:33.343094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a0f8-8e27-4523-ab40-8b1cce533fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:33.343694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a0f8-8e27-4523-ab40-8b1cce533fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:33.344180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a0f8-8e27-4523-ab40-8b1cce533fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:33.345109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35a0f8-8e27-4523-ab40-8b1cce533fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:33.348636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35a0f8-8e27-4523-ab40-8b1cce533fa4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:33.365336 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1564/3101] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:33.383222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:33.405843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c575d4-b8df-472d-af55-a990dc71eff2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:33.432969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:33.435071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:33.435530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:33.435977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] PATH_INFO: `/v3/projects/4a96c6ddad354b0dae6d6b7b0ad3f209/users/c2b66ab13a2346988beb6a679dfd257e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:33.441089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a96c6ddad354b0dae6d6b7b0ad3f209, user_id=c2b66ab13a2346988beb6a679dfd257e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:33.447909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:33.466582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1538/3102] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:33 2022] PUT /identity/v3/projects/4a96c6ddad354b0dae6d6b7b0ad3f209/users/c2b66ab13a2346988beb6a679dfd257e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:33.479801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2b51-5c57-44cc-91a8-51ae6e1e2189 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:33.480100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2b51-5c57-44cc-91a8-51ae6e1e2189 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:33.480583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2b51-5c57-44cc-91a8-51ae6e1e2189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:33.523524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3f0d2b51-5c57-44cc-91a8-51ae6e1e2189 None None] MFA Rules not processed for user `c2b66ab13a2346988beb6a679dfd257e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:33.527207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f0d2b51-5c57-44cc-91a8-51ae6e1e2189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:33.692617 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1565/3103] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:33.749125 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:33.987899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:33.991349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:34.182605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca905591-99ce-4a1f-9284-35b2d9d71b0f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:34.196295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:34.197450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:34.198198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:34.198746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:34.217601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:34.220575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:34.251642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1539/3104] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:35.769210 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:36.163930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa23d-d19d-49a0-ad35-1cd56764c40b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:36.164488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa23d-d19d-49a0-ad35-1cd56764c40b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:36.164488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa23d-d19d-49a0-ad35-1cd56764c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:36.199331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-195aa23d-d19d-49a0-ad35-1cd56764c40b None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:36.200560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-195aa23d-d19d-49a0-ad35-1cd56764c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:36.289862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:36.291924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:36.293134 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1566/3105] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:36.429353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55226-e6e8-43d9-aaba-9ff90f5fae4a service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:36.438006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:36.438932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:36.440342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:36.440925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:36.484625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:36.489967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:36.521574 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1540/3106] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:20:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:20:38.336696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa23d-d19d-49a0-ad35-1cd56764c40b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:38.508142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa23d-d19d-49a0-ad35-1cd56764c40b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:38.521089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:38.522641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:38.523593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:38.524039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] PATH_INFO: `/v3/users/13cbbf15045b448798dcbb42d8049a59` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:38.527581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cbbf15045b448798dcbb42d8049a59)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:38.531006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:38.552452 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:38.810798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cbbf15045b448798dcbb42d8049a59'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:38.812751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cbbf15045b448798dcbb42d8049a59'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:38.914408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cbbf15045b448798dcbb42d8049a59'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:38.930327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cbbf15045b448798dcbb42d8049a59'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:38.942485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd98fb11-0f5e-4af5-80bb-80b7ab4a7d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cbbf15045b448798dcbb42d8049a59'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:38.950078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:38.952196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:38.975252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279076-9b3c-4bcf-aa69-27742a0e48ab service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:38.982364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe120e1-afd7-41b7-8a20-3ac9e41aa401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:38.985378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe120e1-afd7-41b7-8a20-3ac9e41aa401 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:38.985928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe120e1-afd7-41b7-8a20-3ac9e41aa401 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:38.986278 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1567/3107] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:38 2022] DELETE /identity/v3/users/13cbbf15045b448798dcbb42d8049a59 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:38.986497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe120e1-afd7-41b7-8a20-3ac9e41aa401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:38.992533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3fe120e1-afd7-41b7-8a20-3ac9e41aa401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:38.992993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:38.993282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:38.993783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:39.024997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:39.026292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:39.117942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe120e1-afd7-41b7-8a20-3ac9e41aa401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:39.119821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe120e1-afd7-41b7-8a20-3ac9e41aa401 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:39.125709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1568/3108] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:39.131762 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1541/3109] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:39.154549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:39.161334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:39.289255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4effc72-dd27-4b79-84d2-94a0196e8040 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:39.294501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:39.295128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:39.295380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:39.302081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:39.322994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:39.323278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:39.323744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:39.329459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:39.332652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:39.367323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] MFA Rules not processed for user `38a38185ccdc4f1693d93aeed92c93fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:39.368904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:39.381968 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1569/3110] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:39.503579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1542/3111] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:40.778661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:40.781098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:40.802288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0321f9-a84b-4d7f-a95d-a9aefbfcdc57 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:40.810734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:40.811963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:40.812442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:40.812884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:40.816511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:40.838532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:40.840737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:40.855190 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1570/3112] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:41.045971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:41.048184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:41.086394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b83f9e-415c-4616-a87e-2ce4d5a66aa2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:41.098631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:41.100721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:41.101022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:41.101302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] PATH_INFO: `/v3/projects/ee6ea2c650d046729876692930727c16` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:41.102678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6ea2c650d046729876692930727c16)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:41.106460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:41.132150 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:41.304691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6ea2c650d046729876692930727c16', 'request_id': 'req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.312487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6ea2c650d046729876692930727c16', 'request_id': 'req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.382328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6ea2c650d046729876692930727c16', 'request_id': 'req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.402132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] The token cache is being invalidate because project ee6ea2c650d046729876692930727c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:41.403001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.404034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.411706 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1543/3113] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:41 2022] DELETE /identity/v3/projects/ee6ea2c650d046729876692930727c16 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:41.412157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:41.440445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440ca2b-86cb-4f66-bab3-30a37bab2880 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:41.479420 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:41.545531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:41.546677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:41.547289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:41.547919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] PATH_INFO: `/v3/users/c2b66ab13a2346988beb6a679dfd257e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:41.550676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b66ab13a2346988beb6a679dfd257e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:41.552786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:41.808853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b66ab13a2346988beb6a679dfd257e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.810699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b66ab13a2346988beb6a679dfd257e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.927574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b66ab13a2346988beb6a679dfd257e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.938639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b66ab13a2346988beb6a679dfd257e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.941997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-541d3896-8baa-44e6-b077-414ed0a69937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b66ab13a2346988beb6a679dfd257e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:41.996439 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1571/3114] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:41 2022] DELETE /identity/v3/users/c2b66ab13a2346988beb6a679dfd257e => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:43.949181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:43.951373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:43.972545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d7ccf-20e5-44cf-8e52-bc4f4aafcc6d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:44.116482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:44.117169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:44.117452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:44.117729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] PATH_INFO: `/v3/projects/4a96c6ddad354b0dae6d6b7b0ad3f209` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:44.124864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a96c6ddad354b0dae6d6b7b0ad3f209)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:44.126803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:44.325963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a96c6ddad354b0dae6d6b7b0ad3f209', 'request_id': 'req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:44.347434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a96c6ddad354b0dae6d6b7b0ad3f209', 'request_id': 'req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:44.452340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a96c6ddad354b0dae6d6b7b0ad3f209', 'request_id': 'req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:44.477717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] The token cache is being invalidate because project 4a96c6ddad354b0dae6d6b7b0ad3f209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:44.477717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:44.478684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fc9ec1e-9a70-4dae-b4f2-19e6df65d100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:44.484570 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1544/3115] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:43 2022] DELETE /identity/v3/projects/4a96c6ddad354b0dae6d6b7b0ad3f209 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:44.489850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9f505-5738-452f-ad9a-742fc969ee08 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:44.490949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9f505-5738-452f-ad9a-742fc969ee08 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:44.491553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9f505-5738-452f-ad9a-742fc969ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:44.532071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8ed9f505-5738-452f-ad9a-742fc969ee08 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:44.538450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ed9f505-5738-452f-ad9a-742fc969ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:44.672720 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1572/3116] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:44.682898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68df0-bad7-4b4f-a05c-e34f8768460b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:44.683182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68df0-bad7-4b4f-a05c-e34f8768460b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:44.683462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68df0-bad7-4b4f-a05c-e34f8768460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:44.718563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1be68df0-bad7-4b4f-a05c-e34f8768460b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:44.720101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1be68df0-bad7-4b4f-a05c-e34f8768460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:44.730042 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1545/3117] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:44.736073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9f505-5738-452f-ad9a-742fc969ee08 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:44.748762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9f505-5738-452f-ad9a-742fc969ee08 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:44.757371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:44.758401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:44.764927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:44.764927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:44.764927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:20:44.764927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:44.766239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:44.788083 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1573/3118] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:20:44.793564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be68df0-bad7-4b4f-a05c-e34f8768460b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:44.801585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be68df0-bad7-4b4f-a05c-e34f8768460b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:44.813971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:44.815507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:44.815901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:44.816281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:44.817274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:44.819402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:44.935621 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1546/3119] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:44 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:20:44.942871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:44.972363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedbcec-0ddc-4c61-a942-0c5eefbc21ba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:45.064110 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:45.112579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:45.113746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:45.114235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:45.114682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:45.115525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:45.118554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:45.197433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:45.199494 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1574/3120] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:44 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:45.232968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73d4ba-ce3e-4859-874b-540489214f72 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:45.248167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:45.249861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:45.250396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:45.250913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:45.251891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:45.254004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:45.255881 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:45.288299 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1547/3121] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:45.292866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:45.311316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aa334-d7b1-42e5-93c0-7f2dddabd83c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:45.317945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad865a-a34c-449c-8ee8-c608abfe7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:45.318962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad865a-a34c-449c-8ee8-c608abfe7de5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:45.319502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad865a-a34c-449c-8ee8-c608abfe7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:45.320541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad865a-a34c-449c-8ee8-c608abfe7de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:45.321471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad865a-a34c-449c-8ee8-c608abfe7de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:45.323632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad865a-a34c-449c-8ee8-c608abfe7de5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:45.344153 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1575/3122] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:45.345033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:45.370640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac506710-ca13-4070-ae89-e9592b2ad0ae admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:45.391131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:45.392728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:45.393802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:45.394299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] PATH_INFO: `/v3/projects/068002f8ed594b5fb50f0565c15cd79b/users/3ef68c7013bc4055bc06bbabe88b414a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:45.417508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068002f8ed594b5fb50f0565c15cd79b, user_id=3ef68c7013bc4055bc06bbabe88b414a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:45.421756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:45.506698 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1548/3123] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:45 2022] PUT /identity/v3/projects/068002f8ed594b5fb50f0565c15cd79b/users/3ef68c7013bc4055bc06bbabe88b414a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:45.517350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb57fd6-c63f-45fc-ac9e-6acab86596c3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:45.517945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb57fd6-c63f-45fc-ac9e-6acab86596c3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:45.517945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb57fd6-c63f-45fc-ac9e-6acab86596c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:45.579569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eeb57fd6-c63f-45fc-ac9e-6acab86596c3 None None] MFA Rules not processed for user `3ef68c7013bc4055bc06bbabe88b414a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:45.581496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eeb57fd6-c63f-45fc-ac9e-6acab86596c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:45.718480 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1576/3124] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:45.718849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:45.890133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25885bc-a52d-4836-8f54-686aa61f4b50 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:45.909473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:45.910280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:45.910669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:45.911006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:45.911725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:45.915737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:46.142730 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1549/3125] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:45 2022] POST /identity/v3/projects => generated 379 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:46.149091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb57fd6-c63f-45fc-ac9e-6acab86596c3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:46.165522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb57fd6-c63f-45fc-ac9e-6acab86596c3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:46.346712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:46.348234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:46.348234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:46.348234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:46.348558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:46.369730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:46.507267 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1577/3126] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:46 2022] POST /identity/v3/users => generated 296 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:46.511647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:46.525233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de44e-bc0b-44d9-ac14-4f7a0e2358b4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:46.534827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:46.540371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:46.540371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:46.540371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:46.540714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:46.544052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:46.586496 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1550/3127] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:46.590460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:46.610890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424570-128e-4a6d-ab30-b9da44c6fa6b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:46.651091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:46.651781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:46.654323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:46.654652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] PATH_INFO: `/v3/projects/c4b8231b9a9b4c0a8f81151c91f1101b/users/ce7a4b9dbac04696b729102dde775377/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:46.689295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b8231b9a9b4c0a8f81151c91f1101b, user_id=ce7a4b9dbac04696b729102dde775377, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:46.697440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:46.711456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:46.714554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:46.857791 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1578/3128] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:46 2022] PUT /identity/v3/projects/c4b8231b9a9b4c0a8f81151c91f1101b/users/ce7a4b9dbac04696b729102dde775377/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:46.861625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:46.868789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cd4d-6ebf-4f7b-a440-5b5207e20e56 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:46.955189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524da94-85c2-445a-b96b-8fa808b53fad admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:46.961011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:46.962294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:46.962578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:46.962845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:46.963494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:46.965213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:46.978662 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1579/3129] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:46.988632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:47.005726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e9c59-6ace-40c6-b4e2-cf2367ef7b38 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:47.007320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:47.011250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:47.012594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:47.012968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:47.015452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:47.029273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab637b4-f52e-4b62-adfa-50b0c1de4139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:47.031732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab637b4-f52e-4b62-adfa-50b0c1de4139 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:47.034821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab637b4-f52e-4b62-adfa-50b0c1de4139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:47.035338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab637b4-f52e-4b62-adfa-50b0c1de4139 admin admin] PATH_INFO: `/v3/projects/c4b8231b9a9b4c0a8f81151c91f1101b/users/ce7a4b9dbac04696b729102dde775377/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:47.039097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab637b4-f52e-4b62-adfa-50b0c1de4139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b8231b9a9b4c0a8f81151c91f1101b, user_id=ce7a4b9dbac04696b729102dde775377, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:47.043400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab637b4-f52e-4b62-adfa-50b0c1de4139 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:47.058234 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1580/3130] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:46 2022] PUT /identity/v3/projects/c4b8231b9a9b4c0a8f81151c91f1101b/users/ce7a4b9dbac04696b729102dde775377/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:47.071288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e571b-054d-4044-bb9a-6435215e90df None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:47.071898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e571b-054d-4044-bb9a-6435215e90df None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:47.072587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e571b-054d-4044-bb9a-6435215e90df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:47.094502 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:47.134408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2a8e571b-054d-4044-bb9a-6435215e90df None None] MFA Rules not processed for user `ce7a4b9dbac04696b729102dde775377`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:47.136217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2a8e571b-054d-4044-bb9a-6435215e90df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:47.220940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:47.225100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:47.235530 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:47.242208 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1551/3131] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:47.322279 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1581/3132] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:47.367855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:47.379286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe247a0c-0037-44a5-ace4-9015e91e5891 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:47.483287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:47.484572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:47.485581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:47.485769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:47.489355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:47.501096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:47.503668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:47.514199 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1552/3133] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:47.577404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec4e5f-0651-4f6c-b88c-6219c71f2d37 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:47.577702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec4e5f-0651-4f6c-b88c-6219c71f2d37 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:47.578011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec4e5f-0651-4f6c-b88c-6219c71f2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:47.622912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e9ec4e5f-0651-4f6c-b88c-6219c71f2d37 None None] MFA Rules not processed for user `47367935d94f408691a9448e06d8fdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:47.625204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e9ec4e5f-0651-4f6c-b88c-6219c71f2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:47.744640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1582/3134] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:47.985018 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:48.068862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:48.071409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:48.207973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69715a6-c8c3-4a56-a725-d3775b5a99b8 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:48.214670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:48.221989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:48.221989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:48.221989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:48.227830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:48.231622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:48.245737 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1553/3135] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:48.317719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec4e5f-0651-4f6c-b88c-6219c71f2d37 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:48.341305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec4e5f-0651-4f6c-b88c-6219c71f2d37 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:48.349589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba675c3c-63c8-41b4-9f19-05e236b5b558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:48.350904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675c3c-63c8-41b4-9f19-05e236b5b558 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:48.351306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675c3c-63c8-41b4-9f19-05e236b5b558 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:48.351999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba675c3c-63c8-41b4-9f19-05e236b5b558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:48.363192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba675c3c-63c8-41b4-9f19-05e236b5b558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:48.365999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba675c3c-63c8-41b4-9f19-05e236b5b558 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:48.387527 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1583/3136] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:51.031372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:51.114010 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:51.263276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f849e3-8079-4188-a6c2-8f178480caca service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:51.268009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:51.268867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:51.269338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:51.269793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] PATH_INFO: `/v3/users/3ef68c7013bc4055bc06bbabe88b414a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:51.271192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef68c7013bc4055bc06bbabe88b414a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:51.273305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:51.529743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef68c7013bc4055bc06bbabe88b414a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:51.574299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef68c7013bc4055bc06bbabe88b414a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:51.586014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef68c7013bc4055bc06bbabe88b414a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:51.587090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef68c7013bc4055bc06bbabe88b414a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:51.651833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef68c7013bc4055bc06bbabe88b414a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:51.659726 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1554/3137] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:51 2022] DELETE /identity/v3/users/3ef68c7013bc4055bc06bbabe88b414a => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:51.664478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:51.665025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:51.665025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:51.730566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:51.732676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:51.821739 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1584/3138] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:51.845041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:51.847546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:51.978397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aed4cf-6902-4e7a-bbc2-f16a02230568 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:51.984575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:51.985266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:51.985568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:51.985843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:52.007718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:52.009186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:52.029138 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1555/3139] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:53.612443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:53.612443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:53.636224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e30bf-714e-429b-9698-1d598c14d4d5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:53.649692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:53.650546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:53.651153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:53.651825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] PATH_INFO: `/v3/projects/068002f8ed594b5fb50f0565c15cd79b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:53.654620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068002f8ed594b5fb50f0565c15cd79b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:53.656976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:53.724814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:53.727278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:53.744656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67aa81f-275d-4954-9225-12fd4ec3ddb2 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:53.752463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:53.754074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:53.756972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:53.756972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] PATH_INFO: `/v3/users/448684b1bbe546398989daf12dbba7cd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:53.756972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448684b1bbe546398989daf12dbba7cd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:53.763357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:53.819638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068002f8ed594b5fb50f0565c15cd79b', 'request_id': 'req-5f01a730-47b0-4664-9371-b3edf452ee94'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:53.829655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068002f8ed594b5fb50f0565c15cd79b', 'request_id': 'req-5f01a730-47b0-4664-9371-b3edf452ee94'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:53.910899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068002f8ed594b5fb50f0565c15cd79b', 'request_id': 'req-5f01a730-47b0-4664-9371-b3edf452ee94'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:53.929564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] The token cache is being invalidate because project 068002f8ed594b5fb50f0565c15cd79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:53.929932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:53.932047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:53.934293 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1585/3140] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:53 2022] DELETE /identity/v3/projects/068002f8ed594b5fb50f0565c15cd79b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:53.941104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:53.948707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:54.008571 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:54.038415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448684b1bbe546398989daf12dbba7cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.059286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448684b1bbe546398989daf12dbba7cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.073386 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:54.094829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448684b1bbe546398989daf12dbba7cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.098189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448684b1bbe546398989daf12dbba7cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.099926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01a730-47b0-4664-9371-b3edf452ee94 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:54.116019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:54.116764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:54.117046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:54.117337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] PATH_INFO: `/v3/users/ce7a4b9dbac04696b729102dde775377` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:54.119283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7a4b9dbac04696b729102dde775377)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:54.122930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:54.188800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448684b1bbe546398989daf12dbba7cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.200996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1556/3141] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:53 2022] DELETE /identity/v3/users/448684b1bbe546398989daf12dbba7cd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:54.398201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7a4b9dbac04696b729102dde775377'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.399446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7a4b9dbac04696b729102dde775377'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.535113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7a4b9dbac04696b729102dde775377'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.546265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7a4b9dbac04696b729102dde775377'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.547352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7a4b9dbac04696b729102dde775377'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:54.577948 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1586/3142] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:53 2022] DELETE /identity/v3/users/ce7a4b9dbac04696b729102dde775377 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:54.610074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:54.613539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:54.708164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73bb06-8dc8-4b30-8198-e00841f0fdc3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:54.818830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:54.822604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:54.822887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:54.823165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] PATH_INFO: `/v3/projects/bc488ecc9b0f4f9dbc46a54d982e2e34` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:54.827070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc488ecc9b0f4f9dbc46a54d982e2e34)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:54.830646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:54.917902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:54.920199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:55.024564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc488ecc9b0f4f9dbc46a54d982e2e34', 'request_id': 'req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.043484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc488ecc9b0f4f9dbc46a54d982e2e34', 'request_id': 'req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.097079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4acf9-d995-4ce3-b3c7-b38ea7564037 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:55.187714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97f85-1ee2-488e-852b-e0a1804ee033 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:55.188757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97f85-1ee2-488e-852b-e0a1804ee033 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:55.189239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97f85-1ee2-488e-852b-e0a1804ee033 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:55.189771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97f85-1ee2-488e-852b-e0a1804ee033 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:55.196145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e8e97f85-1ee2-488e-852b-e0a1804ee033 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:55.239948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97f85-1ee2-488e-852b-e0a1804ee033 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:55.241805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97f85-1ee2-488e-852b-e0a1804ee033 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:55.259109 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1587/3143] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:20:55.260677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:55.261022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:55.261369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:55.287231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc488ecc9b0f4f9dbc46a54d982e2e34', 'request_id': 'req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.290640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] MFA Rules not processed for user `81c50e66203b49cbb601370e2b0555ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:55.292492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:55.309694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] The token cache is being invalidate because project bc488ecc9b0f4f9dbc46a54d982e2e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:55.314381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.316862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6a32a1ae-cd6c-4a29-a3fd-765bfa5744d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.326225 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1557/3144] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:54 2022] DELETE /identity/v3/projects/bc488ecc9b0f4f9dbc46a54d982e2e34 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:55.334292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:55.335336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:55.336929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:55.394023 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1588/3145] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:55.395032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:55.411006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:55.455036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:55.456595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:55.522375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d542-2905-4c2a-8b39-ce0d46f86ee5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:55.528079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:55.529194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:55.530386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:55.530876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] PATH_INFO: `/v3/users/e285fefe9cb44cadaec6e58a31ef3afe` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:55.536887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e285fefe9cb44cadaec6e58a31ef3afe)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:55.537429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:55.643161 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1558/3146] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:55.644619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:55.646636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:55.663593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254bc93-38e5-4921-803e-c4d783d9306c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:55.670269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:55.671576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:55.672157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:55.673372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] PATH_INFO: `/v3/projects/c4b8231b9a9b4c0a8f81151c91f1101b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:55.675806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b8231b9a9b4c0a8f81151c91f1101b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:55.701082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:55.794647 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:55.809330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e285fefe9cb44cadaec6e58a31ef3afe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.809330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e285fefe9cb44cadaec6e58a31ef3afe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.887247 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:55.888135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e285fefe9cb44cadaec6e58a31ef3afe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.907872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e285fefe9cb44cadaec6e58a31ef3afe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.909262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-42d2dac6-e96d-4f5c-91d6-eb83d887568c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e285fefe9cb44cadaec6e58a31ef3afe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.922947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b8231b9a9b4c0a8f81151c91f1101b', 'request_id': 'req-3febce8a-fcdf-4322-bf4c-66071e00cabf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.932902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b8231b9a9b4c0a8f81151c91f1101b', 'request_id': 'req-3febce8a-fcdf-4322-bf4c-66071e00cabf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:55.944389 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1589/3147] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:55 2022] DELETE /identity/v3/users/e285fefe9cb44cadaec6e58a31ef3afe => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:55.945708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab3e6-2f8f-41e4-b4d2-56996932a669 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:55.946022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab3e6-2f8f-41e4-b4d2-56996932a669 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:55.946301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab3e6-2f8f-41e4-b4d2-56996932a669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:55.993460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4b1ab3e6-2f8f-41e4-b4d2-56996932a669 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:55.998195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4b1ab3e6-2f8f-41e4-b4d2-56996932a669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:56.036471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b8231b9a9b4c0a8f81151c91f1101b', 'request_id': 'req-3febce8a-fcdf-4322-bf4c-66071e00cabf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:56.061054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] The token cache is being invalidate because project c4b8231b9a9b4c0a8f81151c91f1101b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:56.061355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:56.064718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3febce8a-fcdf-4322-bf4c-66071e00cabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:56.069986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1559/3148] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:55 2022] DELETE /identity/v3/projects/c4b8231b9a9b4c0a8f81151c91f1101b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:56.075669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53369b-8086-4944-803b-b54ebd790ba3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.079935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53369b-8086-4944-803b-b54ebd790ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.079935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53369b-8086-4944-803b-b54ebd790ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.101192 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1590/3149] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:56.106000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ab3e6-2f8f-41e4-b4d2-56996932a669 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.128799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ab3e6-2f8f-41e4-b4d2-56996932a669 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.130102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3b53369b-8086-4944-803b-b54ebd790ba3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:56.131977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b53369b-8086-4944-803b-b54ebd790ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:56.135196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.136420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.136826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.137442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.138749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:20:56.139009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.140780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.147358 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1560/3150] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:56.162392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f358530-9d4b-40d7-84e0-624ce3c3331f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.162998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f358530-9d4b-40d7-84e0-624ce3c3331f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.163275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f358530-9d4b-40d7-84e0-624ce3c3331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.165315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1591/3151] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:20:56.171919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.197789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7f358530-9d4b-40d7-84e0-624ce3c3331f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:56.199750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7f358530-9d4b-40d7-84e0-624ce3c3331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:56.207680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a6d86-c98f-485e-9230-bd737d52fa3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.219907 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1561/3152] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:56.219907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f358530-9d4b-40d7-84e0-624ce3c3331f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.228125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.228745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.229022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.229291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.230158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.231999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.251304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f358530-9d4b-40d7-84e0-624ce3c3331f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.260955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.261648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.262048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.276061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.276901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:20:56.280031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.282019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.306392 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1562/3153] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:20:56.307445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.323011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694151c-b439-439c-951b-7999b5e3cb41 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.330130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.331081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.331476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.331818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.332488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.335291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.395635 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1592/3154] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:56 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:56.395635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.479367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0174-6e56-4258-931f-8ac1e14c4173 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.484915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.490001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.494881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.498858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1563/3155] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:56 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:56.499868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.503016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.503016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.504411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:56.506105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.650920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5ab7-4125-4148-94f6-312712b85338 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.656450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.657107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.657391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.658019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] PATH_INFO: `/v3/projects/3db4526757ac41afbf2d54dd0d27b64b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.659899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db4526757ac41afbf2d54dd0d27b64b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.661915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.668290 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1593/3156] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:56 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:56.668290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.682865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafdd9f-f428-459d-aa78-583842c25d90 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.690449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.691765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.692646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.692939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.693891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.705949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.819327 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1594/3157] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:56 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:56.822266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.846651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db4526757ac41afbf2d54dd0d27b64b', 'request_id': 'req-d964fe87-4aae-4d61-a489-973ce890e54b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:56.849185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09a09a-9641-433c-890d-68ceb05a003d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.869799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db4526757ac41afbf2d54dd0d27b64b', 'request_id': 'req-d964fe87-4aae-4d61-a489-973ce890e54b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:56.956878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.957507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.957784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.962486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.962486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:56.962486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:56.974260 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1595/3158] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:56.975318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:56.987456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b696a3-1b64-4d6c-8f88-8db6d99a2e33 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:56.997902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:56.998648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:56.998940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:56.999216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:56.999953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:57.001760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:57.019413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db4526757ac41afbf2d54dd0d27b64b', 'request_id': 'req-d964fe87-4aae-4d61-a489-973ce890e54b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.027170 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1596/3159] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:57.028926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:57.041543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] The token cache is being invalidate because project 3db4526757ac41afbf2d54dd0d27b64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:57.041837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.044477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.047012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1564/3160] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:56 2022] DELETE /identity/v3/projects/3db4526757ac41afbf2d54dd0d27b64b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:57.047619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d535bdb-46a0-4aec-9af4-bdd4de3dba76 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:57.053492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:57.055636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:57.056300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:57.056760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.057089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.057500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.058251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:57.060604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:57.074725 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1597/3161] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:57.075483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:57.077586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:57.079334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fe87-4aae-4d61-a489-973ce890e54b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:57.090433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:57.091213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.091709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.092595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.093402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:57.094212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b97dc-f4f6-4f4f-b7cb-2b3d1edcfffa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:57.095586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:57.102152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:57.103261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.103733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.104232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] PATH_INFO: `/v3/users/b66ba66ffa184f0180b505e831bc4fe7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.106261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66ba66ffa184f0180b505e831bc4fe7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:57.116435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:57.118229 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1565/3162] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:57.119485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:57.121735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:57.146519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4289d8-79a4-4dc6-a715-546348166f0d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:57.171865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:57.172634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.173014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.173394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] PATH_INFO: `/v3/projects/ebaf3f90ede8433fa8426fab2b7609eb/users/1d38b3bd03cc4c008039999b9258f5e0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.194810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebaf3f90ede8433fa8426fab2b7609eb, user_id=1d38b3bd03cc4c008039999b9258f5e0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:57.198025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:57.278004 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1566/3163] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:57 2022] PUT /identity/v3/projects/ebaf3f90ede8433fa8426fab2b7609eb/users/1d38b3bd03cc4c008039999b9258f5e0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:57.279006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:57.366388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b89bd6-056e-4885-9103-1c81998a0fea admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:57.381839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66ba66ffa184f0180b505e831bc4fe7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.381839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66ba66ffa184f0180b505e831bc4fe7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.382172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977347c4-0006-421b-a199-778ea01d5d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:57.382172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977347c4-0006-421b-a199-778ea01d5d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.382172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977347c4-0006-421b-a199-778ea01d5d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.382172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977347c4-0006-421b-a199-778ea01d5d4b admin admin] PATH_INFO: `/v3/projects/920dbe6565b1451e8be5ab8796f306bc/users/82ee1574bc5541459235111a7d7f8136/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.389504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977347c4-0006-421b-a199-778ea01d5d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=920dbe6565b1451e8be5ab8796f306bc, user_id=82ee1574bc5541459235111a7d7f8136, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:57.392200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977347c4-0006-421b-a199-778ea01d5d4b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:57.517113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66ba66ffa184f0180b505e831bc4fe7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.523006 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1567/3164] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:57 2022] PUT /identity/v3/projects/920dbe6565b1451e8be5ab8796f306bc/users/82ee1574bc5541459235111a7d7f8136/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:57.524154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.524451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.524874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.530596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66ba66ffa184f0180b505e831bc4fe7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.531584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a3666e93-d404-46f3-8185-73586b1845dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66ba66ffa184f0180b505e831bc4fe7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:57.546949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:57.549043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:57.569240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1598/3165] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:20:57 2022] DELETE /identity/v3/users/b66ba66ffa184f0180b505e831bc4fe7 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:20:57.570678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abe9a-0dbd-4b8f-a842-bdb7c2bf0ff4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.571384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abe9a-0dbd-4b8f-a842-bdb7c2bf0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.571675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abe9a-0dbd-4b8f-a842-bdb7c2bf0ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.644895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1568/3166] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:57.661330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ec2abe9a-0dbd-4b8f-a842-bdb7c2bf0ff4 None None] MFA Rules not processed for user `82ee1574bc5541459235111a7d7f8136`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:57.662786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ec2abe9a-0dbd-4b8f-a842-bdb7c2bf0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:57.667616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:57.669012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:57.767366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1599/3167] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:57.779725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.780277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.780713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.820886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] MFA Rules not processed for user `82ee1574bc5541459235111a7d7f8136`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:57.822153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:57.829318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4c04-d1a9-41c0-b518-be25dabac10f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:57.833752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1600/3168] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:57.904171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:57.904720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:57.905008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:57.905288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:57.996791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:58.000408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.023197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:58.034907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:58.045264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1569/3169] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:20:58.136620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:58.138426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.151507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177921-4d8f-4413-8549-db4b494d6373 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:58.158183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:58.159629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.160577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.160918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] PATH_INFO: `/v3/projects/e68a8b3ff6724e53852d7c1d2e9045d5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.163404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68a8b3ff6724e53852d7c1d2e9045d5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:58.165562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:58.262204 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:58.290172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b1124-3f1a-410a-93e9-d7158e49e93f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:58.301367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7b545-1d5a-44e9-9929-52126d8a8e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:58.302364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b545-1d5a-44e9-9929-52126d8a8e94 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.304359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b545-1d5a-44e9-9929-52126d8a8e94 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.304524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b545-1d5a-44e9-9929-52126d8a8e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.326328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7b545-1d5a-44e9-9929-52126d8a8e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:58.328634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7b545-1d5a-44e9-9929-52126d8a8e94 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:58.334471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68a8b3ff6724e53852d7c1d2e9045d5', 'request_id': 'req-e3529211-28f9-40ed-866a-cb0c38df97bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:58.340415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1570/3170] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:58.343703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68a8b3ff6724e53852d7c1d2e9045d5', 'request_id': 'req-e3529211-28f9-40ed-866a-cb0c38df97bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:58.459789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68a8b3ff6724e53852d7c1d2e9045d5', 'request_id': 'req-e3529211-28f9-40ed-866a-cb0c38df97bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:58.462697 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:58.477452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] The token cache is being invalidate because project e68a8b3ff6724e53852d7c1d2e9045d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:20:58.477772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:58.478630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:20:58.485746 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1601/3171] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:20:57 2022] DELETE /identity/v3/projects/e68a8b3ff6724e53852d7c1d2e9045d5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:20:58.487961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b81d36-c3e9-4c2e-92ab-55834b8f24b6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.488742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b81d36-c3e9-4c2e-92ab-55834b8f24b6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.489254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b81d36-c3e9-4c2e-92ab-55834b8f24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.528787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-14b81d36-c3e9-4c2e-92ab-55834b8f24b6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:58.531093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-14b81d36-c3e9-4c2e-92ab-55834b8f24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.607414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:58.609341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.655189 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1571/3172] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:58.663847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbc7f-4806-4e8b-825b-9f2a45f995e5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.664310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbc7f-4806-4e8b-825b-9f2a45f995e5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.664697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bbc7f-4806-4e8b-825b-9f2a45f995e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.689423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c36bbc7f-4806-4e8b-825b-9f2a45f995e5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:58.691514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c36bbc7f-4806-4e8b-825b-9f2a45f995e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.701692 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1572/3173] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:58.706336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bbc7f-4806-4e8b-825b-9f2a45f995e5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:58.717984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bbc7f-4806-4e8b-825b-9f2a45f995e5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:58.726031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:58.732821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.732821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.732821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.732821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:20:58.732821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:58.732821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:58.763674 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1573/3174] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:20:58.767010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:58.772324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3529211-28f9-40ed-866a-cb0c38df97bc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:58.786596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:58.787198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.787494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.787494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.789694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.795972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b958e-46ce-4abc-96ef-09d9d6979f2a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:58.808404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:58.809242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:58.810334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.810620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.810904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.811265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:58.811548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:58.813461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:58.826005 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1602/3175] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:20:58.943819 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1574/3176] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:58 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:20:58.948195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:58.963065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39c9b-6e8e-4198-822d-dcddfd4d9830 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:59.090063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:59.091881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:59.098805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:59.099092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:59.101504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:59.106617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:59.257407 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1603/3177] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:58 2022] POST /identity/v3/users => generated 291 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:20:59.257958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:59.270867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb297b6-5e4b-4545-8cd7-dbb19bd53c2c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:59.277309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:59.278016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:59.278295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:59.278577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:59.279283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:59.280935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:59.298566 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1575/3178] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:20:59.301123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:59.322376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44bab0-437e-4483-b7a4-3aed1da27abf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:59.340150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71060e-7604-490d-90e0-f9691fcb4751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:59.340857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71060e-7604-490d-90e0-f9691fcb4751 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:59.341214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71060e-7604-490d-90e0-f9691fcb4751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:59.341557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71060e-7604-490d-90e0-f9691fcb4751 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:59.342319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71060e-7604-490d-90e0-f9691fcb4751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:59.344000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71060e-7604-490d-90e0-f9691fcb4751 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:59.387179 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1604/3179] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:20:59.391210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:59.408211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c109-496f-4f0f-a6d7-427ef8f71cf5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:59.422388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:59.422388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:59.422388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:59.422388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4/users/1815b1faa4b04f938bd947b6e797e0c3/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:59.447778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23debbbae67c4925bbba891ef306b9d4, user_id=1815b1faa4b04f938bd947b6e797e0c3, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:59.451596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:59.562553 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1576/3180] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:20:59 2022] PUT /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4/users/1815b1faa4b04f938bd947b6e797e0c3/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:20:59.577009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1498e-e5eb-4662-a7ca-2a633f681e48 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:59.577290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1498e-e5eb-4662-a7ca-2a633f681e48 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:59.578081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1498e-e5eb-4662-a7ca-2a633f681e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:59.615234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-26f1498e-e5eb-4662-a7ca-2a633f681e48 None None] MFA Rules not processed for user `1815b1faa4b04f938bd947b6e797e0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:59.616745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-26f1498e-e5eb-4662-a7ca-2a633f681e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:59.752929 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1605/3181] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:20:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:20:59.757437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:59.853760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416ff92-6d78-41d2-9fa8-4de88429bd13 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:59.860024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:59.860685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:59.861020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:59.861301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:59.862765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:59.865178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:59.974823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1577/3182] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:20:59 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:20:59.978976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1498e-e5eb-4662-a7ca-2a633f681e48 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:00.001233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1498e-e5eb-4662-a7ca-2a633f681e48 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:00.115678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:00.117098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:00.117641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:00.117918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:00.118677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:00.120791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:00.373265 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1606/3183] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:20:59 2022] POST /identity/v3/users => generated 298 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:21:00.377302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:00.390491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cf1a6-9ac4-4b29-8874-bb96b28b4466 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:00.395699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:00.396311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:00.396587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:00.396860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:00.397503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:00.399164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:00.413453 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1578/3184] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:21:00.417889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:00.429119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531862c-6a29-40da-914c-969bd130ebe1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:00.444063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:00.444820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:00.445507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:00.446031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] PATH_INFO: `/v3/projects/f08c2baa1a6d4e09a5e0605a3368d4c8/users/303ddd790d15450a8fafb1e6a9a20fca/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:00.479883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08c2baa1a6d4e09a5e0605a3368d4c8, user_id=303ddd790d15450a8fafb1e6a9a20fca, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:00.483372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:00.594189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1607/3185] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:21:00 2022] PUT /identity/v3/projects/f08c2baa1a6d4e09a5e0605a3368d4c8/users/303ddd790d15450a8fafb1e6a9a20fca/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:00.594625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:00.608123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318daa3f-36c0-4884-9d13-dabd7d4079ca admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:00.735422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ebe55-064d-47ed-8272-252be460fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:00.736253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ebe55-064d-47ed-8272-252be460fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:00.736595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ebe55-064d-47ed-8272-252be460fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:00.737524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ebe55-064d-47ed-8272-252be460fbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:00.738289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ebe55-064d-47ed-8272-252be460fbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:00.740254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ebe55-064d-47ed-8272-252be460fbc7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:00.767300 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1579/3186] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:21:00.771839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:00.785993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a4319-479f-4704-9463-57e2d5c4a712 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:00.795895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:00.796912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:00.797902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:00.798502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] PATH_INFO: `/v3/projects/f08c2baa1a6d4e09a5e0605a3368d4c8/users/303ddd790d15450a8fafb1e6a9a20fca/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:00.802133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08c2baa1a6d4e09a5e0605a3368d4c8, user_id=303ddd790d15450a8fafb1e6a9a20fca, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:00.805692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:00.840384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1608/3187] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:21:00 2022] PUT /identity/v3/projects/f08c2baa1a6d4e09a5e0605a3368d4c8/users/303ddd790d15450a8fafb1e6a9a20fca/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:21:00.845625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241fe99-cfca-4b3a-8693-a4706e315e94 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:00.845907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241fe99-cfca-4b3a-8693-a4706e315e94 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:00.846685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241fe99-cfca-4b3a-8693-a4706e315e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:00.888799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7241fe99-cfca-4b3a-8693-a4706e315e94 None None] MFA Rules not processed for user `303ddd790d15450a8fafb1e6a9a20fca`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:00.890199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7241fe99-cfca-4b3a-8693-a4706e315e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:00.963140 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:00.992857 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1580/3188] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:01.059452 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:01.565535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:01.568922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:01.746305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b9fbc-5161-4ead-8968-764a0189cc9e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:01.757991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:01.763796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:01.763796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:01.763796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:01.770665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:01.772465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:01.797303 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1609/3189] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:21:01.805268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d44c-e263-42a3-abdb-93a9a5ce1997 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:01.805898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d44c-e263-42a3-abdb-93a9a5ce1997 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:01.805898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d44c-e263-42a3-abdb-93a9a5ce1997 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:01.807409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1581/3190] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:01.813219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:01.833629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:01.853683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b7f37-7d99-4b69-9b6f-fa244a53034d service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:01.859692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:01.860860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:01.861574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:01.863130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:01.865015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:01.867862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:01.870377 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1610/3191] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:01 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:02.443122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a73c5-3b94-442c-96f1-d38cc6d7d82d None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:02.448333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a73c5-3b94-442c-96f1-d38cc6d7d82d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:02.448333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a73c5-3b94-442c-96f1-d38cc6d7d82d None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:02.448333 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1582/3192] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:02.456036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:02.457902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:02.486557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:02.504948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffa68c-3197-48ed-93af-6fb851cfc172 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:02.527012 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:02.528406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:02.529786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:02.530110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:02.530401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:02.532622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:02.535507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:02.547963 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1611/3193] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:02 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:02.789590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7722f6-6c8e-4b3b-9a3b-0cc8ec01d531 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:02.789978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7722f6-6c8e-4b3b-9a3b-0cc8ec01d531 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:02.790347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7722f6-6c8e-4b3b-9a3b-0cc8ec01d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:02.827275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ed7722f6-6c8e-4b3b-9a3b-0cc8ec01d531 None None] MFA Rules not processed for user `1815b1faa4b04f938bd947b6e797e0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:02.828856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ed7722f6-6c8e-4b3b-9a3b-0cc8ec01d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:02.915103 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1583/3194] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:03.238668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:03.256395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e8d41-8ddc-48b9-90c8-564500d5c71a tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:03.263616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:03.264328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:03.264692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:03.265049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:03.291838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:03.293447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:03.315817 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1612/3195] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:21:03.572012 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:04.574347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c3ac-74b3-48c1-9321-61d0b0f91d2a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:04.575453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c3ac-74b3-48c1-9321-61d0b0f91d2a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:04.575952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090c3ac-74b3-48c1-9321-61d0b0f91d2a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:04.578653 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1584/3196] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:04.585128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:04.599682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:04.609871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4b0d-a4c5-4a87-9752-dd65f13ebf51 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:04.614898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:04.615606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:04.615894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:04.616278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:04.617455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:04.619573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:04.621399 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1613/3197] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:04 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:05.159254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5281-4311-4cd1-8172-46b30d610f65 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:05.159828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5281-4311-4cd1-8172-46b30d610f65 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:05.160271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5281-4311-4cd1-8172-46b30d610f65 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:05.162442 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1585/3198] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:05.167562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:05.182672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:05.195228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922efec-218a-4380-ba9d-ec02a5704197 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:05.200770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:05.201523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:05.202238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:05.202633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:05.203922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:05.207044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:05.211461 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1614/3199] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:05 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:21:05.381931 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:05.428718 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:05.446819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b9e30-8992-4535-8417-650ab832c68a None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:05.447285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b9e30-8992-4535-8417-650ab832c68a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:05.447650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b9e30-8992-4535-8417-650ab832c68a None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:05.449374 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1586/3200] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:05.455918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:05.470560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:05.482218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9698c-ab0b-4870-b519-274cef5422f2 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:05.488322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909170-c0a4-429b-bcf1-e7bc54414730 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:05.489027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909170-c0a4-429b-bcf1-e7bc54414730 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:05.489315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909170-c0a4-429b-bcf1-e7bc54414730 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:05.489595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909170-c0a4-429b-bcf1-e7bc54414730 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:05.490948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13909170-c0a4-429b-bcf1-e7bc54414730 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:05.493576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13909170-c0a4-429b-bcf1-e7bc54414730 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:05.495881 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1615/3201] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:05 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:05.705262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:05.705749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:05.705749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:05.734678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] MFA Rules not processed for user `1815b1faa4b04f938bd947b6e797e0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:05.741056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:05.755563 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1587/3202] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:06.400393 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:07.795521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360a59-d176-4f43-93cb-5579373bffd9 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:07.796117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360a59-d176-4f43-93cb-5579373bffd9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:07.796117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360a59-d176-4f43-93cb-5579373bffd9 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:07.797664 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1616/3203] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:07.808144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:07.827807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:07.840044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9712bf3-2b27-46d1-b800-dff13fc7f9f7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:07.861421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:07.863007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:07.863494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:07.863937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:07.865300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:07.867559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:07.880804 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1588/3204] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:07 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:08.216628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a27e49-8c26-4799-867d-1b68824a8f00 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:08.217166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a27e49-8c26-4799-867d-1b68824a8f00 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:08.217433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a27e49-8c26-4799-867d-1b68824a8f00 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:08.219042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1617/3205] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:08.226137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:08.247153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:08.257523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90350287-af2b-4c3f-a72e-1fc84b104419 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:08.262382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:08.263093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:08.263632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:08.264138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:08.265392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:08.267645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:08.269901 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1589/3206] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:08 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:08.415175 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:08.569657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd686a-5bd2-4921-bd62-179372816e3e None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:08.569987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd686a-5bd2-4921-bd62-179372816e3e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:08.570267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd686a-5bd2-4921-bd62-179372816e3e None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:08.572385 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1618/3207] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:08.577173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:08.593743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:08.609087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ee43e-d1e3-47d4-a061-7ba466296486 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:08.616298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3112bf-a7fd-4380-86d0-2e1edb1d0069 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:08.619188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3112bf-a7fd-4380-86d0-2e1edb1d0069 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:08.619188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3112bf-a7fd-4380-86d0-2e1edb1d0069 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:08.619188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3112bf-a7fd-4380-86d0-2e1edb1d0069 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:08.619188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3112bf-a7fd-4380-86d0-2e1edb1d0069 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:08.632204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3112bf-a7fd-4380-86d0-2e1edb1d0069 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:08.652919 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1590/3208] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:08 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:08.874241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:08.874838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:08.874838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:08.898009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] MFA Rules not processed for user `1815b1faa4b04f938bd947b6e797e0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:08.899471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:08.913640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1619/3209] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:09.978201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c596b-bb94-41f2-91fe-b62f9b5a3bad None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:09.982427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c596b-bb94-41f2-91fe-b62f9b5a3bad None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:09.982427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c596b-bb94-41f2-91fe-b62f9b5a3bad None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:09.982427 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1591/3210] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:21:09.993744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:21:10.051624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:10.086833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b925ec-8d8b-4c80-91aa-908ec4797c26 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:10.093129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f65d0-1881-4ea2-b63d-488a3ce78b70 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303ddd790d15450a8fafb1e6a9a20fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:10.094198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f65d0-1881-4ea2-b63d-488a3ce78b70 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:10.094807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f65d0-1881-4ea2-b63d-488a3ce78b70 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:10.095234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f65d0-1881-4ea2-b63d-488a3ce78b70 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:10.098098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f65d0-1881-4ea2-b63d-488a3ce78b70 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorizing `identity:get_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:10.100858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f65d0-1881-4ea2-b63d-488a3ce78b70 tempest-QuotasAdminNegativeTest-1930792111 tempest-QuotasAdminNegativeTest-1930792111-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:10.104259 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1620/3211] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:21:09 2022] GET /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 381 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:10.383379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1387caf-c680-4b81-adae-9ab979f04e88 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:10.383379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1387caf-c680-4b81-adae-9ab979f04e88 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:10.383594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1387caf-c680-4b81-adae-9ab979f04e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:10.486322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c1387caf-c680-4b81-adae-9ab979f04e88 None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:10.488207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1387caf-c680-4b81-adae-9ab979f04e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:10.719038 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1592/3212] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:10.727688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6d57c-6587-436e-b8d0-bf0de68a24bd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:10.728020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6d57c-6587-436e-b8d0-bf0de68a24bd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:10.728299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6d57c-6587-436e-b8d0-bf0de68a24bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:10.769967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-72d6d57c-6587-436e-b8d0-bf0de68a24bd None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:10.771245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-72d6d57c-6587-436e-b8d0-bf0de68a24bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:10.798526 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1621/3213] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:10.896920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1387caf-c680-4b81-adae-9ab979f04e88 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:10.913337 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:11.010054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1387caf-c680-4b81-adae-9ab979f04e88 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:11.020343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:11.021832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:11.022163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6d57c-6587-436e-b8d0-bf0de68a24bd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:11.022899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:11.023402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] PATH_INFO: `/v3/users/1815b1faa4b04f938bd947b6e797e0c3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:11.024877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1815b1faa4b04f938bd947b6e797e0c3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:11.027339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:11.054553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6d57c-6587-436e-b8d0-bf0de68a24bd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:11.077686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0a7d6-5f61-4bde-bdfa-c4e232834f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:11.078358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0a7d6-5f61-4bde-bdfa-c4e232834f59 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:11.078645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0a7d6-5f61-4bde-bdfa-c4e232834f59 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:11.078929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0a7d6-5f61-4bde-bdfa-c4e232834f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:11.092008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0a7d6-5f61-4bde-bdfa-c4e232834f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:11.094912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0a7d6-5f61-4bde-bdfa-c4e232834f59 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:11.113459 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1622/3214] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:21:11.288553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1815b1faa4b04f938bd947b6e797e0c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:11.312072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1815b1faa4b04f938bd947b6e797e0c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:11.320845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1815b1faa4b04f938bd947b6e797e0c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:11.321719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1815b1faa4b04f938bd947b6e797e0c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:11.413138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e3954159-91d1-4683-921c-ff8ef6b65e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1815b1faa4b04f938bd947b6e797e0c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:11.434628 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1593/3215] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:21:10 2022] DELETE /identity/v3/users/1815b1faa4b04f938bd947b6e797e0c3 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:11.441493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:11.443652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:11.451303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:11.495532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:11.496833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:11.537150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:11.541060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:11.541060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:11.558120 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:11.563204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:11.565228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:11.585644 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1623/3216] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:11.596381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:11.598551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:11.687195 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1594/3217] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:21:11.702588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:11.703791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:11.705095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35eb5cd-d379-4020-a0bd-dfdd08852e7b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:11.714087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:11.715467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:11.715924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:11.716622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:11.734759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:11.737836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:11.755065 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1624/3218] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:21:11.827423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687d63-75c3-4fb4-8142-8ca8f9d25a32 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:11.835255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:11.835874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:11.836451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:11.837404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:11.850134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:11.851929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:11.864562 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1595/3219] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:21:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:21:11.870488 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:13.523843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:13.525593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:13.554351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528513c-176d-415e-8a46-60ec715b5f9f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:13.563842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:13.564500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:13.565873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:13.566167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] PATH_INFO: `/v3/projects/23debbbae67c4925bbba891ef306b9d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:13.570648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23debbbae67c4925bbba891ef306b9d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:13.573847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:13.759041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23debbbae67c4925bbba891ef306b9d4', 'request_id': 'req-c91794eb-f16d-4cd8-906f-386b4c3bcb29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:13.766648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23debbbae67c4925bbba891ef306b9d4', 'request_id': 'req-c91794eb-f16d-4cd8-906f-386b4c3bcb29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:13.840211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23debbbae67c4925bbba891ef306b9d4', 'request_id': 'req-c91794eb-f16d-4cd8-906f-386b4c3bcb29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:13.859929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] The token cache is being invalidate because project 23debbbae67c4925bbba891ef306b9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:21:13.860286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:13.863663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:13.866974 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1625/3220] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:21:13 2022] DELETE /identity/v3/projects/23debbbae67c4925bbba891ef306b9d4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:13.874883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:13.888317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f937d1d-d3f0-4c9e-929b-a70e6c3ed99a service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:14.141841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:14.142524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:14.143374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:14.144728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] PATH_INFO: `/v3/users/303ddd790d15450a8fafb1e6a9a20fca` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:14.148632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] RBAC: Authorizing `identity:delete_user(user_id=303ddd790d15450a8fafb1e6a9a20fca)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:14.154918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:14.442521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:14.444152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:14.475060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303ddd790d15450a8fafb1e6a9a20fca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:14.564066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303ddd790d15450a8fafb1e6a9a20fca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:14.594339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303ddd790d15450a8fafb1e6a9a20fca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:14.595191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303ddd790d15450a8fafb1e6a9a20fca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:14.639932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91794eb-f16d-4cd8-906f-386b4c3bcb29 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:14.654283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:14.667239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:14.668102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:14.676929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:14.683217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:14.709586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:14.711370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:14.754036 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1626/3221] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:21:14.778919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-005e15cf-1bc1-4ef6-83ad-1ebcf038576c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303ddd790d15450a8fafb1e6a9a20fca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:14.795455 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1596/3222] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:21:13 2022] DELETE /identity/v3/users/303ddd790d15450a8fafb1e6a9a20fca => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:15.968457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:15.972588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:15.994333 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:16.013131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408be11-7efc-4d49-865c-adea6a85002e service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:16.168286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:16.169110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:16.169490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:16.170047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] PATH_INFO: `/v3/projects/f08c2baa1a6d4e09a5e0605a3368d4c8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:16.175590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08c2baa1a6d4e09a5e0605a3368d4c8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:16.178186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:16.368103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'request_id': 'req-da61cac9-c583-41f9-b331-f88351b3bb1a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:16.377183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'request_id': 'req-da61cac9-c583-41f9-b331-f88351b3bb1a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:16.476403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08c2baa1a6d4e09a5e0605a3368d4c8', 'request_id': 'req-da61cac9-c583-41f9-b331-f88351b3bb1a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:16.496044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] The token cache is being invalidate because project f08c2baa1a6d4e09a5e0605a3368d4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:21:16.496342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:16.497017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-da61cac9-c583-41f9-b331-f88351b3bb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:16.506599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ec52-f54f-4f2a-a092-7d554867c052 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:16.507295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ec52-f54f-4f2a-a092-7d554867c052 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:16.507295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9ec52-f54f-4f2a-a092-7d554867c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:16.511139 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1627/3223] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:21:15 2022] DELETE /identity/v3/projects/f08c2baa1a6d4e09a5e0605a3368d4c8 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:16.532410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f3f9ec52-f54f-4f2a-a092-7d554867c052 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:16.534922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f3f9ec52-f54f-4f2a-a092-7d554867c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:16.586660 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:16.623424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f4bbd-896f-416d-8aa2-cb1b4af50f2a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:16.624125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f4bbd-896f-416d-8aa2-cb1b4af50f2a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:16.624670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f4bbd-896f-416d-8aa2-cb1b4af50f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:16.629579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1597/3224] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:16.650205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-843f4bbd-896f-416d-8aa2-cb1b4af50f2a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:16.651835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-843f4bbd-896f-416d-8aa2-cb1b4af50f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:16.668341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ec52-f54f-4f2a-a092-7d554867c052 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:16.680687 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1628/3225] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:16.681108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9ec52-f54f-4f2a-a092-7d554867c052 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:16.687119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:16.687959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:16.688642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:16.689209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:16.690256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:21:16.690751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:16.693841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:16.718735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f4bbd-896f-416d-8aa2-cb1b4af50f2a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:16.730192 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1598/3226] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:21:16.731543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f4bbd-896f-416d-8aa2-cb1b4af50f2a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:16.738133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:16.738973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:16.739448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:16.739887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:16.740693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:16.743191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:16.887137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1629/3227] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:21:16 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:21:16.892617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:16.908251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764ecef-b5de-489a-8bab-759e35b01561 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:17.219364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:17.231931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:17.232466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:17.233069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:17.234048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:17.241945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:17.432885 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1599/3228] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:21:16 2022] POST /identity/v3/users => generated 293 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:21:17.434472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:17.467029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045dfa2-0ec7-41ab-8bd9-3d9d9dc5cabf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:17.475637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:17.476522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:17.492332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:17.492967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:17.493947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:17.496092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:17.525993 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1630/3229] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:21:17.531588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:17.553056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70beb59-baa4-4cdf-84d2-93cdea9e0798 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:17.559601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa174c-721e-41a8-86c5-30984b0ad846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:17.560767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa174c-721e-41a8-86c5-30984b0ad846 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:17.561212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa174c-721e-41a8-86c5-30984b0ad846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:17.562131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa174c-721e-41a8-86c5-30984b0ad846 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:17.563220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa174c-721e-41a8-86c5-30984b0ad846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:17.565036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa174c-721e-41a8-86c5-30984b0ad846 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:17.589185 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1600/3230] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:21:17.591891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:17.635767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b2242-5008-4c36-903c-fc3a1daea00f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:17.663763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:17.664870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:17.665246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:17.665526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] PATH_INFO: `/v3/projects/0a621f47a1284128962c8f55775b2c9e/users/c69ab491e3ba4451baba751279ef3123/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:17.702817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a621f47a1284128962c8f55775b2c9e, user_id=c69ab491e3ba4451baba751279ef3123, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:17.707215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:17.822192 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1631/3231] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:21:17 2022] PUT /identity/v3/projects/0a621f47a1284128962c8f55775b2c9e/users/c69ab491e3ba4451baba751279ef3123/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:17.828700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32ad9-8b20-459a-a050-6e6aff578d43 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:17.828828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32ad9-8b20-459a-a050-6e6aff578d43 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:17.829010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d32ad9-8b20-459a-a050-6e6aff578d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:17.907952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e3d32ad9-8b20-459a-a050-6e6aff578d43 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:17.913881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e3d32ad9-8b20-459a-a050-6e6aff578d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:18.105864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1601/3232] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:18.198192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:18.203339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:18.274909 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:18.341304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a6bec-27ec-45b3-a0c9-f540cb0f462e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:18.350433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cc696-23f8-4cc1-a12f-6343871c1903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:18.351362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc696-23f8-4cc1-a12f-6343871c1903 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:18.351729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc696-23f8-4cc1-a12f-6343871c1903 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:18.352121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cc696-23f8-4cc1-a12f-6343871c1903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:18.374756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cc696-23f8-4cc1-a12f-6343871c1903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:18.378959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cc696-23f8-4cc1-a12f-6343871c1903 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:18.403602 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1632/3233] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:21:18.530348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:18.536175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:18.536175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:18.579805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] MFA Rules not processed for user `81c50e66203b49cbb601370e2b0555ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:18.583436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:18.655231 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:18.685949 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1602/3234] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:21.509958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6ff3-475b-46c7-a5ea-3128fb891616 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:21.510510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6ff3-475b-46c7-a5ea-3128fb891616 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:21.510510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6ff3-475b-46c7-a5ea-3128fb891616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:21.546909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e67e6ff3-475b-46c7-a5ea-3128fb891616 None None] MFA Rules not processed for user `ca7c543aa0e04fbd9eaa1fa04378accc`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:21.548859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e67e6ff3-475b-46c7-a5ea-3128fb891616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:21.637748 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1633/3235] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:24.219553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:24.224125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:24.290199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aeee8-6972-4b70-a9a1-c29c0a03d26d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:24.310805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:24.311766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:24.314542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:24.315759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] PATH_INFO: `/v3/users/47367935d94f408691a9448e06d8fdfd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:24.323307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47367935d94f408691a9448e06d8fdfd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:24.332532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:24.651465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47367935d94f408691a9448e06d8fdfd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:24.688576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47367935d94f408691a9448e06d8fdfd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:24.736370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47367935d94f408691a9448e06d8fdfd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:24.740631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47367935d94f408691a9448e06d8fdfd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:24.888916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3844a2-cd1b-4739-91cc-8a09f1424008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47367935d94f408691a9448e06d8fdfd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:24.901718 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1603/3236] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:21:24 2022] DELETE /identity/v3/users/47367935d94f408691a9448e06d8fdfd => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:25.545997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6ff3-475b-46c7-a5ea-3128fb891616 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:25.573875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6ff3-475b-46c7-a5ea-3128fb891616 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:25.669433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:25.670186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:25.670534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:25.670898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] PATH_INFO: `/v3/projects/c67e0618a3af4ccb920a9b832cd6245d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:25.673889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67e0618a3af4ccb920a9b832cd6245d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:25.676647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:25.944157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67e0618a3af4ccb920a9b832cd6245d', 'request_id': 'req-4948146b-60b9-40b4-adf6-44d6802e9d56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:25.966947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67e0618a3af4ccb920a9b832cd6245d', 'request_id': 'req-4948146b-60b9-40b4-adf6-44d6802e9d56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:26.199135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67e0618a3af4ccb920a9b832cd6245d', 'request_id': 'req-4948146b-60b9-40b4-adf6-44d6802e9d56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:26.213029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] The token cache is being invalidate because project c67e0618a3af4ccb920a9b832cd6245d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:21:26.213328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:26.214797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4948146b-60b9-40b4-adf6-44d6802e9d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:21:26.216528 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1634/3237] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:21:25 2022] DELETE /identity/v3/projects/c67e0618a3af4ccb920a9b832cd6245d => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:26.223618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056d0a-ae76-4fe1-831a-5ce5bce4ef0d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:26.231999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056d0a-ae76-4fe1-831a-5ce5bce4ef0d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:26.231999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056d0a-ae76-4fe1-831a-5ce5bce4ef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:26.261034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-49056d0a-ae76-4fe1-831a-5ce5bce4ef0d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:26.265957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-49056d0a-ae76-4fe1-831a-5ce5bce4ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:26.456911 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1604/3238] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:26.462813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca797de-d5cb-49ad-85c9-fdab394900cd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:26.463140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca797de-d5cb-49ad-85c9-fdab394900cd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:26.463702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca797de-d5cb-49ad-85c9-fdab394900cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:26.502846 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:26.525983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-aca797de-d5cb-49ad-85c9-fdab394900cd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:26.527732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aca797de-d5cb-49ad-85c9-fdab394900cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:26.549598 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1635/3239] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:26.553477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056d0a-ae76-4fe1-831a-5ce5bce4ef0d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:26.568849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056d0a-ae76-4fe1-831a-5ce5bce4ef0d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:26.583405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:26.584029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:26.584317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:26.584595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:26.585619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:21:26.586033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:26.587748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:26.609878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1605/3240] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:21:26.612443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca797de-d5cb-49ad-85c9-fdab394900cd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:26.626188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca797de-d5cb-49ad-85c9-fdab394900cd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:26.698409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:26.699561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:26.700068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:26.700548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:26.701549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:26.704916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:27.149625 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1636/3241] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:21:26 2022] POST /identity/v3/projects => generated 381 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:21:27.153751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:27.168637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264a098-7db3-45ea-8b92-9b0731f88560 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:27.266150 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:27.284035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:27.284035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:27.284262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:27.285712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:27.286684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:27.289156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:27.447012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1606/3242] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:21:27 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:21:27.448939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:27.469159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04243429-ec5d-456d-9b68-031a641da8e9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:27.486868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f833fe3-7cde-417a-bcb4-b1b352dc0dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:27.491670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833fe3-7cde-417a-bcb4-b1b352dc0dbc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:27.491935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833fe3-7cde-417a-bcb4-b1b352dc0dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:27.493081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f833fe3-7cde-417a-bcb4-b1b352dc0dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:27.493785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f833fe3-7cde-417a-bcb4-b1b352dc0dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:27.496233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f833fe3-7cde-417a-bcb4-b1b352dc0dbc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:27.538899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1637/3243] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:21:27.543499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:27.552241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:27.553782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:27.556248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:27.562940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b7d8-a625-49ca-ad91-bc852dd653c3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:27.571192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:27.572283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:27.572830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:27.573357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:27.574636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:27.576700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:27.590438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:27.591670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:27.611063 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1607/3244] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:21:27.617668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:27.648116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fbd89-e4b3-4553-a01f-4f7f8ba3af64 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:27.664271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12602d25-fa95-4399-850c-6888016ed640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:27.664992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602d25-fa95-4399-850c-6888016ed640 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:27.665282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602d25-fa95-4399-850c-6888016ed640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:27.670067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12602d25-fa95-4399-850c-6888016ed640 admin admin] PATH_INFO: `/v3/projects/96c32776837d4c89bebb402c3c374bb7/users/cb7f5378ae6f467c939f924d15112640/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:27.707361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12602d25-fa95-4399-850c-6888016ed640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c32776837d4c89bebb402c3c374bb7, user_id=cb7f5378ae6f467c939f924d15112640, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:27.713756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12602d25-fa95-4399-850c-6888016ed640 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:27.755783 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1638/3245] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:27.779876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:27.783225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:27.820010 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1608/3246] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:21:27 2022] PUT /identity/v3/projects/96c32776837d4c89bebb402c3c374bb7/users/cb7f5378ae6f467c939f924d15112640/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:27.829130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:27.829705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:27.830156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:27.937544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:27.946513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:28.061357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93995536-f1cb-48ba-95e6-ee4673f12e79 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:28.106612 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1609/3247] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:28.119784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:28.124094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:28.172520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:28.173150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:28.173708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:28.174646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:28.229768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87609f7-da6c-4edc-bfdd-887fbce304e3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:28.234905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2f7e-2f36-4cdf-ab7f-a799f9e1f63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:28.235737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2f7e-2f36-4cdf-ab7f-a799f9e1f63b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:28.236027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2f7e-2f36-4cdf-ab7f-a799f9e1f63b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:28.237693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2f7e-2f36-4cdf-ab7f-a799f9e1f63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:28.250768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a2f7e-2f36-4cdf-ab7f-a799f9e1f63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:28.256254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a2f7e-2f36-4cdf-ab7f-a799f9e1f63b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:28.257188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:28.258967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:28.265566 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1610/3248] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:21:28.285191 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1639/3249] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:21:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:21:29.682281 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:36.257495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007abaf-b856-4ac5-abba-a7021609fab8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:36.258563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007abaf-b856-4ac5-abba-a7021609fab8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:36.259051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007abaf-b856-4ac5-abba-a7021609fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:36.299235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b007abaf-b856-4ac5-abba-a7021609fab8 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:36.301318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b007abaf-b856-4ac5-abba-a7021609fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:36.325160 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1611/3250] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:21:36.343284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:36.358777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951d20-f855-493d-bd7d-2a3966618b22 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:36.373362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b57c6-d626-4ee8-a16d-7ff2ec654ae9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:36.374028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b57c6-d626-4ee8-a16d-7ff2ec654ae9 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:36.374316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b57c6-d626-4ee8-a16d-7ff2ec654ae9 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:36.380537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b57c6-d626-4ee8-a16d-7ff2ec654ae9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:36.444789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b57c6-d626-4ee8-a16d-7ff2ec654ae9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:36.446536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b57c6-d626-4ee8-a16d-7ff2ec654ae9 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:36.475688 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1640/3251] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:21:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:21:39.483035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:39.483617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:39.483888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:39.523034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] MFA Rules not processed for user `38a38185ccdc4f1693d93aeed92c93fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:39.529044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:39.658162 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:39.707073 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1612/3252] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:39.767831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cf7e3-8656-43d1-abaf-ba9d75838286 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:39.767831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cf7e3-8656-43d1-abaf-ba9d75838286 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:39.767831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cf7e3-8656-43d1-abaf-ba9d75838286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:39.868733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-089cf7e3-8656-43d1-abaf-ba9d75838286 None None] MFA Rules not processed for user `c69ab491e3ba4451baba751279ef3123`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:39.879543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-089cf7e3-8656-43d1-abaf-ba9d75838286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:40.103855 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1641/3253] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:40.108073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:40.110529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:40.160127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91babbc-55b3-4c3f-b421-d2d008e73172 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:40.180751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:40.181398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:40.181680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:40.184102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:40.185124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:40.189123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:40.343269 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1613/3254] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:21:40 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:21:40.347549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cf7e3-8656-43d1-abaf-ba9d75838286 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:40.364722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cf7e3-8656-43d1-abaf-ba9d75838286 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:40.612581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:40.613241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:40.619144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:40.619144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:40.621975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:40.629743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:40.764130 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1642/3255] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:21:40 2022] POST /identity/v3/users => generated 298 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:21:40.769362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:40.789109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37887d-8f01-4392-ab6d-b66420cc88f8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:40.808442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:40.809323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:40.809749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:40.810519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:40.811485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:40.813380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:40.854486 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1614/3256] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:21:40.854858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:40.866218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419092-8c1f-456f-88d6-0eba2a346b91 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:40.896203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:40.897603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:40.897603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:40.898300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] PATH_INFO: `/v3/projects/16d7c5f8c4dc4541b5970c10270c1319/users/1a3b46689dca44699e070c473b84a488/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:40.968985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d7c5f8c4dc4541b5970c10270c1319, user_id=1a3b46689dca44699e070c473b84a488, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:40.980363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:41.079448 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:41.086195 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1643/3257] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:21:40 2022] PUT /identity/v3/projects/16d7c5f8c4dc4541b5970c10270c1319/users/1a3b46689dca44699e070c473b84a488/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:41.090098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:41.105052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f31a8-d1a9-466a-b854-5098c8dd79a0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:41.269361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900300e-a23d-4c81-afa9-939a21dda3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:41.270289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900300e-a23d-4c81-afa9-939a21dda3ff admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:41.270674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900300e-a23d-4c81-afa9-939a21dda3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:41.271110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900300e-a23d-4c81-afa9-939a21dda3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:41.272013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900300e-a23d-4c81-afa9-939a21dda3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:41.276564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900300e-a23d-4c81-afa9-939a21dda3ff admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:41.331682 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1615/3258] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:21:41.332005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:41.394634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830f215-f8ac-41b4-830b-ecd9041ca40b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:41.436666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:41.437471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:41.437701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:41.438009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] PATH_INFO: `/v3/projects/16d7c5f8c4dc4541b5970c10270c1319/users/1a3b46689dca44699e070c473b84a488/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:41.453608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d7c5f8c4dc4541b5970c10270c1319, user_id=1a3b46689dca44699e070c473b84a488, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:41.477695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:41.665221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1644/3259] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:21:41 2022] PUT /identity/v3/projects/16d7c5f8c4dc4541b5970c10270c1319/users/1a3b46689dca44699e070c473b84a488/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:21:44.834581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968eafa-f12f-400f-9573-73503f2eb825 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:44.835082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968eafa-f12f-400f-9573-73503f2eb825 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:44.835222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968eafa-f12f-400f-9573-73503f2eb825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:44.921161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c968eafa-f12f-400f-9573-73503f2eb825 None None] MFA Rules not processed for user `cb7f5378ae6f467c939f924d15112640`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:44.922828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c968eafa-f12f-400f-9573-73503f2eb825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:45.240309 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1616/3260] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:46.717965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:21:46.719986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:47.014782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa462-c9e6-4509-9d4a-6396fea4c778 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:21:47.023168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5292a-c1d9-4780-8b16-7ce089a8ec58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:21:47.024159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5292a-c1d9-4780-8b16-7ce089a8ec58 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:47.024542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5292a-c1d9-4780-8b16-7ce089a8ec58 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:47.024920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5292a-c1d9-4780-8b16-7ce089a8ec58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:47.037407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5292a-c1d9-4780-8b16-7ce089a8ec58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:21:47.054052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5292a-c1d9-4780-8b16-7ce089a8ec58 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:21:47.073391 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1645/3261] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:21:50.183341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2832c4-6255-43a0-8d42-068de3fd79cd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:50.184291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2832c4-6255-43a0-8d42-068de3fd79cd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:50.184768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2832c4-6255-43a0-8d42-068de3fd79cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:50.248654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cd2832c4-6255-43a0-8d42-068de3fd79cd None None] MFA Rules not processed for user `cb7f5378ae6f467c939f924d15112640`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:50.250676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cd2832c4-6255-43a0-8d42-068de3fd79cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:50.275162 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1617/3262] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:51.912540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897ce5e-8382-49f6-a757-4b63b18f7713 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:51.913386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897ce5e-8382-49f6-a757-4b63b18f7713 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:51.914016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897ce5e-8382-49f6-a757-4b63b18f7713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:51.954274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5897ce5e-8382-49f6-a757-4b63b18f7713 None None] MFA Rules not processed for user `81c50e66203b49cbb601370e2b0555ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:51.960206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5897ce5e-8382-49f6-a757-4b63b18f7713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:52.095471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1646/3263] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:21:57.187506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedd31-fa20-4ac3-b106-73d67d1c4800 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:21:57.188733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedd31-fa20-4ac3-b106-73d67d1c4800 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:21:57.189720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedd31-fa20-4ac3-b106-73d67d1c4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:21:57.216899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a3cedd31-fa20-4ac3-b106-73d67d1c4800 None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:21:57.218594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a3cedd31-fa20-4ac3-b106-73d67d1c4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:21:57.312352 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:57.402319 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1618/3264] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:00.070118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606264-ccd8-4fc9-9295-7b48629c5eee None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:00.071015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606264-ccd8-4fc9-9295-7b48629c5eee None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:00.071439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5606264-ccd8-4fc9-9295-7b48629c5eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:00.132220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c5606264-ccd8-4fc9-9295-7b48629c5eee None None] MFA Rules not processed for user `1a3b46689dca44699e070c473b84a488`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:00.135927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c5606264-ccd8-4fc9-9295-7b48629c5eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:00.335764 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:00.346105 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1647/3265] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:01.964120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cedd31-fa20-4ac3-b106-73d67d1c4800 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:01.995534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cedd31-fa20-4ac3-b106-73d67d1c4800 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:02.015620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:02.016430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:02.018123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:02.021142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:02.209701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:02.211604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:02.245905 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1619/3266] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:03.050722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6f2e-0fdf-419d-83c5-264c2a713d19 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:03.052389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6f2e-0fdf-419d-83c5-264c2a713d19 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:03.053331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad6f2e-0fdf-419d-83c5-264c2a713d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:03.092380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-afad6f2e-0fdf-419d-83c5-264c2a713d19 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:03.094481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-afad6f2e-0fdf-419d-83c5-264c2a713d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:03.293164 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1648/3267] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:03.328892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:03.453570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19362a75-5905-4c89-92e1-7fa559ace231 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:03.462746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9621eb-39a5-4618-a792-ce51a7bf1f66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:03.463759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9621eb-39a5-4618-a792-ce51a7bf1f66 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:03.464003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9621eb-39a5-4618-a792-ce51a7bf1f66 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:03.464284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9621eb-39a5-4618-a792-ce51a7bf1f66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:03.475235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9621eb-39a5-4618-a792-ce51a7bf1f66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:03.477190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9621eb-39a5-4618-a792-ce51a7bf1f66 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:03.541987 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1620/3268] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:22:08.066075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe31f4-a36a-44f8-bcef-2fc7850846da None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:08.067969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe31f4-a36a-44f8-bcef-2fc7850846da None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:08.067969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe31f4-a36a-44f8-bcef-2fc7850846da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:08.087219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-debe31f4-a36a-44f8-bcef-2fc7850846da None None] MFA Rules not processed for user `c69ab491e3ba4451baba751279ef3123`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:08.088549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-debe31f4-a36a-44f8-bcef-2fc7850846da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:08.100343 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1649/3269] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:13.368763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8832bd-ed06-4e37-b011-f422c1893e39 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:13.369296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8832bd-ed06-4e37-b011-f422c1893e39 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:13.369390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8832bd-ed06-4e37-b011-f422c1893e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:13.396376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3c8832bd-ed06-4e37-b011-f422c1893e39 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:13.397767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c8832bd-ed06-4e37-b011-f422c1893e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:13.407118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1621/3270] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:13.424072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe31f4-a36a-44f8-bcef-2fc7850846da None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:13.442504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe31f4-a36a-44f8-bcef-2fc7850846da None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:13.448036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae42c7a-5d2a-4ae6-bc16-9f91fa8bdabf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:13.448770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42c7a-5d2a-4ae6-bc16-9f91fa8bdabf service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:13.449059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42c7a-5d2a-4ae6-bc16-9f91fa8bdabf service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:13.449352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae42c7a-5d2a-4ae6-bc16-9f91fa8bdabf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:13.460087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae42c7a-5d2a-4ae6-bc16-9f91fa8bdabf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:13.461889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae42c7a-5d2a-4ae6-bc16-9f91fa8bdabf service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:13.474899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1650/3271] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:22:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:22:23.388786 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=72 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:23.473697 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=34 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:28.324590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8832bd-ed06-4e37-b011-f422c1893e39 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:28.519270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8832bd-ed06-4e37-b011-f422c1893e39 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:28.532892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:28.533599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:28.535043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:28.537213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:28.541955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:28.829422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:28.830643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:28.852512 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1622/3272] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:31.898767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3d52d-0e04-4111-b01d-93c79962b189 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:31.901458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3d52d-0e04-4111-b01d-93c79962b189 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:31.901945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3d52d-0e04-4111-b01d-93c79962b189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:31.930868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a3f3d52d-0e04-4111-b01d-93c79962b189 None None] MFA Rules not processed for user `cb7f5378ae6f467c939f924d15112640`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:31.932325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a3f3d52d-0e04-4111-b01d-93c79962b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:31.950057 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1651/3273] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:33.896640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:33.898388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:33.940578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3d52d-0e04-4111-b01d-93c79962b189 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:33.954588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3d52d-0e04-4111-b01d-93c79962b189 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:33.967383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb9360-6d43-471d-9d74-784aa21244bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:33.969143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb9360-6d43-471d-9d74-784aa21244bf service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:33.971720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb9360-6d43-471d-9d74-784aa21244bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:33.973888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb9360-6d43-471d-9d74-784aa21244bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:33.991862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e3eb9360-6d43-471d-9d74-784aa21244bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:34.040853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb9360-6d43-471d-9d74-784aa21244bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:34.047172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb9360-6d43-471d-9d74-784aa21244bf service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:34.091617 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1652/3274] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:34.139053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90154a8e-2746-4c43-91f8-d8abaf17ebff service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:34.146478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:34.147648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:34.148381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:34.148832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:34.151714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:34.166792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:34.169579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:34.193096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1623/3275] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:34.751924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:34.752145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:34.752423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:34.773851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:34.775996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:34.787505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1653/3276] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:34.836179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:34.856820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7f37-d200-41c3-b3d5-79e3117b4eed service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:34.872486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:34.873167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:34.873438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:34.873999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:34.916795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:34.920591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:34.959867 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1624/3277] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:22:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:22:38.818676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:38.820620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:38.840837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126da9cc-6992-4fb1-a63f-2d8de4852f78 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:38.848162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:38.849021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:38.849651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:38.850341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] PATH_INFO: `/v3/users/38a38185ccdc4f1693d93aeed92c93fd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:38.853689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a38185ccdc4f1693d93aeed92c93fd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:38.856128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:39.043209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a38185ccdc4f1693d93aeed92c93fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:39.043878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a38185ccdc4f1693d93aeed92c93fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:39.106309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a38185ccdc4f1693d93aeed92c93fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:39.121234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a38185ccdc4f1693d93aeed92c93fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:39.122309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a38185ccdc4f1693d93aeed92c93fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:39.144346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1654/3278] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:22:38 2022] DELETE /identity/v3/users/38a38185ccdc4f1693d93aeed92c93fd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:39.155415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:39.166405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:39.184521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe49937-d8e4-46e4-9b84-cded6ce9fe8e service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:39.215885 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:39.244971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:39.245651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:39.246196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:39.246529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:39.248553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:39.322357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:39.323827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:39.335013 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1625/3279] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:39.708363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:39.710630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:39.739385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b746c-5cf0-4221-abd9-d1e51dfb3ad8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:39.770745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:39.772591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:39.773590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:39.774667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] PATH_INFO: `/v3/projects/71566602401d421e8ba90e1c079c9314` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:39.777949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71566602401d421e8ba90e1c079c9314)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:39.783901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:39.866940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:39.873967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:39.894538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432016b-f141-42b4-be53-e4d98b8fbae2 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:39.900296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e04a2-1db9-49a0-bcd0-c4b41f2830f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:39.901516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e04a2-1db9-49a0-bcd0-c4b41f2830f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:39.903171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e04a2-1db9-49a0-bcd0-c4b41f2830f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:39.903675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e04a2-1db9-49a0-bcd0-c4b41f2830f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:39.919601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4c1e04a2-1db9-49a0-bcd0-c4b41f2830f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:39.966674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71566602401d421e8ba90e1c079c9314', 'request_id': 'req-9497a8f8-ade7-43e6-82f2-0152b647efb2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:39.980712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71566602401d421e8ba90e1c079c9314', 'request_id': 'req-9497a8f8-ade7-43e6-82f2-0152b647efb2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:40.050916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e04a2-1db9-49a0-bcd0-c4b41f2830f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:40.052528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e04a2-1db9-49a0-bcd0-c4b41f2830f6 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:40.065302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1626/3280] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:22:40.131059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71566602401d421e8ba90e1c079c9314', 'request_id': 'req-9497a8f8-ade7-43e6-82f2-0152b647efb2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:40.147259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] The token cache is being invalidate because project 71566602401d421e8ba90e1c079c9314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:22:40.147499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:40.148360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9497a8f8-ade7-43e6-82f2-0152b647efb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:40.150832 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1655/3281] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:22:39 2022] DELETE /identity/v3/projects/71566602401d421e8ba90e1c079c9314 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:40.156972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11a643-28b1-4322-9229-dd5c3abda402 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:40.158082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11a643-28b1-4322-9229-dd5c3abda402 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:40.158700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11a643-28b1-4322-9229-dd5c3abda402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:40.206816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2f11a643-28b1-4322-9229-dd5c3abda402 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:40.208442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2f11a643-28b1-4322-9229-dd5c3abda402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:40.312345 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1627/3282] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:40.320478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2467-c2ae-4bba-b88a-3eafbeaddf86 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:40.320792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2467-c2ae-4bba-b88a-3eafbeaddf86 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:40.321148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2467-c2ae-4bba-b88a-3eafbeaddf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:40.347122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-97dd2467-c2ae-4bba-b88a-3eafbeaddf86 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:40.348648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97dd2467-c2ae-4bba-b88a-3eafbeaddf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:40.358246 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1656/3283] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:40.365384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11a643-28b1-4322-9229-dd5c3abda402 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:40.373945 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:40.380502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11a643-28b1-4322-9229-dd5c3abda402 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:40.386721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:40.387744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:40.388324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:40.388919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:40.390667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:22:40.390974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:40.393101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:40.412797 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1628/3284] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:22:40.415392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd2467-c2ae-4bba-b88a-3eafbeaddf86 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:40.429607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd2467-c2ae-4bba-b88a-3eafbeaddf86 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:40.436176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:40.436735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:40.437029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:40.437897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:40.438020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:40.440993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:40.466808 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:40.575009 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1657/3285] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:22:40 2022] POST /identity/v3/projects => generated 399 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:22:40.579536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:40.593310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84781-dcf6-42a2-a1ca-809a32fc08f2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:40.672566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:40.673804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:40.674157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:40.674588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:40.675250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:40.677216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:40.853516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1629/3286] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:22:40 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:22:40.854070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:40.894756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176d554-a6cc-4c80-a8a5-7baf2b828b44 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:40.909435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:40.910416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:40.920175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:40.920175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:40.920175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:40.920175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:40.944326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1658/3287] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:40.945572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:40.966552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64b094-8451-49ed-b8fb-f39f0f70596f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:40.984101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72e910-c47a-43fd-91d4-901362d64ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:40.986769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e910-c47a-43fd-91d4-901362d64ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:40.987081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e910-c47a-43fd-91d4-901362d64ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:40.998589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e910-c47a-43fd-91d4-901362d64ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:41.002987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72e910-c47a-43fd-91d4-901362d64ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:41.014707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72e910-c47a-43fd-91d4-901362d64ba8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:41.080542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:41.086628 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1630/3288] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:41.105590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4832-5bc6-4153-a232-8cd3e1f5feae admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:41.113984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:41.115744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:41.116400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:41.116832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] PATH_INFO: `/v3/projects/3b528f2bca9e41c38140b291d97777e9/users/0635b4466d3d41eb95eb7fef0138437a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:41.152102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b528f2bca9e41c38140b291d97777e9, user_id=0635b4466d3d41eb95eb7fef0138437a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:41.156595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:41.274664 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1659/3289] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:22:41 2022] PUT /identity/v3/projects/3b528f2bca9e41c38140b291d97777e9/users/0635b4466d3d41eb95eb7fef0138437a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:22:41.280264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:41.280797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:41.280797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:41.316026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:41.319577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:41.464721 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1631/3290] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:41.484381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:41.487805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:41.594314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aa5ed-b18b-439a-9e62-755cae230420 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:41.599478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:41.600281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:41.600912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:41.600912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:41.613436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:41.616852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:41.631232 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1660/3291] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:41.964989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:41.966495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:41.986562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290f6cf-e62a-4bd2-9f23-a537493ea341 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:42.003574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ecb8d-1433-4662-bbca-7b98d44c46f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:42.004385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ecb8d-1433-4662-bbca-7b98d44c46f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:42.004934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ecb8d-1433-4662-bbca-7b98d44c46f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:42.005353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ecb8d-1433-4662-bbca-7b98d44c46f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:42.013746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-128ecb8d-1433-4662-bbca-7b98d44c46f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:42.044929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ecb8d-1433-4662-bbca-7b98d44c46f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:42.050852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ecb8d-1433-4662-bbca-7b98d44c46f7 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:42.084185 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1632/3292] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:44.186331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:44.189571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:44.219117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e9c2c-b968-4813-89c0-f8d6dfabdd7f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:44.229378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:44.230431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:44.230935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:44.231421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] PATH_INFO: `/v3/users/82ee1574bc5541459235111a7d7f8136` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:44.233416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ee1574bc5541459235111a7d7f8136)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:44.237528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:44.508483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ee1574bc5541459235111a7d7f8136'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:44.509599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ee1574bc5541459235111a7d7f8136'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:44.618355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ee1574bc5541459235111a7d7f8136'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:44.630899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ee1574bc5541459235111a7d7f8136'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:44.632494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ee1574bc5541459235111a7d7f8136'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:44.700189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1661/3293] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:22:44 2022] DELETE /identity/v3/users/82ee1574bc5541459235111a7d7f8136 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:44.706359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:44.706825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:44.707262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:44.753610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:44.756441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:44.926005 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:44.956932 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1633/3294] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:44.971226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:44.980594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:45.049673 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:45.104423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4612cd-ca5f-4a82-a3f0-2c0faa51da3b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:45.104682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:45.106944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:45.110343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:45.111184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:45.111568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:45.111943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:45.130102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:45.132391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:45.135328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfd415-fbba-44d7-b4c5-f25ea6a0a956 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:45.151256 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1662/3295] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:45.155331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:45.156164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:45.156649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:45.157096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] PATH_INFO: `/v3/users/29f68fba91f1433bb6d51e956ea19022` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:45.162551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f68fba91f1433bb6d51e956ea19022)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:45.183462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:45.491589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f68fba91f1433bb6d51e956ea19022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.505548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f68fba91f1433bb6d51e956ea19022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.514888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f68fba91f1433bb6d51e956ea19022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.515626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f68fba91f1433bb6d51e956ea19022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.558302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:45.561108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:45.609981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77a4e9-392a-4751-9cf3-ec7030eed825 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:45.627135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:45.627804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:45.628087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:45.628361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] PATH_INFO: `/v3/projects/920dbe6565b1451e8be5ab8796f306bc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:45.629637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920dbe6565b1451e8be5ab8796f306bc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:45.631585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:45.641652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0c8318b-a686-4ca0-b579-186f819e6686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f68fba91f1433bb6d51e956ea19022'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.677646 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1634/3296] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:22:45 2022] DELETE /identity/v3/users/29f68fba91f1433bb6d51e956ea19022 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:45.826455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920dbe6565b1451e8be5ab8796f306bc', 'request_id': 'req-4661b656-bc77-492e-931c-f86d1702a0f7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.837598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920dbe6565b1451e8be5ab8796f306bc', 'request_id': 'req-4661b656-bc77-492e-931c-f86d1702a0f7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.904840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920dbe6565b1451e8be5ab8796f306bc', 'request_id': 'req-4661b656-bc77-492e-931c-f86d1702a0f7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.920009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] The token cache is being invalidate because project 920dbe6565b1451e8be5ab8796f306bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:22:45.920574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.921528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4661b656-bc77-492e-931c-f86d1702a0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:45.929838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1866-dc02-49ee-9154-97870af6ac1a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:45.931061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1866-dc02-49ee-9154-97870af6ac1a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:45.933243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1866-dc02-49ee-9154-97870af6ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:45.937037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1663/3297] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:22:45 2022] DELETE /identity/v3/projects/920dbe6565b1451e8be5ab8796f306bc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:45.963008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-77ab1866-dc02-49ee-9154-97870af6ac1a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:45.964258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77ab1866-dc02-49ee-9154-97870af6ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:46.041434 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1635/3298] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:46.050194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f491a-128e-44f8-9d1b-9550b3b30056 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:46.050852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f491a-128e-44f8-9d1b-9550b3b30056 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:46.051291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f491a-128e-44f8-9d1b-9550b3b30056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:46.078572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f76f491a-128e-44f8-9d1b-9550b3b30056 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:46.080837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f76f491a-128e-44f8-9d1b-9550b3b30056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:46.122550 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1664/3299] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:46.126449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab1866-dc02-49ee-9154-97870af6ac1a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:46.141726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab1866-dc02-49ee-9154-97870af6ac1a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:46.158089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:46.158964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:46.159331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:46.159614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:46.160279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:22:46.160596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:46.162274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:46.187096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1636/3300] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:22:46.188589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f491a-128e-44f8-9d1b-9550b3b30056 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:46.204099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f491a-128e-44f8-9d1b-9550b3b30056 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:46.213323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:46.214287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:46.214719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:46.217992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:46.218834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:46.229956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:46.344460 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1665/3301] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:22:46 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:22:46.349017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:46.365126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4cd93-af1d-4378-802f-e247e01dec1e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:46.491762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:46.494381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:46.578387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:46.583584 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:46.588357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:46.588357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:46.588357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:46.588357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:46.590452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:46.657034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9e2d-ba8f-4337-af3a-f7525e0a2364 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:46.664371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:46.665222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:46.665876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:46.666357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] PATH_INFO: `/v3/projects/10a28f315c8e4766bc5754524ddde678` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:46.670652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a28f315c8e4766bc5754524ddde678)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:46.673034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:46.752271 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1637/3302] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:22:46 2022] POST /identity/v3/users => generated 286 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:22:46.756309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:46.785023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3fb80-5702-4231-ad0b-1140e03c2d34 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:46.792346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:46.809194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:46.810747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:46.810747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:46.810747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:46.813728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:46.838205 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1638/3303] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:46.840802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:46.861508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacc000-0e0b-4935-9160-d62a62301f68 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:46.901399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a28f315c8e4766bc5754524ddde678', 'request_id': 'req-d1c58040-8a0b-46da-9505-f00357f18e5f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:46.919850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a28f315c8e4766bc5754524ddde678', 'request_id': 'req-d1c58040-8a0b-46da-9505-f00357f18e5f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:46.989190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:46.990151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:46.990445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:46.990726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:46.992933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:46.995767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:47.016101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a28f315c8e4766bc5754524ddde678', 'request_id': 'req-d1c58040-8a0b-46da-9505-f00357f18e5f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.037540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] The token cache is being invalidate because project 10a28f315c8e4766bc5754524ddde678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:22:47.038283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.042573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.047614 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1666/3304] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:22:46 2022] DELETE /identity/v3/projects/10a28f315c8e4766bc5754524ddde678 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:22:47.050843 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1639/3305] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:47.052429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:47.056326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:47.056628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:47.069753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:47.103328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58040-8a0b-46da-9505-f00357f18e5f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:47.104588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a486d-f87b-47a6-8f61-055f368b577a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:47.112972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:47.113638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:47.113976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:47.114256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] PATH_INFO: `/v3/users/ea83122847e746eab3398447e90d52fd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:47.115577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea83122847e746eab3398447e90d52fd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:47.116705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9883-9ad4-4f16-851f-e82762593bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:47.121176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9883-9ad4-4f16-851f-e82762593bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:47.121176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9883-9ad4-4f16-851f-e82762593bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:47.121176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9883-9ad4-4f16-851f-e82762593bfc admin admin] PATH_INFO: `/v3/projects/fe433682ca4944f08b4b142370f72238/users/74725019f5c845be94bd737e526b5f54/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:47.121466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:47.137271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9883-9ad4-4f16-851f-e82762593bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe433682ca4944f08b4b142370f72238, user_id=74725019f5c845be94bd737e526b5f54, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:47.140517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9883-9ad4-4f16-851f-e82762593bfc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:47.229309 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1640/3306] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:22:47 2022] PUT /identity/v3/projects/fe433682ca4944f08b4b142370f72238/users/74725019f5c845be94bd737e526b5f54/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:47.241837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:47.242469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:47.242897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:47.300346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] MFA Rules not processed for user `74725019f5c845be94bd737e526b5f54`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:47.301674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:47.377530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea83122847e746eab3398447e90d52fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.380925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea83122847e746eab3398447e90d52fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.398804 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1641/3307] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:22:47.426495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:47.428125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:47.499508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea83122847e746eab3398447e90d52fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.512999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea83122847e746eab3398447e90d52fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.514912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea83122847e746eab3398447e90d52fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:47.580673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1667/3308] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:22:47 2022] DELETE /identity/v3/users/ea83122847e746eab3398447e90d52fd => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:22:47.652109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36735b-5c31-400b-8213-2a8acf4059cc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:47.756533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2389def-fa3c-4ddf-8046-b2aa7fb07ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:47.756533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389def-fa3c-4ddf-8046-b2aa7fb07ef2 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:47.757105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389def-fa3c-4ddf-8046-b2aa7fb07ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:47.757563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389def-fa3c-4ddf-8046-b2aa7fb07ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:47.768401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e2389def-fa3c-4ddf-8046-b2aa7fb07ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:47.900716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2389def-fa3c-4ddf-8046-b2aa7fb07ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:47.903188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2389def-fa3c-4ddf-8046-b2aa7fb07ef2 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:47.918886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1642/3309] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:22:48.166820 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:48.553038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:48.555557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:48.660204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653752b-95d6-4fc2-a95a-ae1ac2a25980 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:48.666346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:48.667373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:48.668061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:48.668603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] PATH_INFO: `/v3/projects/a5adbcacc529415e8c3f0a2962b6341f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:48.670009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5adbcacc529415e8c3f0a2962b6341f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:48.672369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:48.846966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5adbcacc529415e8c3f0a2962b6341f', 'request_id': 'req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:48.854803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5adbcacc529415e8c3f0a2962b6341f', 'request_id': 'req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:48.966428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5adbcacc529415e8c3f0a2962b6341f', 'request_id': 'req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:48.980788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] The token cache is being invalidate because project a5adbcacc529415e8c3f0a2962b6341f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:22:48.981091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:48.981848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca1540c8-f2bf-4db9-abe6-0b2c7c8ca917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:48.992585 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1668/3310] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:22:48 2022] DELETE /identity/v3/projects/a5adbcacc529415e8c3f0a2962b6341f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:48.999908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160692-32c7-4031-a9fb-6bcc38719bc8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:48.999908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160692-32c7-4031-a9fb-6bcc38719bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:48.999908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160692-32c7-4031-a9fb-6bcc38719bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.027348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c9160692-32c7-4031-a9fb-6bcc38719bc8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:49.028573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c9160692-32c7-4031-a9fb-6bcc38719bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:49.093960 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1643/3311] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:49.103344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0b116-befb-4fbe-8f2d-05b0fd792983 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.104272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0b116-befb-4fbe-8f2d-05b0fd792983 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.104631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0b116-befb-4fbe-8f2d-05b0fd792983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.135318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-14b0b116-befb-4fbe-8f2d-05b0fd792983 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:49.137073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-14b0b116-befb-4fbe-8f2d-05b0fd792983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:49.152024 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1669/3312] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:49.153858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160692-32c7-4031-a9fb-6bcc38719bc8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:49.171630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160692-32c7-4031-a9fb-6bcc38719bc8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:49.177610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:49.178294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.178604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.179011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.179608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:22:49.184912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:49.184912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:49.200529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0b116-befb-4fbe-8f2d-05b0fd792983 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:49.206728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1644/3313] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:22:49.214238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0b116-befb-4fbe-8f2d-05b0fd792983 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:49.221256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:49.222247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.222605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.223556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.224965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:49.227404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:49.360777 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1670/3314] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:22:49 2022] POST /identity/v3/projects => generated 403 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:22:49.364679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:49.379886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6d0bb-e65e-45e8-a9ca-e8c6cf28bdc9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:49.503045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:49.503931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.504211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.504478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.505149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:49.507093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:49.607297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1645/3315] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:22:49 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:22:49.611485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:49.625073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d13088-d88f-4da1-b109-4e315d9467b5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:49.633012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:49.633836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.636108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.636108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.636108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:49.637421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:49.651261 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1671/3316] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:49.655918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:49.669247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8824bc-93d1-4127-a4c4-243331e260ab admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:49.679303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ff25-4cb5-4870-a671-db7bd450b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:49.681993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ff25-4cb5-4870-a671-db7bd450b591 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.683684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ff25-4cb5-4870-a671-db7bd450b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.684183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ff25-4cb5-4870-a671-db7bd450b591 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.688030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ff25-4cb5-4870-a671-db7bd450b591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:49.693062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ff25-4cb5-4870-a671-db7bd450b591 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:49.727721 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1646/3317] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:49.733370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:49.748895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660ff06-b9c9-4dfd-864a-2b53526e73a7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:49.755292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:49.756360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.756901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.757384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] PATH_INFO: `/v3/projects/228de79b8ff74453af62f6936ba634fa/users/f11993e60e454595aabc0b7fb8d1c079/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.766674 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:49.780779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=228de79b8ff74453af62f6936ba634fa, user_id=f11993e60e454595aabc0b7fb8d1c079, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:49.784899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:49.888015 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1672/3318] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:22:49 2022] PUT /identity/v3/projects/228de79b8ff74453af62f6936ba634fa/users/f11993e60e454595aabc0b7fb8d1c079/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:22:49.893351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:49.894014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:49.899916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:49.941964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:49.944492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:50.040456 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1647/3319] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:50.051313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:50.053116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:50.196151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273b0e-4d8b-4ba0-bfbf-03854ebb5c2f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:50.212435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706ac8-8f0b-470b-8042-b5e57d284f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:50.214113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706ac8-8f0b-470b-8042-b5e57d284f06 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:50.214559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706ac8-8f0b-470b-8042-b5e57d284f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:50.214993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706ac8-8f0b-470b-8042-b5e57d284f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:50.231396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706ac8-8f0b-470b-8042-b5e57d284f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:50.233528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706ac8-8f0b-470b-8042-b5e57d284f06 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:50.245904 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1673/3320] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:50.690184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:50.692065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:50.711204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e74a4-d9d2-4014-9ab2-2e390578594f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:50.725987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:50.726655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:50.726939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:50.727216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] PATH_INFO: `/v3/users/74725019f5c845be94bd737e526b5f54` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:50.730996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74725019f5c845be94bd737e526b5f54)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:50.733912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:50.903031 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:51.058488 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:51.063146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74725019f5c845be94bd737e526b5f54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:51.101654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74725019f5c845be94bd737e526b5f54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:51.122091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74725019f5c845be94bd737e526b5f54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:51.126997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74725019f5c845be94bd737e526b5f54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:51.230907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74725019f5c845be94bd737e526b5f54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:51.245048 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1648/3321] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:22:50 2022] DELETE /identity/v3/users/74725019f5c845be94bd737e526b5f54 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:51.247142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097953a5-b0bd-4c44-b719-145885621345 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:51.252544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097953a5-b0bd-4c44-b719-145885621345 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:51.253148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097953a5-b0bd-4c44-b719-145885621345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:51.286312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-097953a5-b0bd-4c44-b719-145885621345 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:51.310713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-097953a5-b0bd-4c44-b719-145885621345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:51.419998 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1674/3322] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:51.464134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:51.466527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:51.624277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f22341-1b5f-44a5-9a8d-ce1900a887b4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:51.630754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcee31-de20-4da6-bc6f-c451a00cce00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:51.631730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcee31-de20-4da6-bc6f-c451a00cce00 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:51.632345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcee31-de20-4da6-bc6f-c451a00cce00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:51.633040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcee31-de20-4da6-bc6f-c451a00cce00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:51.655138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcee31-de20-4da6-bc6f-c451a00cce00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:51.658451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcee31-de20-4da6-bc6f-c451a00cce00 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:51.671821 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1649/3323] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:51.727161 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:52.858187 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:53.082833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097953a5-b0bd-4c44-b719-145885621345 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:53.085027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-097953a5-b0bd-4c44-b719-145885621345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:53.115874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097953a5-b0bd-4c44-b719-145885621345 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:53.131216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:53.132177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:53.133463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:53.138114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] PATH_INFO: `/v3/projects/fe433682ca4944f08b4b142370f72238` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:53.140492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe433682ca4944f08b4b142370f72238)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:53.145896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:53.364661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe433682ca4944f08b4b142370f72238', 'request_id': 'req-449b1c37-e5cf-4030-bcfa-1a0ebee80887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:53.378539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe433682ca4944f08b4b142370f72238', 'request_id': 'req-449b1c37-e5cf-4030-bcfa-1a0ebee80887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:53.463430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe433682ca4944f08b4b142370f72238', 'request_id': 'req-449b1c37-e5cf-4030-bcfa-1a0ebee80887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:53.480883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] The token cache is being invalidate because project fe433682ca4944f08b4b142370f72238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:22:53.484130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:53.484130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-449b1c37-e5cf-4030-bcfa-1a0ebee80887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:53.484130 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1675/3324] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:22:53 2022] DELETE /identity/v3/projects/fe433682ca4944f08b4b142370f72238 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:53.492311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a337f0-bc1c-4e3c-8644-fa15d791ed0e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:53.492877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a337f0-bc1c-4e3c-8644-fa15d791ed0e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:53.492959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a337f0-bc1c-4e3c-8644-fa15d791ed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:53.562898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c9a337f0-bc1c-4e3c-8644-fa15d791ed0e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:53.566355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c9a337f0-bc1c-4e3c-8644-fa15d791ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:53.765649 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1650/3325] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:53.778119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875ec8-f7e7-408d-b280-f5bcbff85407 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:53.783892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875ec8-f7e7-408d-b280-f5bcbff85407 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:53.783892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875ec8-f7e7-408d-b280-f5bcbff85407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:53.819708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c1875ec8-f7e7-408d-b280-f5bcbff85407 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:53.821405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c1875ec8-f7e7-408d-b280-f5bcbff85407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:53.832625 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1676/3326] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:53.836570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a337f0-bc1c-4e3c-8644-fa15d791ed0e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:53.852233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a337f0-bc1c-4e3c-8644-fa15d791ed0e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:53.858306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:53.859016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:53.859384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:53.859739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:53.863235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:22:53.863659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:53.866819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:53.905259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1651/3327] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:22:53.910168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875ec8-f7e7-408d-b280-f5bcbff85407 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:53.923468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875ec8-f7e7-408d-b280-f5bcbff85407 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:53.931694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:53.932449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:53.932879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:53.933235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:53.933985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:53.937316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:54.050857 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1677/3328] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:22:53 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:22:54.055585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:54.096532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c42739-c2f0-498d-bb37-196dfebb0c34 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:54.240746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:54.242968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:54.299577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3316-898d-474d-9e63-879b73bbe531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:54.310298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3316-898d-474d-9e63-879b73bbe531 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.310298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3316-898d-474d-9e63-879b73bbe531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.310298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3316-898d-474d-9e63-879b73bbe531 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:54.310298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3316-898d-474d-9e63-879b73bbe531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:54.310298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf3316-898d-474d-9e63-879b73bbe531 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:54.450958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6a547-e9bd-4659-942b-001f53d3ff36 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:54.469045 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1652/3329] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:22:54 2022] POST /identity/v3/users => generated 290 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:22:54.472969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56d0a-1f6b-4112-bd57-c46f0853a3af None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.472969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56d0a-1f6b-4112-bd57-c46f0853a3af None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.472969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab56d0a-1f6b-4112-bd57-c46f0853a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:54.476735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:54.481206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.481493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.481771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:54.488544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:54.523892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:54.530448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:54.531145 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:54.557735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8ab56d0a-1f6b-4112-bd57-c46f0853a3af None None] MFA Rules not processed for user `0635b4466d3d41eb95eb7fef0138437a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:54.559119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8ab56d0a-1f6b-4112-bd57-c46f0853a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:54.568694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1678/3330] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:54.570962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:54.605519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6101-3dd0-48b0-a699-1422a85a488e service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:54.622006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:54.622638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.622921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.623365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:54.624029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:54.625657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:54.655039 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1679/3331] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:54.659000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:54.692586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6e90-45ec-4734-87f7-649bd7b6cb27 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:54.720908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:54.722875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.722875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.723372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:54.724074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:54.729431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:54.757388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1680/3332] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:54.760350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:54.783593 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1653/3333] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:54.783768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9398-f727-493b-9cfd-0d1a41e88899 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:54.783768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:54.785048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398deb91-4838-4974-9b3d-c09219bf8b02 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.785338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398deb91-4838-4974-9b3d-c09219bf8b02 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.785615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398deb91-4838-4974-9b3d-c09219bf8b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:54.796420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.798643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.799487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] PATH_INFO: `/v3/projects/8e14362a12f849c29e3d8a3cad149f56/users/88ea35cbd47442db8858868da31320ad/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:54.821474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-398deb91-4838-4974-9b3d-c09219bf8b02 None None] MFA Rules not processed for user `0635b4466d3d41eb95eb7fef0138437a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:54.822860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-398deb91-4838-4974-9b3d-c09219bf8b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:54.848095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e14362a12f849c29e3d8a3cad149f56, user_id=88ea35cbd47442db8858868da31320ad, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:54.856221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1654/3334] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:22:54.856437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:54.873449 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:54.950389 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1681/3335] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:22:54 2022] PUT /identity/v3/projects/8e14362a12f849c29e3d8a3cad149f56/users/88ea35cbd47442db8858868da31320ad/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:54.962376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074358cf-d5f4-470d-b318-be6335784235 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:54.962684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074358cf-d5f4-470d-b318-be6335784235 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:54.962987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074358cf-d5f4-470d-b318-be6335784235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:55.029089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-074358cf-d5f4-470d-b318-be6335784235 None None] MFA Rules not processed for user `88ea35cbd47442db8858868da31320ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:55.030385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-074358cf-d5f4-470d-b318-be6335784235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:55.192749 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1655/3336] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:55.243832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:55.378096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074358cf-d5f4-470d-b318-be6335784235 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:55.380098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-074358cf-d5f4-470d-b318-be6335784235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:55.429504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acffae-db48-4192-8e1b-b00fe937267e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:55.449209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:55.451268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:55.451268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:55.451268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:55.547466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:55.549979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:55.562432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1682/3337] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:55.635547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074358cf-d5f4-470d-b318-be6335784235 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:55.671274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338658a-85db-49d8-ae37-016191123e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:55.671929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338658a-85db-49d8-ae37-016191123e7a service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:55.672209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338658a-85db-49d8-ae37-016191123e7a service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:55.673419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338658a-85db-49d8-ae37-016191123e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:55.699594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338658a-85db-49d8-ae37-016191123e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:55.705276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338658a-85db-49d8-ae37-016191123e7a service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:55.740253 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1656/3338] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:55.860144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:56.049671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0208-0421-46de-accc-0cdd4ab2c5c8 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:56.057025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:56.057796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:56.058137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:56.058442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] PATH_INFO: `/v3/users/88ea35cbd47442db8858868da31320ad` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:56.059960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ea35cbd47442db8858868da31320ad)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:56.062023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:56.270020 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:56.326601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ea35cbd47442db8858868da31320ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:56.326601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ea35cbd47442db8858868da31320ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:56.441724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ea35cbd47442db8858868da31320ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:56.467106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ea35cbd47442db8858868da31320ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:56.467106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ea35cbd47442db8858868da31320ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:56.486010 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1683/3339] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:22:55 2022] DELETE /identity/v3/users/88ea35cbd47442db8858868da31320ad => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:56.487698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:56.488030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:56.488306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:56.504037 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:56.511920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:56.513328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:56.653720 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1657/3340] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:56.662921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:56.664951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:56.824903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017c25-5b04-4e0e-9ecf-faf811374bd0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:56.831650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2058-2b6b-4675-8112-df8fbd1cd113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:56.832554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2058-2b6b-4675-8112-df8fbd1cd113 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:56.833075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2058-2b6b-4675-8112-df8fbd1cd113 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:56.834273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2058-2b6b-4675-8112-df8fbd1cd113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:56.851917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2058-2b6b-4675-8112-df8fbd1cd113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:56.856140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2058-2b6b-4675-8112-df8fbd1cd113 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:56.879376 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1684/3341] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:57.740406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:57.742647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:57.787188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cba6de-fb91-4bf6-a13a-36f6a378b9b7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:57.816756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:57.817782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:57.820288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:57.821464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] PATH_INFO: `/v3/projects/8e14362a12f849c29e3d8a3cad149f56` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:57.826998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e14362a12f849c29e3d8a3cad149f56)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:57.839651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:58.019235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e14362a12f849c29e3d8a3cad149f56', 'request_id': 'req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:58.040710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e14362a12f849c29e3d8a3cad149f56', 'request_id': 'req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:58.120234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e14362a12f849c29e3d8a3cad149f56', 'request_id': 'req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:58.155504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] The token cache is being invalidate because project 8e14362a12f849c29e3d8a3cad149f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:22:58.157241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:58.157241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a6816ae-8f1c-4b66-be26-40bd2c7b5316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:22:58.163080 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1658/3342] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:22:57 2022] DELETE /identity/v3/projects/8e14362a12f849c29e3d8a3cad149f56 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:58.163892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7eefea-c140-48e4-a5c0-2019f50e64db None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:58.164338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7eefea-c140-48e4-a5c0-2019f50e64db None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:58.164519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7eefea-c140-48e4-a5c0-2019f50e64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:58.213486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2a7eefea-c140-48e4-a5c0-2019f50e64db None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:58.232276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2a7eefea-c140-48e4-a5c0-2019f50e64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:58.426558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28e74-df4e-426a-8dac-61ac93c6b2b5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:58.426558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28e74-df4e-426a-8dac-61ac93c6b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:58.426558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d28e74-df4e-426a-8dac-61ac93c6b2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:58.436344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1685/3343] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:22:58.465629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a2d28e74-df4e-426a-8dac-61ac93c6b2b5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:58.467167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2d28e74-df4e-426a-8dac-61ac93c6b2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:58.491823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7eefea-c140-48e4-a5c0-2019f50e64db None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:58.499320 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1659/3344] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:58.510019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7eefea-c140-48e4-a5c0-2019f50e64db None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:58.522403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:58.523197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:58.523924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:58.523924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:58.525183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:22:58.525722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:58.531790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:58.546929 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1686/3345] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:22:58.549700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28e74-df4e-426a-8dac-61ac93c6b2b5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:58.560112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d28e74-df4e-426a-8dac-61ac93c6b2b5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:58.565518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:58.566256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:58.566624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:58.566966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:58.567620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:58.569711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:58.732400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:58.753901 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1660/3346] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:22:58 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:22:58.768581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8adc-5a3f-42d7-a3de-c0e91ca4960a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:58.875459 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:58.921182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:58.976296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:58.976296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:58.976296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:58.976296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:58.976296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:59.116240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1687/3347] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:22:58 2022] POST /identity/v3/users => generated 284 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:22:59.116685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:59.132697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b83ca-fe74-4638-a1cf-9c9cb44c070c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:59.138384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:59.139240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:59.139732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:59.140233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:59.142434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:59.149064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:59.183529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:59.201167 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1661/3348] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:22:59.201263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52dda-5fcf-4c9d-a47d-b8a82aada3e5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:59.203726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af1dd-d52f-4f7b-aa4c-4ea25771d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:59.205442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af1dd-d52f-4f7b-aa4c-4ea25771d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:59.206015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af1dd-d52f-4f7b-aa4c-4ea25771d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:59.206472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af1dd-d52f-4f7b-aa4c-4ea25771d1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:59.207352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af1dd-d52f-4f7b-aa4c-4ea25771d1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:59.210079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af1dd-d52f-4f7b-aa4c-4ea25771d1c1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:59.240116 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1688/3349] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:22:59.241442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:59.257708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a793-b86c-480b-8c7a-9d0d61a28779 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:59.267612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:59.268510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:59.268947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:59.269579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] PATH_INFO: `/v3/projects/5c83cbefc0494bcca8a8a5ead3902d70/users/67e550a0e9044ea187299e8b2f5b434a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:59.315696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c83cbefc0494bcca8a8a5ead3902d70, user_id=67e550a0e9044ea187299e8b2f5b434a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:59.316431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:59.439611 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1662/3350] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:22:59 2022] PUT /identity/v3/projects/5c83cbefc0494bcca8a8a5ead3902d70/users/67e550a0e9044ea187299e8b2f5b434a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:22:59.445843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:59.446144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:59.446665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:59.461265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:59.470579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:59.511958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:59.512974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:59.536376 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:59.632889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b921ad-d5ba-48a1-9101-85d85d957b55 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:59.656048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:59.656048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:59.656048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:59.656048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] PATH_INFO: `/v3/users/ca7c543aa0e04fbd9eaa1fa04378accc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:59.656549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7c543aa0e04fbd9eaa1fa04378accc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:59.656549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:59.683204 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1689/3351] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:59.684374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:59.690136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:59.806498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51aa6-4134-4347-9ed3-b578f8fc9ce0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:59.816018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa90eb-5e10-43a7-9071-89ee679b4562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:59.816018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa90eb-5e10-43a7-9071-89ee679b4562 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:59.816018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa90eb-5e10-43a7-9071-89ee679b4562 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:59.816018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa90eb-5e10-43a7-9071-89ee679b4562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:59.826659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa90eb-5e10-43a7-9071-89ee679b4562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:59.828623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa90eb-5e10-43a7-9071-89ee679b4562 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:59.841887 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1690/3352] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:23:00.047743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7c543aa0e04fbd9eaa1fa04378accc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:00.063146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7c543aa0e04fbd9eaa1fa04378accc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:00.105940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7c543aa0e04fbd9eaa1fa04378accc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:00.107123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7c543aa0e04fbd9eaa1fa04378accc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:00.271411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7c543aa0e04fbd9eaa1fa04378accc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:00.280163 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1663/3353] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:22:59 2022] DELETE /identity/v3/users/ca7c543aa0e04fbd9eaa1fa04378accc => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:01.290190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45245f6-e437-4074-b667-c7c4352fbdc8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:01.291233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45245f6-e437-4074-b667-c7c4352fbdc8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:01.291814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45245f6-e437-4074-b667-c7c4352fbdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:01.354038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c45245f6-e437-4074-b667-c7c4352fbdc8 None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:01.359751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c45245f6-e437-4074-b667-c7c4352fbdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:01.560144 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1691/3354] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:02.060621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:02.062977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:02.196893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4688-9182-4518-8f65-c83108070e72 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:02.211336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:02.212447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:02.212974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:02.213594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] PATH_INFO: `/v3/projects/09bbd7da71d44fe2bd4ae516dc578da6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:02.218992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bbd7da71d44fe2bd4ae516dc578da6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:02.222499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:02.379982 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:02.381650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bbd7da71d44fe2bd4ae516dc578da6', 'request_id': 'req-3a476d71-4199-4ae5-a939-73e47353b586'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:02.390077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bbd7da71d44fe2bd4ae516dc578da6', 'request_id': 'req-3a476d71-4199-4ae5-a939-73e47353b586'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:02.474143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bbd7da71d44fe2bd4ae516dc578da6', 'request_id': 'req-3a476d71-4199-4ae5-a939-73e47353b586'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:02.510132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] The token cache is being invalidate because project 09bbd7da71d44fe2bd4ae516dc578da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:02.510599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:02.511812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a476d71-4199-4ae5-a939-73e47353b586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:02.514264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1664/3355] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:02 2022] DELETE /identity/v3/projects/09bbd7da71d44fe2bd4ae516dc578da6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:02.520391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c7daf-1520-43b4-a986-363924164a3b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:02.520899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c7daf-1520-43b4-a986-363924164a3b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:02.520981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c7daf-1520-43b4-a986-363924164a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:02.536197 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:02.549987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e35c7daf-1520-43b4-a986-363924164a3b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:02.551711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e35c7daf-1520-43b4-a986-363924164a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:02.674498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1692/3356] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:02.682825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f6b81-cb98-470a-bacf-b18607ab8f24 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:02.683117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f6b81-cb98-470a-bacf-b18607ab8f24 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:02.683400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f6b81-cb98-470a-bacf-b18607ab8f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:02.727324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2d4f6b81-cb98-470a-bacf-b18607ab8f24 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:02.731647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2d4f6b81-cb98-470a-bacf-b18607ab8f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:02.775513 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1665/3357] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:02.779885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c7daf-1520-43b4-a986-363924164a3b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:02.792910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c7daf-1520-43b4-a986-363924164a3b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:02.800351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:02.803358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:02.804392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:02.805535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:02.807047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:02.807562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:02.812358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:02.845416 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1693/3358] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:02.847070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f6b81-cb98-470a-bacf-b18607ab8f24 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:02.857484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f6b81-cb98-470a-bacf-b18607ab8f24 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:02.871321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:02.875711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:02.875711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:02.875711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:02.875711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:02.875711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:03.016959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:03.019374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:03.057793 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1666/3359] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:02 2022] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:03.062190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:03.086260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d7d29-c1d7-427c-8248-5c27615115b6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:03.292567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b371e-52e9-42b4-9b48-c4a0137dad00 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:03.305124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:03.306037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:03.306490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:03.307087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:03.307951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:03.312784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:03.324802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:03.325558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:03.326034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:03.328440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] PATH_INFO: `/v3/users/81c50e66203b49cbb601370e2b0555ef` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:03.330168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c50e66203b49cbb601370e2b0555ef)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:03.335728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:03.435054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1667/3360] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:03 2022] POST /identity/v3/users => generated 282 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:03.439583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:03.463485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85097719-2b63-43c5-bfe4-5d7b8c77c51e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:03.485686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:03.485686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:03.485686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:03.485995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:03.486608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:03.488255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:03.524565 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1668/3361] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:03.528398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:03.551404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74309-ac4b-422c-b204-5067e6a4cff4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:03.573622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:03.574891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:03.575186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:03.575462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:03.576470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:03.578614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:03.592982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c50e66203b49cbb601370e2b0555ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:03.592982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c50e66203b49cbb601370e2b0555ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:03.613245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1669/3362] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:03.617472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:03.637424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46801a3-ccc3-47cd-86d3-604a410ea280 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:03.663760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:03.664444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:03.664762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:03.665014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] PATH_INFO: `/v3/projects/c020d71455a44827a633bb914bf93c7e/users/e7757ef7771f414da8e49f0f82def636/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:03.691664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c50e66203b49cbb601370e2b0555ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:03.692898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c020d71455a44827a633bb914bf93c7e, user_id=e7757ef7771f414da8e49f0f82def636, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:03.695732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:03.703102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c50e66203b49cbb601370e2b0555ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:03.704684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-809f0754-4830-4f2f-9ac5-dfd5043484f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c50e66203b49cbb601370e2b0555ef'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:03.731644 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1694/3363] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:03 2022] DELETE /identity/v3/users/81c50e66203b49cbb601370e2b0555ef => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:03.733379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28dd45-9794-40b0-aa33-f7dd66f7876b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:03.738940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28dd45-9794-40b0-aa33-f7dd66f7876b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:03.739502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28dd45-9794-40b0-aa33-f7dd66f7876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:03.815234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-db28dd45-9794-40b0-aa33-f7dd66f7876b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:03.816895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-db28dd45-9794-40b0-aa33-f7dd66f7876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:03.830950 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1670/3364] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:03 2022] PUT /identity/v3/projects/c020d71455a44827a633bb914bf93c7e/users/e7757ef7771f414da8e49f0f82def636/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:03.831968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:03.852104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:03.854349 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:03.983671 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1695/3365] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:03.984864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:03.985259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:03.986943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:04.001528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014453d-795b-4cbe-a6d6-7db2aab8823f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:04.013466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:04.015462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:04.017356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:04.018992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:04.022955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:04.044755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:04.046478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:04.049804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] MFA Rules not processed for user `e7757ef7771f414da8e49f0f82def636`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:04.051701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:04.060209 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1671/3366] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:04.061418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:04.063959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:04.192969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1696/3367] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:04.195117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:04.197049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:04.215004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bfbb0-662d-4183-aae5-a5accd0b56d0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:04.220178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:04.223344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:04.223344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:04.223344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:04.225637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde3aef-e167-4843-ab31-92f6492f71ab service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:04.227936 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:04.244784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a06f8a-1108-49a9-98dc-7662bed47afc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:04.245538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a06f8a-1108-49a9-98dc-7662bed47afc service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:04.245884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a06f8a-1108-49a9-98dc-7662bed47afc service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:04.252067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a06f8a-1108-49a9-98dc-7662bed47afc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:04.252561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:04.252561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:04.261757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c9a06f8a-1108-49a9-98dc-7662bed47afc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:04.282412 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1697/3368] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:04.283090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a06f8a-1108-49a9-98dc-7662bed47afc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:04.287343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a06f8a-1108-49a9-98dc-7662bed47afc service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:04.311148 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1672/3369] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:04.374945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:04.377338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:04.656433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4b77a-9747-4ff4-ab7d-cd33d4b58ec9 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:04.664560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73af2-ab51-47ff-a8b7-7306de82ac3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:04.665709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73af2-ab51-47ff-a8b7-7306de82ac3d service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:04.669364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73af2-ab51-47ff-a8b7-7306de82ac3d service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:04.669673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73af2-ab51-47ff-a8b7-7306de82ac3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:04.686448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73af2-ab51-47ff-a8b7-7306de82ac3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:04.695236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73af2-ab51-47ff-a8b7-7306de82ac3d service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:04.739213 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1698/3370] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:04.799578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:04.800210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:04.800638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:04.805685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:04.806089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:04.806446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:04.863027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:04.864740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:04.866297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] MFA Rules not processed for user `f11993e60e454595aabc0b7fb8d1c079`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:04.867984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:05.009096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1699/3371] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:23:05.010472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:05.014358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:05.045893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776cc3-51c4-4aae-9907-1d75e39852e6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:05.051548 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1673/3372] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:05.052565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:05.054296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:05.062312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:05.065983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:05.067631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:05.068115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] PATH_INFO: `/v3/projects/ec8225f796ab433b9260b0af5874025b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:05.071753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696be99-3700-42d1-a07e-4eee5fffbab6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:05.072349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8225f796ab433b9260b0af5874025b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:05.077886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:05.078152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:05.079589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:05.080074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:05.080858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] PATH_INFO: `/v3/users/e7757ef7771f414da8e49f0f82def636` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:05.088385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7757ef7771f414da8e49f0f82def636)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:05.090811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:05.333670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8225f796ab433b9260b0af5874025b', 'request_id': 'req-69f86026-ae38-495f-b512-8d78d941f1b6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.341205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8225f796ab433b9260b0af5874025b', 'request_id': 'req-69f86026-ae38-495f-b512-8d78d941f1b6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.343805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7757ef7771f414da8e49f0f82def636'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.365057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7757ef7771f414da8e49f0f82def636'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.375026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7757ef7771f414da8e49f0f82def636'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.376437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7757ef7771f414da8e49f0f82def636'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.429549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8225f796ab433b9260b0af5874025b', 'request_id': 'req-69f86026-ae38-495f-b512-8d78d941f1b6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.447426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] The token cache is being invalidate because project ec8225f796ab433b9260b0af5874025b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:05.447730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.449518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.451911 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1700/3373] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:05 2022] DELETE /identity/v3/projects/ec8225f796ab433b9260b0af5874025b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:05.453356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:05.455677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:05.526496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7757ef7771f414da8e49f0f82def636'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.535701 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1674/3374] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:05 2022] DELETE /identity/v3/users/e7757ef7771f414da8e49f0f82def636 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:05.536756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:05.540422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:05.550574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f86026-ae38-495f-b512-8d78d941f1b6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:05.666571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34614897-f315-4917-b1d7-bd1528203fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:05.667560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614897-f315-4917-b1d7-bd1528203fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:05.667997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614897-f315-4917-b1d7-bd1528203fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:05.668329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614897-f315-4917-b1d7-bd1528203fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:05.669020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34614897-f315-4917-b1d7-bd1528203fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:05.671282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34614897-f315-4917-b1d7-bd1528203fc6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:05.701768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b7d7-505a-4c2d-9ea1-d3991ab325ea admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:05.702674 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:05.709099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:05.710239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:05.710623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:05.710992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] PATH_INFO: `/v3/users/ff924d0a34394f8280bfcda1d656ffb6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:05.712535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff924d0a34394f8280bfcda1d656ffb6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:05.714799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:05.805136 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1701/3375] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:05 2022] POST /identity/v3/projects => generated 405 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:05.808477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1bb0-a430-484c-bc74-fa60a6cbef27 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:05.809186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1bb0-a430-484c-bc74-fa60a6cbef27 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:05.810553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba1bb0-a430-484c-bc74-fa60a6cbef27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:05.842942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-06ba1bb0-a430-484c-bc74-fa60a6cbef27 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:05.852137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-06ba1bb0-a430-484c-bc74-fa60a6cbef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:05.962917 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1702/3376] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:05.963936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1bb0-a430-484c-bc74-fa60a6cbef27 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:05.976621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff924d0a34394f8280bfcda1d656ffb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:05.990776 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:05.992117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba1bb0-a430-484c-bc74-fa60a6cbef27 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:06.002568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff924d0a34394f8280bfcda1d656ffb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:06.004198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:06.005614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:06.006094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:06.006514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:06.007347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:06.013521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff924d0a34394f8280bfcda1d656ffb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:06.014776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff924d0a34394f8280bfcda1d656ffb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:06.015817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:06.112979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff924d0a34394f8280bfcda1d656ffb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:06.123251 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1675/3377] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:05 2022] DELETE /identity/v3/users/ff924d0a34394f8280bfcda1d656ffb6 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:06.124624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:06.138365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:06.148720 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1703/3378] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:05 2022] POST /identity/v3/users => generated 309 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:06.152876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:06.154569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:06.179174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695bbd5-319a-4f2e-a442-16580a77ec39 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:06.337468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:06.338144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:06.338431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:06.339275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:06.339946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:06.341633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:06.360468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa08cb-72b7-4a49-80e0-33e6f5381fac admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:06.370868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1704/3379] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:23:06.371978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:06.372386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:06.373308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:06.373838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:06.374289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:06.383165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:06.393568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683da1d3-635f-4520-a77f-2059b1334751 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:06.411188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:06.411876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:06.412161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:06.412449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] PATH_INFO: `/v3/projects/de22b333b87147d69ad670386cad204c/users/67b82f18c3204fc3bb9abd839d7df0c9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:06.412735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:06.416351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:06.440343 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1676/3380] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:06.457569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de22b333b87147d69ad670386cad204c, user_id=67b82f18c3204fc3bb9abd839d7df0c9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:06.460571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:06.531884 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:06.568973 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1705/3381] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:06 2022] PUT /identity/v3/projects/de22b333b87147d69ad670386cad204c/users/67b82f18c3204fc3bb9abd839d7df0c9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:06.573258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:06.605333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:06.605571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1935fce-2278-4d4e-8df7-d1019c6ad391 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:06.609146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:06.785071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:06.786683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:06.787011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:06.788447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:06.789119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:06.796370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:06.822396 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1677/3382] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:06.824351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:06.853658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b1ab8-18be-467e-8f4e-ff82d9d68041 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:06.856126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1c12-8c92-46f3-a105-16344a10bba6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:06.866266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:06.866921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:06.867261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:06.869976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] PATH_INFO: `/v3/projects/11c547b190cb479888e1b74db1436149` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:06.870094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9651a-00ce-40bd-a06d-8657199be129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:06.870094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9651a-00ce-40bd-a06d-8657199be129 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:06.870094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9651a-00ce-40bd-a06d-8657199be129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:06.870094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9651a-00ce-40bd-a06d-8657199be129 admin admin] PATH_INFO: `/v3/projects/de22b333b87147d69ad670386cad204c/users/67b82f18c3204fc3bb9abd839d7df0c9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:06.871282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c547b190cb479888e1b74db1436149)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:06.873374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:06.885980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9651a-00ce-40bd-a06d-8657199be129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de22b333b87147d69ad670386cad204c, user_id=67b82f18c3204fc3bb9abd839d7df0c9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:06.891004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9651a-00ce-40bd-a06d-8657199be129 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:06.922569 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1678/3383] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:06 2022] PUT /identity/v3/projects/de22b333b87147d69ad670386cad204c/users/67b82f18c3204fc3bb9abd839d7df0c9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:07.081302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c547b190cb479888e1b74db1436149', 'request_id': 'req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.091880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c547b190cb479888e1b74db1436149', 'request_id': 'req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.167191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c547b190cb479888e1b74db1436149', 'request_id': 'req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.184172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] The token cache is being invalidate because project 11c547b190cb479888e1b74db1436149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:07.185044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.185935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb2fb8b1-1228-44c4-9872-7ffcb9907ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.188280 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1706/3384] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:06 2022] DELETE /identity/v3/projects/11c547b190cb479888e1b74db1436149 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:07.193343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:07.193868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:07.193993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:07.250125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:07.252349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:07.351043 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:07.445599 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1679/3385] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:07.468859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b207b4-8d06-4a71-9f3b-f1ea62717b4b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:07.470114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b207b4-8d06-4a71-9f3b-f1ea62717b4b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:07.470661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b207b4-8d06-4a71-9f3b-f1ea62717b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:07.482209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:07.484355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:07.506837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11656734-04e7-44f9-a8bd-59aacfacf56b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:07.523016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:07.524268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:07.530703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:07.530703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] PATH_INFO: `/v3/projects/c020d71455a44827a633bb914bf93c7e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:07.531486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-68b207b4-8d06-4a71-9f3b-f1ea62717b4b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:07.531486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-68b207b4-8d06-4a71-9f3b-f1ea62717b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:07.531663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c020d71455a44827a633bb914bf93c7e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:07.535913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:07.573572 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1707/3386] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:07.577134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b207b4-8d06-4a71-9f3b-f1ea62717b4b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:07.612589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b207b4-8d06-4a71-9f3b-f1ea62717b4b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:07.633524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:07.634224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:07.634503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:07.634953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:07.635624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:07.636066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:07.637693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:07.673527 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1708/3387] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:07.683533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:07.699830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dff328-01a5-429b-b97a-96430253295f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:07.718153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:07.720144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:07.721360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:07.721842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:07.724848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:07.728122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:07.764636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c020d71455a44827a633bb914bf93c7e', 'request_id': 'req-4158f372-1d25-4559-96c2-2703f0d08fd3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.794769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c020d71455a44827a633bb914bf93c7e', 'request_id': 'req-4158f372-1d25-4559-96c2-2703f0d08fd3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.893443 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1709/3388] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:07 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:07.897749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:07.932240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c020d71455a44827a633bb914bf93c7e', 'request_id': 'req-4158f372-1d25-4559-96c2-2703f0d08fd3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.960514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] The token cache is being invalidate because project c020d71455a44827a633bb914bf93c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:07.960896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.961736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4158f372-1d25-4559-96c2-2703f0d08fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:07.964281 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1680/3389] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:07 2022] DELETE /identity/v3/projects/c020d71455a44827a633bb914bf93c7e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:07.971541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a493ec7-d83e-4919-aadb-62883a206c24 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:07.971994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a493ec7-d83e-4919-aadb-62883a206c24 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:07.972443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a493ec7-d83e-4919-aadb-62883a206c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.020869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6a493ec7-d83e-4919-aadb-62883a206c24 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:08.025683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6a493ec7-d83e-4919-aadb-62883a206c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:08.073143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0458483-fb5d-4276-8e32-7ddcd5dc3998 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:08.091677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:08.092692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.093159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.093607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.095076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:08.099419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:08.239516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1681/3390] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:23:08.250443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a3467-96e8-4f1f-98b4-af0cdfbe44ad None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.251088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a3467-96e8-4f1f-98b4-af0cdfbe44ad None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.251565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a3467-96e8-4f1f-98b4-af0cdfbe44ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.275480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0e9a3467-96e8-4f1f-98b4-af0cdfbe44ad None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:08.277404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0e9a3467-96e8-4f1f-98b4-af0cdfbe44ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:08.287979 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1682/3391] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:08.292061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a3467-96e8-4f1f-98b4-af0cdfbe44ad None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:08.315251 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1710/3392] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:07 2022] POST /identity/v3/users => generated 289 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:08.315817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:08.321761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:08.331549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a3467-96e8-4f1f-98b4-af0cdfbe44ad None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:08.351819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:08.352512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.353981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.354917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61008e-99e0-46d6-867b-27190177787b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:08.355253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.357410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:08.357936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:08.364060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:08.364239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:08.365270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.367942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.368257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.369101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:08.372161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:08.386946 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1711/3393] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:08.391183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:08.404869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4918ad-d4dc-4537-9840-ccd12e708524 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:08.411533 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1683/3394] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:23:08.413373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:08.414470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.414890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.415367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:08.415480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.416618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:08.419157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:08.442007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5df8-2acb-44f8-9aa0-7ae6700a463f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:08.446287 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1712/3395] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:08.447014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:08.449597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.449597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.449597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.449597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:08.451294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:08.451432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:08.465367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ef135-36c1-414b-a0f7-c82e46a15b67 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:08.474007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218c81-5229-4acc-8b51-46e8d9125da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:08.475142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218c81-5229-4acc-8b51-46e8d9125da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.476374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218c81-5229-4acc-8b51-46e8d9125da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.476374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218c81-5229-4acc-8b51-46e8d9125da8 admin admin] PATH_INFO: `/v3/projects/732402892e1d457f8cb97adf5a4a05c8/users/436b0032d7d14067abaecfa29655690c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.512479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218c81-5229-4acc-8b51-46e8d9125da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732402892e1d457f8cb97adf5a4a05c8, user_id=436b0032d7d14067abaecfa29655690c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:08.521327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218c81-5229-4acc-8b51-46e8d9125da8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:08.622261 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1684/3396] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:08 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:08.624692 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1713/3397] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:08 2022] PUT /identity/v3/projects/732402892e1d457f8cb97adf5a4a05c8/users/436b0032d7d14067abaecfa29655690c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:08.637717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6d59-983d-48d2-bba9-9f9195714648 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.638496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6d59-983d-48d2-bba9-9f9195714648 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.638496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6d59-983d-48d2-bba9-9f9195714648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.645711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:08.695295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eaae6d59-983d-48d2-bba9-9f9195714648 None None] MFA Rules not processed for user `436b0032d7d14067abaecfa29655690c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:08.696864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eaae6d59-983d-48d2-bba9-9f9195714648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:08.816125 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:08.843641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798540a-c6f6-49b9-aa1f-0ca880e9670c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:08.857431 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1714/3398] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:08.862326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:08.863102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:08.863393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:08.863670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:08.864977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:08.867742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:09.029608 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1685/3399] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:08 2022] POST /identity/v3/users => generated 284 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:09.032904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae6d59-983d-48d2-bba9-9f9195714648 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:09.036235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:09.038319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:09.060678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae6d59-983d-48d2-bba9-9f9195714648 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:09.068788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:09.072540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:09.072540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:09.072540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:09.072540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:09.072540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:09.086830 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1715/3400] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:09.090214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:09.108323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a6c0-9362-48d8-9fec-deaa5803d749 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:09.116043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:09.116982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:09.120546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:09.120988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:09.121776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:09.125474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:09.151888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1716/3401] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:09.154911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:09.169638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a4ee-186e-409e-944f-5e26857bf07d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:09.176370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61a64b-76ce-4422-a1b5-0c1f2dc8675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:09.177203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61a64b-76ce-4422-a1b5-0c1f2dc8675b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:09.177583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61a64b-76ce-4422-a1b5-0c1f2dc8675b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:09.178041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61a64b-76ce-4422-a1b5-0c1f2dc8675b admin admin] PATH_INFO: `/v3/projects/a5ab72f354304233824fbd0cdf129c4c/users/031060ea777c4bdebef6c0bdecccb626/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:09.203820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61a64b-76ce-4422-a1b5-0c1f2dc8675b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ab72f354304233824fbd0cdf129c4c, user_id=031060ea777c4bdebef6c0bdecccb626, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:09.209339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61a64b-76ce-4422-a1b5-0c1f2dc8675b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:09.240460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69903cc-f5c5-49cd-98a6-f8c059e495cb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:09.253034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:09.254084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:09.254632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:09.255114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:09.271510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:09.274208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:09.297445 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1717/3402] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:09 2022] PUT /identity/v3/projects/a5ab72f354304233824fbd0cdf129c4c/users/031060ea777c4bdebef6c0bdecccb626/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:09.300868 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1686/3403] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:09.311528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ef8b-7fb7-4386-8dd4-249e5875a43f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:09.315615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ef8b-7fb7-4386-8dd4-249e5875a43f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:09.316708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ef8b-7fb7-4386-8dd4-249e5875a43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:09.445938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ef11ef8b-7fb7-4386-8dd4-249e5875a43f None None] MFA Rules not processed for user `031060ea777c4bdebef6c0bdecccb626`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:09.449452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef11ef8b-7fb7-4386-8dd4-249e5875a43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:09.457386 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:09.635834 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1718/3404] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:09.647937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:09.650126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:09.750593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfb216-6686-4f77-b039-b82f09ecffb4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:09.751444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfb216-6686-4f77-b039-b82f09ecffb4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:09.752034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfb216-6686-4f77-b039-b82f09ecffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:09.883940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d80de-2c71-44c5-abc8-65d889efa9ff service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:09.918594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2bdfb216-6686-4f77-b039-b82f09ecffb4 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:09.921706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2bdfb216-6686-4f77-b039-b82f09ecffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:10.012312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:10.014582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:10.016843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:10.018703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:10.041295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:10.043047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:10.070468 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1687/3405] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:10.098472 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1719/3406] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:23:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:10.114678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:10.116613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:10.154930 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:10.283650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427b17-a505-4ad7-b2dc-91c7ab70601a service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:10.291558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dff4b-540a-49e0-b6df-b905529d3a50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:10.292893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dff4b-540a-49e0-b6df-b905529d3a50 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:10.293478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dff4b-540a-49e0-b6df-b905529d3a50 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:10.294046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dff4b-540a-49e0-b6df-b905529d3a50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:10.332788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dff4b-540a-49e0-b6df-b905529d3a50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:10.342544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dff4b-540a-49e0-b6df-b905529d3a50 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:10.370459 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1688/3407] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:23:10.877733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c518c1-dffe-4ecb-80f0-60e3768df5ad None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:10.878176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c518c1-dffe-4ecb-80f0-60e3768df5ad None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:10.878752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c518c1-dffe-4ecb-80f0-60e3768df5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:10.919636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-13c518c1-dffe-4ecb-80f0-60e3768df5ad None None] MFA Rules not processed for user `436b0032d7d14067abaecfa29655690c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:10.921216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13c518c1-dffe-4ecb-80f0-60e3768df5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:11.109260 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1720/3408] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:11.660380 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:12.111190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429979-3d16-4460-a717-4382d73feef7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:12.112089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429979-3d16-4460-a717-4382d73feef7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:12.113423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429979-3d16-4460-a717-4382d73feef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:12.135066 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:12.162545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f7429979-3d16-4460-a717-4382d73feef7 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:12.165516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f7429979-3d16-4460-a717-4382d73feef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:12.176011 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1689/3409] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:12.189851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c518c1-dffe-4ecb-80f0-60e3768df5ad None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:12.206336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c518c1-dffe-4ecb-80f0-60e3768df5ad None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:12.215012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf7311-7f9a-4dea-9802-a121b5a7ba6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:12.216237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf7311-7f9a-4dea-9802-a121b5a7ba6b service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:12.216712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf7311-7f9a-4dea-9802-a121b5a7ba6b service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:12.217482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf7311-7f9a-4dea-9802-a121b5a7ba6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:12.231263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf7311-7f9a-4dea-9802-a121b5a7ba6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:12.233494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf7311-7f9a-4dea-9802-a121b5a7ba6b service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:12.245930 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1721/3410] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:23:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:23:12.749330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7429979-3d16-4460-a717-4382d73feef7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:12.765712 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:12.891144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7429979-3d16-4460-a717-4382d73feef7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:12.916130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:12.916767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:12.917784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:12.918725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] PATH_INFO: `/v3/users/436b0032d7d14067abaecfa29655690c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:12.921804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436b0032d7d14067abaecfa29655690c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:12.925624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:13.262534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436b0032d7d14067abaecfa29655690c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:13.284832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436b0032d7d14067abaecfa29655690c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:13.294096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436b0032d7d14067abaecfa29655690c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:13.296300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436b0032d7d14067abaecfa29655690c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:13.365716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436b0032d7d14067abaecfa29655690c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:13.374974 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1690/3411] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:12 2022] DELETE /identity/v3/users/436b0032d7d14067abaecfa29655690c => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:13.380039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:13.380578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:13.380662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:13.446542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:13.449640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:13.619010 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:13.639302 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1722/3412] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:23:13.652804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:13.657631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:13.789183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c3d2-2dab-41b6-9d69-379323838867 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:13.796428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca1092-446b-4c04-bec8-3ba49c797a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:13.797138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca1092-446b-4c04-bec8-3ba49c797a19 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:13.798341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca1092-446b-4c04-bec8-3ba49c797a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:13.803702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca1092-446b-4c04-bec8-3ba49c797a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:13.814547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca1092-446b-4c04-bec8-3ba49c797a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:13.816200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca1092-446b-4c04-bec8-3ba49c797a19 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:13.834531 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1691/3413] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:15.533167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:15.539510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:15.563131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9ae65-6601-4292-a9a3-b76cb21750ea None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:15.577124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:15.577994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:15.578398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:15.578808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] PATH_INFO: `/v3/projects/732402892e1d457f8cb97adf5a4a05c8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:15.581296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] RBAC: Authorizing `identity:delete_project(project_id=732402892e1d457f8cb97adf5a4a05c8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:15.587152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:15.791563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732402892e1d457f8cb97adf5a4a05c8', 'request_id': 'req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:15.809593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732402892e1d457f8cb97adf5a4a05c8', 'request_id': 'req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:15.894438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732402892e1d457f8cb97adf5a4a05c8', 'request_id': 'req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:15.928789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] The token cache is being invalidate because project 732402892e1d457f8cb97adf5a4a05c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:15.930043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:15.939124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-709f5a9b-8a1f-4c6b-83c7-a3c740d3266b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:15.946676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1723/3414] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:15 2022] DELETE /identity/v3/projects/732402892e1d457f8cb97adf5a4a05c8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:15.951638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fd2fb-0f19-4f15-835c-7bd5b31986e3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:15.954258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fd2fb-0f19-4f15-835c-7bd5b31986e3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:15.955131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fd2fb-0f19-4f15-835c-7bd5b31986e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:15.988953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bc9fd2fb-0f19-4f15-835c-7bd5b31986e3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:15.996789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bc9fd2fb-0f19-4f15-835c-7bd5b31986e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:16.088662 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:16.210581 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1692/3415] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:16.219906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3123f3-709d-43d4-aad0-dc5a704a9dc5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:16.223137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3123f3-709d-43d4-aad0-dc5a704a9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:16.223663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3123f3-709d-43d4-aad0-dc5a704a9dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:16.271538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0b3123f3-709d-43d4-aad0-dc5a704a9dc5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:16.283601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0b3123f3-709d-43d4-aad0-dc5a704a9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:16.314576 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1724/3416] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:16.323513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fd2fb-0f19-4f15-835c-7bd5b31986e3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:16.331969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fd2fb-0f19-4f15-835c-7bd5b31986e3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:16.358031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:16.358031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:16.358031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:16.358031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:16.358470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:16.358470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:16.358602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:16.377805 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1693/3417] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:16.382691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3123f3-709d-43d4-aad0-dc5a704a9dc5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:16.396090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3123f3-709d-43d4-aad0-dc5a704a9dc5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:16.406472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:16.408421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:16.408936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:16.409433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:16.412265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:16.415943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:16.562093 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1725/3418] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:16 2022] POST /identity/v3/projects => generated 403 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:16.571088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:16.587204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2198247-3856-4899-9cd9-d928b9ccd7f5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:16.770940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:16.772530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:16.774652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:16.775397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:16.777917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:16.780995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:16.934119 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1694/3419] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:16 2022] POST /identity/v3/users => generated 302 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:16.938413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:16.958601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3ad50-00c7-43c9-9208-e30cc09b721b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:16.974622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:16.975263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:16.975547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:16.975827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:16.976524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:16.987465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:17.021132 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1726/3420] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:17.022902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:17.040077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740a526-68e8-44da-8324-5d5d2189b4bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:17.056290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f322-3dba-4df3-b12e-8818c1bea3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:17.056935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f322-3dba-4df3-b12e-8818c1bea3aa admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:17.057702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f322-3dba-4df3-b12e-8818c1bea3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:17.058064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f322-3dba-4df3-b12e-8818c1bea3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:17.059615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f322-3dba-4df3-b12e-8818c1bea3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:17.061274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f322-3dba-4df3-b12e-8818c1bea3aa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:17.096377 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1695/3421] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:23:17.100544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:17.117990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aada6-6674-4d85-b060-4215d4d9221d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:17.135155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:17.136000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:17.136299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:17.136578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] PATH_INFO: `/v3/projects/89a789527552496fabd09092a839d662/users/a224301f3eac42f0832a3cf0cd93e32f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:17.159512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a789527552496fabd09092a839d662, user_id=a224301f3eac42f0832a3cf0cd93e32f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:17.163330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:17.277309 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1727/3422] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:17 2022] PUT /identity/v3/projects/89a789527552496fabd09092a839d662/users/a224301f3eac42f0832a3cf0cd93e32f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:17.281436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298918b1-514e-4a81-8d99-82b7da65c676 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:17.281436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298918b1-514e-4a81-8d99-82b7da65c676 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:17.281436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298918b1-514e-4a81-8d99-82b7da65c676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:17.321793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-298918b1-514e-4a81-8d99-82b7da65c676 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:17.327151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-298918b1-514e-4a81-8d99-82b7da65c676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:17.474071 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1696/3423] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:17.563722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:17.568907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:17.705444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95af35-94ad-482f-b683-c8d526e8df97 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:17.711017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:17.723961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:17.724161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:17.726625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:17.749305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:17.751008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:17.777953 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1728/3424] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:19.302674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffea7d-fe45-4b25-81e0-2f8cbf69d541 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:19.303126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffea7d-fe45-4b25-81e0-2f8cbf69d541 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:19.303220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffea7d-fe45-4b25-81e0-2f8cbf69d541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:19.398843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d5ffea7d-fe45-4b25-81e0-2f8cbf69d541 None None] MFA Rules not processed for user `67e550a0e9044ea187299e8b2f5b434a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:19.400411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5ffea7d-fe45-4b25-81e0-2f8cbf69d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:19.522152 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:19.681382 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1697/3425] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:19.935329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:19.937326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:20.004168 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:20.138994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45659c7-2958-4a56-8dc8-8899663c5fe4 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:20.188320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:20.198039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:20.198039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:20.198039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:20.220237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:20.222026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:20.253158 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1729/3426] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:21.517795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffea7d-fe45-4b25-81e0-2f8cbf69d541 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:21.555405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffea7d-fe45-4b25-81e0-2f8cbf69d541 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:21.571205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf005-b73c-4d89-85fe-f703feac25c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:21.571849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf005-b73c-4d89-85fe-f703feac25c7 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:21.572156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf005-b73c-4d89-85fe-f703feac25c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:21.572430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf005-b73c-4d89-85fe-f703feac25c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:21.584077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-37ebf005-b73c-4d89-85fe-f703feac25c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:21.611714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf005-b73c-4d89-85fe-f703feac25c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:21.618176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf005-b73c-4d89-85fe-f703feac25c7 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:21.674514 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1698/3427] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:23:22.205683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:22.207218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:22.243180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225a075-a85c-4467-b9e9-9ae9997dfa35 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:22.280329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b08ab0-68d6-4f2f-95f7-cfe81802789b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:22.281078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b08ab0-68d6-4f2f-95f7-cfe81802789b service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:22.281498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b08ab0-68d6-4f2f-95f7-cfe81802789b service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:22.282022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b08ab0-68d6-4f2f-95f7-cfe81802789b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:22.292618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-23b08ab0-68d6-4f2f-95f7-cfe81802789b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:22.330349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b08ab0-68d6-4f2f-95f7-cfe81802789b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:22.332512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b08ab0-68d6-4f2f-95f7-cfe81802789b service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:22.388024 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1730/3428] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:22.963054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad05a-7646-4fa1-a272-60e5f3a004c5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:22.974004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad05a-7646-4fa1-a272-60e5f3a004c5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:22.974004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad05a-7646-4fa1-a272-60e5f3a004c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:23.041994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8e3ad05a-7646-4fa1-a272-60e5f3a004c5 None None] MFA Rules not processed for user `67b82f18c3204fc3bb9abd839d7df0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:23.043657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8e3ad05a-7646-4fa1-a272-60e5f3a004c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:23.195769 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1699/3429] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:29.826066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76fb04-39d2-40f1-af8c-4361f27cb2ea None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:29.826572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76fb04-39d2-40f1-af8c-4361f27cb2ea None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:29.826654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76fb04-39d2-40f1-af8c-4361f27cb2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:29.930203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3d76fb04-39d2-40f1-af8c-4361f27cb2ea None None] MFA Rules not processed for user `67e550a0e9044ea187299e8b2f5b434a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:29.930203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3d76fb04-39d2-40f1-af8c-4361f27cb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:29.930203 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1731/3430] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:32.999242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad05a-7646-4fa1-a272-60e5f3a004c5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:33.025077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad05a-7646-4fa1-a272-60e5f3a004c5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:33.036407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:33.036407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:33.036944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:33.037497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:33.040538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:33.184618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:33.186540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:33.198186 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1700/3431] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:33.796623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:33.797750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:33.798085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:33.855262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] MFA Rules not processed for user `a224301f3eac42f0832a3cf0cd93e32f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:33.861036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:33.992194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1732/3432] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:34.330326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:34.345087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1f4cd-87c8-4490-b3e0-4a72760ab770 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:34.352599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ec4f0-1422-4113-8f10-e56009f51c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:34.353724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec4f0-1422-4113-8f10-e56009f51c5f service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:34.354046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec4f0-1422-4113-8f10-e56009f51c5f service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:34.354324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec4f0-1422-4113-8f10-e56009f51c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:34.366651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ec4f0-1422-4113-8f10-e56009f51c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:34.368765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ec4f0-1422-4113-8f10-e56009f51c5f service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:34.392683 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1701/3433] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:34 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:40.873168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:40.874907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:40.930027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f74c0-4485-4ea6-9e95-78dc889cce53 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:40.945517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:40.946194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:40.949248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:40.949694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] PATH_INFO: `/v3/users/031060ea777c4bdebef6c0bdecccb626` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:40.954468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031060ea777c4bdebef6c0bdecccb626)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:40.961483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:41.277565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031060ea777c4bdebef6c0bdecccb626'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:41.278405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031060ea777c4bdebef6c0bdecccb626'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:41.409568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031060ea777c4bdebef6c0bdecccb626'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:41.420223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031060ea777c4bdebef6c0bdecccb626'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:41.420974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031060ea777c4bdebef6c0bdecccb626'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:41.439577 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:41.474322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1733/3434] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:40 2022] DELETE /identity/v3/users/031060ea777c4bdebef6c0bdecccb626 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:41.475533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bebfd-7065-42b0-8a16-8438f5650b12 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:41.476104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bebfd-7065-42b0-8a16-8438f5650b12 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:41.476505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bebfd-7065-42b0-8a16-8438f5650b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:41.519171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b08bebfd-7065-42b0-8a16-8438f5650b12 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:41.520694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b08bebfd-7065-42b0-8a16-8438f5650b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:41.560245 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:41.665630 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1702/3435] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:41.786896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:41.788729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:41.942905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df40e5b-e919-4329-8978-9de5f23b33f0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:41.947540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:41.949481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:41.950358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:41.951069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:41.964457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:41.966009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:41.998584 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1734/3436] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:44.396822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e270ab-a01f-4977-ba14-bb273dd430db None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:44.397869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e270ab-a01f-4977-ba14-bb273dd430db None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:44.398361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e270ab-a01f-4977-ba14-bb273dd430db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:44.442180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-50e270ab-a01f-4977-ba14-bb273dd430db None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:44.443926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-50e270ab-a01f-4977-ba14-bb273dd430db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:44.525095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:44.528946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:44.554568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdd540-5a36-4b52-9249-1588a4e7f3ec service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:44.556625 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1703/3437] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:44.569561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:44.573933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:44.573933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:44.573933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] PATH_INFO: `/v3/projects/a5ab72f354304233824fbd0cdf129c4c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:44.575001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ab72f354304233824fbd0cdf129c4c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:44.577630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:44.770155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ab72f354304233824fbd0cdf129c4c', 'request_id': 'req-67d301fc-8766-4e3f-8830-0d09ebe181f5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:44.786861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ab72f354304233824fbd0cdf129c4c', 'request_id': 'req-67d301fc-8766-4e3f-8830-0d09ebe181f5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:44.873957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ab72f354304233824fbd0cdf129c4c', 'request_id': 'req-67d301fc-8766-4e3f-8830-0d09ebe181f5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:44.889312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] The token cache is being invalidate because project a5ab72f354304233824fbd0cdf129c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:44.889904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:44.891275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-67d301fc-8766-4e3f-8830-0d09ebe181f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:44.895707 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1735/3438] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:44 2022] DELETE /identity/v3/projects/a5ab72f354304233824fbd0cdf129c4c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:44.903639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b312-4d15-4050-9127-5c9cb660014d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:44.904359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b312-4d15-4050-9127-5c9cb660014d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:44.904850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b312-4d15-4050-9127-5c9cb660014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:44.956480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ed38b312-4d15-4050-9127-5c9cb660014d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:44.959435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ed38b312-4d15-4050-9127-5c9cb660014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:45.115719 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1704/3439] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:45.124739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d56d1-3fa7-4167-a09d-ab01dc35598d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.125946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d56d1-3fa7-4167-a09d-ab01dc35598d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.126327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d56d1-3fa7-4167-a09d-ab01dc35598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.165895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f78d56d1-3fa7-4167-a09d-ab01dc35598d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:45.167338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f78d56d1-3fa7-4167-a09d-ab01dc35598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:45.186535 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1736/3440] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:45.190223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b312-4d15-4050-9127-5c9cb660014d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:45.211815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b312-4d15-4050-9127-5c9cb660014d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:45.236633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:45.237526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.237826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.238112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.238776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:45.239080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:45.240692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:45.258526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1705/3441] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:45.262979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d56d1-3fa7-4167-a09d-ab01dc35598d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:45.275405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d56d1-3fa7-4167-a09d-ab01dc35598d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:45.283740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:45.284828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.287420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.293627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.293627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:45.293627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:45.388619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:45.390457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:45.429415 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1737/3442] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:45 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:45.435237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:45.470993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b109f-ca5b-41c2-ba56-b93fd49bfba5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:45.602050 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:45.605256 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:45.633830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135104f9-3ba3-4c7a-8458-b6ab1ed6bb33 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:45.647324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:45.650693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.650693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.650693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.652373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:45.655504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:45.655811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:45.657905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.659322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.659709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] PATH_INFO: `/v3/users/f11993e60e454595aabc0b7fb8d1c079` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.663897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11993e60e454595aabc0b7fb8d1c079)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:45.667980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:45.795136 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1738/3443] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:45 2022] POST /identity/v3/users => generated 294 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:45.800461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:45.828029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7f139-56e3-410d-9936-f1cb12153eba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:45.840645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:45.841298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.841565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.841858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.845428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:45.850236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:45.869179 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1739/3444] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:45.872079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:45.883756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3ee7-8dcc-4b24-b07f-a268abadc788 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:45.889280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:45.889836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.890127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.890404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.891476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:45.893293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:45.905792 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1740/3445] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:45.910656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:45.925642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a257220-5ed9-4f2c-bc02-66572fa7456f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:45.930317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403e3ea-c91d-4592-b6be-5831e315628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:45.930968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e3ea-c91d-4592-b6be-5831e315628e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:45.931351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e3ea-c91d-4592-b6be-5831e315628e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:45.931802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e3ea-c91d-4592-b6be-5831e315628e admin admin] PATH_INFO: `/v3/projects/7c2ed05d3e3346f6a6a12d7e4b9a4691/users/fc379d2156954258a08d4402296ff9a8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:45.956639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11993e60e454595aabc0b7fb8d1c079'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:45.967122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403e3ea-c91d-4592-b6be-5831e315628e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2ed05d3e3346f6a6a12d7e4b9a4691, user_id=fc379d2156954258a08d4402296ff9a8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:45.972291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403e3ea-c91d-4592-b6be-5831e315628e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:45.981429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11993e60e454595aabc0b7fb8d1c079'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:45.991263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11993e60e454595aabc0b7fb8d1c079'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:45.992322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11993e60e454595aabc0b7fb8d1c079'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:46.063866 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1741/3446] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:45 2022] PUT /identity/v3/projects/7c2ed05d3e3346f6a6a12d7e4b9a4691/users/fc379d2156954258a08d4402296ff9a8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:46.077267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:46.078189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:46.078647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:46.090746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11993e60e454595aabc0b7fb8d1c079'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:46.113588 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1706/3447] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:45 2022] DELETE /identity/v3/users/f11993e60e454595aabc0b7fb8d1c079 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:46.164603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] MFA Rules not processed for user `fc379d2156954258a08d4402296ff9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:46.166096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:46.327952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1742/3448] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:46.329978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:46.332276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:46.471999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba9fd2-9b24-4b3a-94f3-2585c80dca67 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:46.480521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:46.481538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:46.485507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:46.485507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:46.485507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:46.486303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:46.580742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:46.581714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:46.615985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f23b2-a6ff-4544-9948-09896b143673 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:46.633896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:46.635737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:46.636184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:46.637263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] PATH_INFO: `/v3/projects/228de79b8ff74453af62f6936ba634fa` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:46.639830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228de79b8ff74453af62f6936ba634fa)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:46.646984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:46.655959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1707/3449] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:46 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:46.658997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:46.776426 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:46.784334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858d7b9-4070-45ec-82c5-f80d36c539cf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:46.791907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:46.794333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:46.795743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:46.796189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:46.797165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:46.800138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:46.834508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228de79b8ff74453af62f6936ba634fa', 'request_id': 'req-b348957c-cf79-4e18-b729-fa17b7ce2e63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:46.842287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228de79b8ff74453af62f6936ba634fa', 'request_id': 'req-b348957c-cf79-4e18-b729-fa17b7ce2e63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:46.926998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228de79b8ff74453af62f6936ba634fa', 'request_id': 'req-b348957c-cf79-4e18-b729-fa17b7ce2e63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:46.932450 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1708/3450] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:46 2022] POST /identity/v3/users => generated 300 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:46.938082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:46.973587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace1bd-10ef-4ff6-92d5-aaacfac05f38 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:46.974104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] The token cache is being invalidate because project 228de79b8ff74453af62f6936ba634fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:46.978903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:46.979907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:46.983256 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1743/3451] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:46 2022] DELETE /identity/v3/projects/228de79b8ff74453af62f6936ba634fa => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:46.989014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:46.990867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:46.998746 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:47.083351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:47.085195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:47.088460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:47.088808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:47.090734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:47.097602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:47.130737 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1709/3452] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:47.137049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:47.142018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:47.192317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44993884-e04e-4e62-8a70-0387d2057340 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:47.215173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3211bce-c44c-41d3-bf4f-276ae900f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:47.216250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211bce-c44c-41d3-bf4f-276ae900f29c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:47.217700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211bce-c44c-41d3-bf4f-276ae900f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:47.218187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211bce-c44c-41d3-bf4f-276ae900f29c admin admin] PATH_INFO: `/v3/projects/e1370e577ac947e4adae5e52734d0b01/users/c569164ed2a04b1a96f5c6403a993758/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:47.251798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348957c-cf79-4e18-b729-fa17b7ce2e63 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:47.265567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3211bce-c44c-41d3-bf4f-276ae900f29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1370e577ac947e4adae5e52734d0b01, user_id=c569164ed2a04b1a96f5c6403a993758, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:47.270653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:47.271318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:47.271640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:47.272062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] PATH_INFO: `/v3/users/67b82f18c3204fc3bb9abd839d7df0c9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:47.275896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b82f18c3204fc3bb9abd839d7df0c9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:47.276896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3211bce-c44c-41d3-bf4f-276ae900f29c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:47.280814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:47.379779 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1710/3453] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:47 2022] PUT /identity/v3/projects/e1370e577ac947e4adae5e52734d0b01/users/c569164ed2a04b1a96f5c6403a993758/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:47.380202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6684-61cc-42b1-9eaa-5e61d9fa8a41 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:47.380917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6684-61cc-42b1-9eaa-5e61d9fa8a41 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:47.380917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6684-61cc-42b1-9eaa-5e61d9fa8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:47.415812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-216f6684-61cc-42b1-9eaa-5e61d9fa8a41 None None] MFA Rules not processed for user `c69ab491e3ba4451baba751279ef3123`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:47.417128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-216f6684-61cc-42b1-9eaa-5e61d9fa8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:47.504634 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1711/3454] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:47.505649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f6684-61cc-42b1-9eaa-5e61d9fa8a41 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:47.595882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f6684-61cc-42b1-9eaa-5e61d9fa8a41 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:47.611826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:47.612874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:47.613575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:47.614248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:47.615168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:47.617147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:47.634040 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1712/3455] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:47.639060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:47.642408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b82f18c3204fc3bb9abd839d7df0c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:47.644509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b82f18c3204fc3bb9abd839d7df0c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:47.652578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378cf3a-a66c-4f57-8a3a-ced9cb14e091 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:47.663604 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:47.670014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958eb23-7e57-407b-b755-b9ebe0505ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:47.670978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958eb23-7e57-407b-b755-b9ebe0505ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:47.671647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958eb23-7e57-407b-b755-b9ebe0505ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:47.672806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958eb23-7e57-407b-b755-b9ebe0505ae3 admin admin] PATH_INFO: `/v3/projects/e1370e577ac947e4adae5e52734d0b01/users/c569164ed2a04b1a96f5c6403a993758/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:47.678747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958eb23-7e57-407b-b755-b9ebe0505ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1370e577ac947e4adae5e52734d0b01, user_id=c569164ed2a04b1a96f5c6403a993758, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:47.686967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958eb23-7e57-407b-b755-b9ebe0505ae3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:47.722233 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1713/3456] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:47 2022] PUT /identity/v3/projects/e1370e577ac947e4adae5e52734d0b01/users/c569164ed2a04b1a96f5c6403a993758/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:47.729044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf1dc-1e95-41b4-8243-f29a9c3a3bac None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:47.729044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf1dc-1e95-41b4-8243-f29a9c3a3bac None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:47.729044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf1dc-1e95-41b4-8243-f29a9c3a3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:47.747855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b82f18c3204fc3bb9abd839d7df0c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:47.761416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b82f18c3204fc3bb9abd839d7df0c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:47.762252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b82f18c3204fc3bb9abd839d7df0c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:47.770345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-727bf1dc-1e95-41b4-8243-f29a9c3a3bac None None] MFA Rules not processed for user `c569164ed2a04b1a96f5c6403a993758`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:47.773205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-727bf1dc-1e95-41b4-8243-f29a9c3a3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:47.808506 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1744/3457] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:46 2022] DELETE /identity/v3/users/67b82f18c3204fc3bb9abd839d7df0c9 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:47.886570 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1714/3458] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:47.887623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:47.992791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c26fb-c97d-4370-9795-a9776ed49de5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:47.999437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.001086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.001086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.001313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.002840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.002987 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:23:48.002987 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:23:48.002987 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:23:48.003963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:48.068959 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1745/3459] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:47 2022] POST /identity/v3/services => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:48.074022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf1dc-1e95-41b4-8243-f29a9c3a3bac None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:48.087178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf1dc-1e95-41b4-8243-f29a9c3a3bac None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:48.121120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.121940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.122430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.122799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.123551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.125644 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:23:48.125644 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:23:48.125644 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:23:48.129113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: On instance['enabled']: Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: On instance['enabled']: Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: 'False' Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise error Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'False' Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.163428 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:23:48.165288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'False' Aug 28 01:23:48.166582 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.170166 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1715/3460] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:23:48 2022] POST /identity/v3/endpoints => generated 283 bytes in 97 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:23:48.175968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:48.191681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5604-c6c7-4ec8-af2a-fcae5f1b6292 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:48.198567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.199337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.199855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.200337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.202478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.213638 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:23:48.213638 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:23:48.213638 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:23:48.215036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: On instance['enabled']: Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: On instance['enabled']: Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: 'True' Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise error Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application 'True' Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:23:48.228089 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:23:48.229846 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application 'True' Aug 28 01:23:48.231012 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:23:48.237787 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1746/3461] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:23:48 2022] POST /identity/v3/endpoints => generated 281 bytes in 57 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:23:48.239146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:48.250983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6844-f4f0-4956-bc16-0a6c635a469e tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:48.258884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.259588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.260926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.263315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.263315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.263857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:48.375922 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-161217123. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:23:48.375922 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:23:48.375922 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:23:48.538505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:48.540308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:48.541592 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1716/3462] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:23:48 2022] POST /identity/v3/endpoints => generated 358 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:48.545595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:48.580311 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:48.676851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1ef74-6282-45ef-ac05-2c48d089290f tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:48.691741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.692416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.694436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.695056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/regions/tempest-region-161217123` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.700142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-161217123)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.701440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:48.711052 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1717/3463] 10.222.0.59 () {58 vars in 1203 bytes} [Sun Aug 28 01:23:48 2022] GET /identity/v3/regions/tempest-region-161217123 => generated 178 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:48.730375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:48.766683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd7c8-c7ff-44aa-b8d6-0cdf30e4ac13 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:48.780031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cbe-2183-4843-8c82-7faa955a6d32 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:48.797346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.799461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.799918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.801989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints/da7946c8e0fb4a869c1e83b5a9f18397` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.817927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.819453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=da7946c8e0fb4a869c1e83b5a9f18397)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.821488 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:23:48.821488 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:23:48.821488 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:23:48.822058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.822361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.822973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] PATH_INFO: `/v3/projects/de22b333b87147d69ad670386cad204c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.824218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de22b333b87147d69ad670386cad204c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.826344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:48.851166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: On instance['enabled']: Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: On instance['enabled']: Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: 'False' Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise error Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'False' Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.857059 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:23:48.858618 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'False' Aug 28 01:23:48.860863 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:48.870225 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1718/3464] 10.222.0.59 () {60 vars in 1255 bytes} [Sun Aug 28 01:23:48 2022] PATCH /identity/v3/endpoints/da7946c8e0fb4a869c1e83b5a9f18397 => generated 283 bytes in 142 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:23:48.873973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:48.901154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeda64-00d2-4cbb-9716-3a166e049bf8 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:48.912045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:48.912716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:48.913054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:48.915893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints/da7946c8e0fb4a869c1e83b5a9f18397` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:48.919341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=da7946c8e0fb4a869c1e83b5a9f18397)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:48.924955 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:23:48.924955 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:23:48.924955 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:23:48.926393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:49.015810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de22b333b87147d69ad670386cad204c', 'request_id': 'req-04c5f447-b9fd-4cdf-83af-6cfc0249e641'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:49.055280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de22b333b87147d69ad670386cad204c', 'request_id': 'req-04c5f447-b9fd-4cdf-83af-6cfc0249e641'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:49.062103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'da7946c8e0fb4a869c1e83b5a9f18397', 'request_id': 'req-c054b6f9-e4fa-4a12-9508-30b572019cc6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:49.085707 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1719/3465] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:23:48 2022] DELETE /identity/v3/endpoints/da7946c8e0fb4a869c1e83b5a9f18397 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:49.087629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:49.122220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054b6f9-e4fa-4a12-9508-30b572019cc6 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:49.135153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de22b333b87147d69ad670386cad204c', 'request_id': 'req-04c5f447-b9fd-4cdf-83af-6cfc0249e641'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:49.154080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] The token cache is being invalidate because project de22b333b87147d69ad670386cad204c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:49.154607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:49.157019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04c5f447-b9fd-4cdf-83af-6cfc0249e641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:49.159690 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1747/3466] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:48 2022] DELETE /identity/v3/projects/de22b333b87147d69ad670386cad204c => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:49.164841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482e91-181f-4ae0-b7ed-fc4d077b382a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.165328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482e91-181f-4ae0-b7ed-fc4d077b382a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.165752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c482e91-181f-4ae0-b7ed-fc4d077b382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.170655 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:49.199724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5c482e91-181f-4ae0-b7ed-fc4d077b382a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:49.201481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5c482e91-181f-4ae0-b7ed-fc4d077b382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:49.223304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:49.224466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.224971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.225462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/regions/tempest-region-161217123` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.234864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-161217123)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:49.234864 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:23:49.234864 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:23:49.234864 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:23:49.234864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:49.318888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1748/3467] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:23:49.329410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1321-c63a-44d0-85fe-49fdf087a5f7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.333139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1321-c63a-44d0-85fe-49fdf087a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.333139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1321-c63a-44d0-85fe-49fdf087a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.333366 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1720/3468] 10.222.0.59 () {58 vars in 1206 bytes} [Sun Aug 28 01:23:49 2022] DELETE /identity/v3/regions/tempest-region-161217123 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:49.339563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:49.343593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:49.378805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b58b1321-c63a-44d0-85fe-49fdf087a5f7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:49.380067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b58b1321-c63a-44d0-85fe-49fdf087a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:49.387972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855027d-263f-4cee-ac37-18daa8672a24 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:49.394528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:49.396343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.396343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.396343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.397322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:49.398972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:49.411591 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1749/3469] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:49.413743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1321-c63a-44d0-85fe-49fdf087a5f7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:49.424834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1321-c63a-44d0-85fe-49fdf087a5f7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:49.431677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:49.432451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.432727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.433000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.433656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:49.434289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:49.436074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:49.448704 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1750/3470] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:49.465696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:49.478142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959534d-d94b-4792-ae6b-8f2ffaf9f1fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:49.487743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:49.489545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.490513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.490703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.491598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:49.495414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:49.530956 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-612016320. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:23:49.530956 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:23:49.530956 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:23:49.642200 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1721/3471] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:23:49 2022] POST /identity/v3/endpoints => generated 359 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:49.644701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:49.647010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:49.682435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934594-ac12-4c19-9a8b-dbae960835ef tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:49.689863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:49.690713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.691528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.691962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] PATH_INFO: `/v3/users/a224301f3eac42f0832a3cf0cd93e32f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.694109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a224301f3eac42f0832a3cf0cd93e32f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:49.696375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:49.699921 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1751/3472] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:49 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:49.699921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:49.855186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e74e-f762-4ffc-8fc5-544ffc130a62 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:49.879654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:49.880758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:49.881257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:49.881967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/regions/tempest-region-612016320` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:49.882929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-612016320)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:49.888079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:49.895058 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1752/3473] 10.222.0.59 () {58 vars in 1203 bytes} [Sun Aug 28 01:23:49 2022] GET /identity/v3/regions/tempest-region-612016320 => generated 178 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:49.895058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:49.943008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a224301f3eac42f0832a3cf0cd93e32f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:49.965221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a224301f3eac42f0832a3cf0cd93e32f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:50.002285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a224301f3eac42f0832a3cf0cd93e32f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:50.003938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a224301f3eac42f0832a3cf0cd93e32f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:50.026623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17bcce-65bb-4d11-80ad-305ea4afb5b4 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.038973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.039841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.040325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.040750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.041610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.044833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.085542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a224301f3eac42f0832a3cf0cd93e32f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:50.092383 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1722/3474] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:49 2022] DELETE /identity/v3/users/a224301f3eac42f0832a3cf0cd93e32f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:50.094692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.098917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:50.118749 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:50.190151 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1753/3475] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:49 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:50.200148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.202068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:50.211154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfd49d-fdd0-4641-b75f-fabe1a2af3f8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.217556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.219914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.220294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddda1f-10ef-4313-b6e9-38a9cec8150e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.220525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.220954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints/984c656c2a0b400d99f421a0a6436341` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.229033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=984c656c2a0b400d99f421a0a6436341)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.232520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: On instance['enabled']: Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: On instance['enabled']: Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: 'True' Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise error Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'True' Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:50.271885 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:23:50.273577 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'True' Aug 28 01:23:50.274832 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:23:50.278253 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1723/3476] 10.222.0.59 () {60 vars in 1255 bytes} [Sun Aug 28 01:23:50 2022] PATCH /identity/v3/endpoints/984c656c2a0b400d99f421a0a6436341 => generated 281 bytes in 185 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:23:50.290069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.318821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e73fb-ce88-4379-800c-eed3ed836ece tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.330394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.331221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.331567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.332156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/endpoints/984c656c2a0b400d99f421a0a6436341` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.334374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=984c656c2a0b400d99f421a0a6436341)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.337242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.340348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.340970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.341250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.341527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.342425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.345642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.367736 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1754/3477] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:23:50.373844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.402562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd3b65-3968-4810-9600-2f0d3d6ee555 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.419107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.427501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.427501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.427501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.427501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.427501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.445172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '984c656c2a0b400d99f421a0a6436341', 'request_id': 'req-6d3777ae-8111-4d95-a53e-5cdb60e13e15'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:50.448277 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1755/3478] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:50.454043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.483204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b5e33-849d-4ad9-9f86-2ad7ca5154da admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.488795 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1724/3479] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:23:50 2022] DELETE /identity/v3/endpoints/984c656c2a0b400d99f421a0a6436341 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:50.491507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.512394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.513999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.514283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.514868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] PATH_INFO: `/v3/projects/383025c420c44c359ac91a45710451c6/users/2a72690865504f47b8f9e7c0b8c5e929/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.517030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3777ae-8111-4d95-a53e-5cdb60e13e15 tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.523217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.523985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.524362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.524817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/regions/tempest-region-612016320` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.525500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-612016320)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.527431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.568067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=383025c420c44c359ac91a45710451c6, user_id=2a72690865504f47b8f9e7c0b8c5e929, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.570446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.621443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1725/3480] 10.222.0.59 () {58 vars in 1206 bytes} [Sun Aug 28 01:23:50 2022] DELETE /identity/v3/regions/tempest-region-612016320 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:50.622467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.627084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:50.655522 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1756/3481] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:50 2022] PUT /identity/v3/projects/383025c420c44c359ac91a45710451c6/users/2a72690865504f47b8f9e7c0b8c5e929/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:50.657176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:50.690560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3d9b5-d851-4889-bc16-18fcb6a01e6d tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.785477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.786986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.787236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcc507-9917-4ce7-9aba-8ef8400496f5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:50.787357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.787603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] PATH_INFO: `/v3/projects/89a789527552496fabd09092a839d662` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.789840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a789527552496fabd09092a839d662)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.792069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.819263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7876ed6-deb0-44f8-aa6c-d408e4c983ea tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c569164ed2a04b1a96f5c6403a993758', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1370e577ac947e4adae5e52734d0b01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:50.819907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876ed6-deb0-44f8-aa6c-d408e4c983ea tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.820188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876ed6-deb0-44f8-aa6c-d408e4c983ea tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.820460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876ed6-deb0-44f8-aa6c-d408e4c983ea tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] PATH_INFO: `/v3/services/42469587ee9144f5b65b4da6e0d7ae71` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:50.821041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7876ed6-deb0-44f8-aa6c-d408e4c983ea tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorizing `identity:delete_service(service_id=42469587ee9144f5b65b4da6e0d7ae71)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:50.822166 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-a7876ed6-deb0-44f8-aa6c-d408e4c983ea tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:23:50.822166 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:23:50.822166 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:23:50.823040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7876ed6-deb0-44f8-aa6c-d408e4c983ea tempest-EndpointsNegativeTestJSON-1637519169 tempest-EndpointsNegativeTestJSON-1637519169-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:50.959607 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1757/3482] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:50 2022] DELETE /identity/v3/services/42469587ee9144f5b65b4da6e0d7ae71 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:50.963432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22476-7659-468d-9af4-8960abcca045 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:50.963971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22476-7659-468d-9af4-8960abcca045 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:50.965180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c22476-7659-468d-9af4-8960abcca045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.003918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-83c22476-7659-468d-9af4-8960abcca045 None None] MFA Rules not processed for user `2a72690865504f47b8f9e7c0b8c5e929`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:51.005543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83c22476-7659-468d-9af4-8960abcca045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:51.011674 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:51.056533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a789527552496fabd09092a839d662', 'request_id': 'req-832b3c7a-1651-4d16-b315-33b96940779f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.066039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a789527552496fabd09092a839d662', 'request_id': 'req-832b3c7a-1651-4d16-b315-33b96940779f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.134655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1758/3483] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:51.142950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22476-7659-468d-9af4-8960abcca045 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:51.145386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83c22476-7659-468d-9af4-8960abcca045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:51.146252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a789527552496fabd09092a839d662', 'request_id': 'req-832b3c7a-1651-4d16-b315-33b96940779f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.159690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] The token cache is being invalidate because project 89a789527552496fabd09092a839d662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:51.160037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.160642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.165590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1726/3484] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:50 2022] DELETE /identity/v3/projects/89a789527552496fabd09092a839d662 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:51.166660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:51.168357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:51.172966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c22476-7659-468d-9af4-8960abcca045 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:51.257591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b3c7a-1651-4d16-b315-33b96940779f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:51.273318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a2013-21b9-4fc9-b137-ed734dd8e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:51.274126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a2013-21b9-4fc9-b137-ed734dd8e9da admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.276403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a2013-21b9-4fc9-b137-ed734dd8e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.278143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a2013-21b9-4fc9-b137-ed734dd8e9da admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.278143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a2013-21b9-4fc9-b137-ed734dd8e9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:51.284408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a2013-21b9-4fc9-b137-ed734dd8e9da admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:51.358063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:51.358872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.359231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.362230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] PATH_INFO: `/v3/users/fc379d2156954258a08d4402296ff9a8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.362230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc379d2156954258a08d4402296ff9a8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:51.363576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:51.426860 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1727/3485] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:51 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:51.428402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67ceb-3c3a-480d-bf1b-0c9d63f2b92e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.428659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67ceb-3c3a-480d-bf1b-0c9d63f2b92e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.430113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b67ceb-3c3a-480d-bf1b-0c9d63f2b92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.507237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-02b67ceb-3c3a-480d-bf1b-0c9d63f2b92e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:51.508655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02b67ceb-3c3a-480d-bf1b-0c9d63f2b92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:51.577726 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1728/3486] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:51.579402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b67ceb-3c3a-480d-bf1b-0c9d63f2b92e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:51.589279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b67ceb-3c3a-480d-bf1b-0c9d63f2b92e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:51.594801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6026ce-c9c0-474f-8ef9-9c732b700c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:51.595419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6026ce-c9c0-474f-8ef9-9c732b700c68 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.595704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6026ce-c9c0-474f-8ef9-9c732b700c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.595976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6026ce-c9c0-474f-8ef9-9c732b700c68 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.596920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6026ce-c9c0-474f-8ef9-9c732b700c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:51.599169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6026ce-c9c0-474f-8ef9-9c732b700c68 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:51.605153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc379d2156954258a08d4402296ff9a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.606303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc379d2156954258a08d4402296ff9a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.726044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc379d2156954258a08d4402296ff9a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.732443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1729/3487] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:51 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:51.735631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.736112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.749692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.756503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc379d2156954258a08d4402296ff9a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.764215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc379d2156954258a08d4402296ff9a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:51.772567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:51.775482 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:51.778153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:51.794992 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1730/3488] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:51.796094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:51.799014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:51.803249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1759/3489] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:51 2022] DELETE /identity/v3/users/fc379d2156954258a08d4402296ff9a8 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:51.804561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:51.816497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a93d0-d323-4d8d-8933-88b37a2ed41b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:51.915301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1a4c7-30dc-4c5d-b6ec-839d9050b035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:51.917925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a4c7-30dc-4c5d-b6ec-839d9050b035 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.918310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a4c7-30dc-4c5d-b6ec-839d9050b035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.918825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a4c7-30dc-4c5d-b6ec-839d9050b035 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.921782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1a4c7-30dc-4c5d-b6ec-839d9050b035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:51.923453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1a4c7-30dc-4c5d-b6ec-839d9050b035 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:51.939881 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1731/3490] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:51.945204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2230d7-2923-40c5-9f9b-3898555e368e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.946537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2230d7-2923-40c5-9f9b-3898555e368e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.946938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2230d7-2923-40c5-9f9b-3898555e368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.953390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326a97-0e9d-4dd6-8a33-15f2dae7a37c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:51.961113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:51.962928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:51.963377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:51.963813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:51.964711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:51.965767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:51.969217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:51.974521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4a2230d7-2923-40c5-9f9b-3898555e368e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:51.975954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a2230d7-2923-40c5-9f9b-3898555e368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:52.003480 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1760/3491] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:52.005863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.022201 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1732/3492] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:52.024412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2230d7-2923-40c5-9f9b-3898555e368e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.033901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f186bb-d69b-453f-9cf1-4f6be8c1c3b7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.041943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.043529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.044004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.044438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] PATH_INFO: `/v3/projects/83dde0ba3ee14136a3c2d9269e1da0b9/users/9b186a4a3a4b4c07b3567e9e2a46c9d1/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.068777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2230d7-2923-40c5-9f9b-3898555e368e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.078126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dde0ba3ee14136a3c2d9269e1da0b9, user_id=9b186a4a3a4b4c07b3567e9e2a46c9d1, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.081547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.082322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.082608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.082884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.084939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.086068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.089324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.256198 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1761/3493] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:52 2022] PUT /identity/v3/projects/83dde0ba3ee14136a3c2d9269e1da0b9/users/9b186a4a3a4b4c07b3567e9e2a46c9d1/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:52.260905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.277140 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1733/3494] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:52 2022] POST /identity/v3/projects => generated 383 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:52.277345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:52.277639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.507401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd6105-b680-4ad4-8c96-06876d3ebc07 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.514098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.516200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.517084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.517679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.519578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.522913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.530133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8af4-92d3-4679-9cd9-966c49496495 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.544350 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1734/3495] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:52.561159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.585800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746b95b-195a-48fd-9b85-2e107d8f0463 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.596947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.599632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.600529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.601714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.602540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.607293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.673782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.676508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.676969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.677393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.708660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.711705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.727925 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1762/3496] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:52.728809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.741533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5728c8-0f88-4644-881a-4afca6e7858a service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.748210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4417a-0a0f-4252-aabf-127367edec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.749333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4417a-0a0f-4252-aabf-127367edec39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.750101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4417a-0a0f-4252-aabf-127367edec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.751602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4417a-0a0f-4252-aabf-127367edec39 admin admin] PATH_INFO: `/v3/projects/83dde0ba3ee14136a3c2d9269e1da0b9/users/9b186a4a3a4b4c07b3567e9e2a46c9d1/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.756110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4417a-0a0f-4252-aabf-127367edec39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dde0ba3ee14136a3c2d9269e1da0b9, user_id=9b186a4a3a4b4c07b3567e9e2a46c9d1, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.760798 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1735/3497] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:52 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:52.762461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.763991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4417a-0a0f-4252-aabf-127367edec39 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.775330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d996d65-2e87-4fd0-a41c-21cf546f5978 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.778792 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1763/3498] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:52 2022] PUT /identity/v3/projects/83dde0ba3ee14136a3c2d9269e1da0b9/users/9b186a4a3a4b4c07b3567e9e2a46c9d1/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:52.791628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a63b-bd06-4c98-a212-3da14d28c4f2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.792290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a63b-bd06-4c98-a212-3da14d28c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.792737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07a63b-bd06-4c98-a212-3da14d28c4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.868134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9f07a63b-bd06-4c98-a212-3da14d28c4f2 None None] MFA Rules not processed for user `9b186a4a3a4b4c07b3567e9e2a46c9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:52.868973 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:52.869437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9f07a63b-bd06-4c98-a212-3da14d28c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:52.904038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.904665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.905573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.905880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.907270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.908903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.921270 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1736/3499] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:52.925606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.942160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a95aa-0318-4aa8-bdd3-b09ce031ad9c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:52.948479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:52.949555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:52.950039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:52.950374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:52.952289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:52.954197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:52.972048 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1737/3500] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:23:52.973153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:52.988000 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:53.002208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5711-87a2-4c7c-aae9-2cbb30170065 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:53.012644 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1764/3501] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:53.014154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07a63b-bd06-4c98-a212-3da14d28c4f2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:53.019100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa098d-120b-4f1f-be8d-84293e34d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:53.019959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa098d-120b-4f1f-be8d-84293e34d3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.021416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa098d-120b-4f1f-be8d-84293e34d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.022829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa098d-120b-4f1f-be8d-84293e34d3bf admin admin] PATH_INFO: `/v3/projects/6c6186dfcf8a4103b40f58c1bda01e64/users/ee4304eed6754c4f8ae8fcf8b16a8854/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.027169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07a63b-bd06-4c98-a212-3da14d28c4f2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:53.034692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:53.035908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.036434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.036905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.037851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:53.038377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:53.040216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:53.060938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa098d-120b-4f1f-be8d-84293e34d3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6186dfcf8a4103b40f58c1bda01e64, user_id=ee4304eed6754c4f8ae8fcf8b16a8854, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:53.062248 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1765/3502] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:53.065333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa098d-120b-4f1f-be8d-84293e34d3bf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:53.066879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:53.091264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9054b30-dd0b-45f2-a9fe-a279d17c553b tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:53.098126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:53.100371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.100371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.100371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.100661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:53.102514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:53.150948 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1738/3503] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:52 2022] PUT /identity/v3/projects/6c6186dfcf8a4103b40f58c1bda01e64/users/ee4304eed6754c4f8ae8fcf8b16a8854/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:53.162903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.163614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.163732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.216115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] MFA Rules not processed for user `ee4304eed6754c4f8ae8fcf8b16a8854`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:53.217415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:53.242109 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1766/3504] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:53 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:53.250888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:53.347831 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1739/3505] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:53.358886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:53.362024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:53.366171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7908255-69b2-4ffd-8a86-b8486e65fe24 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:53.372300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:53.372300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.372300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.372754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.373349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:53.373729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:53.376173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:53.389773 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1767/3506] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:53.407952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:53.412518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:53.482661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b910-8194-4bc3-8b79-12887e01b621 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:53.512706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598aad8-6db3-4246-893b-da44fffdbba9 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:53.521216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35d65-814f-4da0-abb5-a563b6ad0883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:53.521752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35d65-814f-4da0-abb5-a563b6ad0883 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.522081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35d65-814f-4da0-abb5-a563b6ad0883 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.522362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35d65-814f-4da0-abb5-a563b6ad0883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.532565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d35d65-814f-4da0-abb5-a563b6ad0883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:53.534332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d35d65-814f-4da0-abb5-a563b6ad0883 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:53.544691 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1768/3507] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:23:53.545722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1ff3c-ca5a-461f-915a-fbc3a77b1fc6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.546038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1ff3c-ca5a-461f-915a-fbc3a77b1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.546314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1ff3c-ca5a-461f-915a-fbc3a77b1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.570138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:53.570138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.570138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.570138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.570486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-76b1ff3c-ca5a-461f-915a-fbc3a77b1fc6 None None] MFA Rules not processed for user `0635b4466d3d41eb95eb7fef0138437a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:53.570486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-76b1ff3c-ca5a-461f-915a-fbc3a77b1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:53.641958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:53.644185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:53.647273 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1769/3508] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:53.648219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfabc9-9ff8-4bef-afe4-41dd6e01f9d6 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.648626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfabc9-9ff8-4bef-afe4-41dd6e01f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.648905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfabc9-9ff8-4bef-afe4-41dd6e01f9d6 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.650821 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1770/3509] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:23:53.660113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfabc9-9ff8-4bef-afe4-41dd6e01f9d6 None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:23:53.662731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1740/3510] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:53.688119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfabc9-9ff8-4bef-afe4-41dd6e01f9d6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:53.700429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfabc9-9ff8-4bef-afe4-41dd6e01f9d6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:53.705348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d4403-7dae-4e6f-a4d2-bf72c1b6b102 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:53.706026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4403-7dae-4e6f-a4d2-bf72c1b6b102 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:53.706312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4403-7dae-4e6f-a4d2-bf72c1b6b102 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:53.706586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4403-7dae-4e6f-a4d2-bf72c1b6b102 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/projects/45148f14a7774d9ebd4cab943fe06e72` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:53.707964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d4403-7dae-4e6f-a4d2-bf72c1b6b102 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:get_project(project_id=45148f14a7774d9ebd4cab943fe06e72)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:53.709861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d4403-7dae-4e6f-a4d2-bf72c1b6b102 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:53.711790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1771/3511] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:23:53 2022] GET /identity/v3/projects/45148f14a7774d9ebd4cab943fe06e72 => generated 369 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:54.175265 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:54.263814 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:54.337899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:54.339463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:54.450779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36be15-537d-48cf-bd4c-9bb567cb555a service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:54.468074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:54.473739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:54.473739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:54.473739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] PATH_INFO: `/v3/projects/7c2ed05d3e3346f6a6a12d7e4b9a4691` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:54.473739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2ed05d3e3346f6a6a12d7e4b9a4691)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:54.477135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:54.511512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5585f-3142-4aa9-b285-0a9c58c3d57e None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:54.511673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5585f-3142-4aa9-b285-0a9c58c3d57e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:54.512345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5585f-3142-4aa9-b285-0a9c58c3d57e None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:54.513799 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1772/3512] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:23:54.525855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5585f-3142-4aa9-b285-0a9c58c3d57e None None] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:23:54.547322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5585f-3142-4aa9-b285-0a9c58c3d57e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:54.568402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5585f-3142-4aa9-b285-0a9c58c3d57e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:54.574148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:54.575123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:54.575484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:54.575827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/projects/45148f14a7774d9ebd4cab943fe06e72` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:54.577393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:get_project(project_id=45148f14a7774d9ebd4cab943fe06e72)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:54.580541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:54.582701 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1773/3513] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:23:54 2022] GET /identity/v3/projects/45148f14a7774d9ebd4cab943fe06e72 => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:54.647551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2ed05d3e3346f6a6a12d7e4b9a4691', 'request_id': 'req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:54.656368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2ed05d3e3346f6a6a12d7e4b9a4691', 'request_id': 'req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:54.659698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:54.684137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecb297-7592-4d10-b64d-43179ed8e118 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:54.770096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2ed05d3e3346f6a6a12d7e4b9a4691', 'request_id': 'req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:54.788079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:54.788691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:54.788982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:54.789262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:54.791162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] The token cache is being invalidate because project 7c2ed05d3e3346f6a6a12d7e4b9a4691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:54.791514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:54.792069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:54.792397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:54.794272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:54.794828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:54.798359 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1741/3514] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:54 2022] DELETE /identity/v3/projects/7c2ed05d3e3346f6a6a12d7e4b9a4691 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:54.802284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:54.804842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:54.821370 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1774/3515] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:54.829627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:54.839893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:54.853611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a34db-5f37-411f-bbf5-5fceeb0b29b7 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:54.858942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:54.860612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:54.861468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:54.861468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:54.862495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:54.864169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:54.892856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66e330-c0e6-4bdd-b60f-cef562c5f0ef admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:54.904438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:54.904438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:54.904438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:54.905038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] PATH_INFO: `/v3/users/c569164ed2a04b1a96f5c6403a993758` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:54.906913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c569164ed2a04b1a96f5c6403a993758)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:54.909093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:54.989825 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1775/3516] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:54 2022] POST /identity/v3/users => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:54.990989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:54.992647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:55.006907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2c22d-ed15-4dd6-87f8-94cbf4dbfcaa tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:55.012485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:55.014658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:55.016176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:55.016176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] PATH_INFO: `/v3/users/cb7f5378ae6f467c939f924d15112640` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:55.017108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7f5378ae6f467c939f924d15112640)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:55.019350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:55.074034 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:55.188824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c569164ed2a04b1a96f5c6403a993758'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.213145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c569164ed2a04b1a96f5c6403a993758'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.229025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c569164ed2a04b1a96f5c6403a993758'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.229025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c569164ed2a04b1a96f5c6403a993758'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.260239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7f5378ae6f467c939f924d15112640'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.261990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7f5378ae6f467c939f924d15112640'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.298432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c569164ed2a04b1a96f5c6403a993758'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.313639 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1742/3517] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:54 2022] DELETE /identity/v3/users/c569164ed2a04b1a96f5c6403a993758 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:55.313639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:55.313639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:55.394627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7f5378ae6f467c939f924d15112640'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.411170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7f5378ae6f467c939f924d15112640'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.411170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7f5378ae6f467c939f924d15112640'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.444951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23d1e-0c09-4e35-940b-fde863a486de admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:55.464559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3807-2ff3-4101-9521-223bc699d1ff tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:55.465865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3807-2ff3-4101-9521-223bc699d1ff tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:55.467635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3807-2ff3-4101-9521-223bc699d1ff tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:55.471470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3807-2ff3-4101-9521-223bc699d1ff tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:55.473508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3807-2ff3-4101-9521-223bc699d1ff tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:55.474466 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1776/3518] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:54 2022] DELETE /identity/v3/users/cb7f5378ae6f467c939f924d15112640 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:55.476488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3807-2ff3-4101-9521-223bc699d1ff tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:55.480368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3807-2ff3-4101-9521-223bc699d1ff tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:55.524535 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1743/3519] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:55.524733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:55.524733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:55.543904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:55.544233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:55.544564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:55.547394 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1744/3520] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:23:55.553642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:23:55.556334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:55.656988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f385996-aa87-4555-bc94-c2f09622fb2d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:55.681728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:55.681728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:55.681728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:55.681728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] PATH_INFO: `/v3/users/ee4304eed6754c4f8ae8fcf8b16a8854` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:55.682246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4304eed6754c4f8ae8fcf8b16a8854)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:55.682246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:55.709790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:55.709790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:55.825909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d106-0f85-426a-ac22-76cc0de687ee None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:55.831056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:55.831808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:55.832163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:55.832512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/projects/45148f14a7774d9ebd4cab943fe06e72` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:55.834452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:get_project(project_id=45148f14a7774d9ebd4cab943fe06e72)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:55.836591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:55.838585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1745/3521] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:23:55 2022] GET /identity/v3/projects/45148f14a7774d9ebd4cab943fe06e72 => generated 369 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:23:55.927935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4304eed6754c4f8ae8fcf8b16a8854'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.936648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4304eed6754c4f8ae8fcf8b16a8854'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:55.966978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:55.970533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:55.993737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7016-cd95-4837-99b9-3799e5389fbc tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.000667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.002511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.003049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.003562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] PATH_INFO: `/v3/projects/96c32776837d4c89bebb402c3c374bb7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.005348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c32776837d4c89bebb402c3c374bb7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:56.007990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:56.026768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4304eed6754c4f8ae8fcf8b16a8854'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.039418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4304eed6754c4f8ae8fcf8b16a8854'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.041896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ce1965d4-79e2-4a0b-be59-d9f3f7627b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4304eed6754c4f8ae8fcf8b16a8854'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.067328 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:56.079418 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1777/3522] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:55 2022] DELETE /identity/v3/users/ee4304eed6754c4f8ae8fcf8b16a8854 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:56.083481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc0a8-cb59-4556-a740-92d9431ad642 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.083774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc0a8-cb59-4556-a740-92d9431ad642 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.084066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dc0a8-cb59-4556-a740-92d9431ad642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.108696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8d2dc0a8-cb59-4556-a740-92d9431ad642 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:56.110438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d2dc0a8-cb59-4556-a740-92d9431ad642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:56.212833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1778/3523] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:56.222442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371fd69-55c4-4813-a201-500abcc9bd3b None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.222734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371fd69-55c4-4813-a201-500abcc9bd3b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.223027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371fd69-55c4-4813-a201-500abcc9bd3b None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.224690 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1779/3524] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:23:56.228942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371fd69-55c4-4813-a201-500abcc9bd3b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.231256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b371fd69-55c4-4813-a201-500abcc9bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:56.260003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c32776837d4c89bebb402c3c374bb7', 'request_id': 'req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.283196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c32776837d4c89bebb402c3c374bb7', 'request_id': 'req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.303101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371fd69-55c4-4813-a201-500abcc9bd3b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.362600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd64d7-0768-4501-8542-9091cd7ab4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.363459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd64d7-0768-4501-8542-9091cd7ab4bd service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.363583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd64d7-0768-4501-8542-9091cd7ab4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.363759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd64d7-0768-4501-8542-9091cd7ab4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.366460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c32776837d4c89bebb402c3c374bb7', 'request_id': 'req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.383364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] The token cache is being invalidate because project 96c32776837d4c89bebb402c3c374bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:56.384050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.385756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.388516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1746/3525] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:55 2022] DELETE /identity/v3/projects/96c32776837d4c89bebb402c3c374bb7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:56.389659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:23:56.392264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:56.455797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd64d7-0768-4501-8542-9091cd7ab4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:56.457259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd64d7-0768-4501-8542-9091cd7ab4bd service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:56.469793 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1780/3526] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:56.471134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ce46a-35d0-47c1-9aa2-c09d8df95115 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.479455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ce46a-35d0-47c1-9aa2-c09d8df95115 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.479455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ce46a-35d0-47c1-9aa2-c09d8df95115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.498475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.500445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ba1ce46a-35d0-47c1-9aa2-c09d8df95115 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:56.502419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ba1ce46a-35d0-47c1-9aa2-c09d8df95115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:56.502700 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:56.505291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:56.524520 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1781/3527] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:56.534044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073999-4c23-4996-b66e-3bc101142171 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.534489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073999-4c23-4996-b66e-3bc101142171 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.534790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073999-4c23-4996-b66e-3bc101142171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.559727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0a073999-4c23-4996-b66e-3bc101142171 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:56.568110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a073999-4c23-4996-b66e-3bc101142171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:56.582629 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1782/3528] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:23:56.586959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a073999-4c23-4996-b66e-3bc101142171 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.597738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a073999-4c23-4996-b66e-3bc101142171 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.602827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.603768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.604223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.604514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.605203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:56.605512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:56.607317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:56.621849 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1783/3529] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:23:56.625292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66951dd-f4bc-4f9e-a9b3-9036c727d3a8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.625423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.628512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.629200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.629659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.629986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/projects/45148f14a7774d9ebd4cab943fe06e72` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.631203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:get_project(project_id=45148f14a7774d9ebd4cab943fe06e72)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:56.633679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:56.635589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1747/3530] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:23:56 2022] GET /identity/v3/projects/45148f14a7774d9ebd4cab943fe06e72 => generated 369 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:56.637228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11739dd-2b20-4502-a06d-080c1b014dc5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.643958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.644604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.644917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.645185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.645851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:56.647798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:56.680090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.691617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a5f2b-3023-4a2c-bb3c-caa640145d84 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.696423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.697141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.697498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.697895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/users/569f3f76fa4749d195464ed5ba97b13e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.713139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:delete_user(user_id=569f3f76fa4749d195464ed5ba97b13e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:56.715111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:56.741944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1784/3531] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:56 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:56.743405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.810302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c546866-a8e6-41ee-993e-c404c6d5d396 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.816640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.820113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:56.820113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:56.820113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:56.820113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:56.820643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:56.865749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569f3f76fa4749d195464ed5ba97b13e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.883362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569f3f76fa4749d195464ed5ba97b13e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.892303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569f3f76fa4749d195464ed5ba97b13e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.893139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569f3f76fa4749d195464ed5ba97b13e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.925749 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:56.965950 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1785/3532] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:56 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:23:56.966126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.969416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:56.986283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667c139-6396-4f33-bb6c-4fef4e6cc168 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:56.987728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569f3f76fa4749d195464ed5ba97b13e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:56.991416 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:56.996050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:56.996216 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1748/3533] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:56 2022] DELETE /identity/v3/users/569f3f76fa4749d195464ed5ba97b13e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:56.997160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:56.999416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:57.000489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:57.002488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:57.002784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] PATH_INFO: `/v3/projects/e1370e577ac947e4adae5e52734d0b01` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:57.007578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1370e577ac947e4adae5e52734d0b01)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:57.011945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:57.114111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551dd5c-442a-46e7-8182-9147aade3794 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:57.126862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:57.127574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:57.127865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:57.128146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:57.129138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:57.131650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:57.160905 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1749/3534] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:57.162985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:57.164847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:57.225967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1370e577ac947e4adae5e52734d0b01', 'request_id': 'req-8745d8b1-06c4-4ad7-aeec-cbb712da2121'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.238160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1370e577ac947e4adae5e52734d0b01', 'request_id': 'req-8745d8b1-06c4-4ad7-aeec-cbb712da2121'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.340136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed411d5-9922-463e-94f2-48c6417d990f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:57.370999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1370e577ac947e4adae5e52734d0b01', 'request_id': 'req-8745d8b1-06c4-4ad7-aeec-cbb712da2121'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.392360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] The token cache is being invalidate because project e1370e577ac947e4adae5e52734d0b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:57.392672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.394173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.399304 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1786/3535] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:56 2022] DELETE /identity/v3/projects/e1370e577ac947e4adae5e52734d0b01 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:57.410463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:57.410463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:57.483568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b186a4a3a4b4c07b3567e9e2a46c9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83dde0ba3ee14136a3c2d9269e1da0b9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:57.486503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:57.499470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:57.500125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] PATH_INFO: `/v3/projects/45148f14a7774d9ebd4cab943fe06e72` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:57.504178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45148f14a7774d9ebd4cab943fe06e72)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:57.509175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:57.561926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745d8b1-06c4-4ad7-aeec-cbb712da2121 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:57.573852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20780ab-7d7b-4064-9705-6f73604b4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:57.573852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20780ab-7d7b-4064-9705-6f73604b4be3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:57.573852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20780ab-7d7b-4064-9705-6f73604b4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:57.573852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20780ab-7d7b-4064-9705-6f73604b4be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:57.574283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20780ab-7d7b-4064-9705-6f73604b4be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:57.575789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20780ab-7d7b-4064-9705-6f73604b4be3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:57.590724 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1787/3536] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:57.592586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:57.593125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:57.594056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:57.618384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:57.619085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:57.636033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1788/3537] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:57.636980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:57.638434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:57.661636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2decd3-c007-4959-a38f-78ca71e99e76 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:57.667537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:57.668908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:57.669692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:57.670611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] PATH_INFO: `/v3/projects/6c6186dfcf8a4103b40f58c1bda01e64` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:57.673049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6186dfcf8a4103b40f58c1bda01e64)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:57.675919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:57.711100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45148f14a7774d9ebd4cab943fe06e72', 'request_id': 'req-6bec4d64-6a3d-402b-bcf2-424adc1bf501'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.721623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45148f14a7774d9ebd4cab943fe06e72', 'request_id': 'req-6bec4d64-6a3d-402b-bcf2-424adc1bf501'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.787987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45148f14a7774d9ebd4cab943fe06e72', 'request_id': 'req-6bec4d64-6a3d-402b-bcf2-424adc1bf501'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.806426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] The token cache is being invalidate because project 45148f14a7774d9ebd4cab943fe06e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:57.807349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.808142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.818417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1750/3538] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:57 2022] DELETE /identity/v3/projects/45148f14a7774d9ebd4cab943fe06e72 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:57.818417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:57.818417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:57.849393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6186dfcf8a4103b40f58c1bda01e64', 'request_id': 'req-3b0e993c-56db-463a-bc14-1968dbb4e392'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.861486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6186dfcf8a4103b40f58c1bda01e64', 'request_id': 'req-3b0e993c-56db-463a-bc14-1968dbb4e392'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.901997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec4d64-6a3d-402b-bcf2-424adc1bf501 tempest-QuotasAdminTestV236-1939778860 tempest-QuotasAdminTestV236-1939778860-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:57.970803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6186dfcf8a4103b40f58c1bda01e64', 'request_id': 'req-3b0e993c-56db-463a-bc14-1968dbb4e392'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:57.998758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] The token cache is being invalidate because project 6c6186dfcf8a4103b40f58c1bda01e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:23:58.000330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:58.002638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b0e993c-56db-463a-bc14-1968dbb4e392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:58.009859 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1789/3539] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:57 2022] DELETE /identity/v3/projects/6c6186dfcf8a4103b40f58c1bda01e64 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:58.009859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.009859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.009859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.046841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481bf5f-78b5-4bd7-8ee4-92d006a40abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.048158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bf5f-78b5-4bd7-8ee4-92d006a40abf admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.048456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bf5f-78b5-4bd7-8ee4-92d006a40abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.048738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bf5f-78b5-4bd7-8ee4-92d006a40abf admin admin] PATH_INFO: `/v3/projects/50ad9843fdef44a7a4d89fcac45106d5/users/b2be15e97a30467db9f6c44ab2e1a3e7/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.057725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:58.062720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.072355 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1790/3540] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:58.075599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.075599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.083878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bf5f-78b5-4bd7-8ee4-92d006a40abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ad9843fdef44a7a4d89fcac45106d5, user_id=b2be15e97a30467db9f6c44ab2e1a3e7, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.090883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bf5f-78b5-4bd7-8ee4-92d006a40abf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.091858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a154e4-febb-4b41-9047-f6120fc41156 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.099262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.099907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.100228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.100499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] PATH_INFO: `/v3/users/2a72690865504f47b8f9e7c0b8c5e929` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.101781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a72690865504f47b8f9e7c0b8c5e929)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.104629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.174097 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1751/3541] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:57 2022] PUT /identity/v3/projects/50ad9843fdef44a7a4d89fcac45106d5/users/b2be15e97a30467db9f6c44ab2e1a3e7/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:58.176197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2dd7b-bb82-485d-b0cc-d0cd72b137d1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.176599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2dd7b-bb82-485d-b0cc-d0cd72b137d1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.176945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2dd7b-bb82-485d-b0cc-d0cd72b137d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.206735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d2e2dd7b-bb82-485d-b0cc-d0cd72b137d1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:58.207975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d2e2dd7b-bb82-485d-b0cc-d0cd72b137d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.267816 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:58.289959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1752/3542] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:58.295652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2dd7b-bb82-485d-b0cc-d0cd72b137d1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.310873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2dd7b-bb82-485d-b0cc-d0cd72b137d1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.317299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a65322-d405-40b0-bb26-9baf78e2f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.318350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a65322-d405-40b0-bb26-9baf78e2f24e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.318911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a65322-d405-40b0-bb26-9baf78e2f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.319429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a65322-d405-40b0-bb26-9baf78e2f24e admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.321011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a65322-d405-40b0-bb26-9baf78e2f24e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:58.321547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a65322-d405-40b0-bb26-9baf78e2f24e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.324540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a65322-d405-40b0-bb26-9baf78e2f24e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.358763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1753/3543] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:58.365365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a72690865504f47b8f9e7c0b8c5e929'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:58.366315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c745-8bd7-4535-a8fa-6c389fc14169 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.366687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c745-8bd7-4535-a8fa-6c389fc14169 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.367126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c745-8bd7-4535-a8fa-6c389fc14169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.367422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a72690865504f47b8f9e7c0b8c5e929'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:58.387922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ea74c745-8bd7-4535-a8fa-6c389fc14169 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:58.389201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea74c745-8bd7-4535-a8fa-6c389fc14169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.401121 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1754/3544] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:58.403697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66013151-b6b7-45c8-abb7-bd1dc3fda21c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.403697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66013151-b6b7-45c8-abb7-bd1dc3fda21c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.403697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66013151-b6b7-45c8-abb7-bd1dc3fda21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.441130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-66013151-b6b7-45c8-abb7-bd1dc3fda21c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:58.442426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-66013151-b6b7-45c8-abb7-bd1dc3fda21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.445930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a72690865504f47b8f9e7c0b8c5e929'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:58.454717 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1755/3545] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:58.455725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66013151-b6b7-45c8-abb7-bd1dc3fda21c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.465645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a72690865504f47b8f9e7c0b8c5e929'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:58.466773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a72690865504f47b8f9e7c0b8c5e929'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:58.471809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66013151-b6b7-45c8-abb7-bd1dc3fda21c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.480014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.481069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.481355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.481634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.482759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.485712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.503689 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1791/3546] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:23:58 2022] DELETE /identity/v3/users/2a72690865504f47b8f9e7c0b8c5e929 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:23:58.506167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.509547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.598327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc8a87-ef63-40a2-a990-f41d6b4d27b3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.603313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cda57a-6f6a-4e1f-b333-a0ef56b68346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.604181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda57a-6f6a-4e1f-b333-a0ef56b68346 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.604454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda57a-6f6a-4e1f-b333-a0ef56b68346 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.604732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda57a-6f6a-4e1f-b333-a0ef56b68346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.606571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-54cda57a-6f6a-4e1f-b333-a0ef56b68346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.623497 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1756/3547] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:58.627787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.629486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.692389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cda57a-6f6a-4e1f-b333-a0ef56b68346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.695208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cda57a-6f6a-4e1f-b333-a0ef56b68346 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.707840 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:58.719385 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1792/3548] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:58.719385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.719385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.719385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.742267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:58.743507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.750518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1873203-bf9d-4090-a524-e8bbd9bb07d6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.753768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1793/3549] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:58.754700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.756217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.756630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.757408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.757764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.759345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.759345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:23:58.759345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.761223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.773192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03bd78-167a-4dfd-bf83-64deadcb4371 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.776971 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1757/3550] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:23:58.778440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.784233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.785285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:58.786413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.786723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.786932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.787588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.789495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.864673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e6691-a3a4-4671-8adb-3340923701dc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.868751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.869370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.869659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.870025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.880825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.882546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.892836 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1794/3551] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:58.894342 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1758/3552] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:58.896482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.902333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.907305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a72e-d15a-40a4-b828-6ba1a778d441 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.912754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.913373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.913662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.913987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.914636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.916288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.927938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351bc5-7ab9-4598-acbe-0c77d78c2371 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.928975 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1759/3553] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:58.932922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.936445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.937424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.937709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.938129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.938765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.940960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.945519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb583095-dea0-4d89-b17d-b4e918ca81f1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.951022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.952153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.952581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.953386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:58.954110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:58.956041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:58.969859 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1760/3554] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:58.973645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:58.989366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34123318-4557-421b-9e84-f8f3b2b69070 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:58.995606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de39fb2-dadb-46c6-92af-2fe950c47c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:58.996434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de39fb2-dadb-46c6-92af-2fe950c47c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:58.996874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de39fb2-dadb-46c6-92af-2fe950c47c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:58.997222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de39fb2-dadb-46c6-92af-2fe950c47c48 admin admin] PATH_INFO: `/v3/projects/eef5166a99874cce86097564bcc984c7/users/f9697d737c34465384f39cef31388ad1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.014912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de39fb2-dadb-46c6-92af-2fe950c47c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef5166a99874cce86097564bcc984c7, user_id=f9697d737c34465384f39cef31388ad1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.019845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de39fb2-dadb-46c6-92af-2fe950c47c48 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.064843 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1795/3555] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:58 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:59.075359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.142298 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1761/3556] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:58 2022] PUT /identity/v3/projects/eef5166a99874cce86097564bcc984c7/users/f9697d737c34465384f39cef31388ad1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:59.153064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3943-ef1e-4c3a-962f-f83fec2f225c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.153406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3943-ef1e-4c3a-962f-f83fec2f225c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.154327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd3943-ef1e-4c3a-962f-f83fec2f225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.173967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc671e-d367-4001-96a0-096f93ed6753 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.189270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1fbd3943-ef1e-4c3a-962f-f83fec2f225c None None] MFA Rules not processed for user `f9697d737c34465384f39cef31388ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:59.190637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1fbd3943-ef1e-4c3a-962f-f83fec2f225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:59.290670 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1762/3557] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:23:59.300743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3943-ef1e-4c3a-962f-f83fec2f225c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.334901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.335665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.336013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.336362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.337388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.339743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.407222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd3943-ef1e-4c3a-962f-f83fec2f225c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.413026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.413890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.414270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.414616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.415412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.417456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.431301 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1796/3558] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:59 2022] POST /identity/v3/users => generated 290 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:59.439089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.466297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fe959-e7bb-46c7-96d9-c8b454b1c684 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.472335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.473043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.473396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.473739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.474522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.476219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.494015 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1797/3559] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:23:59.494806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.505274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d1690-2ca7-45e6-acf0-52baa66b6a44 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.511463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.512167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.514025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.514025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.514025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.515126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.527819 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1798/3560] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:59.532451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.542836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec88b-246f-4d2c-be3c-29119fb93dcb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.548142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.552634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.552634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.552634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] PATH_INFO: `/v3/projects/ab4e846211c643bdb176dba54ad0b757/users/18ac94451b0a4d7185a4d002ddd22879/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.552920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1763/3561] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:23:59 2022] POST /identity/v3/projects => generated 367 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:59.555422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.567783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4e846211c643bdb176dba54ad0b757, user_id=18ac94451b0a4d7185a4d002ddd22879, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.578012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.638462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e08d-0a73-42c0-b382-6750c6560b59 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.643925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d49cd-b2ce-4251-b2d1-ae94f462d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.644544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d49cd-b2ce-4251-b2d1-ae94f462d003 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.644827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d49cd-b2ce-4251-b2d1-ae94f462d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.645102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d49cd-b2ce-4251-b2d1-ae94f462d003 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.645739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d49cd-b2ce-4251-b2d1-ae94f462d003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.647692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d49cd-b2ce-4251-b2d1-ae94f462d003 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.685422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1799/3562] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:23:59 2022] PUT /identity/v3/projects/ab4e846211c643bdb176dba54ad0b757/users/18ac94451b0a4d7185a4d002ddd22879/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:23:59.690466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.691335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:59.756111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1764/3563] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:23:59 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:23:59.758136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e893c-868b-4c66-a84c-2ae28370ad0e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.758723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e893c-868b-4c66-a84c-2ae28370ad0e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.759459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e893c-868b-4c66-a84c-2ae28370ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.766252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3876e4-8419-46ce-abf2-315ddfbf3151 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.772293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.772931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.773223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.773503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] PATH_INFO: `/v3/projects/383025c420c44c359ac91a45710451c6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.775289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383025c420c44c359ac91a45710451c6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.783158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.783300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1d1e893c-868b-4c66-a84c-2ae28370ad0e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:59.783300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1d1e893c-868b-4c66-a84c-2ae28370ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:59.793170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1765/3564] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:59.794098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e893c-868b-4c66-a84c-2ae28370ad0e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.806052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e893c-868b-4c66-a84c-2ae28370ad0e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.828589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.829168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.829454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.829727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:59.830422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:59.832084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:59.842815 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1766/3565] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:23:59.844034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:59.910276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b44ec-24d7-495d-9586-d90ed9c6f81a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:59.930175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383025c420c44c359ac91a45710451c6', 'request_id': 'req-79f636cd-8b87-4557-8e04-daaa402bf032'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:59.952297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383025c420c44c359ac91a45710451c6', 'request_id': 'req-79f636cd-8b87-4557-8e04-daaa402bf032'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:23:59.970493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:59.974775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:59.974775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:59.974775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.043233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:00.045128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:00.055072 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:00.055980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1767/3566] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:00.057125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:00.070265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d05f9f-4cf7-4948-8608-3798186b2f33 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:00.077568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:00.079406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:00.079669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:00.079956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] PATH_INFO: `/v3/projects/3b2e8f226b564ada8aea8fbdace99e89/users/248ab15ba9a9419c9d5b843e01388bb2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.100901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2e8f226b564ada8aea8fbdace99e89, user_id=248ab15ba9a9419c9d5b843e01388bb2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:00.103742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:00.135944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383025c420c44c359ac91a45710451c6', 'request_id': 'req-79f636cd-8b87-4557-8e04-daaa402bf032'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.152222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] The token cache is being invalidate because project 383025c420c44c359ac91a45710451c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:00.152496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.153122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.155042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1800/3567] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:23:59 2022] DELETE /identity/v3/projects/383025c420c44c359ac91a45710451c6 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:00.159378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:00.160933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:00.183529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f636cd-8b87-4557-8e04-daaa402bf032 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:00.189519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:00.190196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:00.190486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:00.190764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] PATH_INFO: `/v3/users/9b186a4a3a4b4c07b3567e9e2a46c9d1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.192449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b186a4a3a4b4c07b3567e9e2a46c9d1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:00.194526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:00.237507 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1768/3568] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:00 2022] PUT /identity/v3/projects/3b2e8f226b564ada8aea8fbdace99e89/users/248ab15ba9a9419c9d5b843e01388bb2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:00.238491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:00.240171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:00.319845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec002-400f-4f2d-b022-d5632c639dfc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:00.325259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:00.325941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:00.326217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:00.326492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.327218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:00.329901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:00.341362 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1769/3569] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:00.346072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:00.357105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95ea0-8c74-4117-bfa3-8565403aea6d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:00.363144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3b11-b562-40ce-822b-966215f31285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:00.363826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3b11-b562-40ce-822b-966215f31285 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:00.364115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3b11-b562-40ce-822b-966215f31285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:00.364394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3b11-b562-40ce-822b-966215f31285 admin admin] PATH_INFO: `/v3/projects/3b2e8f226b564ada8aea8fbdace99e89/users/248ab15ba9a9419c9d5b843e01388bb2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.366435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3b11-b562-40ce-822b-966215f31285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2e8f226b564ada8aea8fbdace99e89, user_id=248ab15ba9a9419c9d5b843e01388bb2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:00.369189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3b11-b562-40ce-822b-966215f31285 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:00.381042 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1770/3570] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:00 2022] PUT /identity/v3/projects/3b2e8f226b564ada8aea8fbdace99e89/users/248ab15ba9a9419c9d5b843e01388bb2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:00.392137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e5a7-53cf-4006-98cf-8015edd356ed None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:00.392428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e5a7-53cf-4006-98cf-8015edd356ed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:00.392799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e5a7-53cf-4006-98cf-8015edd356ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.411625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b186a4a3a4b4c07b3567e9e2a46c9d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.412295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b186a4a3a4b4c07b3567e9e2a46c9d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.442055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2a94e5a7-53cf-4006-98cf-8015edd356ed None None] MFA Rules not processed for user `248ab15ba9a9419c9d5b843e01388bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:00.443510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2a94e5a7-53cf-4006-98cf-8015edd356ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:00.475467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b186a4a3a4b4c07b3567e9e2a46c9d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.502386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b186a4a3a4b4c07b3567e9e2a46c9d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.504173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b186a4a3a4b4c07b3567e9e2a46c9d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:00.536011 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1801/3571] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:00 2022] DELETE /identity/v3/users/9b186a4a3a4b4c07b3567e9e2a46c9d1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:00.549224 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:00.553577 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1771/3572] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:24:00.556944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:00.629766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe6974-c7c3-41d3-9b32-d6a3cfad9550 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:00.645426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:00.645426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:00.645426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:00.645760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.645760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:00.645760 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:00.645760 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:00.645760 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:00.645760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:00.731164 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1802/3573] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:24:00 2022] POST /identity/v3/domains => generated 277 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:00.733211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94e5a7-53cf-4006-98cf-8015edd356ed None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:00.746597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94e5a7-53cf-4006-98cf-8015edd356ed None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:00.829508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:00.830171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:00.830456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:00.830786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:00.831366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:00.832654 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:00.832654 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:00.832654 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:00.834226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.117863 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1772/3574] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:24:00 2022] POST /identity/v3/groups => generated 280 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:01.128133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.150815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ffa71-94ce-4803-be85-1f6d24ea7857 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.158883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.159550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.159871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.160153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/cece64a86a7845088411fecf943583d3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.166723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:update_group(group_id=cece64a86a7845088411fecf943583d3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.170904 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:01.170904 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:01.170904 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:01.170904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.228957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.230864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:01.287571 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1803/3575] 10.222.0.59 () {60 vars in 1247 bytes} [Sun Aug 28 01:24:01 2022] PATCH /identity/v3/groups/cece64a86a7845088411fecf943583d3 => generated 291 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:01.287571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.310457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e055b-6ab1-42ad-b6e8-f048558ff760 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.319150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.322164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.322616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.323427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/cece64a86a7845088411fecf943583d3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.332406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:get_group(group_id=cece64a86a7845088411fecf943583d3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.333707 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:01.333707 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:01.333707 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:01.336368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.340876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1804/3576] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:01 2022] GET /identity/v3/groups/cece64a86a7845088411fecf943583d3 => generated 291 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:24:01.345390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.355732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b08aa-2130-4850-b00b-0e7525726beb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.357235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412c03-cbc7-4c28-af8d-f16f9aa88adc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.363351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.363982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.364265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.365298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] PATH_INFO: `/v3/projects/83dde0ba3ee14136a3c2d9269e1da0b9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.366018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dde0ba3ee14136a3c2d9269e1da0b9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.367950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.376402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.380529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.380529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.380529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/cece64a86a7845088411fecf943583d3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.380529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:update_group(group_id=cece64a86a7845088411fecf943583d3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.382029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.478070 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1805/3577] 10.222.0.59 () {60 vars in 1246 bytes} [Sun Aug 28 01:24:01 2022] PATCH /identity/v3/groups/cece64a86a7845088411fecf943583d3 => generated 306 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:24:01.479284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.492963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da42bc-120e-4845-a484-405db961bac6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.501198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dde0ba3ee14136a3c2d9269e1da0b9', 'request_id': 'req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:01.512637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dde0ba3ee14136a3c2d9269e1da0b9', 'request_id': 'req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:01.585344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.586656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.590320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.590884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/cece64a86a7845088411fecf943583d3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.594258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dde0ba3ee14136a3c2d9269e1da0b9', 'request_id': 'req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:01.602661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cece64a86a7845088411fecf943583d3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.604487 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:01.604487 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:01.604487 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:01.607849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.612820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] The token cache is being invalidate because project 83dde0ba3ee14136a3c2d9269e1da0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:01.619598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:01.619598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77164896-fcd1-4ec6-8bcc-ca9fdb1e6d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:01.622246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1773/3578] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:01 2022] DELETE /identity/v3/projects/83dde0ba3ee14136a3c2d9269e1da0b9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:01.629481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3840be-9256-4ea0-98cd-8b945b1c427d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.629895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3840be-9256-4ea0-98cd-8b945b1c427d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.630268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3840be-9256-4ea0-98cd-8b945b1c427d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.681175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cd3840be-9256-4ea0-98cd-8b945b1c427d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:01.687700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cd3840be-9256-4ea0-98cd-8b945b1c427d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:01.782948 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1774/3579] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:01.784586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e7d7-3008-4340-a4d7-abb8bfa84660 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.784947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e7d7-3008-4340-a4d7-abb8bfa84660 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.785384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e7d7-3008-4340-a4d7-abb8bfa84660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.805767 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1806/3580] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:24:01 2022] DELETE /identity/v3/groups/cece64a86a7845088411fecf943583d3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:01.811866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.811866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:01.812317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-60e3e7d7-3008-4340-a4d7-abb8bfa84660 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:01.814054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-60e3e7d7-3008-4340-a4d7-abb8bfa84660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:01.911588 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1775/3581] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:01.912698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3e7d7-3008-4340-a4d7-abb8bfa84660 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.925010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3e7d7-3008-4340-a4d7-abb8bfa84660 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.930969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.931784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.932261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.938365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.938365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:01.938365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.938669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6aec0-4bb6-4b0f-8f83-dcaac2718109 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.938781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.940779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.941645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.942066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.942576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.943493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.944870 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:01.944870 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:01.944870 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:01.946365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:01.955279 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1776/3582] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:01.956471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:01.969309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3dac0-3b95-46fc-975c-db7f1a0565bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:01.974594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:01.975314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:01.975560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:01.975841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:01.976490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:01.978469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.036855 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1807/3583] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:24:01 2022] POST /identity/v3/groups => generated 326 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:02.038978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.051337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc8c6b-5d5e-43a7-a3b1-e8b73a6a6287 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.056548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.057176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.057463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.057742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.058418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.061099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.112871 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1777/3584] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:01 2022] POST /identity/v3/projects => generated 395 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:02.134858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.208233 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1808/3585] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:02 2022] POST /identity/v3/users => generated 323 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:02.209859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.237112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81bc02-f597-43bd-952e-5c225e9f17e8 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.289188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783e47a-0029-49ae-91ee-67c548b0535e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.302174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.302805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.303084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.303357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.303993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.306021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.314846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.315638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.315893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.316177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/933b9ec7e3c0428db97f3341e091c9cc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.342071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=933b9ec7e3c0428db97f3341e091c9cc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.344591 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:02.344591 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:02.344591 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:02.346156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.458902 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1778/3586] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:02 2022] POST /identity/v3/users => generated 298 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:02.469767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.480696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c03d5-3bf7-41d7-ba5a-733581b5fadb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.486362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.487270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.487415 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:02.487759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.488216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.488968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.490848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.500584 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1809/3587] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:24:02 2022] PUT /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/933b9ec7e3c0428db97f3341e091c9cc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:02.503011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.522122 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1779/3588] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:24:02.526835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.563488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905257aa-14d3-4738-869b-2a96b19e2744 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.634267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473f7a-3623-431d-8550-a1e273875f7b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.640747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.641846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.642232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.642616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.643541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.646495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.667323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.667880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.668168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.668485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.669295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.670937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.695964 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1780/3589] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:24:02.697154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.709566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6d2a7-af64-499a-8539-dd1e78c3a9c3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.716387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950d1a3-de8b-408b-be29-6dfc81f61748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.717080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950d1a3-de8b-408b-be29-6dfc81f61748 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.717286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950d1a3-de8b-408b-be29-6dfc81f61748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.717570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950d1a3-de8b-408b-be29-6dfc81f61748 admin admin] PATH_INFO: `/v3/projects/dd5c28182a23440782a46f2d08791955/users/df310911396d4dbea6cffd534976f0a1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.751619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950d1a3-de8b-408b-be29-6dfc81f61748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5c28182a23440782a46f2d08791955, user_id=df310911396d4dbea6cffd534976f0a1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.758423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950d1a3-de8b-408b-be29-6dfc81f61748 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.766988 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:02.784599 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1810/3590] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:02 2022] POST /identity/v3/users => generated 319 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:02.788909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:02.811147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9aeec-b676-493a-985c-57905cb61324 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:02.816827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:02.817564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.817877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.818208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/a2dac22e4d574c54a76d70c9c5ed17ae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.850553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=a2dac22e4d574c54a76d70c9c5ed17ae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:02.861781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:02.880710 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1781/3591] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:02 2022] PUT /identity/v3/projects/dd5c28182a23440782a46f2d08791955/users/df310911396d4dbea6cffd534976f0a1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:02.883048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087388cd-51f4-4441-a8e3-b6b48ad44a34 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:02.884041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087388cd-51f4-4441-a8e3-b6b48ad44a34 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:02.885452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087388cd-51f4-4441-a8e3-b6b48ad44a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:02.932251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-087388cd-51f4-4441-a8e3-b6b48ad44a34 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:02.932702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-087388cd-51f4-4441-a8e3-b6b48ad44a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:03.006499 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1782/3592] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:03.082374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087388cd-51f4-4441-a8e3-b6b48ad44a34 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:03.082716 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1811/3593] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:24:02 2022] PUT /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/a2dac22e4d574c54a76d70c9c5ed17ae => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:03.091615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:03.094834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:03.188988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087388cd-51f4-4441-a8e3-b6b48ad44a34 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:03.224138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0751d6-b757-4f60-9f46-ae2469e9d8d0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:03.232092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:03.236117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:03.236593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:03.237054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:03.298731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:03.299381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:03.299668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:03.301987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:03.304407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:03.306380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:03.347357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:03.349084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:03.368059 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1812/3594] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:03.413992 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1783/3595] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:03 2022] POST /identity/v3/users => generated 323 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:03.417750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:03.436207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6202-34f9-4c44-afc9-59a24995fd82 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:03.442576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:03.443347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:03.443730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:03.444130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/0ce3b2cbdf5643a795aaa77a12f47817` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:03.483783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=0ce3b2cbdf5643a795aaa77a12f47817)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:03.490959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:03.639788 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1813/3596] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:24:03 2022] PUT /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/0ce3b2cbdf5643a795aaa77a12f47817 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:03.648152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:03.674160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c90d1-046c-4b20-9bcd-b3287141a1b3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:03.753610 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:03.872428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:03.873090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:03.880156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:03.880615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:03.882680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:03.884329 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:03.884329 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:03.884329 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:03.885904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:03.948985 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1784/3597] 10.222.0.59 () {58 vars in 1242 bytes} [Sun Aug 28 01:24:03 2022] GET /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users => generated 1081 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:03.952948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:03.974054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f98d-434a-4b4e-a080-db9ef61c1f3a tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:03.986634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:03.987444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:03.988150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:03.988676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/933b9ec7e3c0428db97f3341e091c9cc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:03.993785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=933b9ec7e3c0428db97f3341e091c9cc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:03.996534 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:03.996534 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:03.996534 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:04.002871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:04.022981 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1814/3598] 10.222.0.59 () {58 vars in 1342 bytes} [Sun Aug 28 01:24:03 2022] HEAD /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/933b9ec7e3c0428db97f3341e091c9cc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:04.027505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:04.049586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489148d-6fd9-4784-bcef-8bab8acc21b0 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:04.059438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:04.060787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:04.060787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:04.061061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/933b9ec7e3c0428db97f3341e091c9cc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:04.063276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=933b9ec7e3c0428db97f3341e091c9cc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:04.068741 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:04.068741 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:04.068741 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:04.072662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:04.170335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '933b9ec7e3c0428db97f3341e091c9cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:04.258260 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1785/3599] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:24:04 2022] DELETE /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/933b9ec7e3c0428db97f3341e091c9cc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:04.259685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:04.274163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c69e4-84eb-4eb9-86aa-a27d44d916ab tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:04.357294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:04.359256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:04.359913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:04.360380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/a2dac22e4d574c54a76d70c9c5ed17ae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:04.362593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=a2dac22e4d574c54a76d70c9c5ed17ae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:04.365436 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:04.371714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:04.392780 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1815/3600] 10.222.0.59 () {58 vars in 1342 bytes} [Sun Aug 28 01:24:04 2022] HEAD /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/a2dac22e4d574c54a76d70c9c5ed17ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:04.393869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:04.411729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7467fab-3743-449d-b4f9-fea8aad6c4eb tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:04.420013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:04.422091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:04.422595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:04.423152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/a2dac22e4d574c54a76d70c9c5ed17ae` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:04.428769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=a2dac22e4d574c54a76d70c9c5ed17ae)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:04.433600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:04.505944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a2dac22e4d574c54a76d70c9c5ed17ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:04.609844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1786/3601] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:24:04 2022] DELETE /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/a2dac22e4d574c54a76d70c9c5ed17ae => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:04.614307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:04.630775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6eaae-1a25-478f-9d3d-1c731f0f7511 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:04.742818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:04.743483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:04.744138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:04.744978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/0ce3b2cbdf5643a795aaa77a12f47817` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:04.748883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=0ce3b2cbdf5643a795aaa77a12f47817)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:04.751835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:04.774728 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1816/3602] 10.222.0.59 () {58 vars in 1342 bytes} [Sun Aug 28 01:24:04 2022] HEAD /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/0ce3b2cbdf5643a795aaa77a12f47817 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:04.788600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:04.800700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135dde3-0ee1-4c54-9e2c-4f1b52dcd579 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:04.807655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:04.808604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:04.809835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:04.810329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/0ce3b2cbdf5643a795aaa77a12f47817` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:04.814043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea, user_id=0ce3b2cbdf5643a795aaa77a12f47817)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:04.817981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:04.879240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0ce3b2cbdf5643a795aaa77a12f47817'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:04.979754 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1787/3603] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:24:04 2022] DELETE /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users/0ce3b2cbdf5643a795aaa77a12f47817 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:04.984591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:04.997672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894856-2033-40c1-bdb2-0a496a8fbb3c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:05.138523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:05.139834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:05.141350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:05.141888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:05.144381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:05.145635 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:05.145635 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:05.145635 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:05.152592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:05.162940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1817/3604] 10.222.0.59 () {58 vars in 1242 bytes} [Sun Aug 28 01:24:04 2022] GET /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea/users => generated 145 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:05.166715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:05.189549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f496-9828-4bba-9ded-2000157349d1 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:05.195794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:05.196752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:05.197211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:05.197922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users/0ce3b2cbdf5643a795aaa77a12f47817` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:05.199530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ce3b2cbdf5643a795aaa77a12f47817)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:05.201747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:05.368563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce3b2cbdf5643a795aaa77a12f47817'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:05.413372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce3b2cbdf5643a795aaa77a12f47817'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:05.434848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce3b2cbdf5643a795aaa77a12f47817'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:05.436010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce3b2cbdf5643a795aaa77a12f47817'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:05.442320 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:05.565023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce3b2cbdf5643a795aaa77a12f47817'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:05.572667 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1788/3605] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:05 2022] DELETE /identity/v3/users/0ce3b2cbdf5643a795aaa77a12f47817 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:05.576836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:05.580061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:05.609653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bd35-8aa9-48d6-a7d6-2a81ec153b78 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:05.749725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:05.751064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:05.752042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:05.752490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users/a2dac22e4d574c54a76d70c9c5ed17ae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:05.756068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a2dac22e4d574c54a76d70c9c5ed17ae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:05.758264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:05.928458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2dac22e4d574c54a76d70c9c5ed17ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:05.929574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2dac22e4d574c54a76d70c9c5ed17ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.017797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2dac22e4d574c54a76d70c9c5ed17ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.028472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2dac22e4d574c54a76d70c9c5ed17ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.029559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2dac22e4d574c54a76d70c9c5ed17ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.101737 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1818/3606] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:05 2022] DELETE /identity/v3/users/a2dac22e4d574c54a76d70c9c5ed17ae => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:06.105780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:06.125772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa554-1758-4815-8549-e9ffcd241f83 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:06.223456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:06.225517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:06.225951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:06.226335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users/933b9ec7e3c0428db97f3341e091c9cc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:06.229496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=933b9ec7e3c0428db97f3341e091c9cc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:06.233383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:06.415674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933b9ec7e3c0428db97f3341e091c9cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.449313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933b9ec7e3c0428db97f3341e091c9cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.459271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933b9ec7e3c0428db97f3341e091c9cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.460615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933b9ec7e3c0428db97f3341e091c9cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.525747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933b9ec7e3c0428db97f3341e091c9cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:06.529613 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:06.537042 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1789/3607] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:06 2022] DELETE /identity/v3/users/933b9ec7e3c0428db97f3341e091c9cc => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:06.541340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:06.542970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:06.567006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28a048-fb4e-4b1a-8a4e-94c3887b826c tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:06.720337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:06.721018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:06.721309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:06.721590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:06.726822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c00d4105e43b438dbbf7d84f4ec1b0ea)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:06.734911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:06.930376 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1819/3608] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:24:06 2022] DELETE /identity/v3/groups/c00d4105e43b438dbbf7d84f4ec1b0ea => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:06.934673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:06.936375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:06.949796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74cac5-0274-49a7-a61a-1a34499da871 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:07.031480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:07.032471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:07.033146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:07.033747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:07.034662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:07.037082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:07.123030 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1790/3609] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:24:06 2022] POST /identity/v3/groups => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:07.127704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:07.143441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e496a1-8f72-4ee0-b222-e577a6b74cd6 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:07.149435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:07.151653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:07.151951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:07.152256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:07.152912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:07.155818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:07.284051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:07.285946 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1820/3610] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:24:07 2022] POST /identity/v3/groups => generated 326 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:07.307073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8393e2-bc19-4bc3-9252-1bc8216dc239 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:07.311457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:07.312363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:07.312843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:07.313308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:07.314192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:07.316802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:07.450060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1791/3611] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:24:07 2022] POST /identity/v3/groups => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:07.450521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:07.464627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4a3b6-3fe7-4ea4-a8a3-88138ea3242e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:07.471783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:07.472318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:07.472717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:07.473004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:07.473685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:07.474791 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:07.474791 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:07.474791 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:07.475938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:07.490379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:07.501427 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1821/3612] 10.222.0.59 () {58 vars in 1125 bytes} [Sun Aug 28 01:24:07 2022] GET /identity/v3/groups => generated 1488 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:07.524535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2248f-1781-47b8-86ec-fbfc8b71921b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:07.533202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:07.534106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:07.535264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:07.536762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/075489b8528e4db5b719c4c1107ddb89` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:07.544453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_group(group_id=075489b8528e4db5b719c4c1107ddb89)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:07.545738 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:07.545738 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:07.545738 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:07.547124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:07.725631 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1792/3613] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:24:07 2022] DELETE /identity/v3/groups/075489b8528e4db5b719c4c1107ddb89 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:07.729641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:07.742043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186dc25-197f-49fa-9252-812697bf5fde tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:07.857868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:07.858684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:07.859659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:07.860036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/52bf880c65f1467cad2ea540082eab9c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:07.866877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_group(group_id=52bf880c65f1467cad2ea540082eab9c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:07.868968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:08.093712 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1822/3614] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:24:07 2022] DELETE /identity/v3/groups/52bf880c65f1467cad2ea540082eab9c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:08.099025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:08.123886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dac539-96de-4a9a-818f-ff7ac8aeb678 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:08.284570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:08.286873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:08.287165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:08.288267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/9f6eb6cfd8ab4f0d9c7583684540590a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:08.310661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9f6eb6cfd8ab4f0d9c7583684540590a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:08.313999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:08.609435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1793/3615] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:24:08 2022] DELETE /identity/v3/groups/9f6eb6cfd8ab4f0d9c7583684540590a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:08.610964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:08.625068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f096461-f2fd-4bb9-8443-f05c09927fdc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:08.826060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:08.829838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:08.831105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:08.832189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:08.836057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:08.847220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:08.908254 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:08.982215 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1823/3616] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:08 2022] POST /identity/v3/users => generated 321 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:08.987549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:09.000356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1c4fe-16df-4786-9ea2-0bdddba84ca3 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:09.008389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:09.009031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:09.009317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:09.009782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:09.010826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:09.014306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:09.062782 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:09.126906 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1794/3617] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:24:08 2022] POST /identity/v3/groups => generated 327 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:09.130877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:09.161499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4435c5e-2dc0-4f14-b955-ee0ce4019f37 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:09.168733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:09.169626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:09.170042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:09.170413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/8a9420dd773043a1bd020b826c23701f/users/cbe702dfe904421691e0f499ae8c33c7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:09.212326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8a9420dd773043a1bd020b826c23701f, user_id=cbe702dfe904421691e0f499ae8c33c7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:09.215230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:09.302804 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1824/3618] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:24:09 2022] PUT /identity/v3/groups/8a9420dd773043a1bd020b826c23701f/users/cbe702dfe904421691e0f499ae8c33c7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:09.307069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:09.320157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafd6aa-9d47-44a0-ad8c-db1bdbcd0768 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:09.460165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:09.460815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:09.461121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:09.461909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:09.462108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:09.464057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:09.571744 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1795/3619] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:24:09 2022] POST /identity/v3/groups => generated 325 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:09.578498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:09.592368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309a3e1-e86f-47fa-8a1d-a0077bad1b6b tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:09.607312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:09.607312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:09.607312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:09.607701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00aff4f701d4fa3a8cafad25d7b1faf/users/cbe702dfe904421691e0f499ae8c33c7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:09.627785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c00aff4f701d4fa3a8cafad25d7b1faf, user_id=cbe702dfe904421691e0f499ae8c33c7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:09.635768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:09.750801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1825/3620] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:24:09 2022] PUT /identity/v3/groups/c00aff4f701d4fa3a8cafad25d7b1faf/users/cbe702dfe904421691e0f499ae8c33c7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:09.758563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:09.767126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88bcc-5945-41f9-b31f-401672b71eee tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:09.866946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:09.867808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:09.868245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:09.868827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users/cbe702dfe904421691e0f499ae8c33c7/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:09.870326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=cbe702dfe904421691e0f499ae8c33c7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:09.874112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:09.901821 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1796/3621] 10.222.0.59 () {58 vars in 1242 bytes} [Sun Aug 28 01:24:09 2022] GET /identity/v3/users/cbe702dfe904421691e0f499ae8c33c7/groups => generated 838 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:09.902794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:09.922257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc3083-91d8-4f9f-a267-8afc38ce1477 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:09.936316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:09.941251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:09.941608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:09.941921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/c00aff4f701d4fa3a8cafad25d7b1faf` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:09.943838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c00aff4f701d4fa3a8cafad25d7b1faf)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:09.948144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:10.137608 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:10.166177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:10.166599 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1826/3622] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:24:09 2022] DELETE /identity/v3/groups/c00aff4f701d4fa3a8cafad25d7b1faf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:10.180672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cca867-f978-4ad2-af4c-b77c78802e5e tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:10.313028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:10.314930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:10.315296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:10.315593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/groups/8a9420dd773043a1bd020b826c23701f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:10.317110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8a9420dd773043a1bd020b826c23701f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:10.319894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:10.492553 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1797/3623] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:24:10 2022] DELETE /identity/v3/groups/8a9420dd773043a1bd020b826c23701f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:10.497220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:10.509748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b746b-920b-4f3b-81f0-cf253d37e1da tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:10.637406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:10.638813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:10.639280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:10.639717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/users/cbe702dfe904421691e0f499ae8c33c7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:10.644760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cbe702dfe904421691e0f499ae8c33c7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:10.647020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:10.704580 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:10.849556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe702dfe904421691e0f499ae8c33c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:10.852507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe702dfe904421691e0f499ae8c33c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:10.932121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe702dfe904421691e0f499ae8c33c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:10.942842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe702dfe904421691e0f499ae8c33c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:10.943958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe702dfe904421691e0f499ae8c33c7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:10.991575 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1827/3624] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:10 2022] DELETE /identity/v3/users/cbe702dfe904421691e0f499ae8c33c7 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:11.003305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:11.006639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:11.032066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec208e1-c5ca-4bb1-a4d3-782dd3c46ce9 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:11.213186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:11.214238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:11.214532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:11.214814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/domains/fb47fefd6ac84f14855063f697b6d43a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:11.218650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fb47fefd6ac84f14855063f697b6d43a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:11.223418 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:11.223418 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:11.223418 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:11.224781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:11.262819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.263833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.394434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.395695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.401417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1798/3625] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:24:11 2022] PATCH /identity/v3/domains/fb47fefd6ac84f14855063f697b6d43a => generated 278 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:11.402894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:11.425919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926472a-8895-4c86-914e-5d85df7370cc tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:11.543783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '248ab15ba9a9419c9d5b843e01388bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b2e8f226b564ada8aea8fbdace99e89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:11.545060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:11.545529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:11.546021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] PATH_INFO: `/v3/domains/fb47fefd6ac84f14855063f697b6d43a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:11.560273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fb47fefd6ac84f14855063f697b6d43a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:11.561591 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:11.561591 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:11.561591 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:11.564136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:11.636358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.649231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.844919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a', 'request_id': 'req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.857665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a', 'request_id': 'req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:11.970704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a', 'request_id': 'req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.002513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] The token cache is being invalidate because project fb47fefd6ac84f14855063f697b6d43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:12.002959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.006474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.048820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a', 'request_id': 'req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.051230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a', 'request_id': 'req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.054248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fb47fefd6ac84f14855063f697b6d43a', 'request_id': 'req-2d2a14d3-83bd-4caf-b969-e1790b4d1c79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.074667 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1828/3626] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:24:11 2022] DELETE /identity/v3/domains/fb47fefd6ac84f14855063f697b6d43a => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:12.079364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:12.080999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:12.102523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:12.102953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:12.103334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:12.182165 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:12.229130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] MFA Rules not processed for user `18ac94451b0a4d7185a4d002ddd22879`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:12.229593 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:UPDATE=2,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:12.231934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:12.317582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32828-8d20-4d7a-bdca-df9082c7b848 tempest-GroupsV3TestJSON-988961503 tempest-GroupsV3TestJSON-988961503-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:12.419168 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1829/3627] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:12.448941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:12.453644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:12.560624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb56b6-2b6d-4135-aa65-b9166bad1bb6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:12.568171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7db0e-70b2-4514-be40-8280e15dfd22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:12.569002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7db0e-70b2-4514-be40-8280e15dfd22 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:12.569460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7db0e-70b2-4514-be40-8280e15dfd22 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:12.569919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7db0e-70b2-4514-be40-8280e15dfd22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:12.587098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7db0e-70b2-4514-be40-8280e15dfd22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:12.588993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7db0e-70b2-4514-be40-8280e15dfd22 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:12.614327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:12.615244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:12.615706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:12.616581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] PATH_INFO: `/v3/users/f9697d737c34465384f39cef31388ad1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:12.618230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9697d737c34465384f39cef31388ad1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:12.620344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:12.620515 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1830/3628] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:12.754202 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:12.882063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9697d737c34465384f39cef31388ad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.940933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9697d737c34465384f39cef31388ad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.969484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9697d737c34465384f39cef31388ad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:12.972183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9697d737c34465384f39cef31388ad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:13.068473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9697d737c34465384f39cef31388ad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:13.087155 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1799/3629] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:12 2022] DELETE /identity/v3/users/f9697d737c34465384f39cef31388ad1 => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:13.091591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd76d1-a130-4c21-a63a-eaae3d0c8a84 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:13.093915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd76d1-a130-4c21-a63a-eaae3d0c8a84 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:13.094388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd76d1-a130-4c21-a63a-eaae3d0c8a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:13.135782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4fdd76d1-a130-4c21-a63a-eaae3d0c8a84 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:13.138420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4fdd76d1-a130-4c21-a63a-eaae3d0c8a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:13.256264 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1831/3630] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:24:13.391272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:13.392755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:13.520992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8083fa-24ee-4837-8f89-e3672f832652 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:13.532730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:13.534097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:13.534097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:13.534097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:13.545076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:13.548048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:13.591357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1800/3631] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:24:13.877019 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:14.640366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:14.641489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:14.656838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:14.720160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] MFA Rules not processed for user `b2be15e97a30467db9f6c44ab2e1a3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:14.723655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:14.811640 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:14.956640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1832/3632] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:14.971932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:14.974802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:15.196491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:15.198837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:15.225906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ed66-b3c6-48da-82f2-8963ce71c343 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:15.238557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247aec3-f6a3-4541-adbb-ad637b38e194 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:15.243620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:15.244220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:15.244605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:15.245919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] PATH_INFO: `/v3/projects/eef5166a99874cce86097564bcc984c7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:15.247663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef5166a99874cce86097564bcc984c7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:15.253990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:15.255132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:15.255928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:15.263421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:15.265218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:15.291932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:15.295651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:15.346268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1801/3633] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:15.486568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef5166a99874cce86097564bcc984c7', 'request_id': 'req-3057b2a7-0f27-409d-b322-51370933c169'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:15.501644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef5166a99874cce86097564bcc984c7', 'request_id': 'req-3057b2a7-0f27-409d-b322-51370933c169'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:15.608109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef5166a99874cce86097564bcc984c7', 'request_id': 'req-3057b2a7-0f27-409d-b322-51370933c169'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:15.664812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] The token cache is being invalidate because project eef5166a99874cce86097564bcc984c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:15.665379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:15.668129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3057b2a7-0f27-409d-b322-51370933c169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:15.678722 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1833/3634] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:15 2022] DELETE /identity/v3/projects/eef5166a99874cce86097564bcc984c7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:15.683881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:15.702029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2316aee-d455-487d-987b-3d8c69931aed service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:15.785529 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:15.874537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:15.876272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:15.876719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:15.877194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] PATH_INFO: `/v3/users/248ab15ba9a9419c9d5b843e01388bb2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:15.879615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=248ab15ba9a9419c9d5b843e01388bb2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:15.884078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:16.190147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248ab15ba9a9419c9d5b843e01388bb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:16.222269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248ab15ba9a9419c9d5b843e01388bb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:16.231677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248ab15ba9a9419c9d5b843e01388bb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:16.233269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248ab15ba9a9419c9d5b843e01388bb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:16.307967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3263409e-a5ce-46e2-bfde-a1f8061430fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248ab15ba9a9419c9d5b843e01388bb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:16.316801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1802/3635] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:15 2022] DELETE /identity/v3/users/248ab15ba9a9419c9d5b843e01388bb2 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:17.396121 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:17.422915 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:17.568769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:17.569325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:17.569762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:17.632357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] MFA Rules not processed for user `df310911396d4dbea6cffd534976f0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:17.633536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:17.776053 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1834/3636] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:17.788532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:17.790379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:17.790379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:17.853404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] MFA Rules not processed for user `df310911396d4dbea6cffd534976f0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:17.855430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:17.875532 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:17.885346 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1803/3637] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:17.908334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:17.910592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:18.069662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758563f-b781-4d05-ba2e-e64f1bbf9116 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:18.078424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d8ff4-6e77-401d-9432-1da6153957fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:18.079714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8ff4-6e77-401d-9432-1da6153957fd service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:18.080001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8ff4-6e77-401d-9432-1da6153957fd service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:18.080331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8ff4-6e77-401d-9432-1da6153957fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:18.100475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d8ff4-6e77-401d-9432-1da6153957fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:18.104043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d8ff4-6e77-401d-9432-1da6153957fd service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:18.130264 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1835/3638] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:17 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:18.179748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:18.181968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:18.377565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b624030-96be-4b3c-8ee4-5a08a215e651 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:18.394559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:18.395540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:18.395976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:18.396450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] PATH_INFO: `/v3/projects/3b2e8f226b564ada8aea8fbdace99e89` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:18.399062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2e8f226b564ada8aea8fbdace99e89)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:18.401335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:18.578757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2e8f226b564ada8aea8fbdace99e89', 'request_id': 'req-295c4ea7-964e-49e3-94ac-2b8444670a34'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:18.591697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2e8f226b564ada8aea8fbdace99e89', 'request_id': 'req-295c4ea7-964e-49e3-94ac-2b8444670a34'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:18.602696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823230b-8a45-46c0-9728-8232c1fda0f7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:18.603886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823230b-8a45-46c0-9728-8232c1fda0f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:18.604171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823230b-8a45-46c0-9728-8232c1fda0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:18.632015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c823230b-8a45-46c0-9728-8232c1fda0f7 None None] MFA Rules not processed for user `b2be15e97a30467db9f6c44ab2e1a3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:18.637458 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:18.642242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c823230b-8a45-46c0-9728-8232c1fda0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:18.683275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2e8f226b564ada8aea8fbdace99e89', 'request_id': 'req-295c4ea7-964e-49e3-94ac-2b8444670a34'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:18.711619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] The token cache is being invalidate because project 3b2e8f226b564ada8aea8fbdace99e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:18.711933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:18.714526 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1836/3639] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:18.714737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-295c4ea7-964e-49e3-94ac-2b8444670a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:18.724753 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1804/3640] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:18 2022] DELETE /identity/v3/projects/3b2e8f226b564ada8aea8fbdace99e89 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:18.727043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273a925-a281-41a6-bfd8-1539e8858768 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:18.727331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273a925-a281-41a6-bfd8-1539e8858768 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:18.727660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273a925-a281-41a6-bfd8-1539e8858768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:18.785882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c10843-728b-4b25-bd0e-60648377e9f3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:18.786183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c10843-728b-4b25-bd0e-60648377e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:18.786466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c10843-728b-4b25-bd0e-60648377e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:18.789902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8273a925-a281-41a6-bfd8-1539e8858768 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:18.794932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8273a925-a281-41a6-bfd8-1539e8858768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:18.866731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f3c10843-728b-4b25-bd0e-60648377e9f3 None None] MFA Rules not processed for user `18ac94451b0a4d7185a4d002ddd22879`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:18.868229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f3c10843-728b-4b25-bd0e-60648377e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:18.954814 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1837/3641] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:18.962764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c05f-14f4-41f1-9680-9de66bb2e169 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:19.020492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c05f-14f4-41f1-9680-9de66bb2e169 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:19.020782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c05f-14f4-41f1-9680-9de66bb2e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:19.064579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1805/3642] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:24:19.072269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ecb1c05f-14f4-41f1-9680-9de66bb2e169 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:19.076144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ecb1c05f-14f4-41f1-9680-9de66bb2e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:19.094559 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1838/3643] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:19.095673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c10843-728b-4b25-bd0e-60648377e9f3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:19.136475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c10843-728b-4b25-bd0e-60648377e9f3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:19.149686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:19.150406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:19.150691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:19.150969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:19.151631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:19.151940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:19.158718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:19.196545 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1806/3644] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:19.200970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1c05f-14f4-41f1-9680-9de66bb2e169 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:19.223738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1c05f-14f4-41f1-9680-9de66bb2e169 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:19.234590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:19.235498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:19.235943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:19.236438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:19.237360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:19.250040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:19.344242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:19.346774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:19.423029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb1273-a9a7-486d-968c-7eefbef98960 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:19.443741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:19.444394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:19.447025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:19.447570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:19.455014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:19.466475 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1839/3645] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:19 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:19.473428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:19.475303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:19.477660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:19.503306 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1807/3646] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:19.651722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79e7fe-d7fc-48d4-9c62-3a13c7f730fb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:19.676922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:19.678659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:19.678659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:19.678659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:19.678926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:19.682088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:19.824818 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1840/3647] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:19 2022] POST /identity/v3/users => generated 294 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:19.824907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:19.848740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352ff3-5d5e-4ad0-b381-c90d5c8b2b03 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:19.855764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:19.857169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:19.857676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:19.858260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:19.859709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:19.861559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:19.876310 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1808/3648] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:19.882091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:19.903110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ba46-facd-422f-966c-6684048a5794 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:19.924522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e25ae-2d72-43e0-99c0-37e466a310ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:19.925364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e25ae-2d72-43e0-99c0-37e466a310ca admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:19.925834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e25ae-2d72-43e0-99c0-37e466a310ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:19.926258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e25ae-2d72-43e0-99c0-37e466a310ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:19.927065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e25ae-2d72-43e0-99c0-37e466a310ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:19.929344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e25ae-2d72-43e0-99c0-37e466a310ca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:19.970394 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1841/3649] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:19.974608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:19.987703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649edd00-83f2-4c69-895e-65efdb90a1e3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:20.002026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:20.002900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:20.003185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:20.003558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] PATH_INFO: `/v3/projects/0e8e86dac4bc40ab9add0e595ea472e4/users/43b555b30ba240dc852edab144434610/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:20.033845 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:20.041297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8e86dac4bc40ab9add0e595ea472e4, user_id=43b555b30ba240dc852edab144434610, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:20.045084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:20.151190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1809/3650] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:19 2022] PUT /identity/v3/projects/0e8e86dac4bc40ab9add0e595ea472e4/users/43b555b30ba240dc852edab144434610/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:20.258884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8e16-2697-42c7-8bbb-20979936242b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:20.258884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8e16-2697-42c7-8bbb-20979936242b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:20.259149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8e16-2697-42c7-8bbb-20979936242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:20.314944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fdcd8e16-2697-42c7-8bbb-20979936242b None None] MFA Rules not processed for user `43b555b30ba240dc852edab144434610`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:20.316350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fdcd8e16-2697-42c7-8bbb-20979936242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:20.471985 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1842/3651] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:20.473352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:20.656810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b7e6d-8aa7-44eb-addb-793453160d6b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:20.674495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:20.675698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:20.676184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:20.679162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:20.681020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:20.684858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:20.766460 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:20.872528 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1810/3652] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:20 2022] POST /identity/v3/projects => generated 385 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:20.877079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd8e16-2697-42c7-8bbb-20979936242b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:20.893947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd8e16-2697-42c7-8bbb-20979936242b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:21.036608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:21.037254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:21.037542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:21.037860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:21.038515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:21.040662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:21.215404 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1843/3653] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:20 2022] POST /identity/v3/users => generated 299 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:21.216175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:21.233418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5061-272b-45fa-8e39-7845faf843c4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:21.243024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:21.244402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:21.246518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:21.247060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:21.250187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:21.254737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:21.277398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:21.278193 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1811/3654] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:21.291849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d981c-6934-4ec4-992b-19a21af3b117 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:21.316726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:21.317532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:21.318183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:21.318582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] PATH_INFO: `/v3/projects/5972246d22f643cd9fa38e58207fafa4/users/af01be4b3b354168abb3ce5f6b1b96ab/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:21.343669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5972246d22f643cd9fa38e58207fafa4, user_id=af01be4b3b354168abb3ce5f6b1b96ab, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:21.347057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:21.445868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1844/3655] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:21 2022] PUT /identity/v3/projects/5972246d22f643cd9fa38e58207fafa4/users/af01be4b3b354168abb3ce5f6b1b96ab/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:21.453570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:21.473701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835de47d-6914-41a4-9936-48b59c0529e0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:21.690760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bcd01-9dfe-4242-a72b-31d3ff7c7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:21.692474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bcd01-9dfe-4242-a72b-31d3ff7c7ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:21.692946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bcd01-9dfe-4242-a72b-31d3ff7c7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:21.694374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bcd01-9dfe-4242-a72b-31d3ff7c7ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:21.697324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bcd01-9dfe-4242-a72b-31d3ff7c7ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:21.701352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bcd01-9dfe-4242-a72b-31d3ff7c7ec9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:21.731600 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1812/3656] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:21.731843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:21.762130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679c87-0c9c-443e-a415-7f163cb329e5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:21.780600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:21.781292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:21.781760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:21.782019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] PATH_INFO: `/v3/projects/5972246d22f643cd9fa38e58207fafa4/users/af01be4b3b354168abb3ce5f6b1b96ab/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:21.788178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5972246d22f643cd9fa38e58207fafa4, user_id=af01be4b3b354168abb3ce5f6b1b96ab, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:21.793481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:21.826096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1845/3657] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:21 2022] PUT /identity/v3/projects/5972246d22f643cd9fa38e58207fafa4/users/af01be4b3b354168abb3ce5f6b1b96ab/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:21.838864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a731-ef23-4f1d-a6ec-a76b720b130b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:21.841798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a731-ef23-4f1d-a6ec-a76b720b130b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:21.841798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a731-ef23-4f1d-a6ec-a76b720b130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:21.914668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-be54a731-ef23-4f1d-a6ec-a76b720b130b None None] MFA Rules not processed for user `af01be4b3b354168abb3ce5f6b1b96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:21.916742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-be54a731-ef23-4f1d-a6ec-a76b720b130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:22.113860 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1813/3658] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:22.114291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:22.149092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f098184-219d-44d6-95a2-f2f9fdb8d410 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:22.156569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:22.157441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:22.157916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:22.158372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:22.159190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:22.168837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:22.317185 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1846/3659] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:22 2022] POST /identity/v3/projects => generated 359 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:22.322297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a731-ef23-4f1d-a6ec-a76b720b130b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:22.335845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a731-ef23-4f1d-a6ec-a76b720b130b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:22.351784 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=3,keystone:SELECT=83,keystone:DELETE=14 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:22.429693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:22.430548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:22.430838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:22.431120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-186528022` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:22.432540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=2cc4696eeb964d04b60db753eeb212b6, value=tempest-tag-186528022)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:22.435718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:22.543667 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-186528022. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:24:22.543667 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:24:22.543667 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:22.553777 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1814/3660] 10.222.0.59 () {60 vars in 1330 bytes} [Sun Aug 28 01:24:22 2022] PUT /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-186528022 => generated 0 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Aug 28 01:24:22.555188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:22.569475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82752f75-a690-4d5c-b4a5-7cc5d667a4f9 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:22.575772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:22.576680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:22.578218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:22.578692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-186528022` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:22.594742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=2cc4696eeb964d04b60db753eeb212b6, value=tempest-tag-186528022)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:22.599257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:22.622606 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1847/3661] 10.222.0.59 () {58 vars in 1311 bytes} [Sun Aug 28 01:24:22 2022] GET /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-186528022 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:22.627546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:22.643024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235f29d-7afb-4be4-baae-6b75bf15e0b6 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:22.650038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:22.650038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:22.650038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:22.650308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:22.651417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=2cc4696eeb964d04b60db753eeb212b6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:22.653987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:22.803986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1815/3662] 10.222.0.59 () {60 vars in 1265 bytes} [Sun Aug 28 01:24:22 2022] PUT /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags => generated 137 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:22.808165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:22.820824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4f61f-26f2-437c-a036-f092131c4a5c tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:22.849956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:22.850989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:22.850989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:22.851209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:22.866781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=2cc4696eeb964d04b60db753eeb212b6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:22.869597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:22.888163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:22.889177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1848/3663] 10.222.0.59 () {58 vars in 1245 bytes} [Sun Aug 28 01:24:22 2022] GET /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags => generated 137 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:22.900032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc0813-f50e-47b9-b7c5-5c28cde38cec tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:22.912491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:22.914856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:22.915446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:22.916621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-158905557` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:22.918814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=2cc4696eeb964d04b60db753eeb212b6, value=tempest-tag-158905557)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:22.922380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:23.113095 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-158905557. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:24:23.113095 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:24:23.113095 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:23.137292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:23.138230 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1816/3664] 10.222.0.59 () {58 vars in 1314 bytes} [Sun Aug 28 01:24:22 2022] DELETE /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-158905557 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:23.143189 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:23.166764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a82edd-0e78-4b33-a612-a2975eddbf8e tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:23.176174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:23.176174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:23.176174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:23.176468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-158905557` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:23.216363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=2cc4696eeb964d04b60db753eeb212b6, value=tempest-tag-158905557)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:23.219658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Could not find project tag: tempest-tag-158905557.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-158905557. Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 28 01:24:23.275998 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 28 01:24:23.277045 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:24:23.277045 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:24:23.277045 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 28 01:24:23.277045 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 28 01:24:23.277045 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-158905557. Aug 28 01:24:23.277045 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:24:23.277713 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1849/3665] 10.222.0.59 () {58 vars in 1311 bytes} [Sun Aug 28 01:24:23 2022] GET /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags/tempest-tag-158905557 => generated 106 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:24:23.284198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:23.294948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af35bc-6554-46cf-b358-f65ba37fc72f tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:23.325593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:23.326651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:23.326942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:23.327268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:23.328817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=2cc4696eeb964d04b60db753eeb212b6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:23.331269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:23.494609 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1817/3666] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:24:23 2022] DELETE /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:23.498642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:23.514516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a30b65-81ed-411d-b695-9005745a18d2 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:23.522864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:23.523773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:23.524250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:23.524687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:23.546676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=2cc4696eeb964d04b60db753eeb212b6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:23.546676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:23.563523 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1850/3667] 10.222.0.59 () {58 vars in 1245 bytes} [Sun Aug 28 01:24:23 2022] GET /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6/tags => generated 66 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:24:23.568639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:23.579636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99228b-870b-4552-b099-50aeca6cb495 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:23.584886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af01be4b3b354168abb3ce5f6b1b96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5972246d22f643cd9fa38e58207fafa4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:23.585993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:23.586287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:23.586613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] PATH_INFO: `/v3/projects/2cc4696eeb964d04b60db753eeb212b6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:23.587800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2cc4696eeb964d04b60db753eeb212b6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:23.589800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:23.739539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc4696eeb964d04b60db753eeb212b6', 'request_id': 'req-767ef75b-9f7d-40da-af1d-b9395244566a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:23.752544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc4696eeb964d04b60db753eeb212b6', 'request_id': 'req-767ef75b-9f7d-40da-af1d-b9395244566a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:23.819825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc4696eeb964d04b60db753eeb212b6', 'request_id': 'req-767ef75b-9f7d-40da-af1d-b9395244566a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:23.839636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] The token cache is being invalidate because project 2cc4696eeb964d04b60db753eeb212b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:23.840020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:23.841204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-767ef75b-9f7d-40da-af1d-b9395244566a tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:23.842458 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1818/3668] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:23 2022] DELETE /identity/v3/projects/2cc4696eeb964d04b60db753eeb212b6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:23.848757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:23.851329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:23.987985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8691-6bb6-4216-842a-daeab94bdda5 tempest-IdentityV3ProjectTagsTest-421302852 tempest-IdentityV3ProjectTagsTest-421302852-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:24.055250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:24.056371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:24.056811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:24.057241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] PATH_INFO: `/v3/users/43b555b30ba240dc852edab144434610` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:24.059134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b555b30ba240dc852edab144434610)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:24.062011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:24.367993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b555b30ba240dc852edab144434610'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:24.368893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b555b30ba240dc852edab144434610'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:24.451576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b555b30ba240dc852edab144434610'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:24.464116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b555b30ba240dc852edab144434610'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:24.466527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b555b30ba240dc852edab144434610'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:24.490719 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1851/3669] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:23 2022] DELETE /identity/v3/users/43b555b30ba240dc852edab144434610 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:24.495620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:24.496016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:24.496369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:24.502222 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:24.518674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:24.520163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:24.679398 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1819/3670] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:24.696950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:24.701950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:24.846309 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:24.846910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795703ec-e349-4a1d-9bb5-7b65feba7bd5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:24.851615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:24.852447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:24.853017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:24.853496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:24.872448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:24.874757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:24.889314 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1852/3671] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:26.184148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:26.185983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:26.215212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932a2e2-500b-4218-a40a-4d3d03afbd1b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:26.239842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:26.242617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:26.243290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:26.243894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] PATH_INFO: `/v3/projects/0e8e86dac4bc40ab9add0e595ea472e4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:26.246632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8e86dac4bc40ab9add0e595ea472e4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:26.250610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:26.420333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8e86dac4bc40ab9add0e595ea472e4', 'request_id': 'req-df91e7ff-1dab-4ef4-b191-8caef7b99abc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:26.428873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8e86dac4bc40ab9add0e595ea472e4', 'request_id': 'req-df91e7ff-1dab-4ef4-b191-8caef7b99abc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:26.817420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8e86dac4bc40ab9add0e595ea472e4', 'request_id': 'req-df91e7ff-1dab-4ef4-b191-8caef7b99abc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:26.832433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] The token cache is being invalidate because project 0e8e86dac4bc40ab9add0e595ea472e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:26.832841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:26.835268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df91e7ff-1dab-4ef4-b191-8caef7b99abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:26.835268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1820/3672] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:26 2022] DELETE /identity/v3/projects/0e8e86dac4bc40ab9add0e595ea472e4 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:26.839270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:26.855293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c025f3-2425-4404-a238-e69285dac93f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:26.909257 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:27.015858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:27.016345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:27.016767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:27.017049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] PATH_INFO: `/v3/users/af01be4b3b354168abb3ce5f6b1b96ab` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:27.018401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=af01be4b3b354168abb3ce5f6b1b96ab)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:27.020407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:27.407293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af01be4b3b354168abb3ce5f6b1b96ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:27.407986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af01be4b3b354168abb3ce5f6b1b96ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:27.531065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af01be4b3b354168abb3ce5f6b1b96ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:27.546052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af01be4b3b354168abb3ce5f6b1b96ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:27.546952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af01be4b3b354168abb3ce5f6b1b96ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:27.581743 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1853/3673] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:26 2022] DELETE /identity/v3/users/af01be4b3b354168abb3ce5f6b1b96ab => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:27.788126 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:28.010661 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:28.266388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb86b8-0fd0-47e3-bd76-18be834cd86c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:28.266990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb86b8-0fd0-47e3-bd76-18be834cd86c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:28.267517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb86b8-0fd0-47e3-bd76-18be834cd86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:28.304220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5dcb86b8-0fd0-47e3-bd76-18be834cd86c None None] MFA Rules not processed for user `0635b4466d3d41eb95eb7fef0138437a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:28.306101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5dcb86b8-0fd0-47e3-bd76-18be834cd86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:28.441303 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1821/3674] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:28.916234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:28.918007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:29.084891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a3eee-ed23-4fed-b99a-98bd864015ca admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:29.102051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:29.140476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:29.140476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:29.140476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] PATH_INFO: `/v3/projects/5972246d22f643cd9fa38e58207fafa4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:29.140476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5972246d22f643cd9fa38e58207fafa4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:29.140476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:29.313936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5972246d22f643cd9fa38e58207fafa4', 'request_id': 'req-c455f474-6442-471d-a2de-24f19e20fee0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:29.331898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5972246d22f643cd9fa38e58207fafa4', 'request_id': 'req-c455f474-6442-471d-a2de-24f19e20fee0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:29.431710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5972246d22f643cd9fa38e58207fafa4', 'request_id': 'req-c455f474-6442-471d-a2de-24f19e20fee0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:29.457539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] The token cache is being invalidate because project 5972246d22f643cd9fa38e58207fafa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:29.457857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:29.458662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c455f474-6442-471d-a2de-24f19e20fee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:29.460563 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1854/3675] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:28 2022] DELETE /identity/v3/projects/5972246d22f643cd9fa38e58207fafa4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:29.467327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d5ce-4423-42ce-8d57-2df9ed9aa81b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:29.468506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d5ce-4423-42ce-8d57-2df9ed9aa81b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:29.468699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d5ce-4423-42ce-8d57-2df9ed9aa81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:29.506911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3734d5ce-4423-42ce-8d57-2df9ed9aa81b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:29.508263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3734d5ce-4423-42ce-8d57-2df9ed9aa81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:29.633691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1822/3676] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:29.643462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e570c-622c-4eca-bf16-f293343b4eef None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:29.644586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e570c-622c-4eca-bf16-f293343b4eef None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:29.644586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e570c-622c-4eca-bf16-f293343b4eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:29.699826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c76e570c-622c-4eca-bf16-f293343b4eef None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:29.704098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c76e570c-622c-4eca-bf16-f293343b4eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:29.731970 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1855/3677] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:29.736708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d5ce-4423-42ce-8d57-2df9ed9aa81b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:29.752989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d5ce-4423-42ce-8d57-2df9ed9aa81b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:29.768968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:29.772160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:29.772685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:29.773201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:29.774122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:29.774638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:29.779565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:29.814450 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1823/3678] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:29.815237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e570c-622c-4eca-bf16-f293343b4eef None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:29.834496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e570c-622c-4eca-bf16-f293343b4eef None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:29.846964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:29.847249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:29.848752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:29.849108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:29.856711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:29.860028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:30.032419 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1856/3679] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:29 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:30.036399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:30.049248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d9aab-e22d-4dac-8276-d1ecdbe061b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:30.137406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:30.138114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:30.138597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:30.139061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:30.140127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:30.143458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:30.158899 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:30.282661 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1824/3680] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:30 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:30.286702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:30.301157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6536e-be2f-4e3a-90ba-f05e1dc95a38 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:30.307046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:30.310571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:30.310571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:30.310571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:30.310571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:30.314776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:30.328728 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1857/3681] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:24:30.332184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:30.348962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84d3a9-d28b-4adb-a335-516aea45b5ec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:30.350770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d32e6a-ac0c-47da-b241-3a84cdaf6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:30.351284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d32e6a-ac0c-47da-b241-3a84cdaf6d83 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:30.351564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d32e6a-ac0c-47da-b241-3a84cdaf6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:30.351843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d32e6a-ac0c-47da-b241-3a84cdaf6d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:30.352496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d32e6a-ac0c-47da-b241-3a84cdaf6d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:30.354216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d32e6a-ac0c-47da-b241-3a84cdaf6d83 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:30.366974 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1825/3682] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:30.371427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:30.382278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf5685-a7ae-4f8c-96c9-78a8184855e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:30.395665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:30.396464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:30.396755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:30.397032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] PATH_INFO: `/v3/projects/d46acb1ea82143afb8514e3c8de934bc/users/0fe62c827f2e4419b1c14d0bc0167bc0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:30.414709 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:30.429670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46acb1ea82143afb8514e3c8de934bc, user_id=0fe62c827f2e4419b1c14d0bc0167bc0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:30.434524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:30.535942 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1858/3683] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:30 2022] PUT /identity/v3/projects/d46acb1ea82143afb8514e3c8de934bc/users/0fe62c827f2e4419b1c14d0bc0167bc0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:30.546386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57a99-86a3-44cd-b57c-d87038fbc08d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:30.546927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57a99-86a3-44cd-b57c-d87038fbc08d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:30.547057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b57a99-86a3-44cd-b57c-d87038fbc08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:30.590212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-94b57a99-86a3-44cd-b57c-d87038fbc08d None None] MFA Rules not processed for user `0fe62c827f2e4419b1c14d0bc0167bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:30.593480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-94b57a99-86a3-44cd-b57c-d87038fbc08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:30.677865 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1826/3684] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:30.681226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:30.755993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daad41-94ab-4261-8bb2-c029149a6c36 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:30.761684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:30.762659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:30.763153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:30.763996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:30.765415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:30.768031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:30.878380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1859/3685] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:30 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:30.879921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b57a99-86a3-44cd-b57c-d87038fbc08d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:30.892321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b57a99-86a3-44cd-b57c-d87038fbc08d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:31.042146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:31.043039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:31.043193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:31.043560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:31.044152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:31.047353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:31.207351 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1827/3686] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:30 2022] POST /identity/v3/users => generated 290 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:31.211841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:31.236689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b71bf7-678c-48f2-89d0-98b4c2ee0acb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:31.241916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:31.242775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:31.243257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:31.243744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:31.244594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:31.246615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:31.260296 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1860/3687] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:31.265295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:31.281440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef8c82-6bde-4d83-bde5-302897886121 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:31.287023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:31.287710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:31.287995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:31.288276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] PATH_INFO: `/v3/projects/f2640ed2b757435eac23b7ac7fd8e920/users/272ffcbf527b4312ae4ce13df1662e6d/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:31.305951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2640ed2b757435eac23b7ac7fd8e920, user_id=272ffcbf527b4312ae4ce13df1662e6d, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:31.308994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:31.416527 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1828/3688] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:31 2022] PUT /identity/v3/projects/f2640ed2b757435eac23b7ac7fd8e920/users/272ffcbf527b4312ae4ce13df1662e6d/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:31.420692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:31.438568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75969f4e-38af-40d3-8c0c-cdf84e59c630 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:31.497143 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:31.572318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5c4a-898d-4ce1-947f-e8f0bcc3788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:31.577794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5c4a-898d-4ce1-947f-e8f0bcc3788e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:31.578175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5c4a-898d-4ce1-947f-e8f0bcc3788e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:31.578423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5c4a-898d-4ce1-947f-e8f0bcc3788e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:31.584359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae5c4a-898d-4ce1-947f-e8f0bcc3788e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:31.585985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae5c4a-898d-4ce1-947f-e8f0bcc3788e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:31.615204 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1861/3689] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:31.635709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:31.650816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc44b-862c-44c0-9a5d-2afd54d6773b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:31.665553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:31.666357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:31.666743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:31.667126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] PATH_INFO: `/v3/projects/f2640ed2b757435eac23b7ac7fd8e920/users/272ffcbf527b4312ae4ce13df1662e6d/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:31.670045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2640ed2b757435eac23b7ac7fd8e920, user_id=272ffcbf527b4312ae4ce13df1662e6d, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:31.673972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:31.691417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1829/3690] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:31 2022] PUT /identity/v3/projects/f2640ed2b757435eac23b7ac7fd8e920/users/272ffcbf527b4312ae4ce13df1662e6d/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:31.701943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e309-148c-4866-8998-e6a6c3697fa4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:31.707291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e309-148c-4866-8998-e6a6c3697fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:31.707291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e309-148c-4866-8998-e6a6c3697fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:31.747963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6e50e309-148c-4866-8998-e6a6c3697fa4 None None] MFA Rules not processed for user `272ffcbf527b4312ae4ce13df1662e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:31.750434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6e50e309-148c-4866-8998-e6a6c3697fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:31.896081 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1862/3691] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:31.899365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:31.916431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079c885-8421-4a2a-b79e-c6dfcb64164e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:31.917506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:31.918454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:31.918968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:31.919482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:31.920405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:31.922926 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:31.922926 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:31.922926 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:31.924403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.018165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e309-148c-4866-8998-e6a6c3697fa4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.025933 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1830/3692] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:24:31 2022] POST /identity/v3/services => generated 239 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:32.034037 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:32.036299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e309-148c-4866-8998-e6a6c3697fa4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.059139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.059845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.060135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.060405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/8257ab4dad7c4d2ab80e9aea3cb908c4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.061593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8257ab4dad7c4d2ab80e9aea3cb908c4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.063235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.161137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1863/3693] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:32 2022] DELETE /identity/v3/services/8257ab4dad7c4d2ab80e9aea3cb908c4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:32.167776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.181373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131b6f-2c0f-49c8-bc44-e6d711d1f4e8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.200202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.200903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.201360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.201849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.202776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.204679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.293866 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1831/3694] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:32 2022] POST /identity/v3/services => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:32.295600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.308548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101fcc-2977-4906-929e-55634edded70 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.324333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.324958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.325242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.325517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/714a4938eb2b46ffaec91a9dbb424977` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.326226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:update_service(service_id=714a4938eb2b46ffaec91a9dbb424977)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.327273 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:32.327273 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:32.327273 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:32.328410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.420441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1864/3695] 10.222.0.59 () {60 vars in 1252 bytes} [Sun Aug 28 01:24:32 2022] PATCH /identity/v3/services/714a4938eb2b46ffaec91a9dbb424977 => generated 283 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:32.424288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.437777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116de5-3428-4bd7-8bbd-0d133fee2014 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.458066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.458711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.458997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.459281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/714a4938eb2b46ffaec91a9dbb424977` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.459893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:get_service(service_id=714a4938eb2b46ffaec91a9dbb424977)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.460943 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:32.460943 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:32.460943 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:32.461916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.478271 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1832/3696] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:24:32 2022] GET /identity/v3/services/714a4938eb2b46ffaec91a9dbb424977 => generated 283 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:32.479847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.501576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac14e2-d741-420c-a0a6-e07aecfdad47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.507310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.508695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.508695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.508695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/714a4938eb2b46ffaec91a9dbb424977` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.509136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:delete_service(service_id=714a4938eb2b46ffaec91a9dbb424977)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.510772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.621003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1865/3697] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:32 2022] DELETE /identity/v3/services/714a4938eb2b46ffaec91a9dbb424977 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:32.622819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.634731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e2438-71a3-4f59-bdd9-78b0e7f4425e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.655638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.657893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.658390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.658874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/714a4938eb2b46ffaec91a9dbb424977` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.660393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:get_service(service_id=714a4938eb2b46ffaec91a9dbb424977)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.662300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Could not find service: 714a4938eb2b46ffaec91a9dbb424977.: keystone.exception.ServiceNotFound: Could not find service: 714a4938eb2b46ffaec91a9dbb424977. Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 714a4938eb2b46ffaec91a9dbb424977. Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:24:32.674929 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:24:32.676281 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 714a4938eb2b46ffaec91a9dbb424977. Aug 28 01:24:32.677558 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:24:32.688207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.694956 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1833/3698] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:24:32 2022] GET /identity/v3/services/714a4938eb2b46ffaec91a9dbb424977 => generated 113 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:24:32.701791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e9b11-929e-473d-a255-025040922408 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.708148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.709041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.709952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.710414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.711778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.713691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.822126 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1866/3699] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:32 2022] POST /identity/v3/services => generated 274 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:32.822369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.834724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce3e5b-aae5-4fdf-9604-906ca460fda5 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.854835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.854835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.854835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.855175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.855855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:32.857720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:32.947714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:32.954037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1834/3700] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:32 2022] POST /identity/v3/services => generated 275 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:32.963014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6ebe6-e24f-4405-b9e0-50b56ba02420 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:32.995102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:32.995950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:32.996393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:32.997506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:32.998442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.001316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.012546 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:33.069938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1867/3701] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:32 2022] POST /identity/v3/services => generated 272 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:33.074370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.089800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2079987-e740-4af1-a220-b125ace32864 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.107012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.107627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.107916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.108252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.109533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.110673 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:33.110673 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:33.110673 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:33.111588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.120454 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1835/3702] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:24:33 2022] GET /identity/v3/services => generated 2976 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:33.125228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.142197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e664b81-8d8f-452a-80f1-350a4a16f578 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.151358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.152096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.152458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.152801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.153930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1056949625) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:33.154336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.156673 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:33.156673 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:24:33.156673 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:24:33.157732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.167239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1868/3703] 10.222.0.59 () {58 vars in 1222 bytes} [Sun Aug 28 01:24:33 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1056949625 => generated 417 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:33.171980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.187978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253589f0-a786-4343-ae9e-038527bb76c8 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.200073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.201260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.203078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.203576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.209341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2006650652) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:33.209341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.210606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.218489 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1836/3704] 10.222.0.59 () {58 vars in 1222 bytes} [Sun Aug 28 01:24:33 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2006650652 => generated 418 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:33.222919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.234331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b88e6-e00b-43a7-9623-db3c65462a47 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.241462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.243341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.243341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.243341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.243653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-26687837) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:33.253646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.256146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.268686 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1869/3705] 10.222.0.59 () {58 vars in 1218 bytes} [Sun Aug 28 01:24:33 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-26687837 => generated 413 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:33.269129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.281117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3df93-0ada-48a7-b56f-c6b3f0e5eb0a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.288093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.288989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.291563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.291563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/35d3e4eabf9746de91958bb9052e4a21` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.291563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:delete_service(service_id=35d3e4eabf9746de91958bb9052e4a21)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.291563 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:24:33.291563 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:24:33.291563 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:24:33.293272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.409091 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1837/3706] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:33 2022] DELETE /identity/v3/services/35d3e4eabf9746de91958bb9052e4a21 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:33.410239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.423697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4ecf7-5df8-411e-9929-393691a76914 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.447276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.448000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.448443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.448727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/f99922b6d1ab4251afc0009726d83d66` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.449384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f99922b6d1ab4251afc0009726d83d66)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.452446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.553131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1870/3707] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:33 2022] DELETE /identity/v3/services/f99922b6d1ab4251afc0009726d83d66 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:33.557485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.568326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ec10-7250-46bc-bc82-87d317876b38 tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.583417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d148306-9ae3-40ec-beba-b2d2210bc85e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '272ffcbf527b4312ae4ce13df1662e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2640ed2b757435eac23b7ac7fd8e920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.585465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148306-9ae3-40ec-beba-b2d2210bc85e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.585465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148306-9ae3-40ec-beba-b2d2210bc85e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.585465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d148306-9ae3-40ec-beba-b2d2210bc85e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] PATH_INFO: `/v3/services/d2ea165e3984406badeca9a48d1780e1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.585465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d148306-9ae3-40ec-beba-b2d2210bc85e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d2ea165e3984406badeca9a48d1780e1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.586788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d148306-9ae3-40ec-beba-b2d2210bc85e tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:33.667072 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1838/3708] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:33 2022] DELETE /identity/v3/services/d2ea165e3984406badeca9a48d1780e1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:33.673038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:33.744664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20480da-22c8-4c70-9888-c0d243af695a tempest-ServicesTestJSON-603141427 tempest-ServicesTestJSON-603141427-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:33.759505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:33.760148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:33.760546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:33.760829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] PATH_INFO: `/v3/users/0fe62c827f2e4419b1c14d0bc0167bc0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:33.762051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe62c827f2e4419b1c14d0bc0167bc0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:33.763989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:34.001729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe62c827f2e4419b1c14d0bc0167bc0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:34.002587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe62c827f2e4419b1c14d0bc0167bc0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:34.078768 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:34.110973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe62c827f2e4419b1c14d0bc0167bc0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:34.121716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe62c827f2e4419b1c14d0bc0167bc0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:34.121716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe62c827f2e4419b1c14d0bc0167bc0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:34.143019 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1871/3709] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:33 2022] DELETE /identity/v3/users/0fe62c827f2e4419b1c14d0bc0167bc0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:34.147615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:34.147892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:34.154675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:34.173043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:34.173043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:34.259043 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1839/3710] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:34.269666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:34.271519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:34.364565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641145d-db18-4a5d-a34f-034009fe782c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:34.391537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:34.392167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:34.392446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:34.392721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:34.426077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:34.426077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:34.445824 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1872/3711] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:35.207148 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:35.734959 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:36.038684 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:36.147096 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:36.364008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:36.365460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:36.378581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db143da2-88ab-4a8b-8cef-3c3ba5d9d097 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:36.384320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:36.385120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:36.385383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:36.386000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] PATH_INFO: `/v3/projects/d46acb1ea82143afb8514e3c8de934bc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:36.401973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46acb1ea82143afb8514e3c8de934bc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:36.409046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:36.572885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46acb1ea82143afb8514e3c8de934bc', 'request_id': 'req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:36.581348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46acb1ea82143afb8514e3c8de934bc', 'request_id': 'req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:36.702796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46acb1ea82143afb8514e3c8de934bc', 'request_id': 'req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:36.729035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] The token cache is being invalidate because project d46acb1ea82143afb8514e3c8de934bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:36.729035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:36.729676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8062d3ed-a587-4fd9-aecb-e3fdcc14d9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:36.731340 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1840/3712] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:36 2022] DELETE /identity/v3/projects/d46acb1ea82143afb8514e3c8de934bc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:36.735877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:36.746252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abb37b-89c2-4c07-b254-301c7e9dc441 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:36.876901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:36.877627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:36.878201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:36.878661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] PATH_INFO: `/v3/users/272ffcbf527b4312ae4ce13df1662e6d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:36.884746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=272ffcbf527b4312ae4ce13df1662e6d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:36.892794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:36.899834 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:37.094066 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:37.240606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272ffcbf527b4312ae4ce13df1662e6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:37.244062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272ffcbf527b4312ae4ce13df1662e6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:37.371288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272ffcbf527b4312ae4ce13df1662e6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:37.383310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272ffcbf527b4312ae4ce13df1662e6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:37.385711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272ffcbf527b4312ae4ce13df1662e6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:37.464330 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1873/3713] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:36 2022] DELETE /identity/v3/users/272ffcbf527b4312ae4ce13df1662e6d => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:37.671808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:37.672592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:37.673214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:37.700874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:37.700874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:37.810304 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1841/3714] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:37.814907 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:38.017286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:38.018976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:38.133728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90587ef9-e547-43db-add6-41c91d833a9c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:38.141009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efb4a9-211e-413c-9a1a-8056e0d04040 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:38.141943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efb4a9-211e-413c-9a1a-8056e0d04040 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:38.142414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efb4a9-211e-413c-9a1a-8056e0d04040 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:38.142833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efb4a9-211e-413c-9a1a-8056e0d04040 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:38.170511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efb4a9-211e-413c-9a1a-8056e0d04040 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:38.170511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efb4a9-211e-413c-9a1a-8056e0d04040 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:38.182367 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1874/3715] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:24:38.209877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:38.219115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:38.297803 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:38.409989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800714a-3364-4e66-b9a7-6081b95649b8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:38.429583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:38.430338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:38.430624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:38.430903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] PATH_INFO: `/v3/projects/f2640ed2b757435eac23b7ac7fd8e920` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:38.441289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2640ed2b757435eac23b7ac7fd8e920)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:38.442660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:38.642477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2640ed2b757435eac23b7ac7fd8e920', 'request_id': 'req-934e8f9c-4d20-4686-aabf-cb4c61771d4d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:38.650502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2640ed2b757435eac23b7ac7fd8e920', 'request_id': 'req-934e8f9c-4d20-4686-aabf-cb4c61771d4d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:38.711577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2640ed2b757435eac23b7ac7fd8e920', 'request_id': 'req-934e8f9c-4d20-4686-aabf-cb4c61771d4d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:38.768592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] The token cache is being invalidate because project f2640ed2b757435eac23b7ac7fd8e920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:38.768893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:38.769638 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:38.773560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-934e8f9c-4d20-4686-aabf-cb4c61771d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:38.785164 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1842/3716] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:38 2022] DELETE /identity/v3/projects/f2640ed2b757435eac23b7ac7fd8e920 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:38.798900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20d8a4-cd50-42ee-969e-d3301b2bab46 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:38.799193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20d8a4-cd50-42ee-969e-d3301b2bab46 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:38.799666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20d8a4-cd50-42ee-969e-d3301b2bab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:38.839808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ab20d8a4-cd50-42ee-969e-d3301b2bab46 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:38.842005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab20d8a4-cd50-42ee-969e-d3301b2bab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:38.877138 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:38.946914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1875/3717] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:24:38.957664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91d28-e736-49d3-9a70-5f76b9d9cbda None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:38.958069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91d28-e736-49d3-9a70-5f76b9d9cbda None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:38.959577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda91d28-e736-49d3-9a70-5f76b9d9cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:38.988443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-eda91d28-e736-49d3-9a70-5f76b9d9cbda None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:38.990265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-eda91d28-e736-49d3-9a70-5f76b9d9cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:39.008932 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1843/3718] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:39.015426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20d8a4-cd50-42ee-969e-d3301b2bab46 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:39.033534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20d8a4-cd50-42ee-969e-d3301b2bab46 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:39.053632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:39.062578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:39.063127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:39.063532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:39.064949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:39.064949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:39.066862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:39.095876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1876/3719] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:24:39.101467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda91d28-e736-49d3-9a70-5f76b9d9cbda None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:39.138007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda91d28-e736-49d3-9a70-5f76b9d9cbda None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:39.149846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:39.151036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:39.152440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:39.152440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:39.153001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:39.156253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:39.324166 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1844/3720] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:39 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:39.328536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:39.339605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab528c39-4ea9-4909-a47e-53101a797ff0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:39.446754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:39.447821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:39.448287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:39.448974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:39.450923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:39.454636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:39.490187 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:39.578859 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:39.599474 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1877/3721] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:39 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:39.603564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:39.623425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a6e19-489a-410f-b3bc-c12e1d772ce3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:39.650947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:39.651662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:39.651953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:39.652284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:39.654080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:39.657056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:39.695742 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1845/3722] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:39.699171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:39.721051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f751-337d-4b63-948e-2db7ae75e86e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:39.742488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd53a8-e448-4c73-9a93-405919197c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:39.743331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd53a8-e448-4c73-9a93-405919197c01 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:39.743475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd53a8-e448-4c73-9a93-405919197c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:39.744697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd53a8-e448-4c73-9a93-405919197c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:39.746672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd53a8-e448-4c73-9a93-405919197c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:39.755387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd53a8-e448-4c73-9a93-405919197c01 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:39.787083 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1878/3723] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:39.791377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:39.808989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa365c47-b10f-43ad-b8ec-f4da588232e8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:39.824114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:39.825899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:39.826461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:39.827014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] PATH_INFO: `/v3/projects/639aac4f68a8404a8d28bd671f6435a2/users/67bfa9dac24c4c0586298e4ec644ad23/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:39.866825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] RBAC: Authorizing `identity:create_grant(project_id=639aac4f68a8404a8d28bd671f6435a2, user_id=67bfa9dac24c4c0586298e4ec644ad23, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:39.870025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:39.974465 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1846/3724] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:39 2022] PUT /identity/v3/projects/639aac4f68a8404a8d28bd671f6435a2/users/67bfa9dac24c4c0586298e4ec644ad23/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:39.992902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd45b9-3c45-4a25-92b4-7baab66ea268 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:39.992902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd45b9-3c45-4a25-92b4-7baab66ea268 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:39.992902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd45b9-3c45-4a25-92b4-7baab66ea268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:40.037062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-19dd45b9-3c45-4a25-92b4-7baab66ea268 None None] MFA Rules not processed for user `67bfa9dac24c4c0586298e4ec644ad23`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:40.038703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-19dd45b9-3c45-4a25-92b4-7baab66ea268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:40.203553 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1879/3725] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:40.208754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:40.229592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b9304-8e88-4a78-9394-35521b2b674e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:40.239409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa36aff-d9d8-4921-bee2-3e9391d61a55 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:40.240465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36aff-d9d8-4921-bee2-3e9391d61a55 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:40.241703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36aff-d9d8-4921-bee2-3e9391d61a55 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:40.242792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36aff-d9d8-4921-bee2-3e9391d61a55 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:40.243957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36aff-d9d8-4921-bee2-3e9391d61a55 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:create_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:40.245459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa36aff-d9d8-4921-bee2-3e9391d61a55 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:40.684909 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1847/3726] 10.222.0.59 () {60 vars in 1314 bytes} [Sun Aug 28 01:24:40 2022] POST /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 789 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:40.687354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd45b9-3c45-4a25-92b4-7baab66ea268 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:40.699121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd45b9-3c45-4a25-92b4-7baab66ea268 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:40.716581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:40.721638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:40.725416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:40.725416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/52f333f3dddc4b7985d1cc48c110f5e8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:40.793213 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:40.804307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:get_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=52f333f3dddc4b7985d1cc48c110f5e8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:40.805988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:40.812454 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1880/3727] 10.222.0.59 () {58 vars in 1392 bytes} [Sun Aug 28 01:24:40 2022] GET /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/52f333f3dddc4b7985d1cc48c110f5e8 => generated 689 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:40.814351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b0c1a-a4e6-4806-937c-b0ba34adf2b3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:40.815414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b0c1a-a4e6-4806-937c-b0ba34adf2b3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:40.815866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b0c1a-a4e6-4806-937c-b0ba34adf2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:40.876334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bf5b0c1a-a4e6-4806-937c-b0ba34adf2b3 None None] MFA Rules not processed for user `67bfa9dac24c4c0586298e4ec644ad23`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:40.878200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bf5b0c1a-a4e6-4806-937c-b0ba34adf2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:41.204436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1848/3728] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:40 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 28 01:24:41.208503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:41.214944 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:41.224806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc1ea0-021d-4063-a255-c870ff409108 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:41.262656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:41.263623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:41.264069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:41.264632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/52f333f3dddc4b7985d1cc48c110f5e8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:41.270571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:delete_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=52f333f3dddc4b7985d1cc48c110f5e8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:41.272271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:41.396323 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1881/3729] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:24:41 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/52f333f3dddc4b7985d1cc48c110f5e8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:41.398614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b0c1a-a4e6-4806-937c-b0ba34adf2b3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:41.417326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b0c1a-a4e6-4806-937c-b0ba34adf2b3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:41.438314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:41.438996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:41.439274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:41.439556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:41.440236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:create_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:41.441419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:41.806350 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1849/3730] 10.222.0.59 () {60 vars in 1315 bytes} [Sun Aug 28 01:24:41 2022] POST /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 921 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:41.810604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:41.823079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfd58a-1957-4b1f-b45b-05653de59d84 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:41.834255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:41.835376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:41.835619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:41.835914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/873f0fd835804500acd4d843fb993c97` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:41.869933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:delete_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=873f0fd835804500acd4d843fb993c97)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:41.873265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:42.041369 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1882/3731] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:24:41 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/873f0fd835804500acd4d843fb993c97 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:42.046921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:42.062707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d5663-fdfc-475b-b84a-0644521cd877 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:42.074868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:42.075883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:42.076356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:42.077459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:42.078437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:create_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:42.079830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:42.847344 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1850/3732] 10.222.0.59 () {60 vars in 1315 bytes} [Sun Aug 28 01:24:42 2022] POST /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 813 bytes in 801 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:42.851623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:42.869581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494862d-f40e-406e-b905-f0d320e8f038 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:42.874322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:42.875209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:42.875648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:42.876093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/25f9904d06b440f2bec0528c6ba58415` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:42.888646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:delete_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=25f9904d06b440f2bec0528c6ba58415)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:42.888646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:43.007003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1883/3733] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:24:42 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/25f9904d06b440f2bec0528c6ba58415 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:43.012307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:43.029626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea91edd-6c24-476a-8815-30467e3ceb9b tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:43.048399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:43.052393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:43.052694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:43.052986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:43.053742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:create_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:43.055068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:43.382151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1851/3734] 10.222.0.59 () {60 vars in 1314 bytes} [Sun Aug 28 01:24:43 2022] POST /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 787 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:43.386869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:43.407682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cacd6-b66d-4604-834a-e1a84bba9c87 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:43.419485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:43.420159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:43.422645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:43.423187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:43.424058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:create_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:43.425509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:43.710110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1884/3735] 10.222.0.59 () {60 vars in 1314 bytes} [Sun Aug 28 01:24:43 2022] POST /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 788 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:43.714811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:43.752692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22956-00ff-412c-b261-9056d18800a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:43.787536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:43.787536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:43.787536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:43.787868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:43.787868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:list_application_credentials(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:43.787868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:43.882405 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1852/3736] 10.222.0.59 () {58 vars in 1293 bytes} [Sun Aug 28 01:24:43 2022] GET /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 1499 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:43.886675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:43.912529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e1656-da2f-49f5-a7c8-15a3bb1c44db tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:43.918355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:43.919276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:43.919728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:43.920174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/f78e7511f1e64d96953b8eb4ec5e05e7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:43.935767 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:43.943861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:delete_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=f78e7511f1e64d96953b8eb4ec5e05e7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:43.945650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:44.060766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:44.062413 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1885/3737] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:24:43 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/f78e7511f1e64d96953b8eb4ec5e05e7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:44.075425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1196c0-cf6b-4b57-8cfc-7a6b5a3616de tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:44.080602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:44.081483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:44.082240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:44.082693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/5e44d570e6a8410ab65da666d1dabeff` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:44.092654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:delete_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=5e44d570e6a8410ab65da666d1dabeff)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:44.094996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:44.223891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:44.224822 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1853/3738] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:24:44 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/5e44d570e6a8410ab65da666d1dabeff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:44.239752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f494565-7846-4ea8-bd9a-bafddb016a19 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:44.251254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b5c2b-8004-4ab9-bcb5-495b6a3dc0a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:44.252450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b5c2b-8004-4ab9-bcb5-495b6a3dc0a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:44.252768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b5c2b-8004-4ab9-bcb5-495b6a3dc0a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:44.253101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b5c2b-8004-4ab9-bcb5-495b6a3dc0a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:44.253745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b5c2b-8004-4ab9-bcb5-495b6a3dc0a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:create_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:44.255872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b5c2b-8004-4ab9-bcb5-495b6a3dc0a5 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:44.352903 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:44.504378 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1886/3739] 10.222.0.59 () {60 vars in 1314 bytes} [Sun Aug 28 01:24:44 2022] POST /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 789 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:44.505856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:44.531410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830856-35b7-41e9-915f-546012cab719 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:44.540315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:44.546388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:44.546388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:44.546388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:44.546388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:create_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:44.546858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:44.631900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094fe5b-3d8d-401e-acfe-98a32bc65a98 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:44.632211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094fe5b-3d8d-401e-acfe-98a32bc65a98 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:44.632481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094fe5b-3d8d-401e-acfe-98a32bc65a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:44.663111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0094fe5b-3d8d-401e-acfe-98a32bc65a98 None None] MFA Rules not processed for user `df310911396d4dbea6cffd534976f0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:44.665246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0094fe5b-3d8d-401e-acfe-98a32bc65a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:44.760513 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1854/3740] 10.222.0.59 () {60 vars in 1314 bytes} [Sun Aug 28 01:24:44 2022] POST /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials => generated 789 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:44.765733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:44.785733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe208-8225-46b4-a631-2e19a4776a4d tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:44.792236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:44.793029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:44.793422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:44.794113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:44.794971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Adding query filter params (name=tempest-application_credential-1008998469) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:44.796073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:list_application_credentials(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:44.813841 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1887/3741] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:24:44.814674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:44.824820 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1855/3742] 10.222.0.59 () {58 vars in 1386 bytes} [Sun Aug 28 01:24:44 2022] GET /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials?name=tempest-application_credential-1008998469 => generated 887 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:44.829697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094fe5b-3d8d-401e-acfe-98a32bc65a98 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:44.846538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094fe5b-3d8d-401e-acfe-98a32bc65a98 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:44.851568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:44.853632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:44.854025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:44.854490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/3640108e415f4463995207bdf7749dae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:44.875259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:delete_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=3640108e415f4463995207bdf7749dae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:44.875694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:45.043194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1888/3743] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:24:44 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/3640108e415f4463995207bdf7749dae => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:24:45.044898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:45.068350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950cba0-9fc0-4466-85a7-3aad44505533 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:45.094398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f571-fe9a-438d-8f25-2ccdd33c1105 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67bfa9dac24c4c0586298e4ec644ad23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '639aac4f68a8404a8d28bd671f6435a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:45.095078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f571-fe9a-438d-8f25-2ccdd33c1105 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:45.095365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f571-fe9a-438d-8f25-2ccdd33c1105 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:45.095648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f571-fe9a-438d-8f25-2ccdd33c1105 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/daa3f08dd75d437c81cf425d36aa489c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:45.122675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f571-fe9a-438d-8f25-2ccdd33c1105 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorizing `identity:delete_application_credential(user_id=67bfa9dac24c4c0586298e4ec644ad23, application_credential_id=daa3f08dd75d437c81cf425d36aa489c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:45.124893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f571-fe9a-438d-8f25-2ccdd33c1105 tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:45.216329 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1856/3744] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:24:45 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23/application_credentials/daa3f08dd75d437c81cf425d36aa489c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:45.227412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:45.361865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b974c-2c5d-43e3-acdb-949a3e41983a tempest-ApplicationCredentialsV3Test-550269823 tempest-ApplicationCredentialsV3Test-550269823-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:45.367155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:45.368038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:45.368499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:45.368941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] PATH_INFO: `/v3/users/67bfa9dac24c4c0586298e4ec644ad23` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:45.370356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bfa9dac24c4c0586298e4ec644ad23)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:45.372769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:45.648421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bfa9dac24c4c0586298e4ec644ad23'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:45.654615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bfa9dac24c4c0586298e4ec644ad23'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:45.770113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bfa9dac24c4c0586298e4ec644ad23'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:45.785848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bfa9dac24c4c0586298e4ec644ad23'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:45.787280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bfa9dac24c4c0586298e4ec644ad23'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:45.939824 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1889/3745] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:45 2022] DELETE /identity/v3/users/67bfa9dac24c4c0586298e4ec644ad23 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:45.941550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:45.941868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:45.942155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:46.017208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:46.018533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:46.144190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1857/3746] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:46.189927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:46.190331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:46.210525 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:46.315617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7eb83-0a8a-457a-bb94-9ee327d69a30 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:46.332462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df097b-de45-4d7e-b270-632d5c0859d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:46.333541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df097b-de45-4d7e-b270-632d5c0859d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:46.333850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df097b-de45-4d7e-b270-632d5c0859d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:46.334179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df097b-de45-4d7e-b270-632d5c0859d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:46.353701 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:46.364234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df097b-de45-4d7e-b270-632d5c0859d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:46.365714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df097b-de45-4d7e-b270-632d5c0859d7 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:46.401710 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1890/3747] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:47.328568 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:48.637695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:48.641379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:48.697605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047956fe-99ef-4011-ae5f-bd71e6b6a790 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:48.709432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:48.712251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:48.713002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:48.713769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] PATH_INFO: `/v3/projects/639aac4f68a8404a8d28bd671f6435a2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:48.718140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=639aac4f68a8404a8d28bd671f6435a2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:48.726860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:48.920575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639aac4f68a8404a8d28bd671f6435a2', 'request_id': 'req-b7b2c2e5-e89a-4039-ba58-192808462ac4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:48.935398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639aac4f68a8404a8d28bd671f6435a2', 'request_id': 'req-b7b2c2e5-e89a-4039-ba58-192808462ac4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:49.036026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639aac4f68a8404a8d28bd671f6435a2', 'request_id': 'req-b7b2c2e5-e89a-4039-ba58-192808462ac4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:49.077952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] The token cache is being invalidate because project 639aac4f68a8404a8d28bd671f6435a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:49.078259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:49.080837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b7b2c2e5-e89a-4039-ba58-192808462ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:49.092637 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1858/3748] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:48 2022] DELETE /identity/v3/projects/639aac4f68a8404a8d28bd671f6435a2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:49.097695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929cfd5-effe-4832-bd8d-e855bbdc59f5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:49.098528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929cfd5-effe-4832-bd8d-e855bbdc59f5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:49.099054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929cfd5-effe-4832-bd8d-e855bbdc59f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:49.157090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9929cfd5-effe-4832-bd8d-e855bbdc59f5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:49.161392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9929cfd5-effe-4832-bd8d-e855bbdc59f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:49.315406 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1891/3749] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:49.323536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0025-7be0-41ee-b459-7744a5fb2cfe None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:49.323536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0025-7be0-41ee-b459-7744a5fb2cfe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:49.324184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe0025-7be0-41ee-b459-7744a5fb2cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:49.371040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5efe0025-7be0-41ee-b459-7744a5fb2cfe None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:49.377123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5efe0025-7be0-41ee-b459-7744a5fb2cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:49.411975 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1859/3750] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:49.416546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929cfd5-effe-4832-bd8d-e855bbdc59f5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:49.434799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929cfd5-effe-4832-bd8d-e855bbdc59f5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:49.447761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:49.450285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:49.451097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:49.453417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:49.454486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:49.455750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:49.460225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:49.499172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1892/3751] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:49.504461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe0025-7be0-41ee-b459-7744a5fb2cfe None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:49.518057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe0025-7be0-41ee-b459-7744a5fb2cfe None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:49.534479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:49.535820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:49.535820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:49.536027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:49.536558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:49.540432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:49.676891 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1860/3752] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:49 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:49.680373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:49.708372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbf931-85a4-4346-a9a7-8a988e7af100 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:49.838004 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:49.868878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:49.870794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:49.871092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:49.872525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:49.876647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:49.879827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:50.032974 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1893/3753] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:49 2022] POST /identity/v3/users => generated 289 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:50.037580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:50.053243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f0d7-750e-422f-ae50-d89857b0f842 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:50.060272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:50.061412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:50.061976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:50.067240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:50.067240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:50.067240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:50.081648 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1861/3754] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:50.085837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:50.098129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58fdb-328d-47f5-9f3c-bf488c652cc7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:50.116045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09014e-f709-45f3-af0a-bb21d03954ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:50.116897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09014e-f709-45f3-af0a-bb21d03954ff admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:50.117283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09014e-f709-45f3-af0a-bb21d03954ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:50.117901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09014e-f709-45f3-af0a-bb21d03954ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:50.118457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09014e-f709-45f3-af0a-bb21d03954ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:50.120170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09014e-f709-45f3-af0a-bb21d03954ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:50.156484 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1894/3755] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:50.157669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:50.176144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba1fe3-6c6b-4c6c-a57c-b59b8fdcf9d4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:50.199555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:50.199555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:50.199555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:50.199555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] PATH_INFO: `/v3/projects/7336417668d84b1293aa53105b8eb365/users/687294ece2084222b6a12f752b1059da/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:50.255456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7336417668d84b1293aa53105b8eb365, user_id=687294ece2084222b6a12f752b1059da, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:50.271401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:50.379471 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1862/3756] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:50 2022] PUT /identity/v3/projects/7336417668d84b1293aa53105b8eb365/users/687294ece2084222b6a12f752b1059da/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:50.403501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0e5b-b4c6-41b4-b95d-edc4b5697ea9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:50.404176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0e5b-b4c6-41b4-b95d-edc4b5697ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:50.404720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0e5b-b4c6-41b4-b95d-edc4b5697ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:50.471872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-185a0e5b-b4c6-41b4-b95d-edc4b5697ea9 None None] MFA Rules not processed for user `687294ece2084222b6a12f752b1059da`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:50.473292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-185a0e5b-b4c6-41b4-b95d-edc4b5697ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:50.615746 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1895/3757] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:50.620723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:50.637793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d439cbb-bd75-4c21-945b-efaf83179b2b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:50.648294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7eb03-7a69-419c-8e8e-e66b3aa67ab0 tempest-DefaultDomainTestJSON-371657810 tempest-DefaultDomainTestJSON-371657810-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687294ece2084222b6a12f752b1059da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7336417668d84b1293aa53105b8eb365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:50.649402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7eb03-7a69-419c-8e8e-e66b3aa67ab0 tempest-DefaultDomainTestJSON-371657810 tempest-DefaultDomainTestJSON-371657810-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:50.649942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7eb03-7a69-419c-8e8e-e66b3aa67ab0 tempest-DefaultDomainTestJSON-371657810 tempest-DefaultDomainTestJSON-371657810-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:50.650446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7eb03-7a69-419c-8e8e-e66b3aa67ab0 tempest-DefaultDomainTestJSON-371657810 tempest-DefaultDomainTestJSON-371657810-project] PATH_INFO: `/v3/domains/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:50.655187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7eb03-7a69-419c-8e8e-e66b3aa67ab0 tempest-DefaultDomainTestJSON-371657810 tempest-DefaultDomainTestJSON-371657810-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:50.660633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7eb03-7a69-419c-8e8e-e66b3aa67ab0 tempest-DefaultDomainTestJSON-371657810 tempest-DefaultDomainTestJSON-371657810-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:50.673699 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1863/3758] 10.222.0.59 () {58 vars in 1152 bytes} [Sun Aug 28 01:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:50.678542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a0e5b-b4c6-41b4-b95d-edc4b5697ea9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:50.813948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a0e5b-b4c6-41b4-b95d-edc4b5697ea9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:50.820957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:50.822024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:50.822312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:50.822592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] PATH_INFO: `/v3/users/687294ece2084222b6a12f752b1059da` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:50.823812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687294ece2084222b6a12f752b1059da)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:50.825873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:51.423488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687294ece2084222b6a12f752b1059da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:51.423488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687294ece2084222b6a12f752b1059da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:51.865191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687294ece2084222b6a12f752b1059da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:51.873023 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:51.881143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687294ece2084222b6a12f752b1059da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:51.883469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687294ece2084222b6a12f752b1059da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:51.926856 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1896/3759] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:24:50 2022] DELETE /identity/v3/users/687294ece2084222b6a12f752b1059da => generated 0 bytes in 1249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:51.931257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:51.931799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:51.931799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:52.039413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:52.061497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:52.212516 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:52.259304 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1864/3760] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:24:52.287954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:52.290550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:52.452284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2625a5-94a2-413d-8b56-9a3c08f39322 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:52.472969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba7f12-2ef4-4562-bf4f-8e99365e1ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:52.472969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7f12-2ef4-4562-bf4f-8e99365e1ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:52.473343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7f12-2ef4-4562-bf4f-8e99365e1ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:52.473786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba7f12-2ef4-4562-bf4f-8e99365e1ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:52.507951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba7f12-2ef4-4562-bf4f-8e99365e1ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:52.509715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba7f12-2ef4-4562-bf4f-8e99365e1ed2 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:52.550090 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1897/3761] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:54.406669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:54.412105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:54.451960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf35d1-a9d8-4eab-84ce-50bae199415a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:54.459496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:54.460678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:54.461186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:54.461675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] PATH_INFO: `/v3/projects/7336417668d84b1293aa53105b8eb365` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:54.463099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7336417668d84b1293aa53105b8eb365)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:54.465177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:54.678881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7336417668d84b1293aa53105b8eb365', 'request_id': 'req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:54.698896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7336417668d84b1293aa53105b8eb365', 'request_id': 'req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:54.803965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7336417668d84b1293aa53105b8eb365', 'request_id': 'req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:54.825131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] The token cache is being invalidate because project 7336417668d84b1293aa53105b8eb365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:24:54.825711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:54.826796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a0c933f-3b1e-4758-bedc-02bd5ab6888c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:24:54.830326 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1865/3762] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:24:54 2022] DELETE /identity/v3/projects/7336417668d84b1293aa53105b8eb365 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:54.836801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62546fb-8a37-4abb-bd4a-63df747d9bf8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:54.837260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62546fb-8a37-4abb-bd4a-63df747d9bf8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:54.837747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62546fb-8a37-4abb-bd4a-63df747d9bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:54.890643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f62546fb-8a37-4abb-bd4a-63df747d9bf8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:54.896635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f62546fb-8a37-4abb-bd4a-63df747d9bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:55.176120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1898/3763] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:55.180448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de5e8-edfa-4c41-8c14-f88a63736196 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:55.180875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de5e8-edfa-4c41-8c14-f88a63736196 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:55.181256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de5e8-edfa-4c41-8c14-f88a63736196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:55.233390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cf9de5e8-edfa-4c41-8c14-f88a63736196 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:55.237495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cf9de5e8-edfa-4c41-8c14-f88a63736196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:55.274863 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1866/3764] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:55.278860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62546fb-8a37-4abb-bd4a-63df747d9bf8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:55.290847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62546fb-8a37-4abb-bd4a-63df747d9bf8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:55.329963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:55.330898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:55.331334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:55.332711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:55.334236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:24:55.337274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:55.348374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:55.392561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9de5e8-edfa-4c41-8c14-f88a63736196 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:55.400161 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1899/3765] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:24:55.410735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9de5e8-edfa-4c41-8c14-f88a63736196 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:55.434772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:55.435417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:55.435780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:55.436662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:55.437308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:55.439893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:55.602014 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1867/3766] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:55.605945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:55.617579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba5fae-ea8f-44b4-9326-35643c595b9b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:55.762627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:55.763301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:55.763584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:55.763891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:55.764539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:55.766556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:55.793989 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:55.893313 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1900/3767] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:55 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:55.894010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:55.912977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c5e9-8710-4885-828d-1c7ef85fb88b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:55.930465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:55.931783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:55.932237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:55.933099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:55.933966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:55.936430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:55.963275 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1868/3768] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:24:55.968896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:55.993301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d42c71-0c6e-4f23-a057-fee067f76bdc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:56.005951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1b2a2-8ed2-47d3-8ce9-1c6b306492b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:56.005951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b2a2-8ed2-47d3-8ce9-1c6b306492b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:56.005951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b2a2-8ed2-47d3-8ce9-1c6b306492b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:56.005951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1b2a2-8ed2-47d3-8ce9-1c6b306492b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:56.006647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1b2a2-8ed2-47d3-8ce9-1c6b306492b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:56.018764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1b2a2-8ed2-47d3-8ce9-1c6b306492b0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:56.097391 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1901/3769] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:56.097634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:56.138060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd05fc4-09b4-4468-90b2-25812b2595fb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:56.162333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:56.164223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:56.164962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:56.165268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] PATH_INFO: `/v3/projects/986a471fdd954b1984432d1a5ae90cbc/users/fddf21ef02e94cbcaf259e91620d8cd6/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:56.227206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=986a471fdd954b1984432d1a5ae90cbc, user_id=fddf21ef02e94cbcaf259e91620d8cd6, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:56.231694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:56.349655 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1869/3770] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:56 2022] PUT /identity/v3/projects/986a471fdd954b1984432d1a5ae90cbc/users/fddf21ef02e94cbcaf259e91620d8cd6/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:56.367283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed3f65-5337-4cf7-a732-bf3726842bcb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:56.367949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed3f65-5337-4cf7-a732-bf3726842bcb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:56.368311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed3f65-5337-4cf7-a732-bf3726842bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:56.446606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d9ed3f65-5337-4cf7-a732-bf3726842bcb None None] MFA Rules not processed for user `fddf21ef02e94cbcaf259e91620d8cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:56.448082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d9ed3f65-5337-4cf7-a732-bf3726842bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:56.607874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1902/3771] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:56.614792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:56.842867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3df003-8a59-4450-a86c-420fd6ced89b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:56.851536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:56.852562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:56.853259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:56.869304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:56.870728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:56.874563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:56.898619 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:57.037438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed3f65-5337-4cf7-a732-bf3726842bcb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:57.038186 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1870/3772] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:24:56 2022] POST /identity/v3/projects => generated 385 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:24:57.061118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed3f65-5337-4cf7-a732-bf3726842bcb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:57.177057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:57.177734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:57.178132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:57.178486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:57.179584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:57.181715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:57.319602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:57.328980 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1903/3773] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:24:57 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:24:57.336761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5ed6-2c68-49bb-becb-c53f81f2b022 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:57.354584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:57.355190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:57.355477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:57.355757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:57.356421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:57.364791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:57.409479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:57.411996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1871/3774] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:57.425916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a635066-2bfc-46d4-ac19-ca4f72c1c122 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:57.448455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc8e9f-9096-47f9-b688-12e7fc7ee1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:57.449144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8e9f-9096-47f9-b688-12e7fc7ee1eb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:57.449430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8e9f-9096-47f9-b688-12e7fc7ee1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:57.449707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8e9f-9096-47f9-b688-12e7fc7ee1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:57.453453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc8e9f-9096-47f9-b688-12e7fc7ee1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:57.458953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc8e9f-9096-47f9-b688-12e7fc7ee1eb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:57.551057 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1904/3775] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:24:57.555333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:57.582452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f03911-5d5e-49c9-a8e4-a1ac36e128de admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:57.604974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:57.608799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:57.611257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:57.617121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] PATH_INFO: `/v3/projects/705119da24204d798d73d49d3d6df040/users/a9bf1a2518144632946c4fe105461b54/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:57.667603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=705119da24204d798d73d49d3d6df040, user_id=a9bf1a2518144632946c4fe105461b54, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:57.676113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:57.836350 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1872/3776] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:24:57 2022] PUT /identity/v3/projects/705119da24204d798d73d49d3d6df040/users/a9bf1a2518144632946c4fe105461b54/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:24:57.840221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c4dd-ce26-47bc-9144-b153bf4984b4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:57.840545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c4dd-ce26-47bc-9144-b153bf4984b4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:57.840899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49c4dd-ce26-47bc-9144-b153bf4984b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:58.022485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8f49c4dd-ce26-47bc-9144-b153bf4984b4 None None] MFA Rules not processed for user `a9bf1a2518144632946c4fe105461b54`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:24:58.032997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f49c4dd-ce26-47bc-9144-b153bf4984b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:58.174242 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:58.213044 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1905/3777] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:24:58.220176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:58.223631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:58.464675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd518e0a-6637-4112-a292-34dfa7cbcc04 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:58.470036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:58.470678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:58.470959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:58.471233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:58.605879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:58.607495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:58.619376 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1873/3778] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:24:59.095369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49c4dd-ce26-47bc-9144-b153bf4984b4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:59.116153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49c4dd-ce26-47bc-9144-b153bf4984b4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:59.140408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:59.141549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:59.142049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:59.142501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:59.176393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:59.182327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:59.225139 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1906/3779] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:00.567353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:00.569127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:00.635522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:00.653897 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:00.690910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7dabb-b93a-4b5b-a9fb-286c54ee8781 service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:00.698747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:00.699803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:00.700306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:00.700815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] PATH_INFO: `/v3/users/b2be15e97a30467db9f6c44ab2e1a3e7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:00.703744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2be15e97a30467db9f6c44ab2e1a3e7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:00.706581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:00.759083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a126-7281-428f-a7ad-c4e6e40db2c5 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:00.764816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:00.766443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:00.766914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:00.767354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] PATH_INFO: `/v3/users/fddf21ef02e94cbcaf259e91620d8cd6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:00.769860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddf21ef02e94cbcaf259e91620d8cd6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:00.773541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:00.909032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2be15e97a30467db9f6c44ab2e1a3e7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:00.924304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2be15e97a30467db9f6c44ab2e1a3e7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:00.937623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2be15e97a30467db9f6c44ab2e1a3e7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:00.937623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2be15e97a30467db9f6c44ab2e1a3e7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.021436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2be15e97a30467db9f6c44ab2e1a3e7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.029126 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1874/3780] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:00 2022] DELETE /identity/v3/users/b2be15e97a30467db9f6c44ab2e1a3e7 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:01.030782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:01.039379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:01.057659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddf21ef02e94cbcaf259e91620d8cd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.063115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddf21ef02e94cbcaf259e91620d8cd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.163558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddf21ef02e94cbcaf259e91620d8cd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.167909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65b435-d6ea-499a-b52b-208bd39b256a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:01.175708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5ebd5-ae11-4928-873b-9d01d02023d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:01.176431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddf21ef02e94cbcaf259e91620d8cd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.177002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5ebd5-ae11-4928-873b-9d01d02023d8 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:01.177337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddf21ef02e94cbcaf259e91620d8cd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.177652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5ebd5-ae11-4928-873b-9d01d02023d8 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:01.178997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5ebd5-ae11-4928-873b-9d01d02023d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:01.182531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0de5ebd5-ae11-4928-873b-9d01d02023d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:01.218268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5ebd5-ae11-4928-873b-9d01d02023d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:01.220665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5ebd5-ae11-4928-873b-9d01d02023d8 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:01.223082 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1907/3781] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:00 2022] DELETE /identity/v3/users/fddf21ef02e94cbcaf259e91620d8cd6 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:01.224884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:01.227644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:01.241339 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1875/3782] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:01.242877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:01.243384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:01.243728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:01.280688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:01.280943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:01.355604 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:01.377422 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:01.385479 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1876/3783] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:01.400808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9648a3-da75-4f97-a83d-6f1cf415b5fd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:01.407594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:01.409025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:01.417344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:01.417344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:01.417344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:01.418497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] PATH_INFO: `/v3/users/67e550a0e9044ea187299e8b2f5b434a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:01.421362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e550a0e9044ea187299e8b2f5b434a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:01.427395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:01.489925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f123b7-32ec-4d20-8f96-788fb5726a4c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:01.494056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:01.494745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:01.495094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:01.496036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:01.507432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:01.508940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:01.520375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1877/3784] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:25:01.638676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e550a0e9044ea187299e8b2f5b434a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.639705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e550a0e9044ea187299e8b2f5b434a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.703203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e550a0e9044ea187299e8b2f5b434a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.712701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e550a0e9044ea187299e8b2f5b434a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.713489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afeedc0b-6101-4fa7-a78a-845204aea33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e550a0e9044ea187299e8b2f5b434a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:01.753147 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1908/3785] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:01 2022] DELETE /identity/v3/users/67e550a0e9044ea187299e8b2f5b434a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:01.915896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:01.917488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:01.933197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406608f-7d49-4f58-b1ab-16c2ad61c09c service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:02.000047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:02.000837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.001128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.001406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] PATH_INFO: `/v3/projects/50ad9843fdef44a7a4d89fcac45106d5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.003267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ad9843fdef44a7a4d89fcac45106d5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:02.005391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:02.180082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ad9843fdef44a7a4d89fcac45106d5', 'request_id': 'req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.189307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ad9843fdef44a7a4d89fcac45106d5', 'request_id': 'req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.244615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ad9843fdef44a7a4d89fcac45106d5', 'request_id': 'req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.274284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] The token cache is being invalidate because project 50ad9843fdef44a7a4d89fcac45106d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:02.274661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.275310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.277123 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1878/3786] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:01 2022] DELETE /identity/v3/projects/50ad9843fdef44a7a4d89fcac45106d5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:02.282517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740939-03dd-4ccf-9cc6-06f4c3ea9ab1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.283044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740939-03dd-4ccf-9cc6-06f4c3ea9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.283478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740939-03dd-4ccf-9cc6-06f4c3ea9ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.306536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ad740939-03dd-4ccf-9cc6-06f4c3ea9ab1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:02.308084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ad740939-03dd-4ccf-9cc6-06f4c3ea9ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:02.386775 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1909/3787] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:02.389506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:02.390248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8cfa-796d-41ef-aa74-5d6f6d6b8b05 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.390545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8cfa-796d-41ef-aa74-5d6f6d6b8b05 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.390824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8cfa-796d-41ef-aa74-5d6f6d6b8b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.393517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:02.418684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-42ea8cfa-796d-41ef-aa74-5d6f6d6b8b05 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:02.421198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-42ea8cfa-796d-41ef-aa74-5d6f6d6b8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:02.441966 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1910/3788] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:02.444474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8cfa-796d-41ef-aa74-5d6f6d6b8b05 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:02.456190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432b1c2-23dc-4a66-a34b-ba79dfd6b5a9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:02.458735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8cfa-796d-41ef-aa74-5d6f6d6b8b05 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:02.468982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:02.469622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.470011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.470296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.474484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:02.474484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:02.474680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:02.474680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.474680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.474680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] PATH_INFO: `/v3/projects/5c83cbefc0494bcca8a8a5ead3902d70` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.475072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:02.475176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c83cbefc0494bcca8a8a5ead3902d70)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:02.476169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:02.488298 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1911/3789] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:25:02.494850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:02.502195 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:02.511074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88033513-64bd-4566-92fb-5c6e61c7b347 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:02.517564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:02.518275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.518556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.518997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.519944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:02.522381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:02.612153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c83cbefc0494bcca8a8a5ead3902d70', 'request_id': 'req-756c1302-d463-45d2-9011-2dcc6e5b62aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.624435 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1912/3790] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:02 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:02.628349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:02.639669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c83cbefc0494bcca8a8a5ead3902d70', 'request_id': 'req-756c1302-d463-45d2-9011-2dcc6e5b62aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.672197 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:02.711880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea7276-9613-4df2-b5d5-2de63a7092ed admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:02.724830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:02.725990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.726432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.726762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.729193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:02.729727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c83cbefc0494bcca8a8a5ead3902d70', 'request_id': 'req-756c1302-d463-45d2-9011-2dcc6e5b62aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.731653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:02.760158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] The token cache is being invalidate because project 5c83cbefc0494bcca8a8a5ead3902d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:02.760833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.762100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-756c1302-d463-45d2-9011-2dcc6e5b62aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:02.771494 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1879/3791] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:02 2022] DELETE /identity/v3/projects/5c83cbefc0494bcca8a8a5ead3902d70 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:02.772920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b3f22-db91-45ca-b31e-48208ecbd739 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.774138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b3f22-db91-45ca-b31e-48208ecbd739 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.774603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b3f22-db91-45ca-b31e-48208ecbd739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.807083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8c0b3f22-db91-45ca-b31e-48208ecbd739 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:02.809511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8c0b3f22-db91-45ca-b31e-48208ecbd739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:02.819208 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1880/3792] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:02.829925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.830155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.830434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.853940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1913/3793] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:02 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:02.855371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:02.859585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:02.879349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97afe0-8220-4062-8bef-8417ff3da603 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:02.884436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:02.884717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.885161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.885369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] PATH_INFO: `/v3/projects/986a471fdd954b1984432d1a5ae90cbc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.886768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986a471fdd954b1984432d1a5ae90cbc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:02.889981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:02.897773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:02.899037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:02.934260 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1881/3794] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:02.934260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:02.939863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:02.969688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421267-7960-47b7-95b1-7658ac73fd52 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:02.988449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:02.988449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:02.988449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:02.988449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:02.988879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:02.988879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.001079 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1882/3795] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:03.001999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.012656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec42e-56e0-4aad-b433-53a6b0e77bf2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.018635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.019411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.019700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.022122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.022122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:03.022122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.022585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.039585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1883/3796] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:03.040425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.051296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439017b-d0a0-493b-85f9-35ee12f261ff admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.066715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986a471fdd954b1984432d1a5ae90cbc', 'request_id': 'req-f76bd772-b227-46ed-bfa7-034420c61bb8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.074759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986a471fdd954b1984432d1a5ae90cbc', 'request_id': 'req-f76bd772-b227-46ed-bfa7-034420c61bb8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.115038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.115681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.115951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.116370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.117125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.118684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.129496 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1884/3797] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:03.130320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.140252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150208bd-9087-421b-bea4-0e055358dafa admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.146193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.148658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.148658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.148658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.148658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.149838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.168301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986a471fdd954b1984432d1a5ae90cbc', 'request_id': 'req-f76bd772-b227-46ed-bfa7-034420c61bb8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.180406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] The token cache is being invalidate because project 986a471fdd954b1984432d1a5ae90cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:03.180621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.181282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.183196 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1914/3798] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:02 2022] DELETE /identity/v3/projects/986a471fdd954b1984432d1a5ae90cbc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:03.183872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.185159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:03.198379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd772-b227-46ed-bfa7-034420c61bb8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.203143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.203792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.205835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.205835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] PATH_INFO: `/v3/projects/747a7385561d49c8b1659a38999246d6/users/b6fd46ce61784787801118b9d98c308b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.219613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a7385561d49c8b1659a38999246d6, user_id=b6fd46ce61784787801118b9d98c308b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.222329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.261085 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1885/3799] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:03 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:03.262310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.264510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:03.323506 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1915/3800] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:03 2022] PUT /identity/v3/projects/747a7385561d49c8b1659a38999246d6/users/b6fd46ce61784787801118b9d98c308b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:03.333429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.335317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:03.359934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6eaaa-f1ea-49eb-9e9d-4a74134e6538 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.433507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7821-ce3d-40f5-afb3-268698f1f0b6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.438662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75761e4d-e48e-435e-abe0-a77d8dfed902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.439269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75761e4d-e48e-435e-abe0-a77d8dfed902 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.439545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75761e4d-e48e-435e-abe0-a77d8dfed902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.439815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75761e4d-e48e-435e-abe0-a77d8dfed902 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.440440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.440584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75761e4d-e48e-435e-abe0-a77d8dfed902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.441409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.441787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.442198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] PATH_INFO: `/v3/users/a9bf1a2518144632946c4fe105461b54` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.442549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75761e4d-e48e-435e-abe0-a77d8dfed902 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.443741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9bf1a2518144632946c4fe105461b54)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.446040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.575707 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1916/3801] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:03 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:03.578145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da43eb0-d00e-4e20-84c6-c1844768c9f4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.578444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da43eb0-d00e-4e20-84c6-c1844768c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.578736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da43eb0-d00e-4e20-84c6-c1844768c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.611634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4da43eb0-d00e-4e20-84c6-c1844768c9f4 None None] MFA Rules not processed for user `b6fd46ce61784787801118b9d98c308b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:03.612918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4da43eb0-d00e-4e20-84c6-c1844768c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:03.713965 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1917/3802] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:03.715571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da43eb0-d00e-4e20-84c6-c1844768c9f4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.729286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da43eb0-d00e-4e20-84c6-c1844768c9f4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.732972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9bf1a2518144632946c4fe105461b54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.735928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33baba-98d4-4b34-98d0-1b23461a24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.736547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33baba-98d4-4b34-98d0-1b23461a24b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.736829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33baba-98d4-4b34-98d0-1b23461a24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.737106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33baba-98d4-4b34-98d0-1b23461a24b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.737753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33baba-98d4-4b34-98d0-1b23461a24b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.739633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33baba-98d4-4b34-98d0-1b23461a24b9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.747687 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:03.749174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9bf1a2518144632946c4fe105461b54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.751421 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1918/3803] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:03.752884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.753174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.753451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.765461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9bf1a2518144632946c4fe105461b54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.766310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9bf1a2518144632946c4fe105461b54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.778786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] MFA Rules not processed for user `b6fd46ce61784787801118b9d98c308b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:03.780109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:03.787383 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1919/3804] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:03.788359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.789582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:03.810227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1475c-2f69-400e-8b77-b6e98079cc2c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.816881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.817744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.818051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.818328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.818977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.820584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:03.835798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1920/3805] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:03.835798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.838595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:03.854709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9bf1a2518144632946c4fe105461b54'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:03.865194 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1886/3806] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:03 2022] DELETE /identity/v3/users/a9bf1a2518144632946c4fe105461b54 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:03.865194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:03.936362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51f35-2551-4c38-94bf-c142497fb66d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.940775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c0764-522a-4894-805b-392b6add90b2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:03.942393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff08c29-a1ff-4494-87b8-77b159d0d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:03.943548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff08c29-a1ff-4494-87b8-77b159d0d378 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:03.943766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff08c29-a1ff-4494-87b8-77b159d0d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:03.944481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff08c29-a1ff-4494-87b8-77b159d0d378 admin admin] PATH_INFO: `/v3/projects/099ca69b6323439092d6b2f6bbd8e657/users/1f4386dc076e45169800276afc1d6c70/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:03.962746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff08c29-a1ff-4494-87b8-77b159d0d378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099ca69b6323439092d6b2f6bbd8e657, user_id=1f4386dc076e45169800276afc1d6c70, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:03.965487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff08c29-a1ff-4494-87b8-77b159d0d378 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:04.018316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:04.018934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:04.019217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:04.019493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:04.021308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:04.086215 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1887/3807] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:03 2022] PUT /identity/v3/projects/099ca69b6323439092d6b2f6bbd8e657/users/1f4386dc076e45169800276afc1d6c70/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:04.089367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bba3d-7840-4d3b-a5a2-3049984b0b95 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:04.089823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bba3d-7840-4d3b-a5a2-3049984b0b95 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:04.090216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bba3d-7840-4d3b-a5a2-3049984b0b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:04.090794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:04.093655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:04.110677 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1921/3808] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:04.128468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2d3bba3d-7840-4d3b-a5a2-3049984b0b95 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:04.128468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2d3bba3d-7840-4d3b-a5a2-3049984b0b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:04.208637 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:04.210315 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1888/3809] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:04.217029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:04.218906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:04.311687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ff378-7c0d-45a3-b3dc-5f10615565da service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:04.364358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:04.364976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:04.365257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:04.365529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:04.375457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:04.376950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:04.394055 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1922/3810] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:04.689787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5e1b-3e56-47dd-9533-95764a0fadf3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:04.690173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5e1b-3e56-47dd-9533-95764a0fadf3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:04.690456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5e1b-3e56-47dd-9533-95764a0fadf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:04.730686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d11b5e1b-3e56-47dd-9533-95764a0fadf3 None None] MFA Rules not processed for user `b6fd46ce61784787801118b9d98c308b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:04.732145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d11b5e1b-3e56-47dd-9533-95764a0fadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:04.814175 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1889/3811] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:05.508787 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:05.776856 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:05.828412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:05.831343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:05.861999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95ff6b-3651-433d-9628-00024ce1a7fb service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:05.886254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:05.886919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:05.887196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:05.890969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] PATH_INFO: `/v3/projects/705119da24204d798d73d49d3d6df040` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:05.895240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=705119da24204d798d73d49d3d6df040)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:05.901725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:06.062470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:06.063456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:06.063901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:06.094291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705119da24204d798d73d49d3d6df040', 'request_id': 'req-68081f6d-fd46-4dc5-819c-8e77b7c831b1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:06.101039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:06.102843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:06.103551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705119da24204d798d73d49d3d6df040', 'request_id': 'req-68081f6d-fd46-4dc5-819c-8e77b7c831b1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:06.181277 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1890/3812] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:06.187480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705119da24204d798d73d49d3d6df040', 'request_id': 'req-68081f6d-fd46-4dc5-819c-8e77b7c831b1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:06.198964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:06.200434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:06.201263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] The token cache is being invalidate because project 705119da24204d798d73d49d3d6df040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:06.201995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:06.202778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68081f6d-fd46-4dc5-819c-8e77b7c831b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:06.205320 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1923/3813] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:05 2022] DELETE /identity/v3/projects/705119da24204d798d73d49d3d6df040 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:06.211527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac417c80-5c6e-438d-9cc3-ef57e3ec928d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:06.214454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac417c80-5c6e-438d-9cc3-ef57e3ec928d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:06.214454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac417c80-5c6e-438d-9cc3-ef57e3ec928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:06.249918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ac417c80-5c6e-438d-9cc3-ef57e3ec928d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:06.251749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac417c80-5c6e-438d-9cc3-ef57e3ec928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:06.316384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f710e-ea19-4286-9ea0-b084bc4e43f3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:06.323312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bd7c9-5c5f-4c0e-b4c1-87fbaa5660fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:06.323947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd7c9-5c5f-4c0e-b4c1-87fbaa5660fd service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:06.324234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd7c9-5c5f-4c0e-b4c1-87fbaa5660fd service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:06.324555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bd7c9-5c5f-4c0e-b4c1-87fbaa5660fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:06.328184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-883bd7c9-5c5f-4c0e-b4c1-87fbaa5660fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:06.343298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd7c9-5c5f-4c0e-b4c1-87fbaa5660fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:06.345092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bd7c9-5c5f-4c0e-b4c1-87fbaa5660fd service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:06.372139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1891/3814] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:25:06.401746 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1924/3815] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:06.411185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56ffb-9878-4cb1-872a-16147beeb05d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:06.411479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56ffb-9878-4cb1-872a-16147beeb05d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:06.411781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe56ffb-9878-4cb1-872a-16147beeb05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:06.440182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5fe56ffb-9878-4cb1-872a-16147beeb05d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:06.441691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5fe56ffb-9878-4cb1-872a-16147beeb05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:06.452489 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1892/3816] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:06.457030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac417c80-5c6e-438d-9cc3-ef57e3ec928d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:06.468355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac417c80-5c6e-438d-9cc3-ef57e3ec928d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:06.479039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:06.480109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:06.480407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:06.480739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:06.481421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:06.481732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:06.483992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:06.525069 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:06.527874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1925/3817] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:06.529116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe56ffb-9878-4cb1-872a-16147beeb05d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:06.543188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe56ffb-9878-4cb1-872a-16147beeb05d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:06.549154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:06.549772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:06.550097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:06.550404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:06.551067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:06.552955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:06.708474 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1893/3818] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:06 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:06.712361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:06.734648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aff5cf-e078-4c70-9a31-b8b2845b0495 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:06.851111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:06.851780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:06.852016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:06.859800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:06.876041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:06.889691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:07.036613 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1926/3819] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:06 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:07.038555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:07.058291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af49ae1-8c94-42da-8fae-f86e784a6c6f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:07.118441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:07.118441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:07.118441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:07.118441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:07.119079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:07.119079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:07.119079 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1894/3820] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:07.119697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:07.133496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19fe6-1210-4ad5-9835-882aa8a99a2d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:07.159506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5c16c-0364-46d9-8110-6848c0d88a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:07.160693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c16c-0364-46d9-8110-6848c0d88a86 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:07.161221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c16c-0364-46d9-8110-6848c0d88a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:07.171712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c16c-0364-46d9-8110-6848c0d88a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:07.176697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5c16c-0364-46d9-8110-6848c0d88a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:07.179113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5c16c-0364-46d9-8110-6848c0d88a86 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:07.208402 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1927/3821] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:07.212426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:07.240664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba78bf-731c-4ea0-9785-fb6b12837ac0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:07.250659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:07.251611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:07.252058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:07.252542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] PATH_INFO: `/v3/projects/deb0f7e313f2487696757689030f1f4f/users/d23694610dc647e0b077e050fc23bdc6/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:07.278230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb0f7e313f2487696757689030f1f4f, user_id=d23694610dc647e0b077e050fc23bdc6, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:07.282219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:07.360348 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1895/3822] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:07 2022] PUT /identity/v3/projects/deb0f7e313f2487696757689030f1f4f/users/d23694610dc647e0b077e050fc23bdc6/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:07.375328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f00500-a9d9-4a29-a58e-5cc10e55695b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:07.375825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f00500-a9d9-4a29-a58e-5cc10e55695b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:07.376776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f00500-a9d9-4a29-a58e-5cc10e55695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:07.457379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-42f00500-a9d9-4a29-a58e-5cc10e55695b None None] MFA Rules not processed for user `d23694610dc647e0b077e050fc23bdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:07.459012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-42f00500-a9d9-4a29-a58e-5cc10e55695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:07.574047 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1928/3823] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:07.587420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:07.595539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:07.749881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6578f97-ea8c-43c4-96b6-447c8e757eb5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:07.753738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8b59d-d77a-424d-be3d-7fb035b8d46c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:07.754702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b59d-d77a-424d-be3d-7fb035b8d46c service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:07.755148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b59d-d77a-424d-be3d-7fb035b8d46c service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:07.755602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b59d-d77a-424d-be3d-7fb035b8d46c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:07.767356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8b59d-d77a-424d-be3d-7fb035b8d46c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:07.769231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8b59d-d77a-424d-be3d-7fb035b8d46c service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:07.781723 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1896/3824] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:08.041762 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:08.551872 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:08.863599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f00500-a9d9-4a29-a58e-5cc10e55695b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:09.061263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f00500-a9d9-4a29-a58e-5cc10e55695b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:09.069992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:09.071449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:09.071840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:09.072219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] PATH_INFO: `/v3/users/d23694610dc647e0b077e050fc23bdc6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:09.074082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23694610dc647e0b077e050fc23bdc6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:09.078934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:09.337850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23694610dc647e0b077e050fc23bdc6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:09.340981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23694610dc647e0b077e050fc23bdc6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:09.444605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23694610dc647e0b077e050fc23bdc6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:09.455742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23694610dc647e0b077e050fc23bdc6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:09.456738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23694610dc647e0b077e050fc23bdc6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:09.480676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1929/3825] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:08 2022] DELETE /identity/v3/users/d23694610dc647e0b077e050fc23bdc6 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:09.484477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:09.485180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:09.485180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:09.526349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:09.531319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:09.648622 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1897/3826] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:09.664013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:09.665706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:09.777529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f52c-6f24-49ad-bb54-ed24e4223664 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:09.788169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296658c-f59c-4c7b-8fb3-42deee3e901c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:09.788950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296658c-f59c-4c7b-8fb3-42deee3e901c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:09.790707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296658c-f59c-4c7b-8fb3-42deee3e901c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:09.791682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296658c-f59c-4c7b-8fb3-42deee3e901c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:09.823603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296658c-f59c-4c7b-8fb3-42deee3e901c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:09.824442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296658c-f59c-4c7b-8fb3-42deee3e901c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:09.855362 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1930/3827] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:10.140374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:10.142335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:10.190851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c662125-9238-47e2-9984-c1e620b1b0dc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:10.197615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:10.198575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:10.199135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:10.199495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] PATH_INFO: `/v3/users/c69ab491e3ba4451baba751279ef3123` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:10.202235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69ab491e3ba4451baba751279ef3123)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:10.204939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:10.231836 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:10.233085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:10.233375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:10.233655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:10.255956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:10.257325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:10.368458 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1931/3828] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:10.430755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69ab491e3ba4451baba751279ef3123'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:10.478635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69ab491e3ba4451baba751279ef3123'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:10.491047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69ab491e3ba4451baba751279ef3123'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:10.492157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69ab491e3ba4451baba751279ef3123'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:10.574017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69ab491e3ba4451baba751279ef3123'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:10.588874 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1898/3829] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:10 2022] DELETE /identity/v3/users/c69ab491e3ba4451baba751279ef3123 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:10.751288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:10.753603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:10.774516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b951eb-b90c-4133-b3c9-c10836ab4291 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:10.875425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:10.876220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:10.876579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:10.876918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] PATH_INFO: `/v3/projects/deb0f7e313f2487696757689030f1f4f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:10.878307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb0f7e313f2487696757689030f1f4f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:10.880319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:11.112296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb0f7e313f2487696757689030f1f4f', 'request_id': 'req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.120578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb0f7e313f2487696757689030f1f4f', 'request_id': 'req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.183660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:11.186059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:11.202042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89ed67-6036-403d-bbf9-67767b856073 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:11.260821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb0f7e313f2487696757689030f1f4f', 'request_id': 'req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.276287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] The token cache is being invalidate because project deb0f7e313f2487696757689030f1f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:11.276865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.278838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4f41d53-3e87-47aa-9476-d46a1e30d2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.283207 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1932/3830] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:10 2022] DELETE /identity/v3/projects/deb0f7e313f2487696757689030f1f4f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:11.288598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548511bf-3d75-433f-8a9b-09052ca71a88 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:11.288897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548511bf-3d75-433f-8a9b-09052ca71a88 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:11.290034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548511bf-3d75-433f-8a9b-09052ca71a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:11.297103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:11.297765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:11.298083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:11.298524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] PATH_INFO: `/v3/projects/0a621f47a1284128962c8f55775b2c9e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:11.303042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a621f47a1284128962c8f55775b2c9e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:11.303042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:11.326467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-548511bf-3d75-433f-8a9b-09052ca71a88 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:11.329952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-548511bf-3d75-433f-8a9b-09052ca71a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:11.342507 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1933/3831] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:11.350109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39512-a152-496c-852c-563031b5957b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:11.350397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39512-a152-496c-852c-563031b5957b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:11.350842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39512-a152-496c-852c-563031b5957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:11.387107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-74f39512-a152-496c-852c-563031b5957b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:11.388716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-74f39512-a152-496c-852c-563031b5957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:11.393766 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:11.405461 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1934/3832] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:11.408189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39512-a152-496c-852c-563031b5957b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:11.419530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39512-a152-496c-852c-563031b5957b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:11.429089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:11.431607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:11.431992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:11.432478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:11.435872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:11.436483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:11.440831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:11.481979 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1935/3833] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:25:11.485199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:11.496584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a621f47a1284128962c8f55775b2c9e', 'request_id': 'req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.512874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70646e2-f90a-48fe-8b15-e4978b586331 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:11.516491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a621f47a1284128962c8f55775b2c9e', 'request_id': 'req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.608857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a621f47a1284128962c8f55775b2c9e', 'request_id': 'req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.628474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] The token cache is being invalidate because project 0a621f47a1284128962c8f55775b2c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:11.629036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.630554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:11.634990 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1899/3834] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:11 2022] DELETE /identity/v3/projects/0a621f47a1284128962c8f55775b2c9e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:11.639228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:11.641366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:11.721723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:11.722634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:11.724082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:11.725155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:11.726842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:11.734592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:11.785622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce147c-b72d-4dfa-8fcd-4083f9682da9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:11.803322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:11.803893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:11.804178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:11.804580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] PATH_INFO: `/v3/users/1a3b46689dca44699e070c473b84a488` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:11.806669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3b46689dca44699e070c473b84a488)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:11.811663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:11.856827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1936/3835] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:11 2022] POST /identity/v3/projects => generated 357 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:11.861326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:11.863163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:11.973742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f43c0-0474-40d6-8c13-f24c2437dc3e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:11.980068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:11.980374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:11.980606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:11.980887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:11.981741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:11.985723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:12.085526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3b46689dca44699e070c473b84a488'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:12.093445 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:12.093676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1937/3836] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:11 2022] POST /identity/v3/users => generated 279 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:12.098152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:12.109266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3b46689dca44699e070c473b84a488'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:12.114139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf37c93-5a6d-4b5c-bc5f-b2126470a001 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:12.117226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3b46689dca44699e070c473b84a488'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:12.118030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3b46689dca44699e070c473b84a488'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:12.119452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:12.120066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:12.120350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:12.120982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:12.121459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:12.123829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:12.138220 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1938/3837] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:12.141766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:12.143852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:12.162302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17f3b-e57e-4c3d-a605-0c5c4c843c17 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:12.167894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:12.168375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:12.168736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:12.168960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:12.170367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:12.172117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:12.189297 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1939/3838] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:12.189560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:12.197834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d368efd3-009a-4331-852d-ef2fe0e3c89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3b46689dca44699e070c473b84a488'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:12.206788 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1900/3839] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:11 2022] DELETE /identity/v3/users/1a3b46689dca44699e070c473b84a488 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:12.241994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1c5d1-a3ea-4922-b55e-89546c7ad6b1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:12.383161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:12.384351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:12.384647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:12.384978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] PATH_INFO: `/v3/projects/d51ab85a16654e6cb96e4ea3295e4209/users/aa860df2d2d247c98e3e534389cd6fd9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:12.430791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51ab85a16654e6cb96e4ea3295e4209, user_id=aa860df2d2d247c98e3e534389cd6fd9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:12.434373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:12.510239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1940/3840] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:12 2022] PUT /identity/v3/projects/d51ab85a16654e6cb96e4ea3295e4209/users/aa860df2d2d247c98e3e534389cd6fd9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:12.521194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f379-a71b-4bad-93d8-e83f7e43a935 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:12.522206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f379-a71b-4bad-93d8-e83f7e43a935 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:12.522685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f379-a71b-4bad-93d8-e83f7e43a935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:12.556810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0356f379-a71b-4bad-93d8-e83f7e43a935 None None] MFA Rules not processed for user `aa860df2d2d247c98e3e534389cd6fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:12.558578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0356f379-a71b-4bad-93d8-e83f7e43a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:12.571482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:12.575751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:12.688798 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1901/3841] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:12.694161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f379-a71b-4bad-93d8-e83f7e43a935 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:12.726465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20a2a9-48f8-4f45-8577-074b8cb03dab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:12.742590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:12.743400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:12.743686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:12.744035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] PATH_INFO: `/v3/projects/16d7c5f8c4dc4541b5970c10270c1319` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:12.746431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d7c5f8c4dc4541b5970c10270c1319)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:12.748933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:12.823486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f379-a71b-4bad-93d8-e83f7e43a935 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:12.830372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:12.831239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:12.831520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:12.831792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:12.832424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:12.834490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:12.882901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d7c5f8c4dc4541b5970c10270c1319', 'request_id': 'req-ad40d528-b27c-4773-9d8a-94465c470330'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:12.889571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d7c5f8c4dc4541b5970c10270c1319', 'request_id': 'req-ad40d528-b27c-4773-9d8a-94465c470330'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:13.009833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1902/3842] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:12 2022] POST /identity/v3/projects => generated 355 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:25:13.013909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.026294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d7c5f8c4dc4541b5970c10270c1319', 'request_id': 'req-ad40d528-b27c-4773-9d8a-94465c470330'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:13.047683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] The token cache is being invalidate because project 16d7c5f8c4dc4541b5970c10270c1319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:13.052938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:13.054602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ad40d528-b27c-4773-9d8a-94465c470330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:13.058938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1941/3843] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:12 2022] DELETE /identity/v3/projects/16d7c5f8c4dc4541b5970c10270c1319 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:13.067124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d970a89-e5ff-4966-b9c0-2c378ca1f432 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.067414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d970a89-e5ff-4966-b9c0-2c378ca1f432 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.067690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d970a89-e5ff-4966-b9c0-2c378ca1f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.112947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5d970a89-e5ff-4966-b9c0-2c378ca1f432 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:13.114629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d970a89-e5ff-4966-b9c0-2c378ca1f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:13.152649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c05deb-d183-4970-873c-a9b0d48ae094 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.163107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.163107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.163107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.163107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.163442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.165960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.225590 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1942/3844] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:13.226181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bf72-c142-4657-a409-f08b332d7c6b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.226538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bf72-c142-4657-a409-f08b332d7c6b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.227349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bf72-c142-4657-a409-f08b332d7c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.255893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-beb4bf72-c142-4657-a409-f08b332d7c6b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:13.261462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-beb4bf72-c142-4657-a409-f08b332d7c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:13.270988 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1943/3845] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:13.271949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bf72-c142-4657-a409-f08b332d7c6b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.285078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bf72-c142-4657-a409-f08b332d7c6b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.291404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.292147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.292438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.293258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.294397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:13.295412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.297062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.314546 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1903/3846] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:13 2022] POST /identity/v3/users => generated 284 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:13.315478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.318057 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1944/3847] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:13.320861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.321025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:13.338307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149adf3-6389-48d0-ab4d-b5e3609512d2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.346423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb512ac-c699-4be1-ac1f-f2538c4a53e6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.347680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.348384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.348744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.349091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.350019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.354509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.355134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.355417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.355691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.356343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.358177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.366103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.375465 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1904/3848] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:13.376358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.387389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb0361-bb3f-4855-b097-85bcb42a6136 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.398631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.400312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.400607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.401117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] PATH_INFO: `/v3/projects/504becf19c984875aa475793d6969ba1/users/d4fca46319d345dbbbda924710cf0371/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.437248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=504becf19c984875aa475793d6969ba1, user_id=d4fca46319d345dbbbda924710cf0371, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.441297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.544297 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1945/3849] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:13 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:13.549596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.578048 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1905/3850] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:13 2022] PUT /identity/v3/projects/504becf19c984875aa475793d6969ba1/users/d4fca46319d345dbbbda924710cf0371/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:13.582225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.681251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e59cb7-0233-45ff-8737-d877fdd8b465 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.722437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf9a2-52e1-413b-8ce8-75df237f41bb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.730173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.731085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.731628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.732142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.733771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.736512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.754327 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1906/3851] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:13.758533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:13.775721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7802f7-721e-4f1f-8702-c1e20b6c7255 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:13.789194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a417ac-3a8e-48f8-a459-dedcf394c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.790034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a417ac-3a8e-48f8-a459-dedcf394c28c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.790468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a417ac-3a8e-48f8-a459-dedcf394c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.790976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a417ac-3a8e-48f8-a459-dedcf394c28c admin admin] PATH_INFO: `/v3/projects/504becf19c984875aa475793d6969ba1/users/d4fca46319d345dbbbda924710cf0371/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.793600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a417ac-3a8e-48f8-a459-dedcf394c28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=504becf19c984875aa475793d6969ba1, user_id=d4fca46319d345dbbbda924710cf0371, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.797907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a417ac-3a8e-48f8-a459-dedcf394c28c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.817139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1907/3852] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:13 2022] PUT /identity/v3/projects/504becf19c984875aa475793d6969ba1/users/d4fca46319d345dbbbda924710cf0371/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:13.839975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81124ff7-7014-46cc-8001-01623b1e0e7d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.841297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81124ff7-7014-46cc-8001-01623b1e0e7d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.842583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81124ff7-7014-46cc-8001-01623b1e0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.843101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:13.843733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:13.844022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:13.844298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:13.845076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:13.847060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:13.900743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-81124ff7-7014-46cc-8001-01623b1e0e7d None None] MFA Rules not processed for user `d4fca46319d345dbbbda924710cf0371`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:13.903084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-81124ff7-7014-46cc-8001-01623b1e0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:13.933469 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:14.014641 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1946/3853] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:13 2022] POST /identity/v3/users => generated 286 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:25:14.020942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:14.026064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:14.033581 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1908/3854] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:14.035334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81124ff7-7014-46cc-8001-01623b1e0e7d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:14.052089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda009b4-b7d7-454c-a21c-515cc5a73a95 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:14.177268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:14.178866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:14.178866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:14.178866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] PATH_INFO: `/v3/users/0635b4466d3d41eb95eb7fef0138437a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:14.180579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0635b4466d3d41eb95eb7fef0138437a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:14.182943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:14.371356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81124ff7-7014-46cc-8001-01623b1e0e7d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:14.381612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:14.382395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:14.383220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:14.383220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:14.383892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:14.385592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:14.401466 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1909/3855] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:14.410148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:14.443212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca64edc-0cb9-41e5-9bf3-bce0f43cdaf3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:14.449949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fca46319d345dbbbda924710cf0371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '504becf19c984875aa475793d6969ba1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:14.450519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:14.462339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:14.462854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:14.463830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:14.464392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:14.466328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:14.486955 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:14.487231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0635b4466d3d41eb95eb7fef0138437a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:14.488033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0635b4466d3d41eb95eb7fef0138437a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:14.493888 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1910/3856] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:14.493888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:14.506038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47514-910a-493c-904d-07d22e1334f3 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:14.511844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:14.512667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:14.512953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:14.515201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:14.515201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:14.516382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:14.557117 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1911/3857] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:14.559183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:14.571283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0635b4466d3d41eb95eb7fef0138437a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:14.580127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5279da-9fe0-471a-8305-09fc7573a2f3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:14.600421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0635b4466d3d41eb95eb7fef0138437a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:14.602316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0635b4466d3d41eb95eb7fef0138437a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:14.603467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fca46319d345dbbbda924710cf0371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '504becf19c984875aa475793d6969ba1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:14.604798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:14.605666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:14.608904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:14.608904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:14.610200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:14.690273 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1947/3858] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:14 2022] DELETE /identity/v3/users/0635b4466d3d41eb95eb7fef0138437a => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:14.692559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:14.697873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:14.780680 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1912/3859] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:14 2022] POST /identity/v3/projects => generated 350 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:14.785891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:14.793461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:14.864394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e40fc-7964-4af4-9448-06dfc154e635 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:15.063795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0963b15-065c-4b75-bb48-23fabbd92b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:15.066975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963b15-065c-4b75-bb48-23fabbd92b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:15.068130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963b15-065c-4b75-bb48-23fabbd92b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:15.069990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963b15-065c-4b75-bb48-23fabbd92b57 admin admin] PATH_INFO: `/v3/projects/0803fc2a6e864c18aca182d04ad26636/users/460d59f33144414983cb72d71c82d64a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:15.112842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0963b15-065c-4b75-bb48-23fabbd92b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0803fc2a6e864c18aca182d04ad26636, user_id=460d59f33144414983cb72d71c82d64a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:15.117381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e1d98-e5c2-4b40-b422-6dc9973443b7 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:15.118371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0963b15-065c-4b75-bb48-23fabbd92b57 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:15.141122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fca46319d345dbbbda924710cf0371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '504becf19c984875aa475793d6969ba1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:15.142343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:15.143448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:15.143662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:15.145007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:15.145680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:15.156271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:15.199018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1913/3860] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:15.212898 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1948/3861] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:14 2022] PUT /identity/v3/projects/0803fc2a6e864c18aca182d04ad26636/users/460d59f33144414983cb72d71c82d64a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:15.224225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:15.226237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:15.227549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:15.227549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:15.229118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:15.315193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] MFA Rules not processed for user `460d59f33144414983cb72d71c82d64a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:15.316979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:15.354489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24ae3a-29f6-4ef8-af4b-f8d4cfe5ff15 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:15.429035 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1949/3862] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:15.448383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:15.451406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:15.461900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:15.462551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:15.463313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:15.463313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:15.582759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:15.584401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:15.598522 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1914/3863] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:15.603782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbf728-eb77-483f-a5b5-f0f206b39bbb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:15.611007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6c1f0-f026-40bf-bb39-80005e3945bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:15.611007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c1f0-f026-40bf-bb39-80005e3945bd service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:15.611345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c1f0-f026-40bf-bb39-80005e3945bd service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:15.611591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c1f0-f026-40bf-bb39-80005e3945bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:15.624168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6c1f0-f026-40bf-bb39-80005e3945bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:15.626233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6c1f0-f026-40bf-bb39-80005e3945bd service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:15.650705 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1950/3864] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:15.782471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:15.784702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:15.899740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b01d56-4a28-48a2-a2d0-e9aec82be4f9 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:15.909852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:15.910600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:15.910898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:15.911869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] PATH_INFO: `/v3/projects/3b528f2bca9e41c38140b291d97777e9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:15.913278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b528f2bca9e41c38140b291d97777e9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:15.915438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:16.072906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b528f2bca9e41c38140b291d97777e9', 'request_id': 'req-69b574d5-9c4d-497d-a923-014ee5f7918f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.081611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b528f2bca9e41c38140b291d97777e9', 'request_id': 'req-69b574d5-9c4d-497d-a923-014ee5f7918f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.135090 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:16.232562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b528f2bca9e41c38140b291d97777e9', 'request_id': 'req-69b574d5-9c4d-497d-a923-014ee5f7918f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.268906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] The token cache is being invalidate because project 3b528f2bca9e41c38140b291d97777e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:16.274335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.275664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.282720 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1915/3865] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:15 2022] DELETE /identity/v3/projects/3b528f2bca9e41c38140b291d97777e9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:16.283953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e01f-4349-40b6-8302-989718521001 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:16.284249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e01f-4349-40b6-8302-989718521001 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:16.284530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e01f-4349-40b6-8302-989718521001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:16.335344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7e43e01f-4349-40b6-8302-989718521001 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:16.337250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7e43e01f-4349-40b6-8302-989718521001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:16.343804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:16.346345 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:16.347569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:16.465462 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1951/3866] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:16.468053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6b2f4-cb1e-4f25-8261-7e6504af85ca None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:16.468348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6b2f4-cb1e-4f25-8261-7e6504af85ca None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:16.468812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6b2f4-cb1e-4f25-8261-7e6504af85ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:16.486128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b574d5-9c4d-497d-a923-014ee5f7918f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:16.501540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fca46319d345dbbbda924710cf0371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '504becf19c984875aa475793d6969ba1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:16.502402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:16.502527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:16.502786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] PATH_INFO: `/v3/projects/a12d611c0df34aa2be1d49750cccb520` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:16.504956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a12d611c0df34aa2be1d49750cccb520)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:16.506911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:16.511814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1ed6b2f4-cb1e-4f25-8261-7e6504af85ca None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:16.513954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ed6b2f4-cb1e-4f25-8261-7e6504af85ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:16.528702 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1952/3867] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:16.533220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6b2f4-cb1e-4f25-8261-7e6504af85ca None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:16.549417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6b2f4-cb1e-4f25-8261-7e6504af85ca None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:16.556705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:16.557876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:16.558238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:16.565893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:16.565893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:16.565893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:16.565893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:16.581859 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1953/3868] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:16.585847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:16.619332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1d370-9266-4e43-9b74-3ae7f963f69d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:16.631578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:16.632280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:16.632723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:16.635285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:16.635285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:16.636781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:16.764209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1954/3869] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:16 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:16.766398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:16.771949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12d611c0df34aa2be1d49750cccb520', 'request_id': 'req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.790620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12d611c0df34aa2be1d49750cccb520', 'request_id': 'req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.870946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12d611c0df34aa2be1d49750cccb520', 'request_id': 'req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.875530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a21c-28ca-46cc-97d1-112a01175ef2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:16.887371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:16.888211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:16.889703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:16.890316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:16.891630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:16.896594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:16.900735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] The token cache is being invalidate because project a12d611c0df34aa2be1d49750cccb520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:16.901040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.907796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:16.912769 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1916/3870] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:16 2022] DELETE /identity/v3/projects/a12d611c0df34aa2be1d49750cccb520 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:16.921847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:16.927484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:17.000110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1955/3871] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:16 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:17.003862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:17.008770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:17.036068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afe6df-d414-4bab-8de3-0a195d491a82 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:17.049721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:17.050382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.050668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.050944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.051603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:17.057869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:17.069721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d7d0-6fa6-467b-8d49-86c0b7f29eb2 tempest-QuotasTest-233108393 tempest-QuotasTest-233108393-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:17.077315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:17.078280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.078715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.079142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] PATH_INFO: `/v3/users/460d59f33144414983cb72d71c82d64a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.080806 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1956/3872] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:17.082597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:17.083667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460d59f33144414983cb72d71c82d64a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:17.090489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:17.107169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae13fa-a7c5-4aab-ba65-d2a237d7b434 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:17.118243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:17.118870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.119152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.119424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.120228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:17.125341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:17.153136 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1957/3873] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:17.154633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:17.180503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a65ffb-f277-4c08-a2d2-a5165e5eb547 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:17.197118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e6cf8-cd95-475f-9cdd-cb21580f237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:17.197827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6cf8-cd95-475f-9cdd-cb21580f237f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.201257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6cf8-cd95-475f-9cdd-cb21580f237f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.201257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e6cf8-cd95-475f-9cdd-cb21580f237f admin admin] PATH_INFO: `/v3/projects/025378d9852b4eccb7e6cdff549ba332/users/1d768b680099437785225cef89343c88/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.232489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e6cf8-cd95-475f-9cdd-cb21580f237f admin admin] RBAC: Authorizing `identity:create_grant(project_id=025378d9852b4eccb7e6cdff549ba332, user_id=1d768b680099437785225cef89343c88, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:17.235475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e6cf8-cd95-475f-9cdd-cb21580f237f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:17.351575 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1958/3874] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:17 2022] PUT /identity/v3/projects/025378d9852b4eccb7e6cdff549ba332/users/1d768b680099437785225cef89343c88/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:17.364013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.364313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.364593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.385865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460d59f33144414983cb72d71c82d64a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:17.414817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460d59f33144414983cb72d71c82d64a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:17.418395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] MFA Rules not processed for user `1d768b680099437785225cef89343c88`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:17.419961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:17.428263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460d59f33144414983cb72d71c82d64a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:17.429009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460d59f33144414983cb72d71c82d64a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:17.468788 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:17.517373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c04b6b2-86bb-4267-9da5-7ab0939d0b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460d59f33144414983cb72d71c82d64a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:17.519524 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1959/3875] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:17.531406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:17.534756 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1917/3876] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:16 2022] DELETE /identity/v3/users/460d59f33144414983cb72d71c82d64a => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:17.535130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:17.536965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.537259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.537542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.544769 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:17.586167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:17.592570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:17.664698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed12a-30cd-49a4-9ff3-ebecb93eb274 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:17.726730 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1918/3877] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:17.743458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:17.745672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:17.766140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:17.774327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.774327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.774327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.832655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfba7f-d48e-43fa-a347-7a62c2bad246 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:17.838296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:17.839282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.839739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.840152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.850924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:17.852768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:17.854287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:17.856301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:17.866684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1960/3878] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:25:17.871083 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1919/3879] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:25:17.923283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:17.924761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:17.963028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c266c8-fa31-4c76-91f5-4d8ef7826212 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:17.969120 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:17.975965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:17.981181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:17.981181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:17.981181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] PATH_INFO: `/v3/users/aa860df2d2d247c98e3e534389cd6fd9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:17.981181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa860df2d2d247c98e3e534389cd6fd9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:17.981795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:18.256024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa860df2d2d247c98e3e534389cd6fd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.256910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa860df2d2d247c98e3e534389cd6fd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.283765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:18.287401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:18.312675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279f459-63db-4619-9e18-c3d52d31ff64 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:18.320708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:18.322175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:18.322732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:18.323211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] PATH_INFO: `/v3/users/1d768b680099437785225cef89343c88` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:18.326531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d768b680099437785225cef89343c88)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:18.332188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:18.340488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa860df2d2d247c98e3e534389cd6fd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.353840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa860df2d2d247c98e3e534389cd6fd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.354538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02f65f07-87a5-448b-b672-7e4c9697e48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa860df2d2d247c98e3e534389cd6fd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.370465 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:18.422347 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1961/3880] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:17 2022] DELETE /identity/v3/users/aa860df2d2d247c98e3e534389cd6fd9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:18.428495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f249d7-fed7-495f-8cab-67972646416b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:18.429150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f249d7-fed7-495f-8cab-67972646416b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:18.429637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f249d7-fed7-495f-8cab-67972646416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:18.429752 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:18.478382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-32f249d7-fed7-495f-8cab-67972646416b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:18.479759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32f249d7-fed7-495f-8cab-67972646416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:18.567404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d768b680099437785225cef89343c88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.604959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d768b680099437785225cef89343c88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.611943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d768b680099437785225cef89343c88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.613154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d768b680099437785225cef89343c88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.634016 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1962/3881] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:18.694987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f249d7-fed7-495f-8cab-67972646416b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:18.697359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32f249d7-fed7-495f-8cab-67972646416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:18.711456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e51f289c-a366-42ae-b84d-05e46253c083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d768b680099437785225cef89343c88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:18.719017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1920/3882] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:18 2022] DELETE /identity/v3/users/1d768b680099437785225cef89343c88 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:18.724718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688b27-7fe2-43f7-b572-f2644f03bc4c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:18.725025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688b27-7fe2-43f7-b572-f2644f03bc4c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:18.725310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688b27-7fe2-43f7-b572-f2644f03bc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:18.795971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f5688b27-7fe2-43f7-b572-f2644f03bc4c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:18.802248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f5688b27-7fe2-43f7-b572-f2644f03bc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:18.911816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f249d7-fed7-495f-8cab-67972646416b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:18.918184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1921/3883] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:18.940202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5688b27-7fe2-43f7-b572-f2644f03bc4c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:19.060656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961aee-8a04-4a9a-8459-f6dc5ca5a267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:19.061978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961aee-8a04-4a9a-8459-f6dc5ca5a267 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.062708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961aee-8a04-4a9a-8459-f6dc5ca5a267 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.062997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961aee-8a04-4a9a-8459-f6dc5ca5a267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.097363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78961aee-8a04-4a9a-8459-f6dc5ca5a267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:19.100612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78961aee-8a04-4a9a-8459-f6dc5ca5a267 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:19.106316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5688b27-7fe2-43f7-b572-f2644f03bc4c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:19.115163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:19.115994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.116118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.116330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.140425 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1963/3884] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:19.152154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:19.154311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:19.155206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.155333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.155637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.195639 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1922/3885] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:25:19.196507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:19.200010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:19.219094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3df0c-8577-42bb-a7ff-fd43fbf63029 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:19.225017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] MFA Rules not processed for user `1f4386dc076e45169800276afc1d6c70`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:19.226652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:19.227304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.227579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.227768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:19.227884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] PATH_INFO: `/v3/projects/0803fc2a6e864c18aca182d04ad26636` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.232683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0803fc2a6e864c18aca182d04ad26636)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:19.234809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:19.340731 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1964/3886] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:19.403191 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:19.424330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:19.427459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:19.442794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0803fc2a6e864c18aca182d04ad26636', 'request_id': 'req-f780b3ba-d332-4f6d-9465-84806bbe0e0b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:19.466996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0803fc2a6e864c18aca182d04ad26636', 'request_id': 'req-f780b3ba-d332-4f6d-9465-84806bbe0e0b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:19.567476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b1203-9d86-4828-a0e8-72a1acd77a7c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:19.574477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0803fc2a6e864c18aca182d04ad26636', 'request_id': 'req-f780b3ba-d332-4f6d-9465-84806bbe0e0b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:19.598568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] The token cache is being invalidate because project 0803fc2a6e864c18aca182d04ad26636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:19.599470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:19.601467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f780b3ba-d332-4f6d-9465-84806bbe0e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:19.606521 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1923/3887] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:19 2022] DELETE /identity/v3/projects/0803fc2a6e864c18aca182d04ad26636 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:19.613344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea7ec-58c5-4ace-8411-2b6c7f50a72b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.614334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea7ec-58c5-4ace-8411-2b6c7f50a72b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.614823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea7ec-58c5-4ace-8411-2b6c7f50a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.666387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3b9ea7ec-58c5-4ace-8411-2b6c7f50a72b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:19.667772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b9ea7ec-58c5-4ace-8411-2b6c7f50a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:19.698144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:19.698901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.699264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.699614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.702776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:19.765452 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1924/3888] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:19.767299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc5ac-dd3a-47f7-bbad-51d65eb13dc6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.767763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc5ac-dd3a-47f7-bbad-51d65eb13dc6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.768193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc5ac-dd3a-47f7-bbad-51d65eb13dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.792782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ec6fc5ac-dd3a-47f7-bbad-51d65eb13dc6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:19.793003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:19.794583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ec6fc5ac-dd3a-47f7-bbad-51d65eb13dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:19.794719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:19.809338 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1925/3889] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:19.810647 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1965/3890] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:19.814622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc5ac-dd3a-47f7-bbad-51d65eb13dc6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:19.825391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc5ac-dd3a-47f7-bbad-51d65eb13dc6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:19.835249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:19.835876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.836193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.836430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.837294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:19.837551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:19.839202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:19.852987 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1926/3891] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:19.859452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:19.876249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e93b0-aadc-4e0d-b41a-2509238648bd service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:19.883916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:19.884714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:19.885065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:19.885412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:19.886572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:19.891700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:20.034411 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1966/3892] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:19 2022] POST /identity/v3/projects => generated 391 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:20.044213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:20.056311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba745d-5fcf-43fe-b602-1c6e81099c28 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:20.131746 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:20.134441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:20.134441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:20.134660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:20.134923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:20.142251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:20.142251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:20.228708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:20.236400 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1927/3893] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:20 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:20.242982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757847-82da-4c8f-a7cb-598746a125fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:20.251594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:20.252301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:20.252583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:20.252922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:20.253582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:20.255699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:20.282508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1967/3894] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:20.286907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:20.313073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af613f86-9afd-4024-bfb9-73ff74779eb6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:20.331743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:20.332863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:20.333319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:20.333701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:20.337331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:20.341771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:20.385333 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1928/3895] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:20.391722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:20.405338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe2a7-340d-49f4-8abe-9a4bc7456478 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:20.424455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be749a-0cec-40a0-a304-6d0a9efb54f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:20.425148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be749a-0cec-40a0-a304-6d0a9efb54f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:20.425461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be749a-0cec-40a0-a304-6d0a9efb54f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:20.425714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be749a-0cec-40a0-a304-6d0a9efb54f9 admin admin] PATH_INFO: `/v3/projects/294e5caeb86d435daabb852c51e9c3cb/users/b8e86d01b927473aa4b3f42729f4ed1a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:20.448395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be749a-0cec-40a0-a304-6d0a9efb54f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294e5caeb86d435daabb852c51e9c3cb, user_id=b8e86d01b927473aa4b3f42729f4ed1a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:20.452796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be749a-0cec-40a0-a304-6d0a9efb54f9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:20.562718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:20.569327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:20.579709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1968/3896] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:20 2022] PUT /identity/v3/projects/294e5caeb86d435daabb852c51e9c3cb/users/b8e86d01b927473aa4b3f42729f4ed1a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:20.595980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:20.596726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:20.600130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:20.608805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4776a0-cfd4-46f8-8d77-3c4e0f9ec4b1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:20.646902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] MFA Rules not processed for user `b8e86d01b927473aa4b3f42729f4ed1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:20.648308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:20.756069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:20.756069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:20.756069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:20.756069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] PATH_INFO: `/v3/projects/025378d9852b4eccb7e6cdff549ba332` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:20.759717 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1969/3897] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:20.761050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025378d9852b4eccb7e6cdff549ba332)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:20.762945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:20.771003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:20.773781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:20.890309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025378d9852b4eccb7e6cdff549ba332', 'request_id': 'req-7d0151c0-f7cb-452c-9203-b43c1cda5324'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:20.900190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025378d9852b4eccb7e6cdff549ba332', 'request_id': 'req-7d0151c0-f7cb-452c-9203-b43c1cda5324'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:20.938963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8d7b3-aed7-4245-b24e-218011ed9284 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:21.026933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025378d9852b4eccb7e6cdff549ba332', 'request_id': 'req-7d0151c0-f7cb-452c-9203-b43c1cda5324'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:21.046624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] The token cache is being invalidate because project 025378d9852b4eccb7e6cdff549ba332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:21.048326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:21.049137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d0151c0-f7cb-452c-9203-b43c1cda5324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:21.051906 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1929/3898] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:20 2022] DELETE /identity/v3/projects/025378d9852b4eccb7e6cdff549ba332 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:21.057666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f859-e99f-466e-af1a-4f14a4d76be2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.059055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f859-e99f-466e-af1a-4f14a4d76be2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.059624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f859-e99f-466e-af1a-4f14a4d76be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.072670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa72ca4-2f87-4d8f-80fc-35c8408444c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:21.073550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72ca4-2f87-4d8f-80fc-35c8408444c6 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.074027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72ca4-2f87-4d8f-80fc-35c8408444c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.077758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72ca4-2f87-4d8f-80fc-35c8408444c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.077758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aaa72ca4-2f87-4d8f-80fc-35c8408444c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:21.103313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1cc0f859-e99f-466e-af1a-4f14a4d76be2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:21.104719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1cc0f859-e99f-466e-af1a-4f14a4d76be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:21.162344 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:21.166981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa72ca4-2f87-4d8f-80fc-35c8408444c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:21.168849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa72ca4-2f87-4d8f-80fc-35c8408444c6 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:21.180677 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1970/3899] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:21.218409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1930/3900] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:21.226753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d5b3-05b5-45c8-a62f-5e4778b74a54 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.227946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d5b3-05b5-45c8-a62f-5e4778b74a54 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.228339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d5b3-05b5-45c8-a62f-5e4778b74a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.266759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-da57d5b3-05b5-45c8-a62f-5e4778b74a54 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:21.268681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-da57d5b3-05b5-45c8-a62f-5e4778b74a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:21.295776 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1971/3901] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:21.296537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f859-e99f-466e-af1a-4f14a4d76be2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:21.309966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f859-e99f-466e-af1a-4f14a4d76be2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:21.320017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:21.321158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.321654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.322174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.323035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:21.323534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:21.344478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:21.356440 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1931/3902] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:21.361896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d5b3-05b5-45c8-a62f-5e4778b74a54 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:21.371845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57d5b3-05b5-45c8-a62f-5e4778b74a54 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:21.377757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:21.378411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.378691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.379653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.380322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:21.385996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:21.536230 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1972/3903] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:21 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:21.541727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:21.546675 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:21.559501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3247af4-0b58-4c3b-998a-ab73aecb5d8b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:21.636235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:21.640204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:21.787892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:21.788529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.788813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.790689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.791261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:21.798502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:21.804520 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:21.871491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0ed17-dc1e-46dd-9d64-3112f0222a26 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:21.877629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:21.879050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.879926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.881626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] PATH_INFO: `/v3/projects/d51ab85a16654e6cb96e4ea3295e4209` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.884164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51ab85a16654e6cb96e4ea3295e4209)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:21.887186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:21.926521 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1932/3904] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:21 2022] POST /identity/v3/users => generated 287 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:25:21.928277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:21.941373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f473e7-3c69-450d-bf6d-838f57f3896a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:21.947705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:21.948587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:21.949064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:21.952906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:21.952906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:21.952906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:22.006534 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1933/3905] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:22.013078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:22.028579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeddfe4-e5df-46ad-bae3-331cc10ae1ec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:22.042112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51ab85a16654e6cb96e4ea3295e4209', 'request_id': 'req-235d6466-94a2-4e27-b0ee-17639003d350'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.053669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51ab85a16654e6cb96e4ea3295e4209', 'request_id': 'req-235d6466-94a2-4e27-b0ee-17639003d350'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.096772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:22.100993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:22.101295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:22.101578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:22.102479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:22.104401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:22.116808 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1934/3906] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:22.117943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:22.121133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51ab85a16654e6cb96e4ea3295e4209', 'request_id': 'req-235d6466-94a2-4e27-b0ee-17639003d350'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.121470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:22.134902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de1e4a-7c6f-4457-8dec-cc946bfe99da admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:22.142023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] The token cache is being invalidate because project d51ab85a16654e6cb96e4ea3295e4209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:22.143265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.145581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:22.146091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.147207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:22.148530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:22.149761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] PATH_INFO: `/v3/users/b8e86d01b927473aa4b3f42729f4ed1a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:22.153321 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1973/3907] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:21 2022] DELETE /identity/v3/projects/d51ab85a16654e6cb96e4ea3295e4209 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:22.155960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e86d01b927473aa4b3f42729f4ed1a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:22.157381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:22.159871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:22.160670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:22.193179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6466-94a2-4e27-b0ee-17639003d350 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:22.202351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:22.202351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:22.202351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:22.202351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] PATH_INFO: `/v3/projects/11652a47950c4c00ae6b8aad1561ff41/users/23f7851651804eec88d6b4f799849133/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:22.220896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11652a47950c4c00ae6b8aad1561ff41, user_id=23f7851651804eec88d6b4f799849133, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:22.224856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:22.548178 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1974/3908] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:22 2022] PUT /identity/v3/projects/11652a47950c4c00ae6b8aad1561ff41/users/23f7851651804eec88d6b4f799849133/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:22.552762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:22.552762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:22.625159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e86d01b927473aa4b3f42729f4ed1a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.659357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e86d01b927473aa4b3f42729f4ed1a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.673161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e86d01b927473aa4b3f42729f4ed1a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.674497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e86d01b927473aa4b3f42729f4ed1a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.740424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189919a-e4af-4651-b09a-21cb71938936 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:22.745858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:22.746594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:22.746950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:22.748686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] PATH_INFO: `/v3/users/d4fca46319d345dbbbda924710cf0371` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:22.750395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fca46319d345dbbbda924710cf0371)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:22.752668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:22.782106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4819fbb-94d5-4ff3-8537-b8d93d789e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e86d01b927473aa4b3f42729f4ed1a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:22.804334 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1935/3909] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:22 2022] DELETE /identity/v3/users/b8e86d01b927473aa4b3f42729f4ed1a => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:22.811832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ad104-cbbc-4547-8d62-a847de1cf54b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:22.813226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ad104-cbbc-4547-8d62-a847de1cf54b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:22.814204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ad104-cbbc-4547-8d62-a847de1cf54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:22.876353 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:22.914604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-943ad104-cbbc-4547-8d62-a847de1cf54b None None] MFA Rules not processed for user `23f7851651804eec88d6b4f799849133`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:22.914604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-943ad104-cbbc-4547-8d62-a847de1cf54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:23.045440 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1936/3910] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:23.048642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:23.049091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:23.049471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:23.078689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:23.080174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:23.095126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fca46319d345dbbbda924710cf0371'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:23.096107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fca46319d345dbbbda924710cf0371'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:23.182861 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1937/3911] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:23.186313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fca46319d345dbbbda924710cf0371'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:23.198520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fca46319d345dbbbda924710cf0371'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:23.199665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fca46319d345dbbbda924710cf0371'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:23.215815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:23.221343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:23.233449 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1975/3912] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:22 2022] DELETE /identity/v3/users/d4fca46319d345dbbbda924710cf0371 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:23.366444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141af55-38e1-4183-8987-f5a6e740a300 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:23.457695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:23.460907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:23.509519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:23.510544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:23.512012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:23.512578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:23.521398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:23.639347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d36-d113-4b42-9254-95696547330a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:23.639883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:23.642106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:23.654389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df26ec-a9ed-4750-928c-54771709ee8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:23.655032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df26ec-a9ed-4750-928c-54771709ee8f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:23.655262 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1938/3913] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:23.655425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df26ec-a9ed-4750-928c-54771709ee8f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:23.656174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df26ec-a9ed-4750-928c-54771709ee8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:23.658855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e1df26ec-a9ed-4750-928c-54771709ee8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:23.749467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df26ec-a9ed-4750-928c-54771709ee8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:23.751100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df26ec-a9ed-4750-928c-54771709ee8f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:23.777629 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1976/3914] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:25:23.912453 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:24.144368 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:24.722070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:24.725384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:24.754457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3042cd-b6f6-46ae-9d9c-b7fea6d8973a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:24.784700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:24.785645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:24.785971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:24.786248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] PATH_INFO: `/v3/projects/504becf19c984875aa475793d6969ba1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:24.788361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=504becf19c984875aa475793d6969ba1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:24.790580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:24.954017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504becf19c984875aa475793d6969ba1', 'request_id': 'req-df0bc653-edeb-4773-ae86-1bf46e866bca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:24.964718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504becf19c984875aa475793d6969ba1', 'request_id': 'req-df0bc653-edeb-4773-ae86-1bf46e866bca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.060561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504becf19c984875aa475793d6969ba1', 'request_id': 'req-df0bc653-edeb-4773-ae86-1bf46e866bca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.077890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] The token cache is being invalidate because project 504becf19c984875aa475793d6969ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:25.078481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.079858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.090724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e67eb-68ce-4c3e-9ff1-37605a0c6c8a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.091772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e67eb-68ce-4c3e-9ff1-37605a0c6c8a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.091980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e67eb-68ce-4c3e-9ff1-37605a0c6c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.092095 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1939/3915] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:24 2022] DELETE /identity/v3/projects/504becf19c984875aa475793d6969ba1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:25.101253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:25.102095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:25.134120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a10e67eb-68ce-4c3e-9ff1-37605a0c6c8a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:25.137733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a10e67eb-68ce-4c3e-9ff1-37605a0c6c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:25.293271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bc653-edeb-4773-ae86-1bf46e866bca admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:25.305344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:25.306188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.306483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.306760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] PATH_INFO: `/v3/projects/294e5caeb86d435daabb852c51e9c3cb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.314558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=294e5caeb86d435daabb852c51e9c3cb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:25.316675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:25.335874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1977/3916] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:25.337424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fc8c-e5ee-4474-957e-13ebd9263a7b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.337851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fc8c-e5ee-4474-957e-13ebd9263a7b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.338225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9fc8c-e5ee-4474-957e-13ebd9263a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.376998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-33f9fc8c-e5ee-4474-957e-13ebd9263a7b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:25.378933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33f9fc8c-e5ee-4474-957e-13ebd9263a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:25.395906 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1978/3917] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:25.398825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fc8c-e5ee-4474-957e-13ebd9263a7b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:25.423421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9fc8c-e5ee-4474-957e-13ebd9263a7b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:25.433680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:25.434748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.435565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.436441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.437733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:25.438651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:25.440887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:25.470061 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1979/3918] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:25.472978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:25.478203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294e5caeb86d435daabb852c51e9c3cb', 'request_id': 'req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.494641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294e5caeb86d435daabb852c51e9c3cb', 'request_id': 'req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.500273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1ede-ce2f-4dc7-be6c-c5272611014a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:25.612675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294e5caeb86d435daabb852c51e9c3cb', 'request_id': 'req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.614871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:25.615771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.616065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.616375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.616980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:25.619386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:25.632827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] The token cache is being invalidate because project 294e5caeb86d435daabb852c51e9c3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:25.634279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.648383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9edf6a6-413c-4dd1-bb53-f00b84a6b7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:25.652294 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1940/3919] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:25 2022] DELETE /identity/v3/projects/294e5caeb86d435daabb852c51e9c3cb => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:25.658002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eaf17-24b4-4d84-a150-41c5534cf026 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.659090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eaf17-24b4-4d84-a150-41c5534cf026 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.659568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eaf17-24b4-4d84-a150-41c5534cf026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.690399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-659eaf17-24b4-4d84-a150-41c5534cf026 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:25.692898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-659eaf17-24b4-4d84-a150-41c5534cf026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:25.709784 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1941/3920] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:25.723521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb768-c0c4-42fd-8363-6de1afc47ce8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.724634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb768-c0c4-42fd-8363-6de1afc47ce8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.725126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb768-c0c4-42fd-8363-6de1afc47ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.767426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b80bb768-c0c4-42fd-8363-6de1afc47ce8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:25.768470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b80bb768-c0c4-42fd-8363-6de1afc47ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:25.788798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1980/3921] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:25 2022] POST /identity/v3/projects => generated 383 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:25.792876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:25.796441 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1942/3922] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:25.796619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:25.797509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb768-c0c4-42fd-8363-6de1afc47ce8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:25.812791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb768-c0c4-42fd-8363-6de1afc47ce8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:25.894390 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:25.961506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:25.962156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.967332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.967332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.967332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:25.967332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:25.971342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:25.972631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a4ecb-7172-49fc-9631-ed300f6edf31 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:25.992565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:25.996245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:25.996245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:25.996245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:25.996245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:25.998027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.002022 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1943/3923] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:25:26.005702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.031018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a158d1-7f7a-462c-a1af-a7e7a8237513 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.037871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.038806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.039598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.040054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.040863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.043086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.138361 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1981/3924] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:25 2022] POST /identity/v3/users => generated 292 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:25:26.142377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.156343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df747c-94bc-48f3-ad1a-eb52287bb34f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.161170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1944/3925] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:26 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:26.164736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.164736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.164736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.164736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.165734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.165906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.167664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.180494 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1982/3926] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:26.184153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.199599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a2e9-f62f-4123-a591-1c22ba5ccfc8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.280345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.280345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.280345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.280345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.282808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.287756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9074c5-3adb-470b-8728-d7429a4614c3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.290205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.293552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.295030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.295561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.295850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.296495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.299074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.309279 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1983/3927] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:26.310785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.321405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae7770-98b1-41f5-8e54-0f4af3bf252d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.332733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640b2a7-5969-46dd-866b-607ede91496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.334382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640b2a7-5969-46dd-866b-607ede91496a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.334991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640b2a7-5969-46dd-866b-607ede91496a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.335345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640b2a7-5969-46dd-866b-607ede91496a admin admin] PATH_INFO: `/v3/projects/e1ce73c0303843828ecf61b3bcbb0bc7/users/1034bec6ffb343f9a051e23a11ac626e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.368476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640b2a7-5969-46dd-866b-607ede91496a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ce73c0303843828ecf61b3bcbb0bc7, user_id=1034bec6ffb343f9a051e23a11ac626e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.379081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640b2a7-5969-46dd-866b-607ede91496a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.438383 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1945/3928] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:26 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:26.439929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.451909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1984/3929] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:26 2022] PUT /identity/v3/projects/e1ce73c0303843828ecf61b3bcbb0bc7/users/1034bec6ffb343f9a051e23a11ac626e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:26.455858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67865d7-c8ec-4788-ab5d-10dcc615a8b3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.465077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955b6b3-e2c3-4be4-8d98-1426d88aa6c3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.465731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955b6b3-e2c3-4be4-8d98-1426d88aa6c3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.471838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955b6b3-e2c3-4be4-8d98-1426d88aa6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.520999 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:26.542802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b955b6b3-e2c3-4be4-8d98-1426d88aa6c3 None None] MFA Rules not processed for user `1034bec6ffb343f9a051e23a11ac626e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:26.547132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b955b6b3-e2c3-4be4-8d98-1426d88aa6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:26.639088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.639721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.640062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.640288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.644060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.648705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.678792 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1946/3930] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:26.682821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.699737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9062e-8a0c-4ee0-8198-ecc587b6891c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.709211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.709870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.710215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.710498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.711154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.713104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.720546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1985/3931] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:26.727776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955b6b3-e2c3-4be4-8d98-1426d88aa6c3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.730435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1947/3932] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:26.734896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.749509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955b6b3-e2c3-4be4-8d98-1426d88aa6c3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.757012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0c429-b711-4b6e-ab81-0dd4eb368102 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:26.765704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eaac3-b62f-4aea-b437-e05fe1bda7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.765704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eaac3-b62f-4aea-b437-e05fe1bda7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.765704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eaac3-b62f-4aea-b437-e05fe1bda7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.765704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eaac3-b62f-4aea-b437-e05fe1bda7e1 admin admin] PATH_INFO: `/v3/projects/ac5cd18688674840a31f065497f19fc4/users/031144c5b60546c090f11070f68f084e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.772587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:26.773225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.773508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.773783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.777053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.780260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.782230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eaac3-b62f-4aea-b437-e05fe1bda7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5cd18688674840a31f065497f19fc4, user_id=031144c5b60546c090f11070f68f084e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:26.786112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6eaac3-b62f-4aea-b437-e05fe1bda7e1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:26.868024 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1948/3933] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:26 2022] PUT /identity/v3/projects/ac5cd18688674840a31f065497f19fc4/users/031144c5b60546c090f11070f68f084e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:26.874700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:26.875062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:26.875415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:26.913380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1986/3934] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:26 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:26.920644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:26.920909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:26.922034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:27.067086 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1949/3935] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:27.095947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:27.097414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:27.145978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461344da-2ed3-4d50-9e9f-6e3ec29a43f9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:27.161049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:27.161896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:27.162352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:27.162768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:27.163731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:27.169178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:27.226457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21ae6e-1f1d-4d34-b99b-ca0550186b52 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:27.233035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:27.233639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:27.234164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:27.234461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:27.254411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:27.256346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:27.266439 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1987/3936] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:26 2022] POST /identity/v3/users => generated 299 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:27.270517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:27.277194 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1950/3937] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:27.286602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb4af9-c0a3-4a3f-9d25-263d8a093e01 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:27.292832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:27.293036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:27.293306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:27.293666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:27.295176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:27.297360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:27.327853 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1988/3938] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:27.329835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:27.342960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af9e0-dcea-4514-85fd-74d142ba1fca service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:27.349192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:27.354931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:27.354931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:27.354931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] PATH_INFO: `/v3/projects/6a3f977903ba4debbf7ee12775d70dc0/users/c00ea6e993c74d499efc14ee889cb5cf/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:27.392971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3f977903ba4debbf7ee12775d70dc0, user_id=c00ea6e993c74d499efc14ee889cb5cf, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:27.399772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:27.498436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1951/3939] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:27 2022] PUT /identity/v3/projects/6a3f977903ba4debbf7ee12775d70dc0/users/c00ea6e993c74d499efc14ee889cb5cf/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:27.503579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:27.506781 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:27.529432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffdb18-723e-4a26-b073-b7e3d93c2ddb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:27.627114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e418c2-1f17-4272-82c3-7937e83e707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:27.627877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e418c2-1f17-4272-82c3-7937e83e707b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:27.628171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e418c2-1f17-4272-82c3-7937e83e707b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:27.628492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e418c2-1f17-4272-82c3-7937e83e707b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:27.629161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e418c2-1f17-4272-82c3-7937e83e707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:27.630796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e418c2-1f17-4272-82c3-7937e83e707b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:27.648059 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1989/3940] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:27.648194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:27.659342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae084-ebd2-40fd-b993-a74b64852ef5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:27.670736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:27.671426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:27.671708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:27.672053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] PATH_INFO: `/v3/projects/6a3f977903ba4debbf7ee12775d70dc0/users/c00ea6e993c74d499efc14ee889cb5cf/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:27.677705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3f977903ba4debbf7ee12775d70dc0, user_id=c00ea6e993c74d499efc14ee889cb5cf, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:27.682746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:27.713876 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1952/3941] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:27 2022] PUT /identity/v3/projects/6a3f977903ba4debbf7ee12775d70dc0/users/c00ea6e993c74d499efc14ee889cb5cf/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:27.717015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:27.717666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:27.718140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:27.777695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] MFA Rules not processed for user `c00ea6e993c74d499efc14ee889cb5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:27.780023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:27.869955 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1990/3942] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:27.881330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:27.883119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:28.006021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8df5-8f8b-4ce8-8472-debadbe25b14 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:28.015181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:28.015680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:28.015960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:28.016641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:28.039575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:28.042293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:28.057440 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1953/3943] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:28.732458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:28.735155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:28.787984 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:28.816556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f21ca-777e-42be-8607-999cb611ea75 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:28.821949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:28.822789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:28.823072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:28.823753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] PATH_INFO: `/v3/users/1f4386dc076e45169800276afc1d6c70` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:28.824497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4386dc076e45169800276afc1d6c70)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:28.827037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:29.065387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4386dc076e45169800276afc1d6c70'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.066277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4386dc076e45169800276afc1d6c70'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.146675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4386dc076e45169800276afc1d6c70'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.157062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4386dc076e45169800276afc1d6c70'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.158231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b985d2f3-4ca2-4ed4-b1ee-82ab25172439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4386dc076e45169800276afc1d6c70'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.180790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1991/3944] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:28 2022] DELETE /identity/v3/users/1f4386dc076e45169800276afc1d6c70 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:29.329905 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:29.535987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:29.548718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a39b1-bec2-42d4-8f2b-63f09a0a8cfc service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:29.641306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:29.642494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:29.642874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:29.643250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] PATH_INFO: `/v3/projects/099ca69b6323439092d6b2f6bbd8e657` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:29.644535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=099ca69b6323439092d6b2f6bbd8e657)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:29.646997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:29.804819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099ca69b6323439092d6b2f6bbd8e657', 'request_id': 'req-377bd0a8-64e8-4251-881b-865faad92951'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.812025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099ca69b6323439092d6b2f6bbd8e657', 'request_id': 'req-377bd0a8-64e8-4251-881b-865faad92951'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.917043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099ca69b6323439092d6b2f6bbd8e657', 'request_id': 'req-377bd0a8-64e8-4251-881b-865faad92951'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.939380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] The token cache is being invalidate because project 099ca69b6323439092d6b2f6bbd8e657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:29.940016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.943955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-377bd0a8-64e8-4251-881b-865faad92951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:29.947363 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1954/3945] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:29 2022] DELETE /identity/v3/projects/099ca69b6323439092d6b2f6bbd8e657 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:29.952517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6343c6-011c-4024-bae8-cf2c2d1ee946 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:29.953056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6343c6-011c-4024-bae8-cf2c2d1ee946 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:29.953141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6343c6-011c-4024-bae8-cf2c2d1ee946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:29.996530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8a6343c6-011c-4024-bae8-cf2c2d1ee946 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:29.999606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8a6343c6-011c-4024-bae8-cf2c2d1ee946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:30.104538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1992/3946] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:30.114535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a59f-1519-4aca-9fc5-72dde586a4a1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.115736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a59f-1519-4aca-9fc5-72dde586a4a1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.115736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a59f-1519-4aca-9fc5-72dde586a4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.154254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5593a59f-1519-4aca-9fc5-72dde586a4a1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:30.158124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5593a59f-1519-4aca-9fc5-72dde586a4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:30.178076 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1955/3947] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:30.182892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6343c6-011c-4024-bae8-cf2c2d1ee946 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:30.196810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6343c6-011c-4024-bae8-cf2c2d1ee946 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:30.203166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:30.204119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.204609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.206003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.206945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:30.207407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:30.209941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:30.225148 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1993/3948] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:30.229698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593a59f-1519-4aca-9fc5-72dde586a4a1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:30.244320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593a59f-1519-4aca-9fc5-72dde586a4a1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:30.250501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:30.253780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.253780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.253780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.253780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:30.255299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:30.400804 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1956/3949] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:30 2022] POST /identity/v3/projects => generated 397 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:30.411060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:30.430776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0c33-3624-4a10-95a2-d776ab7a9626 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:30.484352 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:30.522791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:30.524063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.524354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.526776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.526776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:30.530085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:30.553039 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:30.631310 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1994/3950] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:30 2022] POST /identity/v3/users => generated 299 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:25:30.637194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:30.662119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1ecd-2da8-45f9-9167-ca762eb676c9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:30.669102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:30.670477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.671341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.671927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.681682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:30.684631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:30.697996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1957/3951] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:30.702828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:30.715098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77580abc-a282-46d7-80d6-c55014b43b0b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:30.722344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137244-b9d6-4b4f-8f3b-9beb3a0d2dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:30.723290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137244-b9d6-4b4f-8f3b-9beb3a0d2dbd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.723745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137244-b9d6-4b4f-8f3b-9beb3a0d2dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.724228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137244-b9d6-4b4f-8f3b-9beb3a0d2dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.725195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137244-b9d6-4b4f-8f3b-9beb3a0d2dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:30.727466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137244-b9d6-4b4f-8f3b-9beb3a0d2dbd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:30.744105 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1995/3952] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:30.748190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:30.760511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16f22f-c166-4236-b766-28e4027b05e1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:30.767840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:30.771331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.771331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.771331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] PATH_INFO: `/v3/projects/e60d36ecb6b5450288676e27a9167910/users/3971dce263494606bc5ed74dc141c482/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.804735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60d36ecb6b5450288676e27a9167910, user_id=3971dce263494606bc5ed74dc141c482, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:30.811629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:30.914073 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1958/3953] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:30 2022] PUT /identity/v3/projects/e60d36ecb6b5450288676e27a9167910/users/3971dce263494606bc5ed74dc141c482/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:30.926227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:30.927883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:30.930308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:30.968982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:30.975500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:31.135104 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1996/3954] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:31.163625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:31.165731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:31.287755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a066c1-39ee-46b9-b884-87b0055fbcf6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:31.302378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1b02-717f-4435-8af3-9e1e41e1543a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:31.303045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1b02-717f-4435-8af3-9e1e41e1543a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:31.306259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1b02-717f-4435-8af3-9e1e41e1543a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:31.306659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1b02-717f-4435-8af3-9e1e41e1543a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:31.320785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1b02-717f-4435-8af3-9e1e41e1543a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:31.323772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1b02-717f-4435-8af3-9e1e41e1543a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:31.357785 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1959/3955] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:31.943107 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:32.317161 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:32.498280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:32.500477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:32.522826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf781cb-459b-489d-ade1-ccad2d904b1c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:32.539982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:32.540788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:32.541072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:32.541346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] PATH_INFO: `/v3/users/23f7851651804eec88d6b4f799849133` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:32.544783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f7851651804eec88d6b4f799849133)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:32.546802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:32.834418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f7851651804eec88d6b4f799849133'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:32.835350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f7851651804eec88d6b4f799849133'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:32.931295 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:32.974182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f7851651804eec88d6b4f799849133'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:32.987269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f7851651804eec88d6b4f799849133'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:32.988005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f7851651804eec88d6b4f799849133'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:33.041685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1997/3956] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:32 2022] DELETE /identity/v3/users/23f7851651804eec88d6b4f799849133 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:33.046253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:33.046542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:33.046912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:33.104524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:33.112449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:33.209568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1960/3957] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:33.242488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:33.244956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:33.374473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a873b6d-9ce8-4f6a-875a-8007a30d5f37 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:33.384629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:33.385360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:33.385649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:33.387073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:33.402938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:33.404950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:33.453617 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1998/3958] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:34.241964 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:34.427412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:34.430535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:34.446694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d9c57-993c-4620-ba7f-b4dd45789488 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:34.456635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:34.456635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:34.456635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:34.456635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] PATH_INFO: `/v3/projects/11652a47950c4c00ae6b8aad1561ff41` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:34.457098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11652a47950c4c00ae6b8aad1561ff41)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:34.464283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:34.624512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11652a47950c4c00ae6b8aad1561ff41', 'request_id': 'req-4721b315-2c01-4f40-b38f-607e67f69a53'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:34.640233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11652a47950c4c00ae6b8aad1561ff41', 'request_id': 'req-4721b315-2c01-4f40-b38f-607e67f69a53'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:34.667736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:34.670056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:34.691255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a56a-7d1a-481a-8ac2-29e01d6a7a88 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:34.735083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11652a47950c4c00ae6b8aad1561ff41', 'request_id': 'req-4721b315-2c01-4f40-b38f-607e67f69a53'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:34.758219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] The token cache is being invalidate because project 11652a47950c4c00ae6b8aad1561ff41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:34.758535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:34.761662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4721b315-2c01-4f40-b38f-607e67f69a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:34.768415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1961/3959] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:34 2022] DELETE /identity/v3/projects/11652a47950c4c00ae6b8aad1561ff41 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:34.774487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd226b-c7f5-43df-b882-4f2787bdf72e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:34.775042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd226b-c7f5-43df-b882-4f2787bdf72e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:34.775592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd226b-c7f5-43df-b882-4f2787bdf72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:34.813913 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:34.835210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-21fd226b-c7f5-43df-b882-4f2787bdf72e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:34.844343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-21fd226b-c7f5-43df-b882-4f2787bdf72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:34.871669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:34.875284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:34.875284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:34.875284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] PATH_INFO: `/v3/users/1034bec6ffb343f9a051e23a11ac626e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:34.880046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1034bec6ffb343f9a051e23a11ac626e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:34.883157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:34.963540 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1962/3960] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:34.971668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb34e65-fbfa-4e86-889b-baa51089dddc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:34.972300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb34e65-fbfa-4e86-889b-baa51089dddc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:34.972740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb34e65-fbfa-4e86-889b-baa51089dddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.011403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0eb34e65-fbfa-4e86-889b-baa51089dddc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:35.020473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0eb34e65-fbfa-4e86-889b-baa51089dddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:35.040126 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1963/3961] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:35.044826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb34e65-fbfa-4e86-889b-baa51089dddc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:35.061080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb34e65-fbfa-4e86-889b-baa51089dddc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:35.079362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:35.079994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.080275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.080545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.081561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:35.082575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:35.084368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:35.119442 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1964/3962] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:25:35.128859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:35.149928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84639c-173b-41b5-85df-e7fabeb1fb03 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:35.159046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1034bec6ffb343f9a051e23a11ac626e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:35.160781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1034bec6ffb343f9a051e23a11ac626e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:35.168103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:35.168773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.169715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.170205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.171219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:35.172711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:35.239539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1034bec6ffb343f9a051e23a11ac626e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:35.248630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1034bec6ffb343f9a051e23a11ac626e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:35.249986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb5617b-cd6a-473f-8960-f027360be5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1034bec6ffb343f9a051e23a11ac626e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:35.334240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 1999/3963] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:34 2022] DELETE /identity/v3/users/1034bec6ffb343f9a051e23a11ac626e => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:35.338760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.339255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.339717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.374606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:35.380211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:35.393940 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1965/3964] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:35 2022] POST /identity/v3/projects => generated 361 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:35.395012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:35.408688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:35.542570 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2000/3965] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:35.567230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51429-ba9f-43d4-9fb1-765a59176f50 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:35.583008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:35.589712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.589712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.589712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.589712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:35.589712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:35.596835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:35.598433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:35.690991 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1966/3966] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:35 2022] POST /identity/v3/users => generated 281 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:25:35.696117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:35.713893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea8ff-be81-4513-9390-bacc6e97b268 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:35.715604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeff29-e97e-4f57-bf7c-27a8cebf4197 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:35.721783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:35.722930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.723625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.724117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.727028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:35.727666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.727949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.728228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.728882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:35.730523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:35.739020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:35.740934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:35.754936 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2001/3967] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:25:35.756673 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1967/3968] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:35.761234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:35.773495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f994da4-85b5-4b01-990e-77165054dc29 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:35.780044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c75bf-bd89-484c-ae69-daeffbcf83fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:35.781969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c75bf-bd89-484c-ae69-daeffbcf83fc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.782361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c75bf-bd89-484c-ae69-daeffbcf83fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.782738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c75bf-bd89-484c-ae69-daeffbcf83fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.783497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c75bf-bd89-484c-ae69-daeffbcf83fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:35.785649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c75bf-bd89-484c-ae69-daeffbcf83fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:35.804047 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2002/3969] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:35.804709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:35.819693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92efce-d9c9-4192-8baa-14859fe7498e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:35.831911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:35.832867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.833376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.833922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] PATH_INFO: `/v3/projects/457b4e0dc97047a484a487598078fadd/users/2b2db10200ff4d8da1da3cfa48af79eb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:35.848716 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:35.872024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=457b4e0dc97047a484a487598078fadd, user_id=2b2db10200ff4d8da1da3cfa48af79eb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:35.875380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:35.972002 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1968/3970] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:35 2022] PUT /identity/v3/projects/457b4e0dc97047a484a487598078fadd/users/2b2db10200ff4d8da1da3cfa48af79eb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:25:35.983496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506feaf3-d174-4691-ad51-ad6e82d03d18 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:35.983781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506feaf3-d174-4691-ad51-ad6e82d03d18 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:35.984115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506feaf3-d174-4691-ad51-ad6e82d03d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:36.070367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-506feaf3-d174-4691-ad51-ad6e82d03d18 None None] MFA Rules not processed for user `2b2db10200ff4d8da1da3cfa48af79eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:36.071621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-506feaf3-d174-4691-ad51-ad6e82d03d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:36.208480 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2003/3971] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:36.411939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:36.415273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:36.533928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ee86-7512-4d18-a30c-aa7c0b990b2d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:36.540343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:36.541035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:36.541422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:36.541710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:36.554345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:36.556537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:36.574526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1969/3972] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:36.668787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506feaf3-d174-4691-ad51-ad6e82d03d18 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:36.762638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506feaf3-d174-4691-ad51-ad6e82d03d18 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:36.772178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:36.773506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:36.774026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:36.774499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] PATH_INFO: `/v3/users/2b2db10200ff4d8da1da3cfa48af79eb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:36.777355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2db10200ff4d8da1da3cfa48af79eb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:36.780112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:36.909401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:36.911108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:36.945141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be6559-8aa9-4cc8-a9bc-547351961071 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:36.970181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:36.972677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:36.987205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:36.987568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] PATH_INFO: `/v3/projects/e1ce73c0303843828ecf61b3bcbb0bc7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:36.993776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ce73c0303843828ecf61b3bcbb0bc7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:36.993776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:37.069927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2db10200ff4d8da1da3cfa48af79eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.071290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2db10200ff4d8da1da3cfa48af79eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.178735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2db10200ff4d8da1da3cfa48af79eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.195872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2db10200ff4d8da1da3cfa48af79eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.196955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997580fa-bd52-4366-bdd1-8c6a5261ee6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2db10200ff4d8da1da3cfa48af79eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.237680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ce73c0303843828ecf61b3bcbb0bc7', 'request_id': 'req-5267ce22-3d39-417d-892c-24c0aee299f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.244567 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2004/3973] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:36 2022] DELETE /identity/v3/users/2b2db10200ff4d8da1da3cfa48af79eb => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:37.249014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:37.250394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:37.250823 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:37.251070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:37.253730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ce73c0303843828ecf61b3bcbb0bc7', 'request_id': 'req-5267ce22-3d39-417d-892c-24c0aee299f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.280955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:37.285834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:37.366531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ce73c0303843828ecf61b3bcbb0bc7', 'request_id': 'req-5267ce22-3d39-417d-892c-24c0aee299f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.396342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] The token cache is being invalidate because project e1ce73c0303843828ecf61b3bcbb0bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:37.399654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.399654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.402334 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1970/3974] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:36 2022] DELETE /identity/v3/projects/e1ce73c0303843828ecf61b3bcbb0bc7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:37.403335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:37.408530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:37.465454 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2005/3975] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:37.516188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267ce22-3d39-417d-892c-24c0aee299f6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:37.521597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:37.522556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:37.523005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:37.523570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] PATH_INFO: `/v3/users/c00ea6e993c74d499efc14ee889cb5cf` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:37.526555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00ea6e993c74d499efc14ee889cb5cf)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:37.532421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:37.533524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:37.535284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:37.649727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dbeb-9fe7-4093-a360-b67f26dae5f3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:37.670987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:37.672592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:37.673397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:37.673915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:37.698010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:37.710733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:37.720625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00ea6e993c74d499efc14ee889cb5cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.751120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2006/3976] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:37.757531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00ea6e993c74d499efc14ee889cb5cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.771131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00ea6e993c74d499efc14ee889cb5cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.772045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00ea6e993c74d499efc14ee889cb5cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.785518 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:37.855693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5fbd3163-8f6d-47b3-bf8b-fb5317721099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00ea6e993c74d499efc14ee889cb5cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:37.864445 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1971/3977] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:37 2022] DELETE /identity/v3/users/c00ea6e993c74d499efc14ee889cb5cf => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:38.111270 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:38.693763 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:38.752979 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:39.257572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:39.267739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e5e5e-eca2-4306-9a55-6d25cb00216f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:39.363184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:39.364077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:39.364437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:39.364784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] PATH_INFO: `/v3/projects/6a3f977903ba4debbf7ee12775d70dc0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:39.366215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3f977903ba4debbf7ee12775d70dc0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:39.368590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:39.547070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3f977903ba4debbf7ee12775d70dc0', 'request_id': 'req-1fee9559-f175-43d9-94d0-a91180493ea1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:39.556271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3f977903ba4debbf7ee12775d70dc0', 'request_id': 'req-1fee9559-f175-43d9-94d0-a91180493ea1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:39.687537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3f977903ba4debbf7ee12775d70dc0', 'request_id': 'req-1fee9559-f175-43d9-94d0-a91180493ea1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:39.703431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] The token cache is being invalidate because project 6a3f977903ba4debbf7ee12775d70dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:39.710218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:39.711087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1fee9559-f175-43d9-94d0-a91180493ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:39.713489 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2007/3978] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:39 2022] DELETE /identity/v3/projects/6a3f977903ba4debbf7ee12775d70dc0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:39.717959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:39.718518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:39.718618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:39.758841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:39.761529 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:39.763564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:39.861949 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1972/3979] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:39.868362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe8916-d496-4de5-9a5d-e915072ed0f0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:39.868846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe8916-d496-4de5-9a5d-e915072ed0f0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:39.868957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe8916-d496-4de5-9a5d-e915072ed0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:39.876475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:39.882445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:39.901209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2ffe8916-d496-4de5-9a5d-e915072ed0f0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:39.904614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2ffe8916-d496-4de5-9a5d-e915072ed0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:39.906245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81672418-4dff-4ec2-a5b7-dd1dabbcb016 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:39.915706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:39.916365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:39.916478 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:39.916649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:39.917149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] PATH_INFO: `/v3/projects/457b4e0dc97047a484a487598078fadd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:39.918496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=457b4e0dc97047a484a487598078fadd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:39.925757 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2008/3980] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:39.926007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:39.926107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe8916-d496-4de5-9a5d-e915072ed0f0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:39.944183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe8916-d496-4de5-9a5d-e915072ed0f0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:39.961063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:39.961693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:39.962004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:39.962276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:39.962939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:39.963242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:39.967185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:39.987244 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2009/3981] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:25:39.989199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.004241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909615ab-1de9-458b-b35a-2a7cf8bf4570 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.009552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.015680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.015680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.015680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.015680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.015680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.179975 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2010/3982] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:39 2022] POST /identity/v3/projects => generated 359 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:40.183097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.207156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457b4e0dc97047a484a487598078fadd', 'request_id': 'req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:40.225462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457b4e0dc97047a484a487598078fadd', 'request_id': 'req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:40.312483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457b4e0dc97047a484a487598078fadd', 'request_id': 'req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:40.322589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed48ac5-cdf2-48f0-98da-b8c6ec4c646a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.327590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.328511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.329045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.329524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.330558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.332340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] The token cache is being invalidate because project 457b4e0dc97047a484a487598078fadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:40.332657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:40.333485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-039dad6f-90ab-418e-bd8d-aa0bc3f160cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:40.334725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.335326 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1973/3983] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:39 2022] DELETE /identity/v3/projects/457b4e0dc97047a484a487598078fadd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:40.341515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b348a5a-69f9-4641-a409-988c4dab808c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.342115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b348a5a-69f9-4641-a409-988c4dab808c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.342585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b348a5a-69f9-4641-a409-988c4dab808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.405081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6b348a5a-69f9-4641-a409-988c4dab808c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:40.406534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6b348a5a-69f9-4641-a409-988c4dab808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:40.435262 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1974/3984] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:40.438848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3640ea-0ee6-46cb-a94e-cbd6d654b0c9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.439397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3640ea-0ee6-46cb-a94e-cbd6d654b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.439687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3640ea-0ee6-46cb-a94e-cbd6d654b0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.461371 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2011/3985] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:40 2022] POST /identity/v3/users => generated 280 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:40.464228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5e3640ea-0ee6-46cb-a94e-cbd6d654b0c9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:40.465967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5e3640ea-0ee6-46cb-a94e-cbd6d654b0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:40.466414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.469673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:40.477037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1975/3986] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:25:40.482477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3640ea-0ee6-46cb-a94e-cbd6d654b0c9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.494286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3640ea-0ee6-46cb-a94e-cbd6d654b0c9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.497861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc5009-a0fc-4792-a08b-c7797f651332 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.505611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.506615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.507219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.507763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.508738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:40.509221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.511265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.523883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.524513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.524793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.525066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.526774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1976/3987] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:40.531777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.531951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.537344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.545372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b0688-4988-4cd7-9666-c2619a8ad7f2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.553919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.555191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.555694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.556206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.557375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.560751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.571810 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2012/3988] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:40.576031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.594876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f1fd2-fc8e-414e-b28f-7186cd512c0e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.607293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.608309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.608807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.609391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.610340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.613480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.627588 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2013/3989] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:40.631893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.646849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a7bdc-514f-4261-b744-dc162dae6b8c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.687988 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1977/3990] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:40 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:40.689125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.689772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23dd2f-bd1c-4925-b927-bd6c5f52127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.698330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23dd2f-bd1c-4925-b927-bd6c5f52127c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.698330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23dd2f-bd1c-4925-b927-bd6c5f52127c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.698330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23dd2f-bd1c-4925-b927-bd6c5f52127c admin admin] PATH_INFO: `/v3/projects/e15ccc47a360435a8d80c8247e2b8744/users/14315dd3cb094342a3601f41b606eb15/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.768009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23dd2f-bd1c-4925-b927-bd6c5f52127c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15ccc47a360435a8d80c8247e2b8744, user_id=14315dd3cb094342a3601f41b606eb15, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.773834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23dd2f-bd1c-4925-b927-bd6c5f52127c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.809625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da6638-e822-40df-bef6-1b38574486f2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:40.816537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:40.817578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.818302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.824782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.824782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:40.828204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:40.849849 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2014/3991] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:40 2022] PUT /identity/v3/projects/e15ccc47a360435a8d80c8247e2b8744/users/14315dd3cb094342a3601f41b606eb15/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:40.862597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:40.863378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:40.863732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:40.945515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] MFA Rules not processed for user `14315dd3cb094342a3601f41b606eb15`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:40.952611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:40.953395 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1978/3992] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:40 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:40.960995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:40.990834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81468c-c293-47a6-a818-0a3144ab595c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.149874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2015/3993] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:41.164395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:41.170682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:41.174686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.175337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.182709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.182709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.182709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.182709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:41.200864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1979/3994] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:41.204585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:41.210193 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:41.220854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3e97f-11b6-43d6-be59-d5dfded9fbcd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.236039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.236985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.237459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.239730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.239730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.248072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:41.272134 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1980/3995] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:25:41.280129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:41.312416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0ed68-7385-4e13-bddf-8bcdadfdcb6c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.330010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.331933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.332457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.332971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] PATH_INFO: `/v3/projects/8a0e3830f5104f41ba3d411acff3b31e/users/25bd1b500f994f27b3c34a55cd9182bf/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.340353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b914-65c1-4754-9050-8105c5ab857d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.384239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0e3830f5104f41ba3d411acff3b31e, user_id=25bd1b500f994f27b3c34a55cd9182bf, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.387154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:41.388085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358175ac-6265-4625-b1a4-3cf5ee1839e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.389093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358175ac-6265-4625-b1a4-3cf5ee1839e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.389592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358175ac-6265-4625-b1a4-3cf5ee1839e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.390119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358175ac-6265-4625-b1a4-3cf5ee1839e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.417190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358175ac-6265-4625-b1a4-3cf5ee1839e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.427319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358175ac-6265-4625-b1a4-3cf5ee1839e5 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:41.440818 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2016/3996] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:25:41.454966 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:41.490201 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1981/3997] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:41 2022] PUT /identity/v3/projects/8a0e3830f5104f41ba3d411acff3b31e/users/25bd1b500f994f27b3c34a55cd9182bf/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:41.498864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69360d-db41-465f-9f0e-0b65aead8476 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.499311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69360d-db41-465f-9f0e-0b65aead8476 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.499731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69360d-db41-465f-9f0e-0b65aead8476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.553999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9e69360d-db41-465f-9f0e-0b65aead8476 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:41.555446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9e69360d-db41-465f-9f0e-0b65aead8476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:41.718679 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2017/3998] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:41.803584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:41.926523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77546021-53f3-47f3-9f48-ea398ed34388 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.931063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b79a-a6c8-4e5a-ad41-6bb1f06058c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.931799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b79a-a6c8-4e5a-ad41-6bb1f06058c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.932726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b79a-a6c8-4e5a-ad41-6bb1f06058c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.933113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b79a-a6c8-4e5a-ad41-6bb1f06058c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.968329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6b79a-a6c8-4e5a-ad41-6bb1f06058c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.974298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6b79a-a6c8-4e5a-ad41-6bb1f06058c2 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.003970 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1982/3999] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:42.787678 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:42.842304 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:43.057421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:43.058315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:43.058836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:43.514810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] MFA Rules not processed for user `031144c5b60546c090f11070f68f084e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:43.516061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:43.720202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2018/4000] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 667 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:43.731853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fef49-a2f7-4a13-8de3-05c008dfbcab None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:43.732442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fef49-a2f7-4a13-8de3-05c008dfbcab None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:43.738464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fef49-a2f7-4a13-8de3-05c008dfbcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:43.785424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a30fef49-a2f7-4a13-8de3-05c008dfbcab None None] MFA Rules not processed for user `031144c5b60546c090f11070f68f084e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:43.786885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a30fef49-a2f7-4a13-8de3-05c008dfbcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:43.803242 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1983/4001] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:44.147886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:44.150123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:44.203728 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:44.415306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2066c85-bd0a-49a8-b67e-5ca525c8b687 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:44.434822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:44.435561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:44.439016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:44.439406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:44.460515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:44.467922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:44.493971 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2019/4002] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:44.650097 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:45.876012 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:46.479946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fef49-a2f7-4a13-8de3-05c008dfbcab None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:46.496346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fef49-a2f7-4a13-8de3-05c008dfbcab None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:46.513470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8c00a-83a5-4973-9bc7-6cfcf42179b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:46.514516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c00a-83a5-4973-9bc7-6cfcf42179b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:46.515000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c00a-83a5-4973-9bc7-6cfcf42179b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:46.515471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c00a-83a5-4973-9bc7-6cfcf42179b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:46.521362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-99e8c00a-83a5-4973-9bc7-6cfcf42179b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:46.549082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8c00a-83a5-4973-9bc7-6cfcf42179b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:46.550953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8c00a-83a5-4973-9bc7-6cfcf42179b4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:46.579137 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1984/4003] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:49.631562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:49.633170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:49.664892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e2d6e-3e6d-4072-9bf6-40a806ca7e0a service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:49.693290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:49.695422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:49.697057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:49.698326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] PATH_INFO: `/v3/users/18ac94451b0a4d7185a4d002ddd22879` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:49.702514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ac94451b0a4d7185a4d002ddd22879)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:49.706113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:50.008183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ac94451b0a4d7185a4d002ddd22879'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:50.010126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ac94451b0a4d7185a4d002ddd22879'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:50.054902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:50.055816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:50.057053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:50.088678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ac94451b0a4d7185a4d002ddd22879'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:50.102003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ac94451b0a4d7185a4d002ddd22879'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:50.102811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bcfbfc7-df19-45f7-8640-bdb721250124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ac94451b0a4d7185a4d002ddd22879'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:50.112944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] MFA Rules not processed for user `3971dce263494606bc5ed74dc141c482`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:50.114700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:50.154410 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2020/4004] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:49 2022] DELETE /identity/v3/users/18ac94451b0a4d7185a4d002ddd22879 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:50.303600 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1985/4005] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:50.321998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:50.322292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:50.322579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:50.387101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] MFA Rules not processed for user `3971dce263494606bc5ed74dc141c482`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:50.389181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:50.495217 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2021/4006] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:50.504439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:50.507214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:50.526586 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:50.533617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd2d3b-4c65-412f-85fe-2a0d65bc6e21 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:50.647025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cbce8-4663-4d46-9def-6ae65c6a30b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:50.647793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cbce8-4663-4d46-9def-6ae65c6a30b0 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:50.648200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cbce8-4663-4d46-9def-6ae65c6a30b0 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:50.648804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cbce8-4663-4d46-9def-6ae65c6a30b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:50.667767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cbce8-4663-4d46-9def-6ae65c6a30b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:50.670741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cbce8-4663-4d46-9def-6ae65c6a30b0 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:50.698418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1986/4007] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:51.293505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:51.296155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:51.409632 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:51.475506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1c12b-269f-4ec5-af73-617509531751 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:51.486076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:51.487159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:51.488921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:51.489291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] PATH_INFO: `/v3/projects/ab4e846211c643bdb176dba54ad0b757` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:51.490788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4e846211c643bdb176dba54ad0b757)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:51.495301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:51.670177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4e846211c643bdb176dba54ad0b757', 'request_id': 'req-042c37a0-5980-4715-90ad-bf24608b2f71'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:51.680118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4e846211c643bdb176dba54ad0b757', 'request_id': 'req-042c37a0-5980-4715-90ad-bf24608b2f71'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:51.761960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4e846211c643bdb176dba54ad0b757', 'request_id': 'req-042c37a0-5980-4715-90ad-bf24608b2f71'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:51.782628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] The token cache is being invalidate because project ab4e846211c643bdb176dba54ad0b757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:51.782985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:51.784273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-042c37a0-5980-4715-90ad-bf24608b2f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:51.787223 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2022/4008] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:51 2022] DELETE /identity/v3/projects/ab4e846211c643bdb176dba54ad0b757 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:51.795180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf0c8-4da5-4aac-be55-def5324d6118 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:51.796125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf0c8-4da5-4aac-be55-def5324d6118 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:51.796341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf0c8-4da5-4aac-be55-def5324d6118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:51.826796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-45bcf0c8-4da5-4aac-be55-def5324d6118 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:51.828348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-45bcf0c8-4da5-4aac-be55-def5324d6118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:51.925763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1987/4009] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:51.933845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06590a-4b70-44b0-80c4-db0c0d71ef4b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:51.934171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06590a-4b70-44b0-80c4-db0c0d71ef4b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:51.934563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06590a-4b70-44b0-80c4-db0c0d71ef4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:51.972457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cb06590a-4b70-44b0-80c4-db0c0d71ef4b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:51.972457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cb06590a-4b70-44b0-80c4-db0c0d71ef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:51.997292 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2023/4010] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:52.001523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf0c8-4da5-4aac-be55-def5324d6118 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:52.014588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf0c8-4da5-4aac-be55-def5324d6118 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:52.020443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:52.021351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:52.024048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:52.024048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:52.024048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:52.024048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:52.025008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:52.077188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06590a-4b70-44b0-80c4-db0c0d71ef4b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:52.085902 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1988/4011] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:25:52.093780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06590a-4b70-44b0-80c4-db0c0d71ef4b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:52.105937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:52.106949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:52.119192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:52.119619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:52.128761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:52.128761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:52.355239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2024/4012] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:52 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:52.359922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:52.383026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397c14-9c01-4295-906a-305d1ad4b902 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:52.525020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:52.525677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:52.525988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:52.526309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:52.532300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:52.534944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:52.675010 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1989/4013] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:52 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:25:52.681342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:52.698883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aea3e-ef9f-4cbb-8215-0ce917bb8f73 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:52.718973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:52.732754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:52.733046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:52.733331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:52.734041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:52.740109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:52.753618 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2025/4014] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:52.757504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:52.773136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dea87e-a8e0-4351-891c-8aeeb9883753 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:52.782071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66201500-e810-4588-843c-1530a35d9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:52.782821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201500-e810-4588-843c-1530a35d9fbf admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:52.783104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201500-e810-4588-843c-1530a35d9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:52.783385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66201500-e810-4588-843c-1530a35d9fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:52.784036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66201500-e810-4588-843c-1530a35d9fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:52.786588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66201500-e810-4588-843c-1530a35d9fbf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:52.788294 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:52.803475 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1990/4015] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:52.814365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:52.827085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bb104-82c2-4094-8542-ec80cc178479 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:52.841744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:52.842646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:52.849165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:52.849165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] PATH_INFO: `/v3/projects/ba905db4262c4fd1bfbecc2f6fb6c0e1/users/239f395ddf0f437fa2f2e81cb56aa08c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:52.867150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba905db4262c4fd1bfbecc2f6fb6c0e1, user_id=239f395ddf0f437fa2f2e81cb56aa08c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:52.870305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:53.018163 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2026/4016] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:52 2022] PUT /identity/v3/projects/ba905db4262c4fd1bfbecc2f6fb6c0e1/users/239f395ddf0f437fa2f2e81cb56aa08c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:53.029820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:53.029820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:53.030133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:53.080926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] MFA Rules not processed for user `239f395ddf0f437fa2f2e81cb56aa08c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:53.080926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:53.265120 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1991/4017] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:53.281648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:53.284377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:53.449544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80533d78-b31d-4d7d-b832-3625a912d373 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:53.467235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:53.468143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:53.468679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:53.469327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:53.482568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:53.485097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:53.500652 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2027/4018] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:53.797681 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:59.082579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:59.084090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:59.258008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52265ff7-b3dd-4466-adcd-e9d895dc47a1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:59.268128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:59.270276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:59.271688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:59.272940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:59.279632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:59.300356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:59.303077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:59.326826 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1992/4019] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:01.512381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:01.513722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:01.800630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c507de-503e-4070-8633-a99ec3e101b3 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:01.837186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:01.838510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:01.839882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:01.840833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] PATH_INFO: `/v3/users/b6fd46ce61784787801118b9d98c308b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:01.843484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fd46ce61784787801118b9d98c308b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:01.849942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:02.131669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fd46ce61784787801118b9d98c308b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:02.133158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fd46ce61784787801118b9d98c308b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:02.308078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fd46ce61784787801118b9d98c308b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:02.349634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fd46ce61784787801118b9d98c308b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:02.351253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e347183-6e00-41dc-869c-bf77c0bffca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fd46ce61784787801118b9d98c308b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:02.437329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:02.438573 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2028/4020] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:01 2022] DELETE /identity/v3/users/b6fd46ce61784787801118b9d98c308b => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:02.439955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:02.440241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:02.440513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:02.457517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:02.488963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:02.490207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:02.594716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968fb09-8cd5-4b84-a990-3f67b8e28493 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:02.640440 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:02.660857 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2029/4021] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:02.739495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:02.740144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:02.740425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:02.740698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] PATH_INFO: `/v3/users/df310911396d4dbea6cffd534976f0a1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:02.742067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df310911396d4dbea6cffd534976f0a1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:02.749431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:02.785741 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:02.797233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:02.798837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:02.963021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80a997-8d1c-4a47-9065-9fad2dc2d983 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:02.968297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:02.969336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:02.970579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:02.971075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:02.992799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:02.995111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:03.015586 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2030/4022] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:26:03.072327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df310911396d4dbea6cffd534976f0a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:03.096526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df310911396d4dbea6cffd534976f0a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:03.110395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df310911396d4dbea6cffd534976f0a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:03.113905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df310911396d4dbea6cffd534976f0a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:03.245615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-006a54f3-f617-4c1c-8f2c-9fbc776cb301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df310911396d4dbea6cffd534976f0a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:03.255716 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1993/4023] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:02 2022] DELETE /identity/v3/users/df310911396d4dbea6cffd534976f0a1 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:03.790197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:03.792178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:03.838948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297a76-fc8b-4506-95c4-0d382625c041 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:03.991601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:03.993091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:03.993442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:03.993779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] PATH_INFO: `/v3/projects/dd5c28182a23440782a46f2d08791955` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:03.995130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5c28182a23440782a46f2d08791955)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:03.997493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:04.206500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5c28182a23440782a46f2d08791955', 'request_id': 'req-a9a1a59b-b687-4011-953f-2669f4666b84'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:04.224441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5c28182a23440782a46f2d08791955', 'request_id': 'req-a9a1a59b-b687-4011-953f-2669f4666b84'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:04.310881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5c28182a23440782a46f2d08791955', 'request_id': 'req-a9a1a59b-b687-4011-953f-2669f4666b84'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:04.329009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] The token cache is being invalidate because project dd5c28182a23440782a46f2d08791955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:04.329565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:04.330486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9a1a59b-b687-4011-953f-2669f4666b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:04.338656 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2031/4024] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:03 2022] DELETE /identity/v3/projects/dd5c28182a23440782a46f2d08791955 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:04.339853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2233a0-40c4-4470-9d1e-9886a38f020f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:04.341584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2233a0-40c4-4470-9d1e-9886a38f020f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:04.341896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2233a0-40c4-4470-9d1e-9886a38f020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:04.371322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7d2233a0-40c4-4470-9d1e-9886a38f020f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:04.375231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d2233a0-40c4-4470-9d1e-9886a38f020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:04.514245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1994/4025] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:04.516237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b0d5-41fa-4225-9075-30eac75a6f1b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:04.516534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b0d5-41fa-4225-9075-30eac75a6f1b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:04.516814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b0d5-41fa-4225-9075-30eac75a6f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:04.541228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-71b0b0d5-41fa-4225-9075-30eac75a6f1b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:04.542475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-71b0b0d5-41fa-4225-9075-30eac75a6f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:04.557172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2032/4026] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:04.560473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2233a0-40c4-4470-9d1e-9886a38f020f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:04.576938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2233a0-40c4-4470-9d1e-9886a38f020f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:04.582272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:04.583007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:04.583389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:04.584591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:04.585385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:04.585798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:04.590994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:04.639779 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1995/4027] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:04.644435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b0d5-41fa-4225-9075-30eac75a6f1b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:04.664300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b0d5-41fa-4225-9075-30eac75a6f1b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:04.671322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:04.674610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:04.674904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:04.675187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:04.678414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:04.680392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:04.766432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:04.768553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:04.792769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2033/4028] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:04 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:04.795478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3569cad-ee61-4b68-8810-90480a500298 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:04.796871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:04.804977 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:04.949608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018af9e-52a9-4aa2-83b4-317df53a38ba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:04.957864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52502c60-94a1-455a-a265-b5008809c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:04.959534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52502c60-94a1-455a-a265-b5008809c5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:04.960512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52502c60-94a1-455a-a265-b5008809c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:04.961313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52502c60-94a1-455a-a265-b5008809c5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:04.964644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52502c60-94a1-455a-a265-b5008809c5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:04.967049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52502c60-94a1-455a-a265-b5008809c5e6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:04.974783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:04.975474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:04.975722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:04.976055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] PATH_INFO: `/v3/projects/747a7385561d49c8b1659a38999246d6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:04.981328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747a7385561d49c8b1659a38999246d6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:04.983276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:05.062518 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:05.128800 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2034/4029] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:04 2022] POST /identity/v3/users => generated 303 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:26:05.130331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312da9e-7846-4dad-87a1-5d4726c92234 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.130692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312da9e-7846-4dad-87a1-5d4726c92234 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.131042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312da9e-7846-4dad-87a1-5d4726c92234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.213826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747a7385561d49c8b1659a38999246d6', 'request_id': 'req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:05.234526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747a7385561d49c8b1659a38999246d6', 'request_id': 'req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:05.254670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b312da9e-7846-4dad-87a1-5d4726c92234 None None] MFA Rules not processed for user `25bd1b500f994f27b3c34a55cd9182bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:05.257421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b312da9e-7846-4dad-87a1-5d4726c92234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:05.328487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747a7385561d49c8b1659a38999246d6', 'request_id': 'req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:05.358052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] The token cache is being invalidate because project 747a7385561d49c8b1659a38999246d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:05.361562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:05.362510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:05.366253 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1996/4030] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:04 2022] DELETE /identity/v3/projects/747a7385561d49c8b1659a38999246d6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:26:05.367703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:05.374196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:05.448976 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2035/4031] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:05.451029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df068139-57a2-4345-89f9-187f220f2ae8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.451316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df068139-57a2-4345-89f9-187f220f2ae8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.451589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df068139-57a2-4345-89f9-187f220f2ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.513479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-df068139-57a2-4345-89f9-187f220f2ae8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:05.515818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df068139-57a2-4345-89f9-187f220f2ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:05.539698 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2036/4032] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:05.541075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad004665-3602-4694-9995-47538058b809 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.541364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad004665-3602-4694-9995-47538058b809 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.541635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad004665-3602-4694-9995-47538058b809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.553191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa37e0-d30e-44e6-a16a-e892c04aa4e9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:05.575255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf8139-22ef-4dec-ba2d-a0b71f0a39cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:05.590952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf8139-22ef-4dec-ba2d-a0b71f0a39cc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.592455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf8139-22ef-4dec-ba2d-a0b71f0a39cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.593195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf8139-22ef-4dec-ba2d-a0b71f0a39cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.594802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf8139-22ef-4dec-ba2d-a0b71f0a39cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:05.599943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf8139-22ef-4dec-ba2d-a0b71f0a39cc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:05.607792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ad004665-3602-4694-9995-47538058b809 None None] MFA Rules not processed for user `25bd1b500f994f27b3c34a55cd9182bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:05.607792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ad004665-3602-4694-9995-47538058b809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:05.647340 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1997/4033] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:05.648396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.648703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.648978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.660536 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2037/4034] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:05.662045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad004665-3602-4694-9995-47538058b809 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:05.681099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad004665-3602-4694-9995-47538058b809 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:05.682313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:05.683832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:05.688431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:05.689163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.689543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.689962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.690709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:05.694262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:05.697755 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1998/4035] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:05.702862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:05.702862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:05.718269 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2038/4036] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:05.718269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:05.737320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced0e03-9842-488c-89c5-fd78b60d19fd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:05.745106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:05.746886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.747189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.748102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.749557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:05.750987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:05.755209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:05.789792 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2039/4037] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:05.790801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:05.811509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6178ed-e253-4c0f-88d6-1e6826aa4737 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:05.817762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:05.819178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.819971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.820457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] PATH_INFO: `/v3/projects/b8d01788def7407e9c73624ed55ee51c/users/a43d35b5382545418114a11c85e52997/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.844886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d01788def7407e9c73624ed55ee51c, user_id=a43d35b5382545418114a11c85e52997, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:05.848708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:05.878572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fd2ba-f27d-497e-9ee9-96dc59383ec9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:05.894599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267474ec-ca21-4da3-979a-57ffc5928f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:05.895359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267474ec-ca21-4da3-979a-57ffc5928f2d service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.895738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267474ec-ca21-4da3-979a-57ffc5928f2d service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.896110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267474ec-ca21-4da3-979a-57ffc5928f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.917802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267474ec-ca21-4da3-979a-57ffc5928f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:05.919693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267474ec-ca21-4da3-979a-57ffc5928f2d service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:05.934493 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2040/4038] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:05 2022] PUT /identity/v3/projects/b8d01788def7407e9c73624ed55ee51c/users/a43d35b5382545418114a11c85e52997/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:05.935832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:05.944204 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 1999/4039] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:05.948695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:05.949072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:05.950113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:05.998193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:06.002660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:06.057404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad169901-c595-4f5f-8ce5-8da17f85ecf9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:06.069662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:06.070372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:06.071751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:06.072039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:06.076063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:06.078950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:06.139802 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:06.163434 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2000/4040] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:06.204826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:06.206412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:06.207536 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2041/4041] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:05 2022] POST /identity/v3/projects => generated 367 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:06.211928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:06.273452 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:06.388503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac21a3-b9fb-4a6c-bfff-d96ac11ac6dd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:06.428390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bae5aa-b444-4696-b127-9414aabefe67 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:06.444893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:06.445522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:06.445803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:06.446149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:06.446792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:06.454830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:06.509643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:06.510542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:06.510833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:06.511109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:06.531089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:06.532608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:06.548584 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2001/4042] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:06.596819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:06.606769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2042/4043] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:06 2022] POST /identity/v3/users => generated 284 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:06.617720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb51898-52d0-4ee2-a9f3-c01ca113484c service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:06.625271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:06.625993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:06.626325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:06.626607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:06.627353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:06.629486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:06.674972 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2002/4044] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:06.675227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:06.678735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9855d8a-b2dd-4f2b-bfc4-9d12870469c3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:06.691090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8713b6e-880d-4bc7-8247-cb5eff5fb426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:06.692092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713b6e-880d-4bc7-8247-cb5eff5fb426 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:06.704075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713b6e-880d-4bc7-8247-cb5eff5fb426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:06.704075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8713b6e-880d-4bc7-8247-cb5eff5fb426 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:06.704075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8713b6e-880d-4bc7-8247-cb5eff5fb426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:06.704075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8713b6e-880d-4bc7-8247-cb5eff5fb426 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:06.712074 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2043/4045] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:06.717509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:06.730215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069291a-5305-4ba0-9e97-6b6d611bb78a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:06.736212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:06.737317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:06.737767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:06.738236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] PATH_INFO: `/v3/projects/7f7b2419381d4a15877f415beaa7e435/users/341614326cee4db394f89ba476a30d9a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:06.776465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7b2419381d4a15877f415beaa7e435, user_id=341614326cee4db394f89ba476a30d9a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:06.779361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:06.917903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7c0fe-d049-4f08-bb0e-7391e8146abd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:06.919163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7c0fe-d049-4f08-bb0e-7391e8146abd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:06.919163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7c0fe-d049-4f08-bb0e-7391e8146abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:06.922537 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2003/4046] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:06 2022] PUT /identity/v3/projects/7f7b2419381d4a15877f415beaa7e435/users/341614326cee4db394f89ba476a30d9a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:06.952317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c9a7c0fe-d049-4f08-bb0e-7391e8146abd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:06.966115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c9a7c0fe-d049-4f08-bb0e-7391e8146abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:07.071110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2044/4047] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:07.143209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:07.366923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb62ba0-1024-4421-9b1b-b846949d9d0a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:07.380142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:07.381938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:07.385263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:07.385862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:07.423218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:07.446947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:07.479854 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2004/4048] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:07.934644 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:08.755134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:08.755707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:08.755707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:08.826231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] MFA Rules not processed for user `1d38b3bd03cc4c008039999b9258f5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:08.827950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:08.855104 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:08.956604 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2045/4049] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:10.875172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:11.092745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb3c0-7895-4eaa-9373-fef93a290f46 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:11.107746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc21bbd-d45b-4bb1-83fc-81ad7b7d34dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:11.110488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc21bbd-d45b-4bb1-83fc-81ad7b7d34dd service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:11.111647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc21bbd-d45b-4bb1-83fc-81ad7b7d34dd service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:11.112717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc21bbd-d45b-4bb1-83fc-81ad7b7d34dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:11.117657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7bc21bbd-d45b-4bb1-83fc-81ad7b7d34dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:11.149552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc21bbd-d45b-4bb1-83fc-81ad7b7d34dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:11.158375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc21bbd-d45b-4bb1-83fc-81ad7b7d34dd service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:11.178850 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2005/4050] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:14.505850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:14.505850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:14.522209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a52de-38d1-4fb2-afc9-0cb5aa18f27f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:14.528772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:14.530043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:14.530742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:14.532627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] PATH_INFO: `/v3/users/239f395ddf0f437fa2f2e81cb56aa08c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:14.534279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=239f395ddf0f437fa2f2e81cb56aa08c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:14.536804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:14.790852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '239f395ddf0f437fa2f2e81cb56aa08c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:14.791552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '239f395ddf0f437fa2f2e81cb56aa08c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:14.859805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '239f395ddf0f437fa2f2e81cb56aa08c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:14.906549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '239f395ddf0f437fa2f2e81cb56aa08c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:14.911993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '239f395ddf0f437fa2f2e81cb56aa08c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:14.958142 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2046/4051] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:14 2022] DELETE /identity/v3/users/239f395ddf0f437fa2f2e81cb56aa08c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:14.959923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a41a4-8edc-4c1f-a847-00237c6e1fe3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:14.960400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a41a4-8edc-4c1f-a847-00237c6e1fe3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:14.960500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a41a4-8edc-4c1f-a847-00237c6e1fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:15.015917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-047a41a4-8edc-4c1f-a847-00237c6e1fe3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:15.017413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-047a41a4-8edc-4c1f-a847-00237c6e1fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:15.174799 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2006/4052] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:15.209582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:15.209582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:15.392327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46c6b-58a4-4093-b1ec-a165616d7e0d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:15.401585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4409e-06c6-4f6e-8639-f570127bf615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:15.402772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4409e-06c6-4f6e-8639-f570127bf615 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:15.409709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4409e-06c6-4f6e-8639-f570127bf615 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:15.409709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4409e-06c6-4f6e-8639-f570127bf615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:15.438204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4409e-06c6-4f6e-8639-f570127bf615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:15.439780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4409e-06c6-4f6e-8639-f570127bf615 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:15.472852 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2047/4053] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:17.005304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb50212-f2fa-4b41-868a-492cd8b7746d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:17.006481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb50212-f2fa-4b41-868a-492cd8b7746d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:17.006928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb50212-f2fa-4b41-868a-492cd8b7746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:17.047186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6cb50212-f2fa-4b41-868a-492cd8b7746d None None] MFA Rules not processed for user `3971dce263494606bc5ed74dc141c482`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:17.048438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6cb50212-f2fa-4b41-868a-492cd8b7746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:17.178886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2007/4054] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:17.316825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a2a0-6a70-40b7-88d9-c381aab91e5b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:17.319470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a2a0-6a70-40b7-88d9-c381aab91e5b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:17.319804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a2a0-6a70-40b7-88d9-c381aab91e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:17.353511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bc99a2a0-6a70-40b7-88d9-c381aab91e5b None None] MFA Rules not processed for user `3971dce263494606bc5ed74dc141c482`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:17.359413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bc99a2a0-6a70-40b7-88d9-c381aab91e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:17.369926 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2048/4055] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:17.422092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241dbc-8866-4e28-8106-334a20d5c514 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:17.422636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241dbc-8866-4e28-8106-334a20d5c514 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:17.423124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241dbc-8866-4e28-8106-334a20d5c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:17.458190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-af241dbc-8866-4e28-8106-334a20d5c514 None None] MFA Rules not processed for user `3971dce263494606bc5ed74dc141c482`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:17.459383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-af241dbc-8866-4e28-8106-334a20d5c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:17.477412 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2008/4056] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:18.012152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:18.012152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:18.012152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:18.053554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] MFA Rules not processed for user `3971dce263494606bc5ed74dc141c482`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:18.053554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:18.078310 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2049/4057] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:18.115658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:18.115658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:18.115658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:18.137359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] MFA Rules not processed for user `3971dce263494606bc5ed74dc141c482`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:18.138765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:18.171589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2009/4058] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:18.328188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:18.334270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:18.350324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035200-17df-4715-a098-ac83fdaac9e5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:18.357085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:18.358340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:18.358605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:18.359119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] PATH_INFO: `/v3/projects/ba905db4262c4fd1bfbecc2f6fb6c0e1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:18.361453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba905db4262c4fd1bfbecc2f6fb6c0e1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:18.364556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:18.529745 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:18.554588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba905db4262c4fd1bfbecc2f6fb6c0e1', 'request_id': 'req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:18.571733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba905db4262c4fd1bfbecc2f6fb6c0e1', 'request_id': 'req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:18.616587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:18.618168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:18.640052 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:18.686980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba905db4262c4fd1bfbecc2f6fb6c0e1', 'request_id': 'req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:18.707287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] The token cache is being invalidate because project ba905db4262c4fd1bfbecc2f6fb6c0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:18.711200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:18.713146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0d44a51c-c161-4c9b-9b4c-5a2b9a361c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:18.718434 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2050/4059] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:18 2022] DELETE /identity/v3/projects/ba905db4262c4fd1bfbecc2f6fb6c0e1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:18.724079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1f8ee-263d-4d6e-936f-e6cf3889f52c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:18.724469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1f8ee-263d-4d6e-936f-e6cf3889f52c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:18.724886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1f8ee-263d-4d6e-936f-e6cf3889f52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:18.759557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f812b-8e09-42c4-9d35-e048beb43cea None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:18.775916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-07f1f8ee-263d-4d6e-936f-e6cf3889f52c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:18.780528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-07f1f8ee-263d-4d6e-936f-e6cf3889f52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:18.900230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:18.908174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:18.909066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:18.910587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:18.916594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:18.942195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:18.945501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:18.959952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2051/4060] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:18.962340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3554-b243-403e-8f16-f258c6b2314d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:18.962635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3554-b243-403e-8f16-f258c6b2314d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:18.962912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3554-b243-403e-8f16-f258c6b2314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:18.986675 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2010/4061] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:26:19.004511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2bdc3554-b243-403e-8f16-f258c6b2314d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:19.007002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2bdc3554-b243-403e-8f16-f258c6b2314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:19.023517 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2052/4062] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:19.028944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.051443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea2dae-6346-4d6f-babb-af41abda8ca9 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.056911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.058131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.063972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.063972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.063972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:19.063972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.063972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.079673 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2011/4063] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:19.084051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3554-b243-403e-8f16-f258c6b2314d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.113239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3554-b243-403e-8f16-f258c6b2314d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.126295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.128522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.128923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.130423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.131498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.136660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.239261 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2053/4064] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:19 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:19.243798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.264677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4c14-c1b3-4cfd-b3f7-6576b91fae1d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.453662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.454387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.454810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.455228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.455874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.458034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.580659 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2012/4065] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:19 2022] POST /identity/v3/users => generated 287 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:19.584979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.601190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2172a9e-fcfb-476d-9c3d-cfed05a2580d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.607421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.617548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.617548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.617548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.617548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.617548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.644049 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2054/4066] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:19.646400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.701660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4acf2e-d717-46ed-9a23-010e1face588 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.750623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59dc1-2e86-4440-89b2-09f8b4dbc0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.751263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59dc1-2e86-4440-89b2-09f8b4dbc0dc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.752149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59dc1-2e86-4440-89b2-09f8b4dbc0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.752438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59dc1-2e86-4440-89b2-09f8b4dbc0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.753104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a59dc1-2e86-4440-89b2-09f8b4dbc0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.754772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a59dc1-2e86-4440-89b2-09f8b4dbc0dc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.795710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.795823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2013/4067] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:19.797667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1944c-89cc-499e-91d3-0baf2fa25edf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.813544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.814852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.815350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.815790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] PATH_INFO: `/v3/projects/4a9ef5573ba4486eb17df3d7858b229c/users/25169831c45f4c27a292a6cc0b7bdafb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.844835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9ef5573ba4486eb17df3d7858b229c, user_id=25169831c45f4c27a292a6cc0b7bdafb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.848946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.994451 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2055/4068] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:19 2022] PUT /identity/v3/projects/4a9ef5573ba4486eb17df3d7858b229c/users/25169831c45f4c27a292a6cc0b7bdafb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:20.089542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78215b-dbbf-4deb-ac3e-96582006fc50 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:20.090469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78215b-dbbf-4deb-ac3e-96582006fc50 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:20.090903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78215b-dbbf-4deb-ac3e-96582006fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:20.131284 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:20.163525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ab78215b-dbbf-4deb-ac3e-96582006fc50 None None] MFA Rules not processed for user `25169831c45f4c27a292a6cc0b7bdafb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:20.164947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ab78215b-dbbf-4deb-ac3e-96582006fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:20.370212 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2014/4069] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:20.382396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:20.384335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:20.485193 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:20.516352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14591f-520d-45d8-9ecd-d4159adab294 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:20.523303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:20.524143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:20.525470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:20.525470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:20.536552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:20.538895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:20.558232 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2056/4070] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:22.651678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210cc4-9c06-4f77-a6d8-1606eb2a7802 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:22.651678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210cc4-9c06-4f77-a6d8-1606eb2a7802 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:22.651678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210cc4-9c06-4f77-a6d8-1606eb2a7802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:22.780808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-59210cc4-9c06-4f77-a6d8-1606eb2a7802 None None] MFA Rules not processed for user `a43d35b5382545418114a11c85e52997`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:22.796046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-59210cc4-9c06-4f77-a6d8-1606eb2a7802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:23.034742 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2015/4071] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:23.262816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:23.287231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b030083-7c75-420a-9653-d392f5edc83b service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:23.298580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e40af-8dc2-4c06-b2f0-54074038bb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:23.299692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e40af-8dc2-4c06-b2f0-54074038bb2b service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:23.300283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e40af-8dc2-4c06-b2f0-54074038bb2b service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:23.302194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e40af-8dc2-4c06-b2f0-54074038bb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:23.321984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e40af-8dc2-4c06-b2f0-54074038bb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:23.324186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e40af-8dc2-4c06-b2f0-54074038bb2b service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:23.351770 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2057/4072] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:23 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:27.822959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:27.825354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:27.825830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:27.889764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:27.892645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:28.028947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c053b-ec19-4528-96ae-339e86d928da None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:28.029493 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2016/4073] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:28.029589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c053b-ec19-4528-96ae-339e86d928da None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:28.029589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c053b-ec19-4528-96ae-339e86d928da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:28.064002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-be5c053b-ec19-4528-96ae-339e86d928da None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:28.065431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-be5c053b-ec19-4528-96ae-339e86d928da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:28.087768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2058/4074] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:28.338326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:28.345078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:28.367349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9623f-6334-4940-80e8-5ff92fa8eeee None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:28.375047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150fd1-e2db-4c5d-9349-37b6940e896a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:28.375956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150fd1-e2db-4c5d-9349-37b6940e896a service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:28.376313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150fd1-e2db-4c5d-9349-37b6940e896a service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:28.376701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150fd1-e2db-4c5d-9349-37b6940e896a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:28.389270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53150fd1-e2db-4c5d-9349-37b6940e896a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:28.390940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53150fd1-e2db-4c5d-9349-37b6940e896a service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:28.422104 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2017/4075] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:29.844467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c053b-ec19-4528-96ae-339e86d928da None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:30.018641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c053b-ec19-4528-96ae-339e86d928da None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:30.029873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:30.033428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:30.034369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:30.034839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] PATH_INFO: `/v3/users/25169831c45f4c27a292a6cc0b7bdafb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:30.039928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25169831c45f4c27a292a6cc0b7bdafb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:30.046866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:30.317648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25169831c45f4c27a292a6cc0b7bdafb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:30.318367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25169831c45f4c27a292a6cc0b7bdafb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:30.423676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25169831c45f4c27a292a6cc0b7bdafb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:30.442670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25169831c45f4c27a292a6cc0b7bdafb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:30.445540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25169831c45f4c27a292a6cc0b7bdafb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:30.554430 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2059/4076] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:29 2022] DELETE /identity/v3/users/25169831c45f4c27a292a6cc0b7bdafb => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:30.555680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:30.557062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:30.558151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:30.568827 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:30.607263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:30.610948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:30.825354 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2018/4077] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:30.849133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:30.851104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:30.998902 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:31.091140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458c59-a4b5-441d-ae8e-e0d9e932a0c6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:31.100722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758f610-3a51-4f3b-98fc-bdc9e19c86d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:31.101394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f610-3a51-4f3b-98fc-bdc9e19c86d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:31.101670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f610-3a51-4f3b-98fc-bdc9e19c86d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:31.101976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f610-3a51-4f3b-98fc-bdc9e19c86d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:31.127379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758f610-3a51-4f3b-98fc-bdc9e19c86d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:31.128869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758f610-3a51-4f3b-98fc-bdc9e19c86d8 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:31.179785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2060/4078] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:32.829999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:32.831712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:32.872814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f60cae-ed52-4abc-84f5-f5f6effa2ddd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:32.899717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:32.905012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:32.905696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:32.906422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] PATH_INFO: `/v3/projects/4a9ef5573ba4486eb17df3d7858b229c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:32.913191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9ef5573ba4486eb17df3d7858b229c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:32.931329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:33.134030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9ef5573ba4486eb17df3d7858b229c', 'request_id': 'req-4bddcf13-d0be-434a-ba5b-dceb076e61f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.148382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9ef5573ba4486eb17df3d7858b229c', 'request_id': 'req-4bddcf13-d0be-434a-ba5b-dceb076e61f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.224509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9ef5573ba4486eb17df3d7858b229c', 'request_id': 'req-4bddcf13-d0be-434a-ba5b-dceb076e61f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.253560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] The token cache is being invalidate because project 4a9ef5573ba4486eb17df3d7858b229c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:33.262525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.265143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4bddcf13-d0be-434a-ba5b-dceb076e61f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.273114 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2019/4079] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:32 2022] DELETE /identity/v3/projects/4a9ef5573ba4486eb17df3d7858b229c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:33.275306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aacc72-fd42-49ae-8a16-78a984ce9407 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:33.275799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aacc72-fd42-49ae-8a16-78a984ce9407 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:33.276321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aacc72-fd42-49ae-8a16-78a984ce9407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:33.341025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f6aacc72-fd42-49ae-8a16-78a984ce9407 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:33.342331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f6aacc72-fd42-49ae-8a16-78a984ce9407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:33.571672 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2061/4080] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:33.579121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9067f-1380-4665-9c9a-e82b0e232efb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:33.580452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9067f-1380-4665-9c9a-e82b0e232efb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:33.580959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9067f-1380-4665-9c9a-e82b0e232efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:33.642628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0ee9067f-1380-4665-9c9a-e82b0e232efb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:33.651030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0ee9067f-1380-4665-9c9a-e82b0e232efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:33.671561 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2020/4081] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:33.673138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aacc72-fd42-49ae-8a16-78a984ce9407 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:33.687825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aacc72-fd42-49ae-8a16-78a984ce9407 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:33.703121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:33.703767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:33.704049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:33.704325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:33.704994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:33.705301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:33.708488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:33.740728 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2062/4082] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:33.747176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9067f-1380-4665-9c9a-e82b0e232efb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:33.768323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9067f-1380-4665-9c9a-e82b0e232efb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:33.780105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:33.780791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:33.781076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:33.781353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:33.783454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:33.786970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:33.969600 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2021/4083] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:33 2022] POST /identity/v3/projects => generated 389 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:33.974628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:33.992131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa63769-1d24-4c84-b084-7aba485f5a45 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.198092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.198092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.198092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.198092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.200178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.200178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.306894 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2063/4084] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:33 2022] POST /identity/v3/users => generated 295 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:34.307659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.348190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fb913-218c-4cc2-a2b5-4fe829ee7a2f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.401274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.414318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.414318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.414318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.414318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.442039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.475033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.489561 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2022/4085] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:34.498210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5007e-a24d-4f44-a5fc-00b7f0d8ffb1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.512024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a2eda-6b9e-44bb-9b3f-402a80e55d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.512764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2eda-6b9e-44bb-9b3f-402a80e55d77 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.513046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2eda-6b9e-44bb-9b3f-402a80e55d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.513394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2eda-6b9e-44bb-9b3f-402a80e55d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.514077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a2eda-6b9e-44bb-9b3f-402a80e55d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.518215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a2eda-6b9e-44bb-9b3f-402a80e55d77 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.546877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.553378 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2064/4086] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:34.566817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad491-1dd6-41a3-a4a3-1d14cae89b08 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.588495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.588495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.588495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.588495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] PATH_INFO: `/v3/projects/650830135714407a9b22078c244fd03a/users/9a0c190f083f4332a2cd6a9d16ba3a8e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.626791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=650830135714407a9b22078c244fd03a, user_id=9a0c190f083f4332a2cd6a9d16ba3a8e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.635230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.728478 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2023/4087] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:34 2022] PUT /identity/v3/projects/650830135714407a9b22078c244fd03a/users/9a0c190f083f4332a2cd6a9d16ba3a8e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:34.743462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06ea7-2401-4e29-a5f0-732dbc23fc61 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.743747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06ea7-2401-4e29-a5f0-732dbc23fc61 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.744022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d06ea7-2401-4e29-a5f0-732dbc23fc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.810089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a0d06ea7-2401-4e29-a5f0-732dbc23fc61 None None] MFA Rules not processed for user `9a0c190f083f4332a2cd6a9d16ba3a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:34.812119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0d06ea7-2401-4e29-a5f0-732dbc23fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:34.864846 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:34.935175 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2065/4088] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:34.942690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.991174 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:35.038733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40b05c-a15e-45dd-a0d9-dfb18b87d7ee admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.044992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.051889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.052282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.054290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.054290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.056428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:35.172163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06ea7-2401-4e29-a5f0-732dbc23fc61 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:35.182633 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2024/4089] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:34 2022] POST /identity/v3/projects => generated 391 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:35.189535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d06ea7-2401-4e29-a5f0-732dbc23fc61 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.283135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.283828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.284031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.284304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.285279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.289034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:35.436902 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2066/4090] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:35 2022] POST /identity/v3/users => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:26:35.441418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:35.463247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5ade-45f5-4821-8702-38b718bd6bd6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.480150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.482967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.483471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.483567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.485026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.488125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:35.521517 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2025/4091] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:35.531832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:35.542405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017ce6-9283-406b-8343-dbf6ad845262 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.552446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.553204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.553494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.554173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] PATH_INFO: `/v3/projects/76afc13b39ba4eaf80ba0e3741763914/users/dec82bf5a2134a919706e5589ba000de/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.598448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76afc13b39ba4eaf80ba0e3741763914, user_id=dec82bf5a2134a919706e5589ba000de, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.603080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:35.699918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2067/4092] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:35 2022] PUT /identity/v3/projects/76afc13b39ba4eaf80ba0e3741763914/users/dec82bf5a2134a919706e5589ba000de/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:35.703967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:35.717512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16aac8-728c-41dc-9790-6c61338095b4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.790702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:35.793333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:35.860276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.861657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.867237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.867237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.867237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.868818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:35.893886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2026/4093] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:35.899786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:35.924172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f4189-9402-4d11-a8d8-45a77490ef03 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.946842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682456f-17e0-4fc4-8009-8fa15e129e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.953703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682456f-17e0-4fc4-8009-8fa15e129e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.954021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682456f-17e0-4fc4-8009-8fa15e129e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.954399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682456f-17e0-4fc4-8009-8fa15e129e7f admin admin] PATH_INFO: `/v3/projects/76afc13b39ba4eaf80ba0e3741763914/users/dec82bf5a2134a919706e5589ba000de/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.956374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68b993-39fa-4648-a635-0789b07a075f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.960422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682456f-17e0-4fc4-8009-8fa15e129e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76afc13b39ba4eaf80ba0e3741763914, user_id=dec82bf5a2134a919706e5589ba000de, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.962287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.964505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.965916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.966366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.968310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682456f-17e0-4fc4-8009-8fa15e129e7f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:35.976352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:35.987514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.989467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:36.004169 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2027/4094] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:35 2022] PUT /identity/v3/projects/76afc13b39ba4eaf80ba0e3741763914/users/dec82bf5a2134a919706e5589ba000de/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:36.015426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e524-bcbb-40af-a5c1-9e9897b368e2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.015716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e524-bcbb-40af-a5c1-9e9897b368e2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.016181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67e524-bcbb-40af-a5c1-9e9897b368e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.018528 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2068/4095] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:26:36.065938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ef67e524-bcbb-40af-a5c1-9e9897b368e2 None None] MFA Rules not processed for user `dec82bf5a2134a919706e5589ba000de`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:36.067202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ef67e524-bcbb-40af-a5c1-9e9897b368e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:36.116273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:36.118091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:36.137343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d353-8779-4cd5-9c1d-ccb854feaaee service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:36.207713 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:36.225050 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2028/4096] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:36.230874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e524-bcbb-40af-a5c1-9e9897b368e2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:36.258603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67e524-bcbb-40af-a5c1-9e9897b368e2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:36.267348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:36.268063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.268348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.268629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] PATH_INFO: `/v3/users/031144c5b60546c090f11070f68f084e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.270054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=031144c5b60546c090f11070f68f084e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:36.272538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:36.281798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:36.282461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.282745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.283021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.283905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:36.284951 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:36.284951 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:26:36.284951 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:26:36.286048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:36.412649 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2029/4097] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:26:36 2022] POST /identity/v3/domains => generated 277 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:36.417338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:36.505207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515025-0c7d-4d18-abd3-2aa8dc4c4aba tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:36.515311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:36.516532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.518294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.518666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.519833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:36.522874 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:36.522874 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:26:36.522874 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:26:36.524359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:36.539120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031144c5b60546c090f11070f68f084e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:36.542806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031144c5b60546c090f11070f68f084e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:36.614732 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:36.637544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031144c5b60546c090f11070f68f084e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:36.647168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031144c5b60546c090f11070f68f084e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:36.647871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031144c5b60546c090f11070f68f084e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:36.657369 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2030/4098] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:26:36 2022] PUT /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config => generated 138 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:26:36.659475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:36.662163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:36.669190 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2069/4099] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:36 2022] DELETE /identity/v3/users/031144c5b60546c090f11070f68f084e => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:26:36.682176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693fda2-21d8-4e3d-98b1-106ed9ef2942 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:36.803850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:36.804950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.805461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.806548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.808593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0, group=identity)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:36.810094 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:36.810094 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:26:36.810094 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:26:36.811565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:36.832107 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2031/4100] 10.222.0.59 () {58 vars in 1275 bytes} [Sun Aug 28 01:26:36 2022] GET /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/identity => generated 45 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:36.833431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:36.850622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e58b9-1942-4266-98b0-20aba559d4ef admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:36.865892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:36.866702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.867068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.867424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/identity/driver` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.871470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0, group=identity, option=driver)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:36.873150 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:36.873150 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:26:36.873150 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:26:36.874295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:36.893027 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2070/4101] 10.222.0.59 () {58 vars in 1296 bytes} [Sun Aug 28 01:26:36 2022] GET /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/identity/driver => generated 31 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:36.896382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:36.913288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766f13-1b3d-47c1-8ed5-4c641ea1f461 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:36.922400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:36.924683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.925587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.926087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/ldap` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.939962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0, group=ldap)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:36.942503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:36.962555 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2032/4102] 10.222.0.59 () {58 vars in 1263 bytes} [Sun Aug 28 01:26:36 2022] GET /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/ldap => generated 106 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:36.962754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:36.967528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652307de-eef6-4f64-a575-1d4da02f7033 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:36.976972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:36.979180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:36.979793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:36.980737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/ldap/url` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:36.983307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0, group=ldap, option=url)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:36.987337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:37.001329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:37.002188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2071/4103] 10.222.0.59 () {58 vars in 1275 bytes} [Sun Aug 28 01:26:36 2022] GET /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/ldap/url => generated 46 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:37.023075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc4f3-10ff-4ff4-be11-c78cf9c7fb8b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:37.045339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:37.046325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:37.046621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:37.046906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/ldap/user_tree_dn` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:37.048567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0, group=ldap, option=user_tree_dn)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:37.051104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:37.061758 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2033/4104] 10.222.0.59 () {58 vars in 1302 bytes} [Sun Aug 28 01:26:37 2022] GET /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config/ldap/user_tree_dn => generated 63 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:37.067765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:37.085636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4acec-75bd-4b10-8db7-0fe57946811b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:37.094213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:37.094959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:37.095249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:37.095526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:37.096200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:37.099646 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:37.099646 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:26:37.099646 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:26:37.105361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:37.160740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:37.163758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:37.174631 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2072/4105] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:26:37 2022] DELETE /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0/config => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:37.179057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:37.199326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b1b1e-6476-48b1-84e1-6115ce74a92b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:37.212704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:37.212704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:37.212704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:37.213052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:37.216984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:37.218036 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:37.218036 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:26:37.218036 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:26:37.218934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:37.272191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.273128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.317496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de314d-f51f-4073-b5c6-ab20fd4cce2a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:37.390046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.391176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.398480 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2073/4106] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:26:37 2022] PATCH /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0 => generated 278 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:37.403925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:37.408379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:37.444263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:37.444930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:37.445217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:37.450361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] PATH_INFO: `/v3/projects/ac5cd18688674840a31f065497f19fc4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:37.454475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5cd18688674840a31f065497f19fc4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:37.465511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:37.520863 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:37.576958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26964b3-305d-48d5-84fc-c0c0578e6336 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:37.586166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:37.589920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:37.589920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:37.589920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:37.611739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0462fe43bafc47ccb34fc5c3fd0e9cf0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:37.615718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:37.640589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5cd18688674840a31f065497f19fc4', 'request_id': 'req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.658153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5cd18688674840a31f065497f19fc4', 'request_id': 'req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.663167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.668623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.766589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5cd18688674840a31f065497f19fc4', 'request_id': 'req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.780236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] The token cache is being invalidate because project ac5cd18688674840a31f065497f19fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:37.780549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.781228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1a765ed5-a163-4a1b-8e81-2dcd269d16d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.782838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2034/4107] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:37 2022] DELETE /identity/v3/projects/ac5cd18688674840a31f065497f19fc4 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:37.788247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e002b2-d0f2-42ab-bb50-5a81cfd0e64c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:37.788548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e002b2-d0f2-42ab-bb50-5a81cfd0e64c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:37.789409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e002b2-d0f2-42ab-bb50-5a81cfd0e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:37.816787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-77e002b2-d0f2-42ab-bb50-5a81cfd0e64c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:37.818370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77e002b2-d0f2-42ab-bb50-5a81cfd0e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:37.844899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0', 'request_id': 'req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.853036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0', 'request_id': 'req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.868761 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:37.921480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0', 'request_id': 'req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.950835 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2035/4108] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:37.960854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] The token cache is being invalidate because project 0462fe43bafc47ccb34fc5c3fd0e9cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:37.961943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.962918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.963731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee4d8-218b-4484-a44d-1a3a592a6d5d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:37.969929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee4d8-218b-4484-a44d-1a3a592a6d5d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:37.971065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee4d8-218b-4484-a44d-1a3a592a6d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:37.977527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0', 'request_id': 'req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.980149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0', 'request_id': 'req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.980999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0462fe43bafc47ccb34fc5c3fd0e9cf0', 'request_id': 'req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:37.999193 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2074/4109] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:26:37 2022] DELETE /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:38.004744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-710ee4d8-218b-4484-a44d-1a3a592a6d5d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:38.005935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.006336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-710ee4d8-218b-4484-a44d-1a3a592a6d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:38.008091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:38.022875 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2036/4110] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:38.023965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee4d8-218b-4484-a44d-1a3a592a6d5d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.040799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee4d8-218b-4484-a44d-1a3a592a6d5d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.048845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.050038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.050484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.051047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.052083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:38.052638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.055060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.080620 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2037/4111] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:38.084879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.110586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef0248-dbed-42b2-8632-7c126a7dd5dd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.118060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.120967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.121860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.122335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.123296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.125804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.153040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca386ec-c9b4-4fb0-a52b-2465ad70419e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.165076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.166532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.166934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.168034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.169563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.171550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.234897 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2038/4112] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:38 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:38.239130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.281964 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2075/4113] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:26:38 2022] POST /identity/v3/domains => generated 275 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:38.284895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.334626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb179b-665c-4006-a0b0-932a40ca8387 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.371838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cce77-438e-4f32-abed-f5fd03ae5815 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.378748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.379831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.380283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.380840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.381750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.382987 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:38.382987 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:26:38.382987 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:26:38.384238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.430102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.430980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.431262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.431532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.432158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.434669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.562362 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2039/4114] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:38 2022] POST /identity/v3/users => generated 301 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:38.566155 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2076/4115] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:26:38 2022] PUT /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config => generated 138 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:38.567158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.567483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.581013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069417d6-1480-4612-85f0-5b26a7856728 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.586844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb955-6b92-4ef4-b365-4469e7ddb64e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.587289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.587994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.588338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.588663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.589610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.591133 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:38.591133 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:26:38.591133 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:26:38.592426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.602907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.603548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.603836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.604112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.605010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.607172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.623492 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2040/4116] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:38.628217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.641634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870fcc6-f509-4fd5-9529-6fe2321edc8e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.648924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.649655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.650358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.650776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.651651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.653259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.671504 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2041/4117] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:38.672830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.685565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13324c-cf6d-49ff-9464-ae256a94e708 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.690817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370bb2c-a757-4c86-983d-ff742bbc2ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.691509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370bb2c-a757-4c86-983d-ff742bbc2ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.692446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370bb2c-a757-4c86-983d-ff742bbc2ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.692446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370bb2c-a757-4c86-983d-ff742bbc2ec5 admin admin] PATH_INFO: `/v3/projects/229fa8a66134407a9b976b4b58af4a50/users/db610ff3282c48c6a85c824ef279ef07/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.709104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370bb2c-a757-4c86-983d-ff742bbc2ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229fa8a66134407a9b976b4b58af4a50, user_id=db610ff3282c48c6a85c824ef279ef07, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.712395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370bb2c-a757-4c86-983d-ff742bbc2ec5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.726627 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2077/4118] 10.222.0.59 () {60 vars in 1271 bytes} [Sun Aug 28 01:26:38 2022] PATCH /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config => generated 141 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:38.730972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.745888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b159e95-3452-4a97-9b7d-fcf304298c18 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.758472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.758472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.758472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.758785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.758785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.758785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.764380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2078/4119] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:26:38 2022] GET /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config => generated 141 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:26:38.768479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.780984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef81d6-2a15-45c0-9f8f-0a32a167cac5 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.785608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:38.786462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.792940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.792940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.792940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:38.792940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:38.803573 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2042/4120] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:38 2022] PUT /identity/v3/projects/229fa8a66134407a9b976b4b58af4a50/users/db610ff3282c48c6a85c824ef279ef07/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:38.808934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99c24-2586-487c-b919-54e3b6359363 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:38.808934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99c24-2586-487c-b919-54e3b6359363 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:38.809273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c99c24-2586-487c-b919-54e3b6359363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:38.845963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-53c99c24-2586-487c-b919-54e3b6359363 None None] MFA Rules not processed for user `db610ff3282c48c6a85c824ef279ef07`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:38.850130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-53c99c24-2586-487c-b919-54e3b6359363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:38.873263 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2079/4121] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:26:38 2022] DELETE /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:26:38.873263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:38.878588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:38.896306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94941-dd6f-4317-a983-a9c2b1ac87cd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:38.985380 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2043/4122] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:38.992165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c99c24-2586-487c-b919-54e3b6359363 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.004972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.005772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.006272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.006552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] PATH_INFO: `/v3/users/3971dce263494606bc5ed74dc141c482` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.008499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3971dce263494606bc5ed74dc141c482)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.012157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.092551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c99c24-2586-487c-b919-54e3b6359363 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.098626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.099430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.099818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.100208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.101634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.103455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Could not find any options in domain configuration for domain d78b6a9eba7a4e6487689e990badfc23.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain d78b6a9eba7a4e6487689e990badfc23. Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:39.113770 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain d78b6a9eba7a4e6487689e990badfc23. Aug 28 01:26:39.115065 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:39.116572 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2044/4123] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:26:38 2022] GET /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config => generated 151 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:26:39.121026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.136100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87eca9-fb1c-49f5-a80a-e2cf83a7aae0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.140154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.141006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.141455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.141926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.142770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.143971 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:39.143971 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:26:39.143971 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:26:39.145323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.154312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2045/4124] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:26:39 2022] DELETE /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23/config => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:39.159230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.187399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d389d90-e18b-4cf9-8f58-9d8af3ecf4d8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.192757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.193613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.194086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.194529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.195842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.197409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.220925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.221687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.257034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3971dce263494606bc5ed74dc141c482'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.257919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3971dce263494606bc5ed74dc141c482'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.338079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.339395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.342235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2046/4125] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:26:39 2022] PATCH /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23 => generated 276 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:26:39.346158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.347597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:39.365098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3971dce263494606bc5ed74dc141c482'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.376874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3971dce263494606bc5ed74dc141c482'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.377757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3971dce263494606bc5ed74dc141c482'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.397691 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2080/4126] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:38 2022] DELETE /identity/v3/users/3971dce263494606bc5ed74dc141c482 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:39.400934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.402363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:39.449615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b657e-d341-4ffd-942d-10fa329b1d2d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.514905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acaf4a-2149-4e7d-a19a-74de44ff2378 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.526072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.526851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.527102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.527378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.529653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:39.540371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.552973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.552973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.552973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.583125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d78b6a9eba7a4e6487689e990badfc23)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.585273 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:39.585273 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:26:39.585273 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:26:39.591520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.617262 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:39.662002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.665797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.681442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.690466 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2081/4127] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:39.693033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.698481 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:39.785122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.792661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:39.850925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23', 'request_id': 'req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.867447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23', 'request_id': 'req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.900214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a879761-0b89-4907-be0d-be763a0ebd6e service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.956170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23', 'request_id': 'req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.975377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] The token cache is being invalidate because project d78b6a9eba7a4e6487689e990badfc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:39.976354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.977573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.994427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.995185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.999292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.999292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] PATH_INFO: `/v3/users/db610ff3282c48c6a85c824ef279ef07` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.999541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23', 'request_id': 'req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.999655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db610ff3282c48c6a85c824ef279ef07)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.999743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23', 'request_id': 'req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.000261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd78b6a9eba7a4e6487689e990badfc23', 'request_id': 'req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.000465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.013573 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2047/4128] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:26:39 2022] DELETE /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:26:40.015471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.017609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.044655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bba68-082d-47cf-a223-9c4f1bfd9b3f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.053160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.054754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.055335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.056141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] PATH_INFO: `/v3/projects/e60d36ecb6b5450288676e27a9167910` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.058036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60d36ecb6b5450288676e27a9167910)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.061339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.228008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60d36ecb6b5450288676e27a9167910', 'request_id': 'req-6194dd6c-0488-4330-b294-01db60b92a85'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.241125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db610ff3282c48c6a85c824ef279ef07'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.242318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db610ff3282c48c6a85c824ef279ef07'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.249101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60d36ecb6b5450288676e27a9167910', 'request_id': 'req-6194dd6c-0488-4330-b294-01db60b92a85'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.354909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db610ff3282c48c6a85c824ef279ef07'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.365205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db610ff3282c48c6a85c824ef279ef07'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.365996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db610ff3282c48c6a85c824ef279ef07'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.388122 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2082/4129] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:39 2022] DELETE /identity/v3/users/db610ff3282c48c6a85c824ef279ef07 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:26:40.389124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.391226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.491004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579bdce-1e29-49ca-ba34-5442b14d6d97 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.497521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913ce54-4bbd-4fe3-8531-f209fdf2e8a4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.498185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913ce54-4bbd-4fe3-8531-f209fdf2e8a4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.498472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913ce54-4bbd-4fe3-8531-f209fdf2e8a4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.498761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913ce54-4bbd-4fe3-8531-f209fdf2e8a4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.499848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913ce54-4bbd-4fe3-8531-f209fdf2e8a4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.501055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913ce54-4bbd-4fe3-8531-f209fdf2e8a4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.519941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60d36ecb6b5450288676e27a9167910', 'request_id': 'req-6194dd6c-0488-4330-b294-01db60b92a85'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.536469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] The token cache is being invalidate because project e60d36ecb6b5450288676e27a9167910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:40.536746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.537417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6194dd6c-0488-4330-b294-01db60b92a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.543294 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2048/4130] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:40 2022] DELETE /identity/v3/projects/e60d36ecb6b5450288676e27a9167910 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:40.543294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.543294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.543294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.568704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:40.570038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.602938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2083/4131] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/domains => generated 275 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:40.604233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.605173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.605653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.652246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:40.654114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.758980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2049/4132] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:40.763825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.765553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.784121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c68dd1-ed20-4b7d-ae40-4f8cc4114bfa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.844086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2084/4133] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:40.846013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.849087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.906927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.907638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.907943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.908227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.908926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.910605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.962607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139cacc-8c94-4076-89b7-6b054a1999ee None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.967510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c923c-03fb-4858-9634-65720a5b6f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.968132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c923c-03fb-4858-9634-65720a5b6f6d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.968562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c923c-03fb-4858-9634-65720a5b6f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.968844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c923c-03fb-4858-9634-65720a5b6f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.979008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c923c-03fb-4858-9634-65720a5b6f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.981140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c923c-03fb-4858-9634-65720a5b6f6d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.992056 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2085/4134] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:40.993463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfbbb0-5c69-44ee-a06f-762973441529 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.993753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfbbb0-5c69-44ee-a06f-762973441529 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.994062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfbbb0-5c69-44ee-a06f-762973441529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.028240 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2050/4135] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:26:40 2022] PUT /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config => generated 138 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:41.030519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.033074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-83cfbbb0-5c69-44ee-a06f-762973441529 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:41.034708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83cfbbb0-5c69-44ee-a06f-762973441529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:41.044912 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2086/4136] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:41.051284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfbbb0-5c69-44ee-a06f-762973441529 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.064333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfbbb0-5c69-44ee-a06f-762973441529 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.069580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0dab-e0ba-4722-a3b8-d5b524936914 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.069857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.070784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.071661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.071661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.078550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:41.078550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.078550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.078958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.081451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.082013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.082909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.084104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc, group=identity)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.086164 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:41.086164 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:26:41.086164 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:26:41.087545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.096319 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2087/4137] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:41.101541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.111517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1aabe-f424-470a-acbb-c6939e13355d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.117492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.118448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.119058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.119515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.122197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.125655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.215551 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2051/4138] 10.222.0.59 () {60 vars in 1297 bytes} [Sun Aug 28 01:26:41 2022] PATCH /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity => generated 177 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:41.222317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.244849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bd310-17c3-42bf-b547-62bd2b00215b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.259996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.261367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.261650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.261962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity/driver` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.262754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc, group=identity, option=driver)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.264384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.275432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2088/4139] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:41 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:41.277526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.298255 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:41.361064 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2052/4140] 10.222.0.59 () {60 vars in 1318 bytes} [Sun Aug 28 01:26:41 2022] PATCH /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity/driver => generated 177 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:26:41.363484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3aa11c-bf6a-453a-a719-7af4689025c0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.364999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.369174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.369964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.370403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.371705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.372673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.375220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.379160 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:41.384952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f858b-07e7-4a12-84da-b7154bdd2b20 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.472457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.473274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.473659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.474070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity/driver` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.474942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc, group=identity, option=driver)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.477423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.500026 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2089/4141] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:41 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:41.503665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.518106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3e07e-4ba8-4f9b-b320-968d786f9565 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.524319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.525183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.525535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.526106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.527353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.529195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.546267 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2090/4142] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:26:41.547401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.564028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f5049-ffac-4401-aa44-5bb1812a0ab4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.567443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2053/4143] 10.222.0.59 () {58 vars in 1299 bytes} [Sun Aug 28 01:26:41 2022] DELETE /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity/driver => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:26:41.572712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.584022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.584665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.585095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.585234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.585853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.587514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.591494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d7d66-65f0-4ead-b43d-87eacc5638d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.603712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.604429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.605324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.605908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity/driver` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.607617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc, group=identity, option=driver)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.611481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.620905 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2091/4144] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:41.626391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Could not find option driver in group identity in domain configuration for domain 5d39e87b5fa24327955e333d178606dc.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 5d39e87b5fa24327955e333d178606dc. Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:41.629263 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 5d39e87b5fa24327955e333d178606dc. Aug 28 01:26:41.630365 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:41.632297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2054/4145] 10.222.0.59 () {58 vars in 1296 bytes} [Sun Aug 28 01:26:41 2022] GET /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity/driver => generated 171 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:26:41.634788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.645929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467001-215f-4158-bf1b-24e947597742 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.650273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956aec57-b95e-4aaa-849e-da337560cf1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.654509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0383c9-bd60-462f-ad77-1b9a9b64eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.655849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0383c9-bd60-462f-ad77-1b9a9b64eaae admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.656196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0383c9-bd60-462f-ad77-1b9a9b64eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.656476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0383c9-bd60-462f-ad77-1b9a9b64eaae admin admin] PATH_INFO: `/v3/projects/021a0b7054904163becc1aa9ccf2e601/users/fcabfd40b20e4e89af56ca21c6f87008/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.678128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.678128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.678128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.678653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.678653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc, group=identity)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.679774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0383c9-bd60-462f-ad77-1b9a9b64eaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=021a0b7054904163becc1aa9ccf2e601, user_id=fcabfd40b20e4e89af56ca21c6f87008, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.681743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.684245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0383c9-bd60-462f-ad77-1b9a9b64eaae admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.789853 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2092/4146] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:41 2022] PUT /identity/v3/projects/021a0b7054904163becc1aa9ccf2e601/users/fcabfd40b20e4e89af56ca21c6f87008/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:41.795287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c833d07-4775-4cb8-a1a2-283bd0f45b8b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.795466 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2055/4147] 10.222.0.59 () {58 vars in 1278 bytes} [Sun Aug 28 01:26:41 2022] DELETE /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:41.797577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c833d07-4775-4cb8-a1a2-283bd0f45b8b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.797577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c833d07-4775-4cb8-a1a2-283bd0f45b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.800829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.816825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475ee81-d0c0-43dc-a69f-29ac86bc5bbc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.825004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4c833d07-4775-4cb8-a1a2-283bd0f45b8b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:41.827928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4c833d07-4775-4cb8-a1a2-283bd0f45b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:41.905475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.906578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.906963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.908127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.910562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc, group=identity)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.912353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.927538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2093/4148] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Could not find group identity in domain configuration for domain 5d39e87b5fa24327955e333d178606dc.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 5d39e87b5fa24327955e333d178606dc. Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:41.931620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 5d39e87b5fa24327955e333d178606dc. Aug 28 01:26:41.933288 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:41.937881 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2056/4149] 10.222.0.59 () {58 vars in 1275 bytes} [Sun Aug 28 01:26:41 2022] GET /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config/identity => generated 154 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:26:41.940914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c833d07-4775-4cb8-a1a2-283bd0f45b8b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.954246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c833d07-4775-4cb8-a1a2-283bd0f45b8b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:41.959229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:41.960053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:41.960448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:41.960730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc/config` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:41.961326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5d39e87b5fa24327955e333d178606dc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:41.963004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:41.982182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:41.986099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:42.050317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d8d39-3b26-4c9e-a6fe-0495142d34b2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:42.054513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:42.055269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:42.055926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:42.056297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:42.060172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2094/4150] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:26:41 2022] DELETE /identity/v3/domains/5d39e87b5fa24327955e333d178606dc/config => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:42.065143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:42.067909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:42.069428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:42.077599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89f32-6481-4d8e-90e4-3c116d8b37ed tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:42.083097 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2057/4151] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:26:42.083326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:42.083953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:42.084236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:42.084513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:42.086243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5d39e87b5fa24327955e333d178606dc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:42.087981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:42.110168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5d39e87b5fa24327955e333d178606dc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.110980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5d39e87b5fa24327955e333d178606dc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.240277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5d39e87b5fa24327955e333d178606dc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.241571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5d39e87b5fa24327955e333d178606dc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.246375 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2095/4152] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:26:42 2022] PATCH /identity/v3/domains/5d39e87b5fa24327955e333d178606dc => generated 276 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:42.250081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:42.266200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa5b43-42a1-4dd8-9053-10348aeef694 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:42.442666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:42.450579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:42.451000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:42.451348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:42.475992 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:42.479083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5d39e87b5fa24327955e333d178606dc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:42.484545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:42.489013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:42.491324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:42.560787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5d39e87b5fa24327955e333d178606dc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.571639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5d39e87b5fa24327955e333d178606dc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.649026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b518ae8-1060-4c1f-bf6f-93da35642cb8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:42.654792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:42.661103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:42.661103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:42.661103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] PATH_INFO: `/v3/projects/229fa8a66134407a9b976b4b58af4a50` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:42.661103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229fa8a66134407a9b976b4b58af4a50)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:42.661103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:42.787153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d39e87b5fa24327955e333d178606dc', 'request_id': 'req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.796265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d39e87b5fa24327955e333d178606dc', 'request_id': 'req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.860079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229fa8a66134407a9b976b4b58af4a50', 'request_id': 'req-9c958705-2271-4f2c-b6fe-dca6eba23d60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.864413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d39e87b5fa24327955e333d178606dc', 'request_id': 'req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.869484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229fa8a66134407a9b976b4b58af4a50', 'request_id': 'req-9c958705-2271-4f2c-b6fe-dca6eba23d60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.886502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] The token cache is being invalidate because project 5d39e87b5fa24327955e333d178606dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:42.886821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.887664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.920070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5d39e87b5fa24327955e333d178606dc', 'request_id': 'req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.920070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5d39e87b5fa24327955e333d178606dc', 'request_id': 'req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.920862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5d39e87b5fa24327955e333d178606dc', 'request_id': 'req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:42.937635 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2058/4153] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:26:42 2022] DELETE /identity/v3/domains/5d39e87b5fa24327955e333d178606dc => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:42.944302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:42.947197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:42.967141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229fa8a66134407a9b976b4b58af4a50', 'request_id': 'req-9c958705-2271-4f2c-b6fe-dca6eba23d60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:43.001215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] The token cache is being invalidate because project 229fa8a66134407a9b976b4b58af4a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:43.001215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:43.006685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9c958705-2271-4f2c-b6fe-dca6eba23d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:43.009003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2096/4154] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:42 2022] DELETE /identity/v3/projects/229fa8a66134407a9b976b4b58af4a50 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:26:43.020065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322ca0f-6d69-461f-b709-1c775c9ed951 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.020065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322ca0f-6d69-461f-b709-1c775c9ed951 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.020065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322ca0f-6d69-461f-b709-1c775c9ed951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.090986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6322ca0f-6d69-461f-b709-1c775c9ed951 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:43.092355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6322ca0f-6d69-461f-b709-1c775c9ed951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:43.098398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81cceb-e89c-49d4-82a2-dfead1c6aa4f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.224715 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2097/4155] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:43.227871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.228731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.229309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.230375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.231282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.232734 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:43.232734 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:26:43.232734 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:26:43.233078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe733fa-9872-436f-a8b0-9d35dac72675 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.233397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe733fa-9872-436f-a8b0-9d35dac72675 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.233686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe733fa-9872-436f-a8b0-9d35dac72675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.234783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.244547 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2059/4156] 10.222.0.59 () {58 vars in 1173 bytes} [Sun Aug 28 01:26:42 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:43.251028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.271423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:43.273583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3fe733fa-9872-436f-a8b0-9d35dac72675 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:43.274832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3fe733fa-9872-436f-a8b0-9d35dac72675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:43.301718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2098/4157] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:43.302810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe733fa-9872-436f-a8b0-9d35dac72675 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.310633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b0f42-c44e-4673-ba38-b197d63573da tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.310923 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:43.316214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.317053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.317279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe733fa-9872-436f-a8b0-9d35dac72675 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.317402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.317583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.318220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.319802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.324656 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2060/4158] 10.222.0.59 () {58 vars in 1200 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.325545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.332759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.333400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.334013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.334119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.335070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:43.335380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.336918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b1f6-96ee-49bc-80b3-9d7aa76ff112 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.337051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.342630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.343291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.343582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.343844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.344435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.346065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.347336 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2061/4159] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.352411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.359923 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2099/4160] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:43.364464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.372369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea79d-7c3d-441c-9609-04b8495a42b8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.377469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.378154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.378436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.378714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.379302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.380887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.382172 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2062/4161] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.386532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.390535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23261f46-6d51-4ab5-b5ba-727842659d8d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.397342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011aba1-99b1-4cc0-b479-5cc5a6a0b97d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.397841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.398568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.398857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.399134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.399920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.403733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.415946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.415946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.415946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.416274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.416417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.418705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.424867 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2063/4162] 10.222.0.59 () {58 vars in 1188 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:26:43.425765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.437063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9ca14-0ab1-4f08-92dd-179bbaa5e8bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.443353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.444053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.444336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.444606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.445936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.446915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.448667 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2064/4163] 10.222.0.59 () {58 vars in 1200 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.452736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.473335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc7f50-a0c4-40d7-bfbc-50be24925fad tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.474765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.475395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.475676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.475951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.477157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.480176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.484772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2065/4164] 10.222.0.59 () {58 vars in 1203 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:43.486394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.503033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc4911-6fe6-4364-8e25-a8992d08d195 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.505460 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2100/4165] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:43 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:43.509616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.590605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.596977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.596977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.597288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.597959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.599587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.601650 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2066/4166] 10.222.0.59 () {58 vars in 1209 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.605969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.618743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63e3b1-febc-4a8f-903b-9ebe014b6f71 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.622392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15aee0-ae75-4cd0-b886-9b2e85ceed45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.626851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.627800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.628293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.628778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.629577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.632554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.634669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.635479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.635935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.636316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.638453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.641146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.648856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2067/4167] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.650328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.662338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226ef1e-0518-4506-85fe-e259079dc37e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.669051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.670060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.670447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.670828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.671547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.674581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.679210 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2068/4168] 10.222.0.59 () {58 vars in 1218 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.680424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.712395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fea18-9afb-4bd7-9456-7375cecd9515 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.726784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.731970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.731970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.731970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.731970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.732742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.740380 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2069/4169] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.742855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.760609 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2101/4170] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:43 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:26:43.764375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.771046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a510da-6552-4b29-a02a-648e380bf14b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.794384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.795827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.795827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.795827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.796663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.796804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6fed9-2e72-4901-a1bb-b2e6fefa667b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.798884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.806354 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2070/4171] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.807549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.818495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.819588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.821575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.821890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.822596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.828539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.829799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea1e5-3513-49c6-a41f-8e28f184f744 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.843150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.843936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.844325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.844712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.845637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.847406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.857393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2071/4172] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.860351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.873207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e14be-da70-4687-87ce-54fbb70198bf tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.879630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.880414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.880922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.881305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.882078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.883773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.888801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2072/4173] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.895507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.902227 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2102/4174] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:43.903164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.907432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9d9c2-4a8b-4ab5-8cab-09a3bb487baa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.913805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.914679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.915064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.915447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.916400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.919237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.925956 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2073/4175] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:43.931182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.940748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75841fc-5681-4d52-b03b-f859348e3f10 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.943380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1497b-80ed-4eac-93d8-b5eff4fb0d63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.955488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.956311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.957039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.957535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.958615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.959227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.959845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.960123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.960393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.960689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.961034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.966374 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2074/4176] 10.222.0.59 () {58 vars in 1239 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:43.967083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.967762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:43.979721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e2be6-aa2f-4128-bb0d-f5f99f8970fa tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:43.986939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:43.987753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:43.993612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:43.993612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:43.993612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:43.993612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:43.996423 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2075/4177] 10.222.0.59 () {58 vars in 1242 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:43.997549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.008755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3721d-8676-45ea-8f2e-798ef36cc858 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.011809 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2103/4178] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:44.018587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.027916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.027916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.027916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.029217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.029217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.029217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.029217 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2076/4179] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:26:43 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.031993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.053968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a2277-d359-4340-a29f-ab24c7e94019 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.063786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f77203-e5fa-45d2-9968-cf6df284796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.064456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f77203-e5fa-45d2-9968-cf6df284796a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.067203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f77203-e5fa-45d2-9968-cf6df284796a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.067203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f77203-e5fa-45d2-9968-cf6df284796a admin admin] PATH_INFO: `/v3/projects/bdadda46353c4f438375aca89dbdb64e/users/c10295ee56f14f8b9eb6bea840a6610c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.072335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebfa6c-d90e-4065-a6b7-41e22e6e1773 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.091861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f77203-e5fa-45d2-9968-cf6df284796a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdadda46353c4f438375aca89dbdb64e, user_id=c10295ee56f14f8b9eb6bea840a6610c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.101911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f77203-e5fa-45d2-9968-cf6df284796a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.114701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.118223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.119554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.119994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.124658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.125585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.130296 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2077/4180] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.134676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.163469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e334c0f-54a0-4f30-88de-831cadd7131c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.183348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.184363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.185694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.186135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.186927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.189076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.190785 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2078/4181] 10.222.0.59 () {58 vars in 1269 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.196163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.212578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9d255-7e4d-4565-a7d7-73fd91f9e892 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.217668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.218658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.218949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.219230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.219825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.222036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.224262 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2079/4182] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.228101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.232312 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2104/4183] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:44 2022] PUT /identity/v3/projects/bdadda46353c4f438375aca89dbdb64e/users/c10295ee56f14f8b9eb6bea840a6610c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:44.237478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890700-c474-4db2-a87f-fe5d371e7542 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.237764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890700-c474-4db2-a87f-fe5d371e7542 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.238094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94890700-c474-4db2-a87f-fe5d371e7542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.247528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528ab06-3cb0-4552-ab58-5c1d01ab9b45 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.276815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-94890700-c474-4db2-a87f-fe5d371e7542 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:44.279065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-94890700-c474-4db2-a87f-fe5d371e7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:44.370412 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:44.394235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.395074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.396378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.396917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.397447 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2105/4184] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:44.398094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.403557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.409281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890700-c474-4db2-a87f-fe5d371e7542 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.416018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2080/4185] 10.222.0.59 () {58 vars in 1257 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.432053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94890700-c474-4db2-a87f-fe5d371e7542 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.437726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.440027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.440027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.440027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.440027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.440991 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:26:44.440991 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:26:44.440991 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:26:44.442022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.443596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2106/4186] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.447383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.455008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.457963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:44.459483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f68ab-5394-4be8-be5c-25410021f259 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.468107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.468923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.469215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.469493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.471052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.473211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.479213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2081/4187] 10.222.0.59 () {58 vars in 1242 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.481420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.508435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767dab9-5fa4-44d9-8b17-16727f2e4573 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.523640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.525096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.525630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.525630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.526440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.528221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.538636 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2082/4188] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.539595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.566534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab3b55-6156-4e0b-a4e2-a8cf0f6c81c9 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.575950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.576659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.576948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.577235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.577850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.579677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.581014 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2083/4189] 10.222.0.59 () {58 vars in 1254 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.585337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.604104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b96cee-07b7-4c94-b60b-2cc2a045547f tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.610517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.611287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.611669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.612027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.612700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.613090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f4488-8f36-4d7c-b8b2-55e5c84eb61e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.614972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.621916 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2084/4190] 10.222.0.59 () {58 vars in 1290 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:44.623092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.624289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.624921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.625201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.625474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.638393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e90f7-4535-44a3-95bb-b24c57fb20e4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.644897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.648264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.655757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.656403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.656562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.658048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.658180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.660043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.665628 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2085/4191] 10.222.0.59 () {58 vars in 1257 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.667375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.679861 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2107/4192] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:44.682774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a2fd-a05e-440c-8cce-88aed85acb2e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.690149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.693671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.693671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.693671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.693671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.694622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.702903 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2086/4193] 10.222.0.59 () {58 vars in 1266 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.703790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.719507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce4293-3813-4383-a4c8-8c768b670fdb service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.730411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.731701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.732003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.732279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.732881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.734570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.749512 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2108/4194] 10.222.0.59 () {58 vars in 1308 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:44.750805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.764285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ec8c9-8df5-4b7c-8590-0508daf96cc6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.777151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.777857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.778148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.778424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.779022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.780617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.785957 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2087/4195] 10.222.0.59 () {58 vars in 1290 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.793045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.808165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31708502-da34-451f-a353-31f317a2fc1d tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.813126 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:44.821396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.821396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.821396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.822262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.822262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.824233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.828782 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2109/4196] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.829975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.844913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb314d-cd71-4a33-b042-9444091e598b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.852154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.852821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.853104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.853378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.854138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.856402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.857920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2088/4197] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.861881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.877215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471a5b7-baaa-430b-81d4-ccfbe96a90f1 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.883758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.885171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.886491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.886491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.886880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.888504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.889755 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2110/4198] 10.222.0.59 () {58 vars in 1242 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:44.894310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.905167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d83349-35fb-4c3a-a3b6-99f6a2a3165c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.915360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.916282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.916639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.918054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.918917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.920636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.922098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2089/4199] 10.222.0.59 () {58 vars in 1245 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:44.926577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.939040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1eba7-3aed-465b-92be-0c486779a93b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.943971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.944658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.944933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.945240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.945907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.947569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.949379 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2111/4200] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:44.953595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.965535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c851e06-ba0e-4233-b49e-a5e8e16a4fde tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:44.972177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:44.972767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.973915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.973915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:44.974234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:44.975830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:44.977856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2090/4201] 10.222.0.59 () {58 vars in 1254 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:44.983265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:44.994234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0531a-10a5-45fc-bb6e-1e07cdc402b6 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.002768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.005205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.005205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.005205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.005205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.006203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.012479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.013189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2112/4202] 10.222.0.59 () {58 vars in 1257 bytes} [Sun Aug 28 01:26:44 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.024014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f81eb4-2085-4984-95a4-83d7be8c89c2 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.030971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.031643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.032117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.035032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.035032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.036439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.042631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.043739 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2091/4203] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.057197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1528b3-3cf3-4299-9818-641594d637c4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.065020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.066085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.066610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.067101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.068044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.070196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.076759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.086656 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2113/4204] 10.222.0.59 () {58 vars in 1257 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.092503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cddc8-b9fd-42e1-a6b1-e08a3b19cd15 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.098149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.099089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.099627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.100101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.100951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.103183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.109724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.138703 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2092/4205] 10.222.0.59 () {58 vars in 1293 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.139227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c1e0-8221-48be-9f9e-4b2a501f6f56 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.153701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.154455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.154744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.155083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.157251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.159587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.164666 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2114/4206] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:45.165396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.185888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d93b5-3e11-43c0-9517-fbfc29e6e4e8 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.201029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.202212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.203899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.204432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.206173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.212720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.217768 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2093/4207] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:45.225699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.249987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f921d-20e6-4e65-af7f-1e539d34291c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.270666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.271910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.272394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.272860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.273639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.285772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.291281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.295592 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2115/4208] 10.222.0.59 () {58 vars in 1212 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.330292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f66f-0cfe-424d-aab2-98164aa0e13b tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.355607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.356693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.357245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.357576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.358224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.360739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.364769 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2094/4209] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.367675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.385153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d878-0fed-447e-aab5-a674f6edb3d4 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.393799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.394709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.395321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.395776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.417964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.422320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.424355 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2116/4210] 10.222.0.59 () {58 vars in 1215 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:45.429973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.445489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381db87c-d432-4c3b-af1d-a71fed444a63 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.452657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.453689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.454878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.459476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.459476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.459476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.459476 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2095/4211] 10.222.0.59 () {58 vars in 1218 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.463358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.482683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d16fc-22d6-424e-be9c-2952889f0909 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.505339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.506308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.508824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.509403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.510312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.515030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.522364 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2117/4212] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.522680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.542670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a16ef-b69d-4c6d-9851-dbec99f4df4c tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.549402 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:45.567036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.567730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.568008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.568293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.568891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.582093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.582093 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2096/4213] 10.222.0.59 () {58 vars in 1239 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:45.582296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.602761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208a62a-ead5-405e-af2d-f2e7c78c7c4a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.617756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.618465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.620114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.624120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.625252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.629236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.644366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.645134 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2118/4214] 10.222.0.59 () {58 vars in 1260 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.658972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f35e-eb72-4dca-981f-14679cf02b43 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.674868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.675516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.675788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.676078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.685972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.685972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.685972 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2097/4215] 10.222.0.59 () {58 vars in 1263 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.686898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.701244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabc2a1-d283-4d28-af8e-b533a400d6bc tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.714130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.715079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.715364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.715646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.716235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.718511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.722112 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2119/4216] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 01:26:45.726096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.741461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a090b44-873b-4b7c-9a4f-79f0380fb5a3 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.745234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.746350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.746557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.746838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.747595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.749210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.754738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.755435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2098/4217] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.766916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffefce-30d8-4ac2-a3e9-10ea2ee1abc0 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.779601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.780632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.781130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.781674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.783274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.785344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.794094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.802215 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2120/4218] 10.222.0.59 () {58 vars in 1278 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 01:26:45.808495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278b4ae-9b86-47fe-9121-f6503a0ac78e tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.827027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.827688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.827973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.828247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/5d39e87b5fa24327955e333d178606dc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.846543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Could not find domain: 5d39e87b5fa24327955e333d178606dc.: keystone.exception.DomainNotFound: Could not find domain: 5d39e87b5fa24327955e333d178606dc. Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5d39e87b5fa24327955e333d178606dc. Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:45.862128 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:45.863169 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:26:45.864198 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5d39e87b5fa24327955e333d178606dc. Aug 28 01:26:45.865279 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:45.869588 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2099/4219] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:26:45 2022] PATCH /identity/v3/domains/5d39e87b5fa24327955e333d178606dc => generated 112 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:26:45.877840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.890935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00e669-5564-4218-a7cb-a81a836e0812 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.906810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.907531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.907817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.908095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/d78b6a9eba7a4e6487689e990badfc23` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.931286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Could not find domain: d78b6a9eba7a4e6487689e990badfc23.: keystone.exception.DomainNotFound: Could not find domain: d78b6a9eba7a4e6487689e990badfc23. Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d78b6a9eba7a4e6487689e990badfc23. Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:45.959450 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:45.960609 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:26:45.962177 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d78b6a9eba7a4e6487689e990badfc23. Aug 28 01:26:45.963274 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:45.971142 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2121/4220] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:26:45 2022] PATCH /identity/v3/domains/d78b6a9eba7a4e6487689e990badfc23 => generated 112 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:26:45.975073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.990555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7560-3ade-40e4-a523-71a58fe3338a tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.996789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180968d-c2f9-4461-94a7-7c4bbcc40c84 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec82bf5a2134a919706e5589ba000de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76afc13b39ba4eaf80ba0e3741763914', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.997655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180968d-c2f9-4461-94a7-7c4bbcc40c84 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.998654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180968d-c2f9-4461-94a7-7c4bbcc40c84 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.999088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180968d-c2f9-4461-94a7-7c4bbcc40c84 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] PATH_INFO: `/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:46.012040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180968d-c2f9-4461-94a7-7c4bbcc40c84 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-b180968d-c2f9-4461-94a7-7c4bbcc40c84 tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Could not find domain: 0462fe43bafc47ccb34fc5c3fd0e9cf0.: keystone.exception.DomainNotFound: Could not find domain: 0462fe43bafc47ccb34fc5c3fd0e9cf0. Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0462fe43bafc47ccb34fc5c3fd0e9cf0. Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:46.017962 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:46.019243 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:26:46.020476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0462fe43bafc47ccb34fc5c3fd0e9cf0. Aug 28 01:26:46.022186 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:46.022186 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2100/4221] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:26:45 2022] PATCH /identity/v3/domains/0462fe43bafc47ccb34fc5c3fd0e9cf0 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:26:46.025132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:46.027649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:46.035675 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:46.049080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac089-7b30-4956-b3ce-2d11af4bd6fd tempest-DomainConfigurationTestJSON-1036468560 tempest-DomainConfigurationTestJSON-1036468560-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:46.064281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:46.065028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:46.066284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:46.066865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] PATH_INFO: `/v3/users/9a0c190f083f4332a2cd6a9d16ba3a8e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:46.070577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0c190f083f4332a2cd6a9d16ba3a8e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:46.078280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:46.333477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0c190f083f4332a2cd6a9d16ba3a8e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:46.334196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0c190f083f4332a2cd6a9d16ba3a8e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:46.470353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0c190f083f4332a2cd6a9d16ba3a8e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:46.485930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0c190f083f4332a2cd6a9d16ba3a8e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:46.488801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0c190f083f4332a2cd6a9d16ba3a8e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:46.554841 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2122/4222] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:46 2022] DELETE /identity/v3/users/9a0c190f083f4332a2cd6a9d16ba3a8e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:46.560654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347112ee-928b-465a-bfef-708337a21104 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:46.561248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347112ee-928b-465a-bfef-708337a21104 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:46.561447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347112ee-928b-465a-bfef-708337a21104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:46.598521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-347112ee-928b-465a-bfef-708337a21104 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:46.603801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-347112ee-928b-465a-bfef-708337a21104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:46.746111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2101/4223] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:46.766174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:46.768584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:46.898312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35447455-0488-458a-828a-b67be7c9f779 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:46.909966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:46.910779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:46.911348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:46.911955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:46.933897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:46.938199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:46.967202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2123/4224] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:47.442206 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=6,keystone:INSERT=1,keystone:SELECT=93 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:47.744588 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:48.950588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347112ee-928b-465a-bfef-708337a21104 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:48.952054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-347112ee-928b-465a-bfef-708337a21104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:48.967286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347112ee-928b-465a-bfef-708337a21104 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:48.978219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:48.988080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:48.988080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:48.988080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] PATH_INFO: `/v3/projects/650830135714407a9b22078c244fd03a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:48.988080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650830135714407a9b22078c244fd03a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:48.988080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:49.177246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650830135714407a9b22078c244fd03a', 'request_id': 'req-5c6e1e03-0a9f-41b6-ad90-793d438bf249'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.193453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650830135714407a9b22078c244fd03a', 'request_id': 'req-5c6e1e03-0a9f-41b6-ad90-793d438bf249'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.333932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650830135714407a9b22078c244fd03a', 'request_id': 'req-5c6e1e03-0a9f-41b6-ad90-793d438bf249'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.344699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:49.346334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:49.363653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] The token cache is being invalidate because project 650830135714407a9b22078c244fd03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:49.363999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.365102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.368069 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2102/4225] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:48 2022] DELETE /identity/v3/projects/650830135714407a9b22078c244fd03a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:49.372528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:49.374934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:49.382685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace331b-427b-4a02-a345-cc50f723d0b4 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:49.439746 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:49.514134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:49.515278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:49.515795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:49.516302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] PATH_INFO: `/v3/users/a43d35b5382545418114a11c85e52997` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:49.521686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43d35b5382545418114a11c85e52997)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:49.524179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:49.554980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e1e03-0a9f-41b6-ad90-793d438bf249 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:49.562534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:49.563596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:49.564034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:49.564743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] PATH_INFO: `/v3/users/dec82bf5a2134a919706e5589ba000de` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:49.566975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec82bf5a2134a919706e5589ba000de)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:49.570010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:49.917628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec82bf5a2134a919706e5589ba000de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.919038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43d35b5382545418114a11c85e52997'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.920999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43d35b5382545418114a11c85e52997'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.962403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec82bf5a2134a919706e5589ba000de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.988873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec82bf5a2134a919706e5589ba000de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:49.989666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec82bf5a2134a919706e5589ba000de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:50.030306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43d35b5382545418114a11c85e52997'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:50.042062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43d35b5382545418114a11c85e52997'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:50.043697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d0bbe8a9-291f-4024-97c2-8a216d3df4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43d35b5382545418114a11c85e52997'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:50.085423 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2124/4226] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:49 2022] DELETE /identity/v3/users/a43d35b5382545418114a11c85e52997 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:50.099053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:50.099342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:50.099603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:50.140609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:50.142143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:50.155742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec82bf5a2134a919706e5589ba000de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:50.165108 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2103/4227] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:49 2022] DELETE /identity/v3/users/dec82bf5a2134a919706e5589ba000de => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:50.247110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2125/4228] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:50.337079 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:51.134391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:51.136292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:51.373494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261d03c-b5a2-4813-8358-62fcdd121d1f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:51.387873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:51.388663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:51.389108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:51.393202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] PATH_INFO: `/v3/projects/b8d01788def7407e9c73624ed55ee51c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:51.395816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d01788def7407e9c73624ed55ee51c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:51.404271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:51.424080 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:51.609681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:51.611427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:51.624563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d01788def7407e9c73624ed55ee51c', 'request_id': 'req-d430e97c-7f75-4944-88fd-0df559a6e09e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:51.668290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d01788def7407e9c73624ed55ee51c', 'request_id': 'req-d430e97c-7f75-4944-88fd-0df559a6e09e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:51.771733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d01788def7407e9c73624ed55ee51c', 'request_id': 'req-d430e97c-7f75-4944-88fd-0df559a6e09e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:51.787940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d7c74-ab8e-43d4-89ca-bc15804873c4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:51.797327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] The token cache is being invalidate because project b8d01788def7407e9c73624ed55ee51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:51.797631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:51.812585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d430e97c-7f75-4944-88fd-0df559a6e09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:51.816467 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2104/4229] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:51 2022] DELETE /identity/v3/projects/b8d01788def7407e9c73624ed55ee51c => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:51.821369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874974d-3511-4e31-8346-a9a6df093fd6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:51.821920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874974d-3511-4e31-8346-a9a6df093fd6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:51.822345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874974d-3511-4e31-8346-a9a6df093fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:51.879208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c874974d-3511-4e31-8346-a9a6df093fd6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:51.880875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c874974d-3511-4e31-8346-a9a6df093fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:51.902718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:51.903359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:51.903652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:51.903928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:51.905767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:52.033050 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:52.045462 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2105/4230] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:52.054047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b08eef-b0da-4c0f-aecf-a1ab2556c64e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.054419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b08eef-b0da-4c0f-aecf-a1ab2556c64e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.054704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b08eef-b0da-4c0f-aecf-a1ab2556c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.068797 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:52.078604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:52.078785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-49b08eef-b0da-4c0f-aecf-a1ab2556c64e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:52.080093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:52.080229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-49b08eef-b0da-4c0f-aecf-a1ab2556c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:52.104617 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2126/4231] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:52.109296 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2106/4232] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:52.109530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:52.126263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2ba3d-8bcc-4354-81b4-f8f1c187d4a9 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:52.150798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:52.152194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.152511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.152754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.153450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:52.153761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:52.155486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:52.169709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2127/4233] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:26:52.174151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b08eef-b0da-4c0f-aecf-a1ab2556c64e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:52.185042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b08eef-b0da-4c0f-aecf-a1ab2556c64e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:52.193977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:52.195471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.195925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.196484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.197329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:52.202462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:52.256193 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:52.319438 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2107/4234] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:52 2022] POST /identity/v3/projects => generated 397 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:52.324590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:52.340331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3a62a-ec9a-48e1-81de-ff3535b80237 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:52.476735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:52.484914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.484914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.484914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.485427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:52.487733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:52.597943 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2128/4235] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:52 2022] POST /identity/v3/users => generated 299 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:52.603100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:52.616484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243f0c9-9bd5-445c-b11d-6072e218004b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:52.627604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:52.628659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.629190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.629681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.630611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:52.633277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:52.663237 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2108/4236] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:52.668903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:52.688322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1bd12-64f6-4e0f-b7bd-81d9f3cce7e6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:52.708949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:52.710081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.710712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.711146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.712109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:52.715912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:52.732032 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2129/4237] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:52.736029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:52.749384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e783d-899e-4eea-9483-2179f158156c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:52.755001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1abc42-61ae-413e-9ac4-0ff7037a35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:52.755831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abc42-61ae-413e-9ac4-0ff7037a35fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.756194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abc42-61ae-413e-9ac4-0ff7037a35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.756583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1abc42-61ae-413e-9ac4-0ff7037a35fe admin admin] PATH_INFO: `/v3/projects/60800392f52f45a6ba977a9e381244a9/users/19b963761a2d4d03a5e818dabc10707c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.783815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1abc42-61ae-413e-9ac4-0ff7037a35fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=60800392f52f45a6ba977a9e381244a9, user_id=19b963761a2d4d03a5e818dabc10707c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:52.786633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1abc42-61ae-413e-9ac4-0ff7037a35fe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:52.820187 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:52.830429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:52.835406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:52.913378 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2109/4238] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:52 2022] PUT /identity/v3/projects/60800392f52f45a6ba977a9e381244a9/users/19b963761a2d4d03a5e818dabc10707c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:52.925235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:52.927130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:52.931053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:52.972238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397770-aec2-481c-a0bf-bcf54a1a6736 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:53.065877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:53.070499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:53.264552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:53.265664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:53.266188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:53.266732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] PATH_INFO: `/v3/projects/76afc13b39ba4eaf80ba0e3741763914` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:53.269334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=76afc13b39ba4eaf80ba0e3741763914)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:53.275066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:53.407235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2110/4239] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:53.455635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:53.458655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:53.498688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76afc13b39ba4eaf80ba0e3741763914', 'request_id': 'req-af69c60e-7ebc-40f3-9398-36a254fef08b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:53.511421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76afc13b39ba4eaf80ba0e3741763914', 'request_id': 'req-af69c60e-7ebc-40f3-9398-36a254fef08b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:53.537938 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:53.592958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76afc13b39ba4eaf80ba0e3741763914', 'request_id': 'req-af69c60e-7ebc-40f3-9398-36a254fef08b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:53.615380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] The token cache is being invalidate because project 76afc13b39ba4eaf80ba0e3741763914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:53.617238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:53.620781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:53.623927 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2130/4240] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:52 2022] DELETE /identity/v3/projects/76afc13b39ba4eaf80ba0e3741763914 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:53.625747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:53.631547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:53.675523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316575e-9cfd-4978-82b2-6c004c768caf None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:53.800464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e396453-e881-41dd-a4b0-5c4da9c105d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:53.801438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396453-e881-41dd-a4b0-5c4da9c105d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:53.801909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396453-e881-41dd-a4b0-5c4da9c105d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:53.802504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396453-e881-41dd-a4b0-5c4da9c105d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:53.808059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7e396453-e881-41dd-a4b0-5c4da9c105d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:53.814658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69c60e-7ebc-40f3-9398-36a254fef08b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:53.830804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4efb9-6164-4211-bc89-f6a8550c1770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:53.831861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4efb9-6164-4211-bc89-f6a8550c1770 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:53.832364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4efb9-6164-4211-bc89-f6a8550c1770 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:53.832874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4efb9-6164-4211-bc89-f6a8550c1770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:53.850590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2f4efb9-6164-4211-bc89-f6a8550c1770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:53.880256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4efb9-6164-4211-bc89-f6a8550c1770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:53.883765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4efb9-6164-4211-bc89-f6a8550c1770 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:53.889143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e396453-e881-41dd-a4b0-5c4da9c105d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:53.890857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e396453-e881-41dd-a4b0-5c4da9c105d9 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:53.902850 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2111/4241] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:26:53.904154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:53.904624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:53.904886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:53.927143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:53.930831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:53.941845 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2112/4242] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:53.941845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:53.958856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:53.960053 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2131/4243] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:53.965175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911263e-6aa6-4c34-9503-2b361341ab73 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:53.965175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911263e-6aa6-4c34-9503-2b361341ab73 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:53.965175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911263e-6aa6-4c34-9503-2b361341ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:53.977283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a334353-7f58-4f9f-bd36-b112355f92c2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:53.984122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:53.985580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:53.986249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:53.986684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:53.992379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:54.008511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:54.010201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1911263e-6aa6-4c34-9503-2b361341ab73 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:54.011625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:54.012729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1911263e-6aa6-4c34-9503-2b361341ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:54.029567 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2113/4244] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:54.041779 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2132/4245] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:54.048916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:54.065596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17003af-6d22-4f4b-9a61-d2acbef256c3 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:54.071576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:54.072442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.072898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.073992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.074994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:54.075441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:54.077260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:54.094031 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2114/4246] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:54.098311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911263e-6aa6-4c34-9503-2b361341ab73 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:54.119546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911263e-6aa6-4c34-9503-2b361341ab73 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:54.124725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e30d8-7d3c-4a14-9d08-c276fafc1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:54.125359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e30d8-7d3c-4a14-9d08-c276fafc1182 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.125636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e30d8-7d3c-4a14-9d08-c276fafc1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.125997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e30d8-7d3c-4a14-9d08-c276fafc1182 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.126715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e30d8-7d3c-4a14-9d08-c276fafc1182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:54.128685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e30d8-7d3c-4a14-9d08-c276fafc1182 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:54.266243 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:54.281864 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2133/4247] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:54 2022] POST /identity/v3/projects => generated 397 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:26:54.283178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:54.301704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e0949-e7fb-4f83-abab-dfe7ae0dcd4c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:54.310240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178dcf-9a4f-44ba-9e24-4180dc0da1cd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.310557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178dcf-9a4f-44ba-9e24-4180dc0da1cd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.310891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178dcf-9a4f-44ba-9e24-4180dc0da1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.334712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ba178dcf-9a4f-44ba-9e24-4180dc0da1cd None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:54.336011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ba178dcf-9a4f-44ba-9e24-4180dc0da1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:54.417090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:54.418513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.419061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.419925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.420772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:54.423481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:54.475756 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2134/4248] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:54.526422 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2115/4249] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:54 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:54.529147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178dcf-9a4f-44ba-9e24-4180dc0da1cd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:54.554059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178dcf-9a4f-44ba-9e24-4180dc0da1cd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:54.580202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:54.583739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.584321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.584765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.586062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:54.588434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:54.619663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:54.621021 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2135/4250] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:54.635823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7285dc-c952-4f6b-88bf-182ad701b3f4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:54.653683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11069fd8-3e88-4b22-8a60-f1f7ffb24049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:54.654565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069fd8-3e88-4b22-8a60-f1f7ffb24049 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.655640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069fd8-3e88-4b22-8a60-f1f7ffb24049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.656029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069fd8-3e88-4b22-8a60-f1f7ffb24049 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.656845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11069fd8-3e88-4b22-8a60-f1f7ffb24049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:54.658846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11069fd8-3e88-4b22-8a60-f1f7ffb24049 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:54.687312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2116/4251] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:54.688921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:54.709139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489493f1-61ae-4ef7-a2e0-d3c81af683d8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:54.721288 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:54.727023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:54.727023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.727023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.727023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] PATH_INFO: `/v3/projects/32f18d98c743425cbcd9897e0f12b252/users/971125a02388453fb42efdc02d7282e5/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.745950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f18d98c743425cbcd9897e0f12b252, user_id=971125a02388453fb42efdc02d7282e5, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:54.749117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:54.830016 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2136/4252] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:54 2022] PUT /identity/v3/projects/32f18d98c743425cbcd9897e0f12b252/users/971125a02388453fb42efdc02d7282e5/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:54.841892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e25a-abcb-4f69-b192-c8feeba42dbb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:54.842360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e25a-abcb-4f69-b192-c8feeba42dbb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:54.842742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e25a-abcb-4f69-b192-c8feeba42dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:54.896175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0f42e25a-abcb-4f69-b192-c8feeba42dbb None None] MFA Rules not processed for user `971125a02388453fb42efdc02d7282e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:54.897584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f42e25a-abcb-4f69-b192-c8feeba42dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:55.035813 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2117/4253] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:55.047713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:55.268463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f9b5-0c33-465b-9add-b342f8d04fbf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:55.287062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:55.287689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:55.287970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:55.288239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:55.289076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:55.291028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:55.472358 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2137/4254] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:55 2022] POST /identity/v3/projects => generated 397 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:55.476874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e25a-abcb-4f69-b192-c8feeba42dbb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:55.491301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e25a-abcb-4f69-b192-c8feeba42dbb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:55.575491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:55.578307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:55.578307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:55.578307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:55.578307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:55.583447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:55.728501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:55.745618 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2118/4255] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:55 2022] POST /identity/v3/users => generated 305 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:55.752976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12657a9-9686-42a7-ba65-aaddcb05a0b7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:55.763630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:55.766036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:55.766036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:55.786218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:55.788456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:55.793554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:55.835036 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2138/4256] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:55.842887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:55.859998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1164-d8b0-4b66-867f-584ca121a5cf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:55.865751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:55.866711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:55.867220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:55.868163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] PATH_INFO: `/v3/projects/4f7e77a3e15d4df2bf1b934ccb841438/users/2c4f0c4541fe4695bd24658b5c05344a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:55.893685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7e77a3e15d4df2bf1b934ccb841438, user_id=2c4f0c4541fe4695bd24658b5c05344a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:55.898253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:55.959440 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:56.026245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2119/4257] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:55 2022] PUT /identity/v3/projects/4f7e77a3e15d4df2bf1b934ccb841438/users/2c4f0c4541fe4695bd24658b5c05344a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:56.026527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.038546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f993e1f-292a-4c93-b970-a3242f0d275d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.103862 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:56.191096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd530498-c403-4361-a9a6-e4ddfe2c6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.192273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd530498-c403-4361-a9a6-e4ddfe2c6bff admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.192872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd530498-c403-4361-a9a6-e4ddfe2c6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.193374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd530498-c403-4361-a9a6-e4ddfe2c6bff admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.194937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd530498-c403-4361-a9a6-e4ddfe2c6bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.201936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd530498-c403-4361-a9a6-e4ddfe2c6bff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:56.216885 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2139/4258] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:56.220939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.233980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518fae8-cf0e-48c8-9844-83cafb66dcea admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.239701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.240529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.240823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.241102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] PATH_INFO: `/v3/projects/4f7e77a3e15d4df2bf1b934ccb841438/users/2c4f0c4541fe4695bd24658b5c05344a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.243544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7e77a3e15d4df2bf1b934ccb841438, user_id=2c4f0c4541fe4695bd24658b5c05344a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.248897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:56.263743 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2120/4259] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:56 2022] PUT /identity/v3/projects/4f7e77a3e15d4df2bf1b934ccb841438/users/2c4f0c4541fe4695bd24658b5c05344a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:56.275424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb3c24-464d-452e-8789-091170d0b8fe None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.275825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb3c24-464d-452e-8789-091170d0b8fe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.277081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb3c24-464d-452e-8789-091170d0b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.328043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-98bb3c24-464d-452e-8789-091170d0b8fe None None] MFA Rules not processed for user `2c4f0c4541fe4695bd24658b5c05344a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:56.332576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-98bb3c24-464d-452e-8789-091170d0b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:56.467315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2140/4260] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:56.471283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.615085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f3247-bf82-4117-baf9-628c74d5c474 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.627209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971125a02388453fb42efdc02d7282e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32f18d98c743425cbcd9897e0f12b252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.627869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.629953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.632132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.632916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 28 01:26:56.648596 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 01:26:56.649994 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.660149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb3c24-464d-452e-8789-091170d0b8fe None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.661064 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2121/4261] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:26:56 2022] POST /identity/v3/projects => generated 136 bytes in 190 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:26:56.676441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb3c24-464d-452e-8789-091170d0b8fe None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.683251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c4f0c4541fe4695bd24658b5c05344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7e77a3e15d4df2bf1b934ccb841438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.683495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.683615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.683838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.684511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.686460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:56.731796 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Invalid input for field 'name': '' is too short Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: On instance['name']: Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: On instance['name']: Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: '' Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise error Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application '' Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.734716 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:26:56.736406 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application '' Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.737607 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2141/4262] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:26:56 2022] POST /identity/v3/projects => generated 283 bytes in 77 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 01:26:56.741029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.762094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345d73-3911-4627-8018-5257cc01b505 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.770934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c4f0c4541fe4695bd24658b5c05344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7e77a3e15d4df2bf1b934ccb841438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.772137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.772446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.772713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.774758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.778631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: On instance['name']: Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: On instance['name']: Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise error Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:26:56.801418 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:56.802786 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 01:26:56.803977 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.808525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2122/4263] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:26:56 2022] POST /identity/v3/projects => generated 412 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:26:56.808715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.828282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7684e-371f-4a5f-9264-d6596f508c1e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.839202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c4f0c4541fe4695bd24658b5c05344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7e77a3e15d4df2bf1b934ccb841438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.839905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.839905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.840167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] PATH_INFO: `/v3/projects/5001dbcdb6674a2c8dfe166545890d26` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.857753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5001dbcdb6674a2c8dfe166545890d26)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.860324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Could not find project: 5001dbcdb6674a2c8dfe166545890d26.: keystone.exception.ProjectNotFound: Could not find project: 5001dbcdb6674a2c8dfe166545890d26. Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 01:26:56.885967 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5001dbcdb6674a2c8dfe166545890d26. Aug 28 01:26:56.891424 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:26:56.893978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.895187 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2142/4264] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:56 2022] DELETE /identity/v3/projects/5001dbcdb6674a2c8dfe166545890d26 => generated 113 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:26:56.909222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8823-b95a-483d-9cf4-c562c34a20e1 tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.925821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971125a02388453fb42efdc02d7282e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32f18d98c743425cbcd9897e0f12b252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.926594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.926853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.927502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.928187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 28 01:26:56.938703 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._list_projects() Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:56.952347 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2123/4265] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:26:56 2022] GET /identity/v3/projects => generated 135 bytes in 51 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:26:56.953322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:56.964393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb048bec-c784-4ec6-b8b5-4b708b08bf8d tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:56.988970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c4f0c4541fe4695bd24658b5c05344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7e77a3e15d4df2bf1b934ccb841438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:56.989630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:56.989943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:56.990221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:56.990863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:56.992800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:57.170243 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2143/4266] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:56 2022] POST /identity/v3/projects => generated 359 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:57.170854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:57.202085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fbb5a-76fb-4864-b464-ebac5f2c84c6 tempest-ProjectsNegativeStaticTestJSON-2140797331 tempest-ProjectsNegativeStaticTestJSON-2140797331-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:57.382028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c4f0c4541fe4695bd24658b5c05344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7e77a3e15d4df2bf1b934ccb841438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:57.387480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:57.387480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:57.387480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:57.387480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:57.391631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:57.453747 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:57.516369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.sql.core [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1198290142' for key 'project.ixu_project_name_domain_id'") Aug 28 01:26:57.516369 n-d-master-1 devstack@keystone.service[82006]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 01:26:57.516369 n-d-master-1 devstack@keystone.service[82006]: [parameters: {'id': '42e8784de0bc487e8c37cd40fdb45f65', 'name': 'tempest-project-dup-1198290142', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 01:26:57.516369 n-d-master-1 devstack@keystone.service[82006]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82006) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1198290142, project id 42e8784de0bc487e8c37cd40fdb45f65.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1198290142, project id 42e8784de0bc487e8c37cd40fdb45f65. Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application conn.query(q) Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 01:26:57.526947 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result.read() Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1198290142' for key 'project.ixu_project_name_domain_id'") Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 01:26:57.528153 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application next(self.gen) Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application yield resource Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application next(self.gen) Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise self.value Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 01:26:57.529514 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application session.commit() Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.session.flush() Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application compat.raise_( Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 01:26:57.531711 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 01:26:57.533136 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application conn.query(q) Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result.read() Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 01:26:57.535008 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1198290142' for key 'project.ixu_project_name_domain_id'") Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [parameters: {'id': '42e8784de0bc487e8c37cd40fdb45f65', 'name': 'tempest-project-dup-1198290142', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:57.538408 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1198290142 at domain ID default. Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:26:57.539585 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1198290142, project id 42e8784de0bc487e8c37cd40fdb45f65. Aug 28 01:26:57.540940 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:26:57.548449 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2124/4267] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:26:57 2022] POST /identity/v3/projects => generated 285 bytes in 378 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 01:26:57.553936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:57.567550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ca974-96e2-4578-aea8-6b77f16c079c tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:57.583092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c4f0c4541fe4695bd24658b5c05344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7e77a3e15d4df2bf1b934ccb841438', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:57.583911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:57.584302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:57.584691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] PATH_INFO: `/v3/projects/8f769671f3d2456ebb63094cd4de3dc8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:57.591430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f769671f3d2456ebb63094cd4de3dc8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:57.593782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:57.779935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f769671f3d2456ebb63094cd4de3dc8', 'request_id': 'req-5ee4651e-61eb-432f-83dc-152d56c08aae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:57.798986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f769671f3d2456ebb63094cd4de3dc8', 'request_id': 'req-5ee4651e-61eb-432f-83dc-152d56c08aae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:57.904177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f769671f3d2456ebb63094cd4de3dc8', 'request_id': 'req-5ee4651e-61eb-432f-83dc-152d56c08aae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:57.922120 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:57.924671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] The token cache is being invalidate because project 8f769671f3d2456ebb63094cd4de3dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:57.925080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:57.926161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:57.928175 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2144/4268] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:57 2022] DELETE /identity/v3/projects/8f769671f3d2456ebb63094cd4de3dc8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:57.934903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:57.938522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:58.069503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c628b5-0149-431b-9a46-04b73fe2054e tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:58.207007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:58.208080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:58.208680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:58.209355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] PATH_INFO: `/v3/users/971125a02388453fb42efdc02d7282e5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:58.211562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=971125a02388453fb42efdc02d7282e5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:58.215783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:58.303166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:58.307982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:58.336986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4651e-61eb-432f-83dc-152d56c08aae tempest-ProjectsNegativeStaticTestJSON-1062604052 tempest-ProjectsNegativeStaticTestJSON-1062604052-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:58.346252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:58.347596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:58.348110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:58.348614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] PATH_INFO: `/v3/users/25bd1b500f994f27b3c34a55cd9182bf` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:58.353054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bd1b500f994f27b3c34a55cd9182bf)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:58.356084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:58.564920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971125a02388453fb42efdc02d7282e5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.587173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971125a02388453fb42efdc02d7282e5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.590305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971125a02388453fb42efdc02d7282e5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.591809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971125a02388453fb42efdc02d7282e5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.660148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bd1b500f994f27b3c34a55cd9182bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.662278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bd1b500f994f27b3c34a55cd9182bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.698634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83df27af-ac1b-47b7-aa14-656fd3ab6eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971125a02388453fb42efdc02d7282e5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.711987 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2125/4269] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:57 2022] DELETE /identity/v3/users/971125a02388453fb42efdc02d7282e5 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:58.714556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:58.715212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:58.715677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:58.761860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:58.763548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:58.780216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bd1b500f994f27b3c34a55cd9182bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.801720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bd1b500f994f27b3c34a55cd9182bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.822391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bd1b500f994f27b3c34a55cd9182bf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:58.881591 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2145/4270] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:58 2022] DELETE /identity/v3/users/25bd1b500f994f27b3c34a55cd9182bf => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:58.920438 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2126/4271] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:58.954142 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:58.970260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:58.970260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:59.085832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d534f-8ee6-4711-b462-edf7a507d4c2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:59.091097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d81c8d-03e7-4389-917e-efc57d6e9356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:59.092123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81c8d-03e7-4389-917e-efc57d6e9356 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:59.092580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81c8d-03e7-4389-917e-efc57d6e9356 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:59.093010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81c8d-03e7-4389-917e-efc57d6e9356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:59.307683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d81c8d-03e7-4389-917e-efc57d6e9356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:59.307683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d81c8d-03e7-4389-917e-efc57d6e9356 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:59.320554 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2146/4272] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:59.509590 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:00.732263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:00.743850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:00.783074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00660-3ddb-4ff2-a695-a96d6f363912 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:00.807762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:00.808922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:00.809604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:00.810402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] PATH_INFO: `/v3/projects/8a0e3830f5104f41ba3d411acff3b31e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:00.811918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0e3830f5104f41ba3d411acff3b31e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:00.826631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:01.033762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0e3830f5104f41ba3d411acff3b31e', 'request_id': 'req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.056181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0e3830f5104f41ba3d411acff3b31e', 'request_id': 'req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.173759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0e3830f5104f41ba3d411acff3b31e', 'request_id': 'req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.194750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] The token cache is being invalidate because project 8a0e3830f5104f41ba3d411acff3b31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:01.195756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.196651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2126fb48-f0de-427b-9ddd-0bfb4bacda7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.204992 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2127/4273] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:00 2022] DELETE /identity/v3/projects/8a0e3830f5104f41ba3d411acff3b31e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:01.205195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c326b5-8bf2-4a1b-8334-3560cad72034 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:01.205688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c326b5-8bf2-4a1b-8334-3560cad72034 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:01.205973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c326b5-8bf2-4a1b-8334-3560cad72034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:01.247196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-98c326b5-8bf2-4a1b-8334-3560cad72034 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:01.248783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-98c326b5-8bf2-4a1b-8334-3560cad72034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:01.392419 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:01.427785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2147/4274] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:01.429766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:01.431401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:01.431771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:01.465849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:01.467284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:01.478254 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2128/4275] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:01.483188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c326b5-8bf2-4a1b-8334-3560cad72034 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:01.497516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c326b5-8bf2-4a1b-8334-3560cad72034 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:01.505537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:01.506705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:01.507255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:01.507747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:01.508733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:01.509243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:01.511373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:01.513174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:01.523253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:01.529100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2eb262-8e62-4c8e-a550-04d0867053dd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:01.546681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:01.547722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:01.548113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:01.553695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] PATH_INFO: `/v3/projects/32f18d98c743425cbcd9897e0f12b252` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:01.553903 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2148/4276] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:01.555630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f18d98c743425cbcd9897e0f12b252)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:01.558695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:01.559369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:01.585662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de1ff8-6809-47b9-8601-3a564e2b72b8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:01.597610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:01.598547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:01.598978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:01.599367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:01.600129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:01.607997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:01.743554 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2149/4277] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:01 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:01.748769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:01.767054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f18d98c743425cbcd9897e0f12b252', 'request_id': 'req-0bbc664d-1149-45fa-8853-2f71bc0b90dc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.781328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f18d98c743425cbcd9897e0f12b252', 'request_id': 'req-0bbc664d-1149-45fa-8853-2f71bc0b90dc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.888327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d29b67-eb4d-490c-8c73-11e61e3514c6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:01.889529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f18d98c743425cbcd9897e0f12b252', 'request_id': 'req-0bbc664d-1149-45fa-8853-2f71bc0b90dc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.898926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:01.899875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:01.900335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:01.901363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:01.902206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:01.904612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:01.915049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] The token cache is being invalidate because project 32f18d98c743425cbcd9897e0f12b252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:01.915234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.917903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:01.940532 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2129/4278] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:01 2022] DELETE /identity/v3/projects/32f18d98c743425cbcd9897e0f12b252 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:01.951369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:01.955526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:02.024514 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2150/4279] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:01 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:02.029057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:02.031963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:02.043107 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:02.071221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83351772-d915-489b-82df-bb97d7949fe1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:02.082293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:02.083329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:02.085966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:02.086509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:02.087414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:02.095546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:02.137940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2151/4280] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:27:02.147745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:02.166967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b748e-9b20-4e6a-80eb-03901ceba10e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:02.174585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc664d-1149-45fa-8853-2f71bc0b90dc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:02.179942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:02.181123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:02.185892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:02.186914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:02.187846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:02.190763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:02.192210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:02.194191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:02.194475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:02.194753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] PATH_INFO: `/v3/users/2c4f0c4541fe4695bd24658b5c05344a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:02.200527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4f0c4541fe4695bd24658b5c05344a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:02.203216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:02.208471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2152/4281] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:02.212856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:02.236491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09caf-e815-462d-83a6-a82c75db1c76 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:02.255270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761731-2c3c-4ba5-a511-466fdd2f9c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:02.256233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761731-2c3c-4ba5-a511-466fdd2f9c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:02.256771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761731-2c3c-4ba5-a511-466fdd2f9c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:02.257361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761731-2c3c-4ba5-a511-466fdd2f9c22 admin admin] PATH_INFO: `/v3/projects/c17c99eff277405da26bea01f0edfd17/users/a239a0dd4451431aa7e3beea2d4b37aa/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:02.296291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761731-2c3c-4ba5-a511-466fdd2f9c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17c99eff277405da26bea01f0edfd17, user_id=a239a0dd4451431aa7e3beea2d4b37aa, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:02.296291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761731-2c3c-4ba5-a511-466fdd2f9c22 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:02.378868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2153/4282] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:02 2022] PUT /identity/v3/projects/c17c99eff277405da26bea01f0edfd17/users/a239a0dd4451431aa7e3beea2d4b37aa/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:02.383742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24564-28d1-44c1-9081-11cc5c82314c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:02.384035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24564-28d1-44c1-9081-11cc5c82314c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:02.384322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24564-28d1-44c1-9081-11cc5c82314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:02.428514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4f0c4541fe4695bd24658b5c05344a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:02.457056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-72d24564-28d1-44c1-9081-11cc5c82314c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:02.458996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-72d24564-28d1-44c1-9081-11cc5c82314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:02.463994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4f0c4541fe4695bd24658b5c05344a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:02.480744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4f0c4541fe4695bd24658b5c05344a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:02.484330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4f0c4541fe4695bd24658b5c05344a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:02.564469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4f0c4541fe4695bd24658b5c05344a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:02.573875 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2130/4283] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:01 2022] DELETE /identity/v3/users/2c4f0c4541fe4695bd24658b5c05344a => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:02.687773 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2154/4284] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:27:02.781436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:02.783651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:02.876300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a57c7-3536-4ab6-8af9-14af2f231911 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:02.881426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:02.882328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:02.882783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:02.883338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:02.981221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:02.983803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:03.006138 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2131/4285] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:03.127254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc652-cbd6-4d9b-abbc-21b7d0d04982 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:03.127543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc652-cbd6-4d9b-abbc-21b7d0d04982 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:03.127820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc652-cbd6-4d9b-abbc-21b7d0d04982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:03.144896 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:03.176110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ae6fc652-cbd6-4d9b-abbc-21b7d0d04982 None None] MFA Rules not processed for user `c10295ee56f14f8b9eb6bea840a6610c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:03.178333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ae6fc652-cbd6-4d9b-abbc-21b7d0d04982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:03.309209 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:03.440981 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2155/4286] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:03.449571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:03.453663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:03.487716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d85356-310e-4dbe-89c3-724a530f88ac service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:03.514943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:03.516205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:03.516712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:03.517168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:03.518150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:03.521366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:03.678696 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2132/4287] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:03 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:27:03.683350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc652-cbd6-4d9b-abbc-21b7d0d04982 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:03.704894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc652-cbd6-4d9b-abbc-21b7d0d04982 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:03.850071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:03.850505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:03.850789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:03.851144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:03.854592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:03.856774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:04.008543 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2156/4288] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:03 2022] POST /identity/v3/users => generated 300 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:27:04.012667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:04.036650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb324b-da91-4b30-b96a-21e1747d4d4e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:04.054771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:04.055675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:04.055955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:04.056232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:04.056953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:04.059672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:04.079119 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2133/4289] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:04.080903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:04.095379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33878-c728-4064-8ab4-584216fe727f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:04.110313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:04.111278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:04.113498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:04.114116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] PATH_INFO: `/v3/projects/92222cad729c4a77a6fd9a98bbe0eb1e/users/58913dfcbc49476283a7624dbc8e73cd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:04.157413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92222cad729c4a77a6fd9a98bbe0eb1e, user_id=58913dfcbc49476283a7624dbc8e73cd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:04.162735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:04.260842 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2157/4290] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:04 2022] PUT /identity/v3/projects/92222cad729c4a77a6fd9a98bbe0eb1e/users/58913dfcbc49476283a7624dbc8e73cd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:04.261476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:04.287529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbb3e6-a9eb-4793-9ed0-3a2d796a0ad8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:04.457473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a9a62-b9e1-4804-9b18-b2f822c7fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:04.458336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a9a62-b9e1-4804-9b18-b2f822c7fc7b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:04.458619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a9a62-b9e1-4804-9b18-b2f822c7fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:04.458897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a9a62-b9e1-4804-9b18-b2f822c7fc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:04.459610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a9a62-b9e1-4804-9b18-b2f822c7fc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:04.461949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a9a62-b9e1-4804-9b18-b2f822c7fc7b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:04.476323 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2134/4291] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:04.480824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:04.498012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f7a47-c566-4dba-bcf7-062172015f40 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:04.509231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcca319-b17c-41b2-850c-9e3cf1b5aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:04.510646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcca319-b17c-41b2-850c-9e3cf1b5aa3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:04.511077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcca319-b17c-41b2-850c-9e3cf1b5aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:04.511362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcca319-b17c-41b2-850c-9e3cf1b5aa3b admin admin] PATH_INFO: `/v3/projects/92222cad729c4a77a6fd9a98bbe0eb1e/users/58913dfcbc49476283a7624dbc8e73cd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:04.518281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcca319-b17c-41b2-850c-9e3cf1b5aa3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92222cad729c4a77a6fd9a98bbe0eb1e, user_id=58913dfcbc49476283a7624dbc8e73cd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:04.520964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcca319-b17c-41b2-850c-9e3cf1b5aa3b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:04.562235 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2158/4292] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:04 2022] PUT /identity/v3/projects/92222cad729c4a77a6fd9a98bbe0eb1e/users/58913dfcbc49476283a7624dbc8e73cd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:04.723533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:04.723830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:04.724114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:04.779061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] MFA Rules not processed for user `fcabfd40b20e4e89af56ca21c6f87008`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:04.780215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:04.937028 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2135/4293] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:27:04.948036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:04.948369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:04.948667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:05.002846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] MFA Rules not processed for user `fcabfd40b20e4e89af56ca21c6f87008`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:05.004111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:05.034158 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2159/4294] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:05.044540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:05.047527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:05.132487 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:05.171486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1f4e8-6bf5-4545-bfdd-1034c13b40f6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:05.177936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf6ef5-8239-49fc-9ba1-7eaa74837ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:05.178907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6ef5-8239-49fc-9ba1-7eaa74837ee5 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:05.179553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6ef5-8239-49fc-9ba1-7eaa74837ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:05.180043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf6ef5-8239-49fc-9ba1-7eaa74837ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:05.190649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf6ef5-8239-49fc-9ba1-7eaa74837ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:05.192810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf6ef5-8239-49fc-9ba1-7eaa74837ee5 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:05.217629 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2136/4295] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:05.245786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:05.246502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:05.374027 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:05.436403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cfea-09b6-451e-adc6-d76d2aedb675 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:05.443686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:05.444358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:05.444642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:05.444918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] PATH_INFO: `/v3/projects/4f7e77a3e15d4df2bf1b934ccb841438` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:05.452653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7e77a3e15d4df2bf1b934ccb841438)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:05.456670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:05.686913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7e77a3e15d4df2bf1b934ccb841438', 'request_id': 'req-b1797180-efde-423c-884b-66d07fa8033d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:05.707226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7e77a3e15d4df2bf1b934ccb841438', 'request_id': 'req-b1797180-efde-423c-884b-66d07fa8033d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:05.815656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7e77a3e15d4df2bf1b934ccb841438', 'request_id': 'req-b1797180-efde-423c-884b-66d07fa8033d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:05.831974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] The token cache is being invalidate because project 4f7e77a3e15d4df2bf1b934ccb841438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:05.835174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:05.836045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b1797180-efde-423c-884b-66d07fa8033d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:05.840580 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2160/4296] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:05 2022] DELETE /identity/v3/projects/4f7e77a3e15d4df2bf1b934ccb841438 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:05.845549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd978167-ab09-4d9e-91aa-815a9a140b9e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:05.845976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd978167-ab09-4d9e-91aa-815a9a140b9e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:05.846344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd978167-ab09-4d9e-91aa-815a9a140b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:05.869029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fd978167-ab09-4d9e-91aa-815a9a140b9e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:05.870721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fd978167-ab09-4d9e-91aa-815a9a140b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:05.950380 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2137/4297] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:27:05.959790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda913-93b8-477a-8c7d-7e0bd6df03b1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:05.960208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda913-93b8-477a-8c7d-7e0bd6df03b1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:05.960635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dda913-93b8-477a-8c7d-7e0bd6df03b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:05.986683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f6dda913-93b8-477a-8c7d-7e0bd6df03b1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:05.988100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f6dda913-93b8-477a-8c7d-7e0bd6df03b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:06.003283 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2161/4298] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:06.007285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd978167-ab09-4d9e-91aa-815a9a140b9e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:06.022893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd978167-ab09-4d9e-91aa-815a9a140b9e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:06.038062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:06.039152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:06.039537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:06.040310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:06.042550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:06.042951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:06.050316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:06.077095 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2138/4299] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:06.081287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dda913-93b8-477a-8c7d-7e0bd6df03b1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:06.097548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dda913-93b8-477a-8c7d-7e0bd6df03b1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:06.113429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:06.114095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:06.114377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:06.119951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:06.120797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:06.126375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:06.299555 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2162/4300] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:06 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:06.304150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:06.320672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433ba3-513d-43b2-b571-88f169790c4a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:06.434699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:06.435603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:06.436276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:06.436722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:06.437695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:06.441018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:06.547149 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2139/4301] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:06 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:06.551804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:06.576373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a072d-3803-4364-bcd7-2778c7aeea41 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:06.581399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:06.582298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:06.582577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:06.582851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:06.590499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:06.600425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:06.629206 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2163/4302] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:06.633781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:06.663303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eebe9-5de7-4c88-af0b-6fe1fe475905 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:06.670574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71496d0-c2e9-4bb8-a997-23f152f56906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:06.671449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71496d0-c2e9-4bb8-a997-23f152f56906 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:06.671731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71496d0-c2e9-4bb8-a997-23f152f56906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:06.672457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71496d0-c2e9-4bb8-a997-23f152f56906 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:06.673316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71496d0-c2e9-4bb8-a997-23f152f56906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:06.675670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71496d0-c2e9-4bb8-a997-23f152f56906 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:06.725784 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2140/4303] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:06.727752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:06.753852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326283c-ab87-4d4c-af88-cd5af62c6a91 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:06.768441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:06.769350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:06.769847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:06.770290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] PATH_INFO: `/v3/projects/b91ae987b92242d9b089ec721ee36168/users/bca789184af348b7b07aee65c247b37b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:06.802916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91ae987b92242d9b089ec721ee36168, user_id=bca789184af348b7b07aee65c247b37b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:06.808385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:06.942261 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2164/4304] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:06 2022] PUT /identity/v3/projects/b91ae987b92242d9b089ec721ee36168/users/bca789184af348b7b07aee65c247b37b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:06.944014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3620ca-4fe2-461f-9bfb-a58455b57f4f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:06.944539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3620ca-4fe2-461f-9bfb-a58455b57f4f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:06.945007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3620ca-4fe2-461f-9bfb-a58455b57f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:07.032075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8f3620ca-4fe2-461f-9bfb-a58455b57f4f None None] MFA Rules not processed for user `bca789184af348b7b07aee65c247b37b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:07.037465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8f3620ca-4fe2-461f-9bfb-a58455b57f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:07.104908 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:07.185513 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2141/4305] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:27:07.190154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:07.386574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca63aa2-b438-40a0-b865-1dced5c1fb14 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:07.396866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:07.397952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:07.398396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:07.398986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:07.399881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:07.403072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:07.451771 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:07.527313 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2165/4306] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:07 2022] POST /identity/v3/projects => generated 369 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:07.528186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3620ca-4fe2-461f-9bfb-a58455b57f4f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:07.547228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3620ca-4fe2-461f-9bfb-a58455b57f4f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:07.643324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:07.644157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:07.644599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:07.645348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:07.646222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:07.648473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:07.753390 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2142/4307] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:07 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:27:07.757369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:07.770474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04247955-4d47-4d6b-9a4c-3d8547093368 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:07.784263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:07.785160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:07.785610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:07.786081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:07.787113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:07.788986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:07.822781 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2166/4308] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:07.824373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:07.842551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33063bcd-c59b-4a46-9293-0cde797ebaa9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:07.860807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:07.861558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:07.861857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:07.862216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] PATH_INFO: `/v3/projects/393354eb2f744108862dd5afb17814b2/users/617b7042b5654f46b0367fd753dc3ae5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:07.914464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393354eb2f744108862dd5afb17814b2, user_id=617b7042b5654f46b0367fd753dc3ae5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:07.918635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:08.042105 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2143/4309] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:07 2022] PUT /identity/v3/projects/393354eb2f744108862dd5afb17814b2/users/617b7042b5654f46b0367fd753dc3ae5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:08.049286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:08.098517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623932d9-f95c-4db4-a78c-c71d8f254bd2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:08.324019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:08.343809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:08.346208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:08.348188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:08.350478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:08.355969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:08.398380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2167/4310] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:08.403629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:08.444596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae0064-eb89-4307-9ab2-276653f29743 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:08.463674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abd924-3fa3-4045-84ec-b7bf1cc3f134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:08.464716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abd924-3fa3-4045-84ec-b7bf1cc3f134 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:08.468401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abd924-3fa3-4045-84ec-b7bf1cc3f134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:08.469802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abd924-3fa3-4045-84ec-b7bf1cc3f134 admin admin] PATH_INFO: `/v3/projects/393354eb2f744108862dd5afb17814b2/users/617b7042b5654f46b0367fd753dc3ae5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:08.490138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abd924-3fa3-4045-84ec-b7bf1cc3f134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393354eb2f744108862dd5afb17814b2, user_id=617b7042b5654f46b0367fd753dc3ae5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:08.491835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:08.493771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:08.514003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abd924-3fa3-4045-84ec-b7bf1cc3f134 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:08.516250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67eb2-7be5-482a-8f00-45a3ca7a98b2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:08.537107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:08.537769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:08.538078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:08.538350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] PATH_INFO: `/v3/users/1d38b3bd03cc4c008039999b9258f5e0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:08.543606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d38b3bd03cc4c008039999b9258f5e0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:08.548308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:08.569213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2144/4311] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:08 2022] PUT /identity/v3/projects/393354eb2f744108862dd5afb17814b2/users/617b7042b5654f46b0367fd753dc3ae5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:08.579904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995c57-75ce-4778-bed9-09c74a81abd0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:08.580197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995c57-75ce-4778-bed9-09c74a81abd0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:08.580477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82995c57-75ce-4778-bed9-09c74a81abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:08.671967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-82995c57-75ce-4778-bed9-09c74a81abd0 None None] MFA Rules not processed for user `617b7042b5654f46b0367fd753dc3ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:08.674809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-82995c57-75ce-4778-bed9-09c74a81abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:08.810257 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:08.817777 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2145/4312] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:08.842982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82995c57-75ce-4778-bed9-09c74a81abd0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:08.880069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d38b3bd03cc4c008039999b9258f5e0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:08.883742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d38b3bd03cc4c008039999b9258f5e0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:08.905025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82995c57-75ce-4778-bed9-09c74a81abd0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:08.936933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '617b7042b5654f46b0367fd753dc3ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '393354eb2f744108862dd5afb17814b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:08.938235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:08.938600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:08.940419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:08.942782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:08.946666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:08.975672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d38b3bd03cc4c008039999b9258f5e0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:08.985077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d38b3bd03cc4c008039999b9258f5e0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:08.986113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d38b3bd03cc4c008039999b9258f5e0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:09.032327 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2168/4313] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:08 2022] DELETE /identity/v3/users/1d38b3bd03cc4c008039999b9258f5e0 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:09.255078 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2146/4314] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:08 2022] POST /identity/v3/projects => generated 359 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:09.259351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:09.262664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:09.452062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1aeb-0620-40c0-a6b3-21c36262778e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:09.564833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '617b7042b5654f46b0367fd753dc3ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '393354eb2f744108862dd5afb17814b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:09.565849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:09.566429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:09.567013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:09.568169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:09.570627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:09.756000 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2169/4315] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:09 2022] POST /identity/v3/users => generated 371 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:09.759407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:09.767684 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:09.786390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893857ce-27bd-44eb-9fb0-549dc0f3edc8 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:09.798654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '617b7042b5654f46b0367fd753dc3ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '393354eb2f744108862dd5afb17814b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:09.799370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:09.799843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:09.800285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:09.801170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:09.801655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:09.805299 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:27:09.805299 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:27:09.805299 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:27:09.810411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:09.892260 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2147/4316] 10.222.0.59 () {58 vars in 1157 bytes} [Sun Aug 28 01:27:09 2022] GET /identity/v3/users?domain_id=default => generated 7734 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:09.896949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:09.918978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e975f19-c1fd-438d-9c12-f512a7ce15fd tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:09.954039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '617b7042b5654f46b0367fd753dc3ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '393354eb2f744108862dd5afb17814b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:09.955165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:09.955716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:09.956183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] PATH_INFO: `/v3/users/00743e1d3fc64fda9a7dfff3a35dcc7e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:10.009121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorizing `identity:update_user(user_id=00743e1d3fc64fda9a7dfff3a35dcc7e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:10.011325 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:27:10.011325 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:27:10.011325 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:27:10.014274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:10.209902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '00743e1d3fc64fda9a7dfff3a35dcc7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.210982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:10.215938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:10.324823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83702-edd1-4703-93d5-2801ad779e80 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:10.340689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:10.342070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:10.342903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:10.343397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] PATH_INFO: `/v3/projects/ebaf3f90ede8433fa8426fab2b7609eb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:10.344770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebaf3f90ede8433fa8426fab2b7609eb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:10.349299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invalidating the token cache because user 00743e1d3fc64fda9a7dfff3a35dcc7e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:10.349595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.350335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d4e97d4b-3d49-4208-a715-26f2d91ab84d tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.352366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2170/4317] 10.222.0.59 () {60 vars in 1244 bytes} [Sun Aug 28 01:27:09 2022] PATCH /identity/v3/users/00743e1d3fc64fda9a7dfff3a35dcc7e => generated 485 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:10.359953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:10.359953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:10.359953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:10.360400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:10.380354 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.auth.plugins.core [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] User is disabled: 00743e1d3fc64fda9a7dfff3a35dcc7e: AssertionError: User is disabled: 00743e1d3fc64fda9a7dfff3a35dcc7e Aug 28 01:27:10.388885 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.server.flask.application [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.59: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 01:27:10.395063 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2171/4318] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:10 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 38 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 01:27:10.397552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:10.399807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:10.428833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07fc37-12ab-435d-9604-eec3d17fbc42 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:10.436019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '617b7042b5654f46b0367fd753dc3ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '393354eb2f744108862dd5afb17814b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:10.436900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:10.437366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:10.437877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] PATH_INFO: `/v3/users/00743e1d3fc64fda9a7dfff3a35dcc7e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:10.481380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorizing `identity:delete_user(user_id=00743e1d3fc64fda9a7dfff3a35dcc7e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:10.483983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:10.630047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebaf3f90ede8433fa8426fab2b7609eb', 'request_id': 'req-9705088f-bdd1-4834-83c8-455a3a8350b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.642676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebaf3f90ede8433fa8426fab2b7609eb', 'request_id': 'req-9705088f-bdd1-4834-83c8-455a3a8350b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.726418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00743e1d3fc64fda9a7dfff3a35dcc7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.728240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00743e1d3fc64fda9a7dfff3a35dcc7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.741367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebaf3f90ede8433fa8426fab2b7609eb', 'request_id': 'req-9705088f-bdd1-4834-83c8-455a3a8350b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.789510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] The token cache is being invalidate because project ebaf3f90ede8433fa8426fab2b7609eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:10.789510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.790439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9705088f-bdd1-4834-83c8-455a3a8350b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.798722 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2148/4319] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:10 2022] DELETE /identity/v3/projects/ebaf3f90ede8433fa8426fab2b7609eb => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:10.800543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18dd2f-55a6-4738-a09e-7cf249385c10 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:10.801135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18dd2f-55a6-4738-a09e-7cf249385c10 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:10.801777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18dd2f-55a6-4738-a09e-7cf249385c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:10.823124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00743e1d3fc64fda9a7dfff3a35dcc7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.831844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00743e1d3fc64fda9a7dfff3a35dcc7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.834788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00743e1d3fc64fda9a7dfff3a35dcc7e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:10.838576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1c18dd2f-55a6-4738-a09e-7cf249385c10 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:10.840756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1c18dd2f-55a6-4738-a09e-7cf249385c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:10.871625 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2172/4320] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:10 2022] DELETE /identity/v3/users/00743e1d3fc64fda9a7dfff3a35dcc7e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:10.876460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:10.879674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:11.083553 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2149/4321] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:11.093278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff721-caf8-4105-900c-e5ad42533a7c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:11.094257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff721-caf8-4105-900c-e5ad42533a7c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:11.097774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ff721-caf8-4105-900c-e5ad42533a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:11.118822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b431f0-8ae9-42e7-955f-cbbc98a4162b tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:11.133338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '617b7042b5654f46b0367fd753dc3ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '393354eb2f744108862dd5afb17814b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:11.138143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:11.138143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:11.138143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] PATH_INFO: `/v3/projects/91cbed856910414ca468862c4708d0c9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:11.154559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91cbed856910414ca468862c4708d0c9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:11.160993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:11.174564 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:11.190364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9b5ff721-caf8-4105-900c-e5ad42533a7c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:11.191730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9b5ff721-caf8-4105-900c-e5ad42533a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:11.333584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cbed856910414ca468862c4708d0c9', 'request_id': 'req-33349262-3dc5-414d-b1b9-ef3aca08f8d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:11.349350 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2150/4322] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:11.349983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cbed856910414ca468862c4708d0c9', 'request_id': 'req-33349262-3dc5-414d-b1b9-ef3aca08f8d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:11.358015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff721-caf8-4105-900c-e5ad42533a7c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:11.377433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ff721-caf8-4105-900c-e5ad42533a7c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:11.423396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cbed856910414ca468862c4708d0c9', 'request_id': 'req-33349262-3dc5-414d-b1b9-ef3aca08f8d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:11.446809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] The token cache is being invalidate because project 91cbed856910414ca468862c4708d0c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:11.446809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:11.449780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:11.471192 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2173/4323] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:10 2022] DELETE /identity/v3/projects/91cbed856910414ca468862c4708d0c9 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:11.477386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:11.484947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:11.550158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:11.552369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:11.552655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:11.553963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:11.557042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:11.558894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:11.564325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:11.607788 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2151/4324] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:27:11.610589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:11.613523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:11.654655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d472-13b9-4652-9ee4-a74005855112 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:11.666699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:11.668006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:11.668297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:11.668574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:11.671742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:11.673704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:11.687161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33349262-3dc5-414d-b1b9-ef3aca08f8d4 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:11.693460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '617b7042b5654f46b0367fd753dc3ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '393354eb2f744108862dd5afb17814b2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:11.694389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:11.694678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:11.694955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:11.695805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:11.699069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Could not find domain: 05490125ed3241548d460d4135f4dd34.: keystone.exception.DomainNotFound: Could not find domain: 05490125ed3241548d460d4135f4dd34. Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 05490125ed3241548d460d4135f4dd34. Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:27:11.729696 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 28 01:27:11.731043 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:27:11.732204 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:27:11.733366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:27:11.733366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 05490125ed3241548d460d4135f4dd34. Aug 28 01:27:11.733366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:27:11.733366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2174/4325] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:11 2022] POST /identity/v3/users => generated 112 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:27:11.741629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:11.744747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:11.769462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18708ac5-8e90-4e4c-9a72-9c29c7aa4162 tempest-UsersNegativeTest-260871325 tempest-UsersNegativeTest-260871325-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:11.774682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:11.776430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:11.776961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:11.777259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] PATH_INFO: `/v3/users/bca789184af348b7b07aee65c247b37b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:11.778945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca789184af348b7b07aee65c247b37b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:11.780981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:11.824418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2152/4326] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:11 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:27:11.829126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:11.967521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9eab-77f9-4b57-ad0a-0759ecfd546f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:11.973579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:11.974637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:11.975540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:11.976656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:11.977915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:11.984018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:12.010621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca789184af348b7b07aee65c247b37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:12.015600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca789184af348b7b07aee65c247b37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:12.121762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca789184af348b7b07aee65c247b37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:12.133391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca789184af348b7b07aee65c247b37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:12.134221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-076dca62-60ed-4a52-9090-372c21078dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca789184af348b7b07aee65c247b37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:12.171998 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2175/4327] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:11 2022] DELETE /identity/v3/users/bca789184af348b7b07aee65c247b37b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:12.176009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:12.176295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:12.176572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:12.222961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:12.224222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:12.268869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2153/4328] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:11 2022] POST /identity/v3/users => generated 290 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:12.270075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:12.274730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:12.296249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc605d3-fa42-4b3a-9ca7-cfc641e6809e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:12.367466 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2176/4329] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:27:12.391934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:12.392969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:12.393241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:12.394153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:12.394302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:12.395190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:12.396781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:12.396925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:12.435705 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2154/4330] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:12.442544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:12.468519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e901f6-61da-4da7-9f59-5e0cd86075d5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:12.482736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:12.483346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:12.483633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:12.484396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:12.485287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:12.487055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:12.511430 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:12.525063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72818a1c-8c79-4b54-a974-23ec1ccc69d3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:12.529284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2155/4331] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:12.532555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:12.539098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5130e-53c4-4068-81cd-d847326674f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:12.547490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5130e-53c4-4068-81cd-d847326674f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:12.547886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5130e-53c4-4068-81cd-d847326674f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:12.548265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5130e-53c4-4068-81cd-d847326674f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:12.562076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de22a9-c535-4103-b221-d104c5b38a0d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:12.567584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5130e-53c4-4068-81cd-d847326674f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:12.567584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5130e-53c4-4068-81cd-d847326674f3 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:12.579976 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2177/4332] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:27:12.588450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7777aa-0abf-485f-80dc-2580ec48c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:12.591625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7777aa-0abf-485f-80dc-2580ec48c685 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:12.591625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7777aa-0abf-485f-80dc-2580ec48c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:12.591625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7777aa-0abf-485f-80dc-2580ec48c685 admin admin] PATH_INFO: `/v3/projects/9d460c0d46f84be186271ba796fd7b05/users/25c450da892f47a6a31149f0796fb363/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:12.628644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7777aa-0abf-485f-80dc-2580ec48c685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d460c0d46f84be186271ba796fd7b05, user_id=25c450da892f47a6a31149f0796fb363, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:12.631347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7777aa-0abf-485f-80dc-2580ec48c685 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:12.731378 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2156/4333] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:12 2022] PUT /identity/v3/projects/9d460c0d46f84be186271ba796fd7b05/users/25c450da892f47a6a31149f0796fb363/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:12.733271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7572-a60a-4b30-86c3-144d00c6c580 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:12.734186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7572-a60a-4b30-86c3-144d00c6c580 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:12.734468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e7572-a60a-4b30-86c3-144d00c6c580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:12.781769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:12.782088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:12.782369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:12.819663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ce2e7572-a60a-4b30-86c3-144d00c6c580 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:12.821262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ce2e7572-a60a-4b30-86c3-144d00c6c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:12.839303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] MFA Rules not processed for user `19b963761a2d4d03a5e818dabc10707c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:12.841270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:12.993401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2178/4334] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:13.009451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e7572-a60a-4b30-86c3-144d00c6c580 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:13.023446 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2157/4335] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:27:13.031085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:13.032546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:13.187399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e7572-a60a-4b30-86c3-144d00c6c580 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:13.193274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:13.194909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:13.195388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:13.195762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:13.210556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:13.212327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:13.227769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2179/4336] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:13.248341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109edb-f17a-4df7-aac3-d73338e867ed None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:13.255594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:13.257178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:13.257636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:13.258094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:13.280788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:13.282835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:13.294573 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2158/4337] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:13.456040 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:13.990698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:13.992471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:14.014441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2dfc4-6d19-4e74-8d17-2cc2c67589e8 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:14.027666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:14.028516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:14.028868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:14.029854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] PATH_INFO: `/v3/projects/b91ae987b92242d9b089ec721ee36168` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:14.034235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91ae987b92242d9b089ec721ee36168)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:14.038453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:14.204965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91ae987b92242d9b089ec721ee36168', 'request_id': 'req-70098aea-6ae2-4040-9b3c-dd82809324ac'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:14.220535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91ae987b92242d9b089ec721ee36168', 'request_id': 'req-70098aea-6ae2-4040-9b3c-dd82809324ac'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:14.348682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91ae987b92242d9b089ec721ee36168', 'request_id': 'req-70098aea-6ae2-4040-9b3c-dd82809324ac'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:14.370383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] The token cache is being invalidate because project b91ae987b92242d9b089ec721ee36168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:14.370676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:14.373250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:14.375045 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2180/4338] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:13 2022] DELETE /identity/v3/projects/b91ae987b92242d9b089ec721ee36168 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:14.379085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:14.398053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3acf-9961-4c1e-b3ba-caa21f9669c3 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:14.578206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:14.584078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:14.584416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:14.584699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] PATH_INFO: `/v3/users/617b7042b5654f46b0367fd753dc3ae5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:14.586942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] RBAC: Authorizing `identity:delete_user(user_id=617b7042b5654f46b0367fd753dc3ae5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:14.591493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:14.794468 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:14.946578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617b7042b5654f46b0367fd753dc3ae5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:15.003077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617b7042b5654f46b0367fd753dc3ae5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:15.030314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617b7042b5654f46b0367fd753dc3ae5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:15.032381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617b7042b5654f46b0367fd753dc3ae5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:15.120880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0dcf65e7-aed4-4f17-86c4-7a0e39ba001a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617b7042b5654f46b0367fd753dc3ae5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:15.128246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2159/4339] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:14 2022] DELETE /identity/v3/users/617b7042b5654f46b0367fd753dc3ae5 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:15.155011 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:15.773802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:15.776348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:15.820067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098aea-6ae2-4040-9b3c-dd82809324ac admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:15.920506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:15.921968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:15.921968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:15.921968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] PATH_INFO: `/v3/projects/393354eb2f744108862dd5afb17814b2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:15.923282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393354eb2f744108862dd5afb17814b2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:15.925292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:16.116426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393354eb2f744108862dd5afb17814b2', 'request_id': 'req-371a98e1-788f-4b6b-a7c6-93ea7be96632'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:16.139701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393354eb2f744108862dd5afb17814b2', 'request_id': 'req-371a98e1-788f-4b6b-a7c6-93ea7be96632'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:16.232720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393354eb2f744108862dd5afb17814b2', 'request_id': 'req-371a98e1-788f-4b6b-a7c6-93ea7be96632'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:16.249136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] The token cache is being invalidate because project 393354eb2f744108862dd5afb17814b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:16.249758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:16.253341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-371a98e1-788f-4b6b-a7c6-93ea7be96632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:16.258358 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2181/4340] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:15 2022] DELETE /identity/v3/projects/393354eb2f744108862dd5afb17814b2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:16.265538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfe9-c6c8-4007-b67e-59bb3212298f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:16.266103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfe9-c6c8-4007-b67e-59bb3212298f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:16.266325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfe9-c6c8-4007-b67e-59bb3212298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:16.305535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9a4fbfe9-c6c8-4007-b67e-59bb3212298f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:16.307511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a4fbfe9-c6c8-4007-b67e-59bb3212298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:16.427127 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:16.454521 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2160/4341] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:16.468793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961462b4-2fab-4aba-aeb8-bfeb0ebce801 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:16.469357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961462b4-2fab-4aba-aeb8-bfeb0ebce801 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:16.469984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961462b4-2fab-4aba-aeb8-bfeb0ebce801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:16.505847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-961462b4-2fab-4aba-aeb8-bfeb0ebce801 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:16.507973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-961462b4-2fab-4aba-aeb8-bfeb0ebce801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:16.549061 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2182/4342] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:16.564560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbfe9-c6c8-4007-b67e-59bb3212298f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:16.578723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbfe9-c6c8-4007-b67e-59bb3212298f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:16.594545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:16.596832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:16.597476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:16.598293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:16.600111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:16.601003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:16.605751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:16.624419 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2161/4343] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:16.629311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961462b4-2fab-4aba-aeb8-bfeb0ebce801 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:16.646879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961462b4-2fab-4aba-aeb8-bfeb0ebce801 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:16.647847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:16.649019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:16.649791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:16.650456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:16.651524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:16.653778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:16.754878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2183/4344] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:16 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:16.756767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:16.770892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4125-fddc-4550-8ec2-ea70745c40a6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:16.857671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:16.859016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:16.859544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:16.860045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:16.861109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:16.863777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:16.941608 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2162/4345] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:16 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:16.942508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:16.958677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6e2b1-5fcd-4f1a-93b0-3e6369b06a4b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:16.966017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:16.966929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:16.967431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:16.967891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:16.968719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:16.971455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:16.986810 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2184/4346] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:27:16.991328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:17.004529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2734da-618f-45cd-b19e-73a3f73fc68e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:17.011803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f32e39-ba2e-481a-adb3-5505fa391779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:17.012848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32e39-ba2e-481a-adb3-5505fa391779 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:17.013307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32e39-ba2e-481a-adb3-5505fa391779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:17.016100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f32e39-ba2e-481a-adb3-5505fa391779 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:17.016100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f32e39-ba2e-481a-adb3-5505fa391779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:17.023711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f32e39-ba2e-481a-adb3-5505fa391779 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:17.055651 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2163/4347] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:17.059790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:17.086364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfc2fa-60e0-46a8-9a84-000346ff6c86 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:17.094447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:17.095382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:17.097560 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:17.098772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:17.099260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] PATH_INFO: `/v3/projects/651300e7df7f40d1afda37224d460e0d/users/e502a9fe738e4403a98d1197979aa6f3/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:17.142162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651300e7df7f40d1afda37224d460e0d, user_id=e502a9fe738e4403a98d1197979aa6f3, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:17.145246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:17.243272 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2185/4348] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:17 2022] PUT /identity/v3/projects/651300e7df7f40d1afda37224d460e0d/users/e502a9fe738e4403a98d1197979aa6f3/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:17.254674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551445-f8b7-480b-9a50-1567c0cc006c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:17.254906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551445-f8b7-480b-9a50-1567c0cc006c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:17.255159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551445-f8b7-480b-9a50-1567c0cc006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:17.315699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ea551445-f8b7-480b-9a50-1567c0cc006c None None] MFA Rules not processed for user `e502a9fe738e4403a98d1197979aa6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:17.318709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea551445-f8b7-480b-9a50-1567c0cc006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:17.433851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2164/4349] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:17.438949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:17.454764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22764f-9b9d-4148-9518-1c3db2859110 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:17.460679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e5b5b-1d8d-4a38-802e-ffd49878053a tempest-IdentityCatalogTest-1631851278 tempest-IdentityCatalogTest-1631851278-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e502a9fe738e4403a98d1197979aa6f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651300e7df7f40d1afda37224d460e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:17.461607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5b5b-1d8d-4a38-802e-ffd49878053a tempest-IdentityCatalogTest-1631851278 tempest-IdentityCatalogTest-1631851278-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:17.462565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5b5b-1d8d-4a38-802e-ffd49878053a tempest-IdentityCatalogTest-1631851278 tempest-IdentityCatalogTest-1631851278-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:17.464186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5b5b-1d8d-4a38-802e-ffd49878053a tempest-IdentityCatalogTest-1631851278 tempest-IdentityCatalogTest-1631851278-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:17.465524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5b5b-1d8d-4a38-802e-ffd49878053a tempest-IdentityCatalogTest-1631851278 tempest-IdentityCatalogTest-1631851278-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:17.466849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5b5b-1d8d-4a38-802e-ffd49878053a tempest-IdentityCatalogTest-1631851278 tempest-IdentityCatalogTest-1631851278-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:17.469609 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2186/4350] 10.222.0.59 () {58 vars in 1143 bytes} [Sun Aug 28 01:27:17 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:27:17.474013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551445-f8b7-480b-9a50-1567c0cc006c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:17.560968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551445-f8b7-480b-9a50-1567c0cc006c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:17.566611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:17.567431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:17.568112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:17.574417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] PATH_INFO: `/v3/users/e502a9fe738e4403a98d1197979aa6f3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:17.576639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e502a9fe738e4403a98d1197979aa6f3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:17.578866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:17.803417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e502a9fe738e4403a98d1197979aa6f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:17.819584 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:17.834687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e502a9fe738e4403a98d1197979aa6f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:17.856345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e502a9fe738e4403a98d1197979aa6f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:17.857131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e502a9fe738e4403a98d1197979aa6f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:17.971245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e502a9fe738e4403a98d1197979aa6f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:17.982100 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2165/4351] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:17 2022] DELETE /identity/v3/users/e502a9fe738e4403a98d1197979aa6f3 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:17.986947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:17.988665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:17.989194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:18.018570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:18.023554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:18.132917 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2187/4352] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:18.154485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:18.155988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:18.247334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e244-c802-498b-b4f5-c30a993dc6d4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:18.253254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0476-35cf-4af5-ac3a-1f9ad794c2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:18.255152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0476-35cf-4af5-ac3a-1f9ad794c2ae service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:18.255551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0476-35cf-4af5-ac3a-1f9ad794c2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:18.255930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0476-35cf-4af5-ac3a-1f9ad794c2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:18.303869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0476-35cf-4af5-ac3a-1f9ad794c2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:18.305963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0476-35cf-4af5-ac3a-1f9ad794c2ae service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:18.319142 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2166/4353] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:27:19.063671 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:21.240673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:21.242263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:21.322596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433bf9c-58d2-4e22-a968-e12d211238f8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:21.338784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:21.339442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:21.339725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:21.340001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] PATH_INFO: `/v3/projects/651300e7df7f40d1afda37224d460e0d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:21.345833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=651300e7df7f40d1afda37224d460e0d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:21.350335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:21.577349 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:21.627636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651300e7df7f40d1afda37224d460e0d', 'request_id': 'req-39e6296a-1b9c-438c-8a1e-aba908e275cc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:21.658717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651300e7df7f40d1afda37224d460e0d', 'request_id': 'req-39e6296a-1b9c-438c-8a1e-aba908e275cc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:21.770741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651300e7df7f40d1afda37224d460e0d', 'request_id': 'req-39e6296a-1b9c-438c-8a1e-aba908e275cc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:21.796511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] The token cache is being invalidate because project 651300e7df7f40d1afda37224d460e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:21.796894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:21.798215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-39e6296a-1b9c-438c-8a1e-aba908e275cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:21.809655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2188/4354] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:21 2022] DELETE /identity/v3/projects/651300e7df7f40d1afda37224d460e0d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:21.817572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8b13-915e-4f60-975e-182263c8dd43 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:21.818088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8b13-915e-4f60-975e-182263c8dd43 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:21.818247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8b13-915e-4f60-975e-182263c8dd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:21.880505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fabf8b13-915e-4f60-975e-182263c8dd43 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:21.882728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fabf8b13-915e-4f60-975e-182263c8dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:22.072789 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2167/4355] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:22.080656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059717a-6480-4a45-af5f-ab9976fdac6d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:22.081277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059717a-6480-4a45-af5f-ab9976fdac6d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:22.082078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059717a-6480-4a45-af5f-ab9976fdac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:22.129313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7059717a-6480-4a45-af5f-ab9976fdac6d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:22.130677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7059717a-6480-4a45-af5f-ab9976fdac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:22.159825 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2189/4356] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:22.164300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8b13-915e-4f60-975e-182263c8dd43 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:22.177469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8b13-915e-4f60-975e-182263c8dd43 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:22.184878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:22.185918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:22.188301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:22.189038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:22.190143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:22.190677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:22.215025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:22.229588 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:22.237232 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2168/4357] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:22.240491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059717a-6480-4a45-af5f-ab9976fdac6d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:22.253463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059717a-6480-4a45-af5f-ab9976fdac6d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:22.264245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:22.266195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:22.270298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:22.270298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:22.270298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:22.271730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:22.430504 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2190/4358] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:22.437947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:22.452396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a22d8f-acd1-4f65-b453-fab00abf92e8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:22.599406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:22.600315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:22.600768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:22.601213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:22.604713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:22.608206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:22.715577 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2169/4359] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:22 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:27:22.719864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:22.736624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5429d82-fb30-4ade-a0f9-314f9e6e3c5e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:22.741880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:22.743598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:22.745328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:22.745881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:22.746771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:22.749173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:22.773754 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2191/4360] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:22.778746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:22.796024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c6ccd-6a40-4121-887e-d00ee2445731 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:22.802045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecad2ee-67c6-487f-a021-dea921ebd8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:22.802936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecad2ee-67c6-487f-a021-dea921ebd8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:22.803439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecad2ee-67c6-487f-a021-dea921ebd8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:22.803926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecad2ee-67c6-487f-a021-dea921ebd8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:22.805568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecad2ee-67c6-487f-a021-dea921ebd8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:22.808317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecad2ee-67c6-487f-a021-dea921ebd8a1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:22.844465 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2170/4361] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:22.851591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:22.883890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb106a3-315a-4857-9a66-51ad1aabee3e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:22.896335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:22.899294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:22.904601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:22.904601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] PATH_INFO: `/v3/projects/2c0e257b3b4b46eaade15962496b2bb3/users/007a2408239e472cb439b14923c405fd/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:22.948473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0e257b3b4b46eaade15962496b2bb3, user_id=007a2408239e472cb439b14923c405fd, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:22.954409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:23.082255 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2192/4362] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:22 2022] PUT /identity/v3/projects/2c0e257b3b4b46eaade15962496b2bb3/users/007a2408239e472cb439b14923c405fd/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:23.095225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa70d6-b97d-45d5-a667-705831d24292 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:23.095225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa70d6-b97d-45d5-a667-705831d24292 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:23.095576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa70d6-b97d-45d5-a667-705831d24292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:23.189798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-12fa70d6-b97d-45d5-a667-705831d24292 None None] MFA Rules not processed for user `007a2408239e472cb439b14923c405fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:23.191064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-12fa70d6-b97d-45d5-a667-705831d24292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:23.373754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:23.376041 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2171/4363] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:23.410683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f07f-9849-4057-a69d-bb4b38831bb4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:23.428138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:23.430399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:23.430873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:23.437720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:23.437720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=007a2408239e472cb439b14923c405fd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:23.437720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:23.566162 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2193/4364] 10.222.0.59 () {60 vars in 1299 bytes} [Sun Aug 28 01:27:23 2022] POST /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2 => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:27:23.573088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa70d6-b97d-45d5-a667-705831d24292 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:23.589146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa70d6-b97d-45d5-a667-705831d24292 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:23.594259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:23.602228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:23.602734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:23.604317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/02916ca920524388be7632ae29ddc0d2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:23.607141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=007a2408239e472cb439b14923c405fd, credential_id=02916ca920524388be7632ae29ddc0d2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:23.608830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:23.711224 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2172/4365] 10.222.0.59 () {58 vars in 1380 bytes} [Sun Aug 28 01:27:23 2022] DELETE /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/02916ca920524388be7632ae29ddc0d2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:23.716162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:23.726866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699acd9-3df1-4ea4-b6eb-c07df3a0d1b8 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:23.735404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:23.736474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:23.743832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:23.743832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:23.743832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=007a2408239e472cb439b14923c405fd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:23.743832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:23.844546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2194/4366] 10.222.0.59 () {60 vars in 1299 bytes} [Sun Aug 28 01:27:23 2022] POST /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2 => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:23.848515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:23.861646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a2bc7-a45a-4d1f-b2bd-dbe1a189da47 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:23.873953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:23.874738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:23.875094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:23.875437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/f6c4263b05694e82b3af588bee682576` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:23.879564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=007a2408239e472cb439b14923c405fd, credential_id=f6c4263b05694e82b3af588bee682576)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:23.883358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:23.998136 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2173/4367] 10.222.0.59 () {58 vars in 1380 bytes} [Sun Aug 28 01:27:23 2022] DELETE /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/f6c4263b05694e82b3af588bee682576 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:23.999471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.012412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836b08-7e6e-4049-9547-2471db100e58 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.023059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd568dec-cb26-433d-ab36-6e32ef71d4fb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.024024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd568dec-cb26-433d-ab36-6e32ef71d4fb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.024415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd568dec-cb26-433d-ab36-6e32ef71d4fb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.024795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd568dec-cb26-433d-ab36-6e32ef71d4fb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/f6c4263b05694e82b3af588bee682576` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-fd568dec-cb26-433d-ab36-6e32ef71d4fb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Could not find credential: 0d2164f9fd50a902428b1a8c9f30e2dc87b9036bd5b456634db50698a11f325c.: keystone.exception.CredentialNotFound: Could not find credential: 0d2164f9fd50a902428b1a8c9f30e2dc87b9036bd5b456634db50698a11f325c. Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 28 01:27:24.066878 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:27:24.075583 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 0d2164f9fd50a902428b1a8c9f30e2dc87b9036bd5b456634db50698a11f325c. Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:27:24.076722 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2195/4368] 10.222.0.59 () {58 vars in 1377 bytes} [Sun Aug 28 01:27:23 2022] GET /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/f6c4263b05694e82b3af588bee682576 => generated 148 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:27:24.080055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.091394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41273-f0f8-4626-b41e-6795b3f7d9c7 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.102405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.106015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.106015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.112173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.112875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=007a2408239e472cb439b14923c405fd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.114465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:24.226521 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2174/4369] 10.222.0.59 () {60 vars in 1299 bytes} [Sun Aug 28 01:27:24 2022] POST /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2 => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:24.230593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd568dec-cb26-433d-ab36-6e32ef71d4fb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.257527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd568dec-cb26-433d-ab36-6e32ef71d4fb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.267064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.268242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.269266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.270162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.277173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=007a2408239e472cb439b14923c405fd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.277173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:24.391721 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2196/4370] 10.222.0.59 () {60 vars in 1299 bytes} [Sun Aug 28 01:27:24 2022] POST /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2 => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:24.397335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.417277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034202c-58ff-40a7-a4a8-468d4e5ab38c tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.431299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.433188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.433738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.434256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.435078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=007a2408239e472cb439b14923c405fd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.442077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:24.469067 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2175/4371] 10.222.0.59 () {58 vars in 1278 bytes} [Sun Aug 28 01:27:24 2022] GET /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2 => generated 865 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:24.470539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.484577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10f506-4b51-4ff3-88e7-dea0e8783fcb tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.497528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.498504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.501433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.501433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/534a3e64f9d64f9e916e9d55c92c5009` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.503615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=007a2408239e472cb439b14923c405fd, credential_id=534a3e64f9d64f9e916e9d55c92c5009)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.506200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:24.578591 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2197/4372] 10.222.0.59 () {58 vars in 1380 bytes} [Sun Aug 28 01:27:24 2022] DELETE /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/534a3e64f9d64f9e916e9d55c92c5009 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:24.582013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.609766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582399-1586-4f2b-a02d-8aa4a571b881 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.616221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.616221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.617841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.618345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/ed9e8d30340b404e9240ba79721d34a6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.621436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=007a2408239e472cb439b14923c405fd, credential_id=ed9e8d30340b404e9240ba79721d34a6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.623601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:24.711216 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:24.726021 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2176/4373] 10.222.0.59 () {58 vars in 1380 bytes} [Sun Aug 28 01:27:24 2022] DELETE /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/ed9e8d30340b404e9240ba79721d34a6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:24.732737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.752671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31cad-deb2-4ca1-baa3-0f6421f1eab4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.765596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.766303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.766588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.766865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.767547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=007a2408239e472cb439b14923c405fd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.770573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:24.871742 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2198/4374] 10.222.0.59 () {60 vars in 1299 bytes} [Sun Aug 28 01:27:24 2022] POST /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2 => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:24.875467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.893899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b647f-de8a-433f-a0f3-a6795732492a tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.907657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.909525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.910606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.911590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/267738eedc084e38b86b6f525e6a61c4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.917906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=007a2408239e472cb439b14923c405fd, credential_id=267738eedc084e38b86b6f525e6a61c4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.919911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:24.928323 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2177/4375] 10.222.0.59 () {58 vars in 1377 bytes} [Sun Aug 28 01:27:24 2022] GET /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/267738eedc084e38b86b6f525e6a61c4 => generated 367 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:24.929019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:24.981668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a2ce-4421-46e4-a4b5-d8458b3690d4 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:24.987067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f48c9-153f-4eff-a645-8aedb2de5be5 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '007a2408239e472cb439b14923c405fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c0e257b3b4b46eaade15962496b2bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:24.987748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f48c9-153f-4eff-a645-8aedb2de5be5 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:24.988037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f48c9-153f-4eff-a645-8aedb2de5be5 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:24.988363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f48c9-153f-4eff-a645-8aedb2de5be5 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/267738eedc084e38b86b6f525e6a61c4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:24.991017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f48c9-153f-4eff-a645-8aedb2de5be5 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=007a2408239e472cb439b14923c405fd, credential_id=267738eedc084e38b86b6f525e6a61c4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:24.992930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f48c9-153f-4eff-a645-8aedb2de5be5 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:25.106129 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2199/4376] 10.222.0.59 () {58 vars in 1380 bytes} [Sun Aug 28 01:27:24 2022] DELETE /identity/v3/users/007a2408239e472cb439b14923c405fd/credentials/OS-EC2/267738eedc084e38b86b6f525e6a61c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:25.110532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:25.255375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be3202-b3fb-4c03-9b19-892806360389 tempest-EC2CredentialsTest-1421617415 tempest-EC2CredentialsTest-1421617415-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:25.271728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:25.272279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:25.273437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:25.274287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] PATH_INFO: `/v3/users/007a2408239e472cb439b14923c405fd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:25.276149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=007a2408239e472cb439b14923c405fd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:25.278919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:25.549285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007a2408239e472cb439b14923c405fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:25.597695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007a2408239e472cb439b14923c405fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:25.621348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007a2408239e472cb439b14923c405fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:25.622184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007a2408239e472cb439b14923c405fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:25.712274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007a2408239e472cb439b14923c405fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:25.723984 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2178/4377] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:25 2022] DELETE /identity/v3/users/007a2408239e472cb439b14923c405fd => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:25.730991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:25.732816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:25.733657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:25.778846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:25.780806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:25.841705 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:25.965000 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2200/4378] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:26.051010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:26.053173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:26.189281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba30848-ca75-4ce1-94ac-d23c3ce0ad0e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:26.193389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:26.194226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:26.194509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:26.194843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:26.207365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:26.209784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:26.222017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2179/4379] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:27:27.323254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:27.324748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:27.362601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486b81-5b71-4cbf-9e7c-82f39c8733a4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:27.385584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:27.386279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:27.386563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:27.386841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] PATH_INFO: `/v3/users/19b963761a2d4d03a5e818dabc10707c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:27.389137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b963761a2d4d03a5e818dabc10707c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:27.394465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:27.681979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b963761a2d4d03a5e818dabc10707c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:27.684355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b963761a2d4d03a5e818dabc10707c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:27.777675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b963761a2d4d03a5e818dabc10707c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:27.788911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b963761a2d4d03a5e818dabc10707c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:27.790281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00ef5b8-7e44-4436-8251-390394775fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b963761a2d4d03a5e818dabc10707c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:27.820641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:27.823679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:27.843601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29670581-bb02-434a-98d9-bb90e988fde2 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:27.846276 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2201/4380] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:27 2022] DELETE /identity/v3/users/19b963761a2d4d03a5e818dabc10707c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:27.850031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:27.864433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:27.865000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:27.865493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] PATH_INFO: `/v3/projects/2c0e257b3b4b46eaade15962496b2bb3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:27.867527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0e257b3b4b46eaade15962496b2bb3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:27.872946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:27.936781 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:28.121349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0e257b3b4b46eaade15962496b2bb3', 'request_id': 'req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:28.138681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0e257b3b4b46eaade15962496b2bb3', 'request_id': 'req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:28.245502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0e257b3b4b46eaade15962496b2bb3', 'request_id': 'req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:28.262795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] The token cache is being invalidate because project 2c0e257b3b4b46eaade15962496b2bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:28.263434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:28.264358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91154d19-3ad1-4b08-82ce-0ac5af2f33fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:28.267806 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2180/4381] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:27 2022] DELETE /identity/v3/projects/2c0e257b3b4b46eaade15962496b2bb3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:27:28.275924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4964-a404-4146-86d1-dc9bf5ca7cfe None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:28.276224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4964-a404-4146-86d1-dc9bf5ca7cfe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:28.276545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4964-a404-4146-86d1-dc9bf5ca7cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:28.358026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-01ca4964-a404-4146-86d1-dc9bf5ca7cfe None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:28.363654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-01ca4964-a404-4146-86d1-dc9bf5ca7cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:28.625237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669f50-1534-447f-bb62-46bfdb46a3b8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:28.625624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669f50-1534-447f-bb62-46bfdb46a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:28.626033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669f50-1534-447f-bb62-46bfdb46a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:28.626976 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2202/4382] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:28.662771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-02669f50-1534-447f-bb62-46bfdb46a3b8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:28.667551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02669f50-1534-447f-bb62-46bfdb46a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:28.682302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2181/4383] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:27:28.689778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4964-a404-4146-86d1-dc9bf5ca7cfe None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:28.721698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4964-a404-4146-86d1-dc9bf5ca7cfe None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:28.736507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:28.737431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:28.738532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:28.739070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:28.740233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:28.741007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:28.743167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:28.765793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669f50-1534-447f-bb62-46bfdb46a3b8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:28.779429 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2203/4384] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:28.783278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669f50-1534-447f-bb62-46bfdb46a3b8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:28.790023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:28.791262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:28.791658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:28.791935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:28.793126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:28.795090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:28.934762 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2182/4385] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:28 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:28.938557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:28.952907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817faf0-75f8-4da9-bb5c-aacb81070498 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:28.994737 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:29.068881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:29.069540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.069970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.070111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:29.070807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:29.073064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:29.200030 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2204/4386] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:28 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:29.200176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:29.221690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd4b9b-68fe-4afd-ab47-de5949131a35 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:29.242150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:29.244432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.247422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.248306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:29.251704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:29.253714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:29.288921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:29.291203 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2183/4387] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:29.314761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534774ac-a821-4f44-aadd-96f97b29e02d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:29.325570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:29.326616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.326983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.327328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:29.328088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:29.329830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:29.388745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2205/4388] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:29.390012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:29.410338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035186c-07f4-4a91-bea8-5f72e7b465be admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:29.424085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:29.427199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:29.428037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95fd94-c4b7-4a2b-91d7-3956a4b99959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:29.428764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95fd94-c4b7-4a2b-91d7-3956a4b99959 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.429045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95fd94-c4b7-4a2b-91d7-3956a4b99959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.429322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95fd94-c4b7-4a2b-91d7-3956a4b99959 admin admin] PATH_INFO: `/v3/projects/583392f7ea45480dae152ff87dd2b64c/users/f731904c67cc4490bcef1a6167357c56/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:29.475946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31e85c-bdec-454c-9ef8-b63585f145ad admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:29.500226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95fd94-c4b7-4a2b-91d7-3956a4b99959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583392f7ea45480dae152ff87dd2b64c, user_id=f731904c67cc4490bcef1a6167357c56, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:29.502707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95fd94-c4b7-4a2b-91d7-3956a4b99959 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:29.512317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:29.513191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.514389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.514694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] PATH_INFO: `/v3/projects/60800392f52f45a6ba977a9e381244a9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:29.521122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60800392f52f45a6ba977a9e381244a9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:29.526651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:29.610413 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2184/4389] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:29 2022] PUT /identity/v3/projects/583392f7ea45480dae152ff87dd2b64c/users/f731904c67cc4490bcef1a6167357c56/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:29.623875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e74d8-ebc8-4efe-847f-f3bacb90510b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.624434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e74d8-ebc8-4efe-847f-f3bacb90510b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.624966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e74d8-ebc8-4efe-847f-f3bacb90510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:29.748066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-229e74d8-ebc8-4efe-847f-f3bacb90510b None None] MFA Rules not processed for user `f731904c67cc4490bcef1a6167357c56`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:29.749402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-229e74d8-ebc8-4efe-847f-f3bacb90510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:29.770393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60800392f52f45a6ba977a9e381244a9', 'request_id': 'req-3db82246-415b-4d30-b5e7-35a793a80c67'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:29.791868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60800392f52f45a6ba977a9e381244a9', 'request_id': 'req-3db82246-415b-4d30-b5e7-35a793a80c67'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:29.890589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60800392f52f45a6ba977a9e381244a9', 'request_id': 'req-3db82246-415b-4d30-b5e7-35a793a80c67'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:29.917300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] The token cache is being invalidate because project 60800392f52f45a6ba977a9e381244a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:29.917686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:29.918483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3db82246-415b-4d30-b5e7-35a793a80c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:29.921875 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2206/4390] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:29 2022] DELETE /identity/v3/projects/60800392f52f45a6ba977a9e381244a9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:29.931660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2db89-3f81-460a-9965-c5e988cd075b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.933119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2db89-3f81-460a-9965-c5e988cd075b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.934684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2db89-3f81-460a-9965-c5e988cd075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:29.948374 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2185/4391] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:29.951293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:29.957320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:29.957888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.000644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b4d2db89-3f81-460a-9965-c5e988cd075b None None] MFA Rules not processed for user `a239a0dd4451431aa7e3beea2d4b37aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:30.002464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b4d2db89-3f81-460a-9965-c5e988cd075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.010245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:30.015489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.070673 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:30.127436 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2207/4392] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:30.136899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8e32-9e7b-489d-bbcd-c7d6ab8d6650 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:30.137192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8e32-9e7b-489d-bbcd-c7d6ab8d6650 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:30.137469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8e32-9e7b-489d-bbcd-c7d6ab8d6650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.167323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5c2b8e32-9e7b-489d-bbcd-c7d6ab8d6650 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:30.169699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5c2b8e32-9e7b-489d-bbcd-c7d6ab8d6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.176801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2186/4393] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:30.179931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:30.179931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.203893 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:30.317538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c7e16-2931-472d-bade-3b92fa11550a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:30.325051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:30.326110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:30.326669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:30.327168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.328231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:30.330290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:30.342601 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2208/4394] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:30.344005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850388-2136-46ad-8a89-6a9e5d2f13ed None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:30.346583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850388-2136-46ad-8a89-6a9e5d2f13ed None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:30.346879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850388-2136-46ad-8a89-6a9e5d2f13ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.444351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5b850388-2136-46ad-8a89-6a9e5d2f13ed None None] MFA Rules not processed for user `58913dfcbc49476283a7624dbc8e73cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:30.447309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5b850388-2136-46ad-8a89-6a9e5d2f13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.479333 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2187/4395] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:30 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:30.479333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:30.490800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.566145 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2209/4396] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:30.568332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3867-9d4b-43da-848b-5e4e9f8ff686 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:30.568863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3867-9d4b-43da-848b-5e4e9f8ff686 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:30.569323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3867-9d4b-43da-848b-5e4e9f8ff686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.614463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c26a3867-9d4b-43da-848b-5e4e9f8ff686 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:30.615425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c26a3867-9d4b-43da-848b-5e4e9f8ff686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.708880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7fb76-4beb-4d2e-9d7b-2b1b190d5a95 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:30.732826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:30.734018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:30.736892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:30.737410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.767216 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2210/4397] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:30.770661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a3867-9d4b-43da-848b-5e4e9f8ff686 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:30.793630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a3867-9d4b-43da-848b-5e4e9f8ff686 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:30.805292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:30.807063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:30.807569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:30.808094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.808949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:30.813799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:30.863986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:30.866686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:30.878678 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2188/4398] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:30.884131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:30.884131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:30.912842 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2211/4399] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:30 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:30.916811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:30.940218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7518e3-38c3-40ed-90ac-28b49fa64a2e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:30.957269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:30.958495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:30.959011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:30.959602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:30.960621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:30.961359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:30.969218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.003503 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2212/4400] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:31.007086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:31.019349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ac8e-52fa-443f-a462-0927d8d94db0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.028832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbdb3-580e-4082-a996-3a3e128d743f service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.032742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.032742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.032742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.032742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.034888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:31.035171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.035967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.036436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.036875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.038519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.039443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:31.062946 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2213/4401] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:31.068697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:31.092926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e6737-9ff4-4be9-ab8a-51426638d75e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.103481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.105645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.105989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.106211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.106861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:31.112499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.130078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:31.132317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.156792 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2189/4402] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:31.158082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:31.185995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724913ac-c567-47a3-af2f-61e7a8959f79 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.192111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.193056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.193341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.193617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.197634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:31.199217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.210778 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:31.242015 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2190/4403] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:31.244839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:31.258385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598ddbc-fe21-4992-890c-3d6d03b9d22e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.266215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a88695-5d83-4706-a229-e9c0f58befc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.270916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a88695-5d83-4706-a229-e9c0f58befc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.270916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a88695-5d83-4706-a229-e9c0f58befc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.270916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a88695-5d83-4706-a229-e9c0f58befc0 admin admin] PATH_INFO: `/v3/projects/17bbd87f9e0b45b49a32f0f6df3b28ad/users/56d4f644de434fc98cf105cd7811af90/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.334085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a88695-5d83-4706-a229-e9c0f58befc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bbd87f9e0b45b49a32f0f6df3b28ad, user_id=56d4f644de434fc98cf105cd7811af90, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:31.334085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a88695-5d83-4706-a229-e9c0f58befc0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.366588 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2214/4404] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:31 2022] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:31.368110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:31.425868 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2191/4405] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:31 2022] PUT /identity/v3/projects/17bbd87f9e0b45b49a32f0f6df3b28ad/users/56d4f644de434fc98cf105cd7811af90/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:27:31.431686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.432159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.446918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.543471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd02595-2de2-4fb4-9aab-10a144163ee6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.552069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] MFA Rules not processed for user `56d4f644de434fc98cf105cd7811af90`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:31.556996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:31.668149 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:31.721166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.722175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.722647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.723095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.724271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:31.726165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.732151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2192/4406] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:31.744593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:31.746410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:31.829695 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2215/4407] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:31 2022] POST /identity/v3/users => generated 294 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:31.834927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:31.879567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802372a2-ef49-4047-8c1b-af73403abd4d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.890337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e7ebe-e8e7-4787-a8d3-1076a4f326c6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:31.903843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.904483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.905613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.905938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.906916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60186-eae6-49ab-b405-66c971e84d24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:31.908050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60186-eae6-49ab-b405-66c971e84d24 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:31.909111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:31.910050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60186-eae6-49ab-b405-66c971e84d24 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:31.910356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60186-eae6-49ab-b405-66c971e84d24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:31.915966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:31.917521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5fb60186-eae6-49ab-b405-66c971e84d24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:31.965022 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2216/4408] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:31.974190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:32.006731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedeb76-9eb5-4f65-a8ee-0fcb23ee11c0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:32.027069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:32.027736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:32.028026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:32.028310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:32.028968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:32.036660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:32.079905 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2217/4409] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:32.080837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:32.108100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f3cc0-45f3-416d-999a-db234d95d8b5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:32.122880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:32.123563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:32.123845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:32.124122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] PATH_INFO: `/v3/projects/37dfcd92b40d47f98b774ce6a8aff2a6/users/17fbb660ff0c4b81af9397a3abc665c3/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:32.141924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60186-eae6-49ab-b405-66c971e84d24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:32.159155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60186-eae6-49ab-b405-66c971e84d24 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:32.196037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dfcd92b40d47f98b774ce6a8aff2a6, user_id=17fbb660ff0c4b81af9397a3abc665c3, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:32.201730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:32.212332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2193/4410] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:27:32.315418 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2218/4411] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:32 2022] PUT /identity/v3/projects/37dfcd92b40d47f98b774ce6a8aff2a6/users/17fbb660ff0c4b81af9397a3abc665c3/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:32.322490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:32.322904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:32.323290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:32.379268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:32.397126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:32.664667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:32.730148 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:32.744745 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2194/4412] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:32.766899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:32.769396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:32.855164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca10b-ad99-453b-a62d-623b6ade16d6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:32.861264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:32.862324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:32.862672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:32.862963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:32.926293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90d381-366c-4487-b6ef-872af2cc5abc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:32.933024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eaa99-d246-4b9b-9432-04ef33a0b637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:32.933657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eaa99-d246-4b9b-9432-04ef33a0b637 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:32.933978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eaa99-d246-4b9b-9432-04ef33a0b637 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:32.934234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eaa99-d246-4b9b-9432-04ef33a0b637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:32.954415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eaa99-d246-4b9b-9432-04ef33a0b637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:32.955875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eaa99-d246-4b9b-9432-04ef33a0b637 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:32.982030 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2195/4413] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:27:32.990676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7cc4-8fcc-4ad2-8491-f7874a5e4559 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:32.991349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7cc4-8fcc-4ad2-8491-f7874a5e4559 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:32.991860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec7cc4-8fcc-4ad2-8491-f7874a5e4559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:33.052493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-72ec7cc4-8fcc-4ad2-8491-f7874a5e4559 None None] MFA Rules not processed for user `25c450da892f47a6a31149f0796fb363`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:33.053903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-72ec7cc4-8fcc-4ad2-8491-f7874a5e4559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:33.056874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:33.059447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:33.095504 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2219/4414] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:33.129740 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:33.221222 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2196/4415] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:33.223181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:33.232863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:33.279574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebbb1-9bf0-4d1e-8219-bb446154f284 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:33.294093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:33.301756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:33.301756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:33.301756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:33.301756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:33.301756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:33.512751 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2220/4416] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:33 2022] POST /identity/v3/projects => generated 379 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:27:33.514414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec7cc4-8fcc-4ad2-8491-f7874a5e4559 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:33.530258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec7cc4-8fcc-4ad2-8491-f7874a5e4559 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:33.723897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:33.729976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:33.730538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:33.731073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:33.733857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:33.770927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:34.000385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:34.010563 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2197/4417] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:33 2022] POST /identity/v3/users => generated 296 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:34.021687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f86f2-ea2e-4409-a330-f3e566270d6c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:34.032031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:34.032669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:34.032949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:34.034259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:34.037403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:34.044318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:34.060615 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2221/4418] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:34.061753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:34.101387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da2485-c9a3-4fc5-8090-165efb5ec300 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:34.111013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:34.114455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:34.115182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:34.117011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] PATH_INFO: `/v3/projects/5f1339cd1c4649c2840ab9a2f565beb6/users/17eadd6b4bd649119d76573f2279eae0/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:34.163202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1339cd1c4649c2840ab9a2f565beb6, user_id=17eadd6b4bd649119d76573f2279eae0, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:34.167159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:34.268150 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2198/4419] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:34 2022] PUT /identity/v3/projects/5f1339cd1c4649c2840ab9a2f565beb6/users/17eadd6b4bd649119d76573f2279eae0/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:34.268789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:34.285753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accfbba-5532-4042-8324-bcd430f1cc2d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:34.304734 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:34.483649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:34.484463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:34.484754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:34.485033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:34.491800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:34.493504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:34.538741 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2222/4420] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:27:34.543513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:34.592544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc32f-928d-4add-9252-8536b3750e9c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:34.622101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:34.628855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:34.631280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:34.633856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] PATH_INFO: `/v3/projects/5f1339cd1c4649c2840ab9a2f565beb6/users/17eadd6b4bd649119d76573f2279eae0/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:34.642498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1339cd1c4649c2840ab9a2f565beb6, user_id=17eadd6b4bd649119d76573f2279eae0, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:34.658081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:34.732380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:34.734733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:34.763433 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2199/4421] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:34 2022] PUT /identity/v3/projects/5f1339cd1c4649c2840ab9a2f565beb6/users/17eadd6b4bd649119d76573f2279eae0/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:34.932620 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:34.957480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9c55-48c8-45ef-a008-f0bf71786305 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:35.151108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519e125-20f5-4a0e-825e-643057b97c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:35.158578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519e125-20f5-4a0e-825e-643057b97c26 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:35.158578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519e125-20f5-4a0e-825e-643057b97c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:35.158578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519e125-20f5-4a0e-825e-643057b97c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:35.158578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f519e125-20f5-4a0e-825e-643057b97c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:35.429184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519e125-20f5-4a0e-825e-643057b97c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:35.432044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519e125-20f5-4a0e-825e-643057b97c26 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:35.445892 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2223/4422] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:38.778159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:38.813567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270a159-2813-42c4-8deb-834d01e651ad None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:38.814198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270a159-2813-42c4-8deb-834d01e651ad None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:38.814198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270a159-2813-42c4-8deb-834d01e651ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:38.854008 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:38.880883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6270a159-2813-42c4-8deb-834d01e651ad None None] MFA Rules not processed for user `a239a0dd4451431aa7e3beea2d4b37aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:38.885902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6270a159-2813-42c4-8deb-834d01e651ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:38.900429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85d44-8872-456d-828e-a455262d605c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:38.912509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:38.913454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:38.913967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:38.914419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] PATH_INFO: `/v3/users/f731904c67cc4490bcef1a6167357c56` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:38.916815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f731904c67cc4490bcef1a6167357c56)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:38.919855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:39.095463 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2224/4423] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:39.215526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f731904c67cc4490bcef1a6167357c56'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:39.235541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f731904c67cc4490bcef1a6167357c56'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:39.248604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f731904c67cc4490bcef1a6167357c56'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:39.264770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f731904c67cc4490bcef1a6167357c56'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:39.370860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f731904c67cc4490bcef1a6167357c56'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:39.381428 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2200/4424] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:38 2022] DELETE /identity/v3/users/f731904c67cc4490bcef1a6167357c56 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:39.383509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a820819-c78a-42b8-af65-4bbe4cd87018 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:39.383995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a820819-c78a-42b8-af65-4bbe4cd87018 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:39.384526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a820819-c78a-42b8-af65-4bbe4cd87018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:39.467533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0a820819-c78a-42b8-af65-4bbe4cd87018 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:39.471090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0a820819-c78a-42b8-af65-4bbe4cd87018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:39.572524 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:39.621508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2225/4425] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:39.698060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:39.698627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:39.858691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d08d6-1d32-4f0e-8d5e-1654d0f77f95 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:39.864005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:39.865010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:39.865537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:39.866111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:39.880478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:39.887374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:39.900775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2201/4426] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:40.337437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a820819-c78a-42b8-af65-4bbe4cd87018 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:40.351438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a820819-c78a-42b8-af65-4bbe4cd87018 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:40.360558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:40.361740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:40.365565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:40.365565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:40.367870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:40.532044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:40.533660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:40.561687 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2226/4427] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:40.864892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:40.867213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:40.978197 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:40.998280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd807c-6a3d-46a6-b013-9297661a21d3 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:41.016750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:41.021992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:41.021992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:41.021992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:41.021992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:41.060553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:41.062670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:41.083701 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2202/4428] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:41.921410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:41.929064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:41.961523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d1ced-590e-49b5-a91a-61cacf7fee43 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:41.974465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:41.975507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:41.976420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:41.976983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] PATH_INFO: `/v3/projects/583392f7ea45480dae152ff87dd2b64c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:41.980351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583392f7ea45480dae152ff87dd2b64c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:41.984801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:42.150536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583392f7ea45480dae152ff87dd2b64c', 'request_id': 'req-91d72f96-76f8-4ed7-a752-ba61d170cd97'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.164686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583392f7ea45480dae152ff87dd2b64c', 'request_id': 'req-91d72f96-76f8-4ed7-a752-ba61d170cd97'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.259297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583392f7ea45480dae152ff87dd2b64c', 'request_id': 'req-91d72f96-76f8-4ed7-a752-ba61d170cd97'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.294823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] The token cache is being invalidate because project 583392f7ea45480dae152ff87dd2b64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:42.296193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.298606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.305802 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2227/4429] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:41 2022] DELETE /identity/v3/projects/583392f7ea45480dae152ff87dd2b64c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:42.311014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:42.332097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605cce4-0948-4870-9cf2-62c2179bb817 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:42.592541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:42.592541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:42.596828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:42.597923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] PATH_INFO: `/v3/users/56d4f644de434fc98cf105cd7811af90` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:42.599729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d4f644de434fc98cf105cd7811af90)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:42.607551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:42.950744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d4f644de434fc98cf105cd7811af90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.972731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d4f644de434fc98cf105cd7811af90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.986166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d4f644de434fc98cf105cd7811af90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:42.986934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d4f644de434fc98cf105cd7811af90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:43.188057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d4f644de434fc98cf105cd7811af90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:43.200229 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2203/4430] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:42 2022] DELETE /identity/v3/users/56d4f644de434fc98cf105cd7811af90 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:43.973073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:43.974956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:43.999871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d72f96-76f8-4ed7-a752-ba61d170cd97 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:44.143982 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:44.172897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:44.173551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:44.173854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:44.174137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] PATH_INFO: `/v3/projects/17bbd87f9e0b45b49a32f0f6df3b28ad` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:44.176863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=17bbd87f9e0b45b49a32f0f6df3b28ad)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:44.178874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:44.432060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17bbd87f9e0b45b49a32f0f6df3b28ad', 'request_id': 'req-dd3cd709-5724-411a-afbc-c8d84722d7df'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:44.444971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17bbd87f9e0b45b49a32f0f6df3b28ad', 'request_id': 'req-dd3cd709-5724-411a-afbc-c8d84722d7df'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:44.576884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17bbd87f9e0b45b49a32f0f6df3b28ad', 'request_id': 'req-dd3cd709-5724-411a-afbc-c8d84722d7df'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:44.594137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:44.598240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:44.610620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] The token cache is being invalidate because project 17bbd87f9e0b45b49a32f0f6df3b28ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:44.615756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:44.622692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dd3cd709-5724-411a-afbc-c8d84722d7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:44.625683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2228/4431] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:43 2022] DELETE /identity/v3/projects/17bbd87f9e0b45b49a32f0f6df3b28ad => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:44.633349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b855cf-045b-4816-8868-b4437331fcf4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:44.634564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b855cf-045b-4816-8868-b4437331fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:44.635210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b855cf-045b-4816-8868-b4437331fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:44.678677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-34b855cf-045b-4816-8868-b4437331fcf4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:44.681477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-34b855cf-045b-4816-8868-b4437331fcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:44.866653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dea88-d5b7-4baa-80bc-cdc38a2be067 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:44.905086 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:45.012989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:45.014061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.014316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.014570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.020497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:45.041272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:45.054655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:45.054838 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2229/4432] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:45.067876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f56ba-d8eb-477c-8e33-323d7d471a6c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.068162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f56ba-d8eb-477c-8e33-323d7d471a6c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.071770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f56ba-d8eb-477c-8e33-323d7d471a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.079651 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2204/4433] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:45.114042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fc3f56ba-d8eb-477c-8e33-323d7d471a6c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:45.119947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fc3f56ba-d8eb-477c-8e33-323d7d471a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:45.141656 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2230/4434] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:45.143251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:45.167163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856bfda-e70c-43c4-83a9-eeac46865c8a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:45.183944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:45.184616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.186035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.186311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.187322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:27:45.187628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:45.189674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:45.204612 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2205/4435] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:27:45.209213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f56ba-d8eb-477c-8e33-323d7d471a6c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:45.220022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f56ba-d8eb-477c-8e33-323d7d471a6c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:45.228936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:45.229875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.230323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.230761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.231605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:45.233715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:45.449116 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2231/4436] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:45 2022] POST /identity/v3/projects => generated 409 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:45.450681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:45.471296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d9b7c-43b9-475e-9d9f-22a47ec00d4f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:45.579686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:45.580923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.581450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.582020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.582994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:45.585643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:45.682854 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2206/4437] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:45 2022] POST /identity/v3/users => generated 305 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:45.686931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:45.707276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3293a-c0ba-482e-9bab-9900f90bc51a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:45.719656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:45.720585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.721061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.721511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.722429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:45.724225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:45.755679 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2232/4438] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:45.760131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:45.786096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5762a-7cf3-48ff-b507-af767cdf8584 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:45.818478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db09d7-2868-44b6-b901-dd878ed1f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:45.820959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db09d7-2868-44b6-b901-dd878ed1f3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.821719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db09d7-2868-44b6-b901-dd878ed1f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.822665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db09d7-2868-44b6-b901-dd878ed1f3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.823675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db09d7-2868-44b6-b901-dd878ed1f3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:45.836022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db09d7-2868-44b6-b901-dd878ed1f3c9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:45.860527 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2207/4439] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:45.865008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:45.876809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e23d-7c8e-429f-841d-236eece8852e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:45.894469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:45.895252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:45.896167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:45.896529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] PATH_INFO: `/v3/projects/de5d97b7489e4a8585a3c30d07f65edd/users/f1914d9cc6a9445da383ce5638f57723/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:45.924242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5d97b7489e4a8585a3c30d07f65edd, user_id=f1914d9cc6a9445da383ce5638f57723, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:45.927032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:46.039245 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2233/4440] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:45 2022] PUT /identity/v3/projects/de5d97b7489e4a8585a3c30d07f65edd/users/f1914d9cc6a9445da383ce5638f57723/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:46.055285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e938-08f8-44a9-a978-a67ec0a8fd02 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:46.055803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e938-08f8-44a9-a978-a67ec0a8fd02 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:46.056277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e938-08f8-44a9-a978-a67ec0a8fd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:46.112432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f044e938-08f8-44a9-a978-a67ec0a8fd02 None None] MFA Rules not processed for user `f1914d9cc6a9445da383ce5638f57723`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:46.116909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f044e938-08f8-44a9-a978-a67ec0a8fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:46.213771 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2208/4441] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:46.215016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:46.260164 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:46.320832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54004dd0-663c-44be-bb8e-5a3534fcfa53 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:46.327845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:46.330522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:46.331723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:46.332101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:46.341596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:46.341596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:46.465883 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2234/4442] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:27:46 2022] POST /identity/v3/projects => generated 409 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:46.483887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044e938-08f8-44a9-a978-a67ec0a8fd02 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:46.498988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044e938-08f8-44a9-a978-a67ec0a8fd02 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:46.517673 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:46.602848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:46.603795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:46.604273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:46.607220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:46.608578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:46.611653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:46.754382 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2209/4443] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:27:46 2022] POST /identity/v3/users => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:27:46.755576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:46.772116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93987-67d4-4f24-ae1c-bca40d2b3a78 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:46.784611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:46.785779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:46.786603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:46.787154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:46.788587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:46.792199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:46.869071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2235/4444] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:27:46.872207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:46.893029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3d408-18e6-4832-bf60-ba2a22707846 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:46.924091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:46.925639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:46.927738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:46.928716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] PATH_INFO: `/v3/projects/b557792266754dd999ea804dd95c5323/users/f16c5a0a589c4e249aa35366ada25cd9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:46.962405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b557792266754dd999ea804dd95c5323, user_id=f16c5a0a589c4e249aa35366ada25cd9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:46.966935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:47.165971 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2210/4445] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:46 2022] PUT /identity/v3/projects/b557792266754dd999ea804dd95c5323/users/f16c5a0a589c4e249aa35366ada25cd9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:47.171372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:47.188011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd40668-a6d1-45b6-873d-a4fbb9c0cc08 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:47.333022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb7a5-61e6-420b-8538-a8fddb665121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:47.334552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb7a5-61e6-420b-8538-a8fddb665121 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:47.334827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb7a5-61e6-420b-8538-a8fddb665121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:47.335095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb7a5-61e6-420b-8538-a8fddb665121 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:47.335740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb7a5-61e6-420b-8538-a8fddb665121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:47.339421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb7a5-61e6-420b-8538-a8fddb665121 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:47.358549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:47.362458 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2236/4446] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:27:47.373859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c52de-3534-4a64-bacf-b60e1b72b4a7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:47.380954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:47.385388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:47.385388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:47.385388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] PATH_INFO: `/v3/projects/b557792266754dd999ea804dd95c5323/users/f16c5a0a589c4e249aa35366ada25cd9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:47.385724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b557792266754dd999ea804dd95c5323, user_id=f16c5a0a589c4e249aa35366ada25cd9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:47.388997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:47.409197 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2211/4447] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:27:47 2022] PUT /identity/v3/projects/b557792266754dd999ea804dd95c5323/users/f16c5a0a589c4e249aa35366ada25cd9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:47.417471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:47.417766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:47.418084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:47.461482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] MFA Rules not processed for user `f16c5a0a589c4e249aa35366ada25cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:47.464282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:47.653881 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2237/4448] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:47.703178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:47.705482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:47.803960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb69af-e8af-4ec7-89ae-081f78f6d28f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:47.808745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:47.809798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:47.810926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:47.811603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:47.834839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:47.836737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:47.855100 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2212/4449] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:47 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:53.973527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:53.979963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:54.046316 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:54.249484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dffee-6743-4848-b577-ebf7bb6ecb40 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:54.267268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95ff88-4635-48c9-bda6-7864f16b817f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:54.275379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ff88-4635-48c9-bda6-7864f16b817f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:54.275379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ff88-4635-48c9-bda6-7864f16b817f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:54.275379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ff88-4635-48c9-bda6-7864f16b817f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:54.275379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fe95ff88-4635-48c9-bda6-7864f16b817f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:54.307476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95ff88-4635-48c9-bda6-7864f16b817f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:54.313012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95ff88-4635-48c9-bda6-7864f16b817f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:54.348833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2238/4450] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:54.402959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:54.581538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae477fd-1747-4f3a-80f3-fb076f994285 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:54.595134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:54.599167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:54.600265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:54.601400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] PATH_INFO: `/v3/users/f1914d9cc6a9445da383ce5638f57723` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:54.606099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1914d9cc6a9445da383ce5638f57723)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:54.612045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:54.669483 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:54.947423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1914d9cc6a9445da383ce5638f57723'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:54.996403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1914d9cc6a9445da383ce5638f57723'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:55.009893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1914d9cc6a9445da383ce5638f57723'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:55.010462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1914d9cc6a9445da383ce5638f57723'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:55.137789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1914d9cc6a9445da383ce5638f57723'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:55.159812 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2213/4451] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:54 2022] DELETE /identity/v3/users/f1914d9cc6a9445da383ce5638f57723 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:55.164402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:55.165672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:55.165672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:55.207029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:55.218060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:55.400749 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2239/4452] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:55.415988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:55.423071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:55.577602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843481eb-fd31-42d1-8eb0-5372027421e9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:55.583083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:55.584795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:55.585325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:55.585785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:55.599465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:55.601399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:55.617509 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2214/4453] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:57.449705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:57.452412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:57.477799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f4df0-3e04-46cc-b390-c4a86c0e023f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:57.485303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:57.495791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:57.496537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:57.496982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] PATH_INFO: `/v3/projects/de5d97b7489e4a8585a3c30d07f65edd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:57.498999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5d97b7489e4a8585a3c30d07f65edd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:57.501618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:57.687089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5d97b7489e4a8585a3c30d07f65edd', 'request_id': 'req-c93778ed-351e-4ea5-be4f-f6a968224a18'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:57.696794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5d97b7489e4a8585a3c30d07f65edd', 'request_id': 'req-c93778ed-351e-4ea5-be4f-f6a968224a18'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:57.770493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5d97b7489e4a8585a3c30d07f65edd', 'request_id': 'req-c93778ed-351e-4ea5-be4f-f6a968224a18'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:57.791113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] The token cache is being invalidate because project de5d97b7489e4a8585a3c30d07f65edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:27:57.791737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:57.793174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c93778ed-351e-4ea5-be4f-f6a968224a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:57.800431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:57.802257 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2240/4454] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:57 2022] DELETE /identity/v3/projects/de5d97b7489e4a8585a3c30d07f65edd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:57.816290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00895f1-bff5-4c35-a5c9-61b703efc6ec service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:57.909698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:57.910813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:57.911721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:57.913487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] PATH_INFO: `/v3/users/f16c5a0a589c4e249aa35366ada25cd9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:57.915533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16c5a0a589c4e249aa35366ada25cd9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:57.918897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:58.138845 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:58.183167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16c5a0a589c4e249aa35366ada25cd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:58.249360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16c5a0a589c4e249aa35366ada25cd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:58.263471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16c5a0a589c4e249aa35366ada25cd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:58.278050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16c5a0a589c4e249aa35366ada25cd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:58.335973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16c5a0a589c4e249aa35366ada25cd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:58.346812 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2215/4455] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:27:57 2022] DELETE /identity/v3/users/f16c5a0a589c4e249aa35366ada25cd9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:27:58.470013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:58.471086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:58.472102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:58.517092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] MFA Rules not processed for user `17fbb660ff0c4b81af9397a3abc665c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:58.518590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:58.540914 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:58.684575 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2241/4456] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:59.181091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:59.184615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:59.361328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dd43c-99cd-41b6-a94c-4ed77cbf854c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:59.368455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f72d03-7684-4b58-8e64-7cfe2e2ce4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:59.370094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72d03-7684-4b58-8e64-7cfe2e2ce4cc service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:59.370666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72d03-7684-4b58-8e64-7cfe2e2ce4cc service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:59.371409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72d03-7684-4b58-8e64-7cfe2e2ce4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:59.381658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f72d03-7684-4b58-8e64-7cfe2e2ce4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:59.399370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f72d03-7684-4b58-8e64-7cfe2e2ce4cc service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:59.423913 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2216/4457] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:59.466222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:59.468042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:59.572266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:59.572578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:59.573125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:59.617045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492799-3956-49b5-95ef-9a0acf25531a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:59.631803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:59.632457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:59.632736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:59.633767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] PATH_INFO: `/v3/projects/b557792266754dd999ea804dd95c5323` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:59.638613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b557792266754dd999ea804dd95c5323)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:59.640571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:59.644853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] MFA Rules not processed for user `17eadd6b4bd649119d76573f2279eae0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:59.646240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:59.812176 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2217/4458] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:27:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:59.824511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:59.826329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:59.887590 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:59.915962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b557792266754dd999ea804dd95c5323', 'request_id': 'req-c9b4bd60-aa78-4b41-8a81-384bc965c94c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:59.932968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b557792266754dd999ea804dd95c5323', 'request_id': 'req-c9b4bd60-aa78-4b41-8a81-384bc965c94c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:27:59.976545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d940a8b-a2c3-4f70-814f-b63e68e4f88a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:00.061252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b557792266754dd999ea804dd95c5323', 'request_id': 'req-c9b4bd60-aa78-4b41-8a81-384bc965c94c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:00.079609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] The token cache is being invalidate because project b557792266754dd999ea804dd95c5323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:00.080085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:00.080761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9b4bd60-aa78-4b41-8a81-384bc965c94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:00.082367 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2242/4459] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:27:59 2022] DELETE /identity/v3/projects/b557792266754dd999ea804dd95c5323 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:00.095259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b8667-f731-4dc0-896b-35e5fc6b9499 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:00.095556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b8667-f731-4dc0-896b-35e5fc6b9499 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:00.095841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b8667-f731-4dc0-896b-35e5fc6b9499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:00.106743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:00.107619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:00.108000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:00.108376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:00.113749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:00.147602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-613b8667-f731-4dc0-896b-35e5fc6b9499 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:00.149657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-613b8667-f731-4dc0-896b-35e5fc6b9499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:00.260016 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:00.295789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:00.301162 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2243/4460] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:00.309261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a728-abbf-4944-8940-75fb53fa53ff None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:00.309548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a728-abbf-4944-8940-75fb53fa53ff None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:00.309836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a728-abbf-4944-8940-75fb53fa53ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:00.311129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:00.347154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2218/4461] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:28:00.348845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2c31a728-abbf-4944-8940-75fb53fa53ff None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:00.350113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c31a728-abbf-4944-8940-75fb53fa53ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:00.379878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2244/4462] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:00.385478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:00.431196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3352a-bb2b-41b2-917f-99457b8bd7e5 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:00.463730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:00.464500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:00.465063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:00.466951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:00.468908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:00.469529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:00.478318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:00.525196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a728-abbf-4944-8940-75fb53fa53ff None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:00.528429 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2219/4463] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:28:00.547280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a728-abbf-4944-8940-75fb53fa53ff None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:00.560769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:00.561705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:00.565777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:00.566383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:00.567445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:00.569587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:00.727344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2245/4464] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:00 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:28:00.732408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:00.751663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4a00e-80f2-4803-a68f-bf5c9d8bf773 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:00.911057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:00.911822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:00.912101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:00.912382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:00.913002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:00.918634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:01.049792 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2220/4465] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:00 2022] POST /identity/v3/users => generated 284 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:01.055634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:01.069525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f02c-bf31-49f0-b366-f41076a97239 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:01.085557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:01.087376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:01.087931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:01.089539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:01.091792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:01.096380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:01.120537 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2246/4466] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:01.125397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:01.141177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752d719-66ea-471f-938c-a6a51aceb65e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:01.154200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae78370-1c9f-44d1-b047-f9b2fa173edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:01.155124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae78370-1c9f-44d1-b047-f9b2fa173edd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:01.155769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae78370-1c9f-44d1-b047-f9b2fa173edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:01.156241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae78370-1c9f-44d1-b047-f9b2fa173edd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:01.157067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae78370-1c9f-44d1-b047-f9b2fa173edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:01.162415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae78370-1c9f-44d1-b047-f9b2fa173edd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:01.172361 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:01.186339 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2221/4467] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:01.189725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:01.205466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025612-b90a-47ff-b330-6532d4d177f6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:01.213656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:01.214765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:01.216758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:01.217259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] PATH_INFO: `/v3/projects/4ef0e5dc8a0240108cdd28e08b95db3d/users/2cc4d10561654b5a8684dd2e2de7d231/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:01.255762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef0e5dc8a0240108cdd28e08b95db3d, user_id=2cc4d10561654b5a8684dd2e2de7d231, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:01.259054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:01.372531 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2247/4468] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:01 2022] PUT /identity/v3/projects/4ef0e5dc8a0240108cdd28e08b95db3d/users/2cc4d10561654b5a8684dd2e2de7d231/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:28:01.384986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128969-a7d1-4783-9117-eb132cd1e2b7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:01.388685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128969-a7d1-4783-9117-eb132cd1e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:01.390004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128969-a7d1-4783-9117-eb132cd1e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:01.485278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ed128969-a7d1-4783-9117-eb132cd1e2b7 None None] MFA Rules not processed for user `2cc4d10561654b5a8684dd2e2de7d231`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:01.486552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ed128969-a7d1-4783-9117-eb132cd1e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:01.679041 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2222/4469] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:01.680651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:01.921842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7f7d-d216-4aa4-9c55-52508cdc1d96 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:01.947857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:01.948495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:01.948785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:01.949072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:01.949713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:01.961080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:02.144900 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2248/4470] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:01 2022] POST /identity/v3/projects => generated 367 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:02.146127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128969-a7d1-4783-9117-eb132cd1e2b7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:02.167800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128969-a7d1-4783-9117-eb132cd1e2b7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:02.305508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:02.306460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:02.306747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:02.307026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:02.307741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:02.313072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:02.418245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2223/4471] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:02 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:02.422301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:02.452529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08f64a-3108-41f5-972e-4e7f0c803cde admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:02.469556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:02.470933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:02.471072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:02.471358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:02.472018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:02.473660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:02.509265 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2249/4472] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:02.513322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:02.531426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b125e33-9d57-487b-917d-12e9dc1d7596 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:02.551561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:02.552905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:02.555673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:02.555673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] PATH_INFO: `/v3/projects/36232471e01742eab6cd5fc0d870e0c0/users/389bc08be2ed4e7c803edd6db7108aef/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:02.598571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] RBAC: Authorizing `identity:create_grant(project_id=36232471e01742eab6cd5fc0d870e0c0, user_id=389bc08be2ed4e7c803edd6db7108aef, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:02.624607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:02.725269 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2224/4473] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:02 2022] PUT /identity/v3/projects/36232471e01742eab6cd5fc0d870e0c0/users/389bc08be2ed4e7c803edd6db7108aef/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:28:02.731704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:02.751518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d785-49fb-47c7-a6e4-ce573b1e2e5a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:02.841988 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:02.862554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38125bb-7d5f-4c59-ba36-e3c1d5c05417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:02.863464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38125bb-7d5f-4c59-ba36-e3c1d5c05417 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:02.863939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38125bb-7d5f-4c59-ba36-e3c1d5c05417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:02.864382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38125bb-7d5f-4c59-ba36-e3c1d5c05417 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:02.865274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38125bb-7d5f-4c59-ba36-e3c1d5c05417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:02.871504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38125bb-7d5f-4c59-ba36-e3c1d5c05417 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:02.901326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2250/4474] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:02.905416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:02.924299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719f84-0fca-47d4-bb2a-f1af08b0afed admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:02.932573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:02.933643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:02.934184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:02.934653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] PATH_INFO: `/v3/projects/36232471e01742eab6cd5fc0d870e0c0/users/389bc08be2ed4e7c803edd6db7108aef/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:02.940412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36232471e01742eab6cd5fc0d870e0c0, user_id=389bc08be2ed4e7c803edd6db7108aef, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:02.943703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:02.984335 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2225/4475] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:02 2022] PUT /identity/v3/projects/36232471e01742eab6cd5fc0d870e0c0/users/389bc08be2ed4e7c803edd6db7108aef/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:02.995179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:02.996038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:02.996495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:03.091251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] MFA Rules not processed for user `389bc08be2ed4e7c803edd6db7108aef`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:03.094419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:03.338768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2251/4476] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:03.357433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:03.359238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:03.550864 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:03.616247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef66a3-26f9-4205-85ee-00cc22d1b081 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:03.620230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd66e7-7e0d-4d0d-ad4e-2bca2c200163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:03.620869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd66e7-7e0d-4d0d-ad4e-2bca2c200163 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:03.621150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd66e7-7e0d-4d0d-ad4e-2bca2c200163 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:03.621423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd66e7-7e0d-4d0d-ad4e-2bca2c200163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:03.645436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd66e7-7e0d-4d0d-ad4e-2bca2c200163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:03.646943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd66e7-7e0d-4d0d-ad4e-2bca2c200163 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:03.690572 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2226/4477] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:06.494708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:06.498645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:06.521646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78953bec-e85c-437b-a3a0-1db3a66c0a3d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:06.531624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f3f6-a320-4440-8ddc-44fb0c0bb86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:06.533341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f3f6-a320-4440-8ddc-44fb0c0bb86b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:06.533957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f3f6-a320-4440-8ddc-44fb0c0bb86b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:06.535063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f3f6-a320-4440-8ddc-44fb0c0bb86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:06.540243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-42e1f3f6-a320-4440-8ddc-44fb0c0bb86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:06.562692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1f3f6-a320-4440-8ddc-44fb0c0bb86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:06.564549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1f3f6-a320-4440-8ddc-44fb0c0bb86b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:06.585031 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2252/4478] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:09.757132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b043-a9d6-48de-9c7e-e3d044e88d15 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:09.758232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b043-a9d6-48de-9c7e-e3d044e88d15 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:09.758734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b043-a9d6-48de-9c7e-e3d044e88d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:09.791716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f5c8b043-a9d6-48de-9c7e-e3d044e88d15 None None] MFA Rules not processed for user `17fbb660ff0c4b81af9397a3abc665c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:09.799506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f5c8b043-a9d6-48de-9c7e-e3d044e88d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:09.911650 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2227/4479] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:11.137426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d42d1-9636-48fe-8c7d-c18102f30a77 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:11.138568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d42d1-9636-48fe-8c7d-c18102f30a77 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:11.139094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d42d1-9636-48fe-8c7d-c18102f30a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:11.173501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6e2d42d1-9636-48fe-8c7d-c18102f30a77 None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:11.174918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6e2d42d1-9636-48fe-8c7d-c18102f30a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:11.364546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2253/4480] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:12.374955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b043-a9d6-48de-9c7e-e3d044e88d15 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:12.660690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b043-a9d6-48de-9c7e-e3d044e88d15 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:12.675296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:12.677058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:12.681380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:12.683025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] PATH_INFO: `/v3/users/2cc4d10561654b5a8684dd2e2de7d231` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:12.691888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc4d10561654b5a8684dd2e2de7d231)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:12.714992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:13.027522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc4d10561654b5a8684dd2e2de7d231'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:13.104623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc4d10561654b5a8684dd2e2de7d231'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:13.131394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc4d10561654b5a8684dd2e2de7d231'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:13.133658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc4d10561654b5a8684dd2e2de7d231'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:13.215164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc4d10561654b5a8684dd2e2de7d231'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:13.226894 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2228/4481] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:12 2022] DELETE /identity/v3/users/2cc4d10561654b5a8684dd2e2de7d231 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:13.228766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:13.229300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:13.229300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:13.288057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:13.292488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:13.531756 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2254/4482] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:13.862860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:13.862860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:13.886932 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:13.991301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cbed-0a3d-4a2e-9c2a-0d8243bd77b5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:13.996549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:13.998972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:14.019981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:14.019981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:14.049074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:14.050614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:14.089534 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2229/4483] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:15.244688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:15.251907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:15.262757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aa2ec-4e1b-489a-be6d-bdc5b2b3f69f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:15.281164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:15.285662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:15.286201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:15.286702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] PATH_INFO: `/v3/projects/4ef0e5dc8a0240108cdd28e08b95db3d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:15.291782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef0e5dc8a0240108cdd28e08b95db3d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:15.296286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:15.319091 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:15.543506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef0e5dc8a0240108cdd28e08b95db3d', 'request_id': 'req-5bc1f7e3-b34b-4719-9428-040609fc500d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:15.559903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef0e5dc8a0240108cdd28e08b95db3d', 'request_id': 'req-5bc1f7e3-b34b-4719-9428-040609fc500d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:15.630246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef0e5dc8a0240108cdd28e08b95db3d', 'request_id': 'req-5bc1f7e3-b34b-4719-9428-040609fc500d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:15.646218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] The token cache is being invalidate because project 4ef0e5dc8a0240108cdd28e08b95db3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:15.650920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:15.650920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:15.654552 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2255/4484] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:15 2022] DELETE /identity/v3/projects/4ef0e5dc8a0240108cdd28e08b95db3d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:15.655887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:15.688226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b140597-c355-466f-91d0-5f00b748a086 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:15.833022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:15.834042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:15.834547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:15.836238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] PATH_INFO: `/v3/users/389bc08be2ed4e7c803edd6db7108aef` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:15.838112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=389bc08be2ed4e7c803edd6db7108aef)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:15.840661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:16.137745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389bc08be2ed4e7c803edd6db7108aef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:16.176003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389bc08be2ed4e7c803edd6db7108aef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:16.204882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389bc08be2ed4e7c803edd6db7108aef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:16.206862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389bc08be2ed4e7c803edd6db7108aef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:16.300844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b26f7855-81d8-429e-b551-0c9201c2a4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389bc08be2ed4e7c803edd6db7108aef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:16.321557 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2230/4485] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:15 2022] DELETE /identity/v3/users/389bc08be2ed4e7c803edd6db7108aef => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:17.119437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:17.119437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:17.142572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1f7e3-b34b-4719-9428-040609fc500d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:17.293947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:17.314133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:17.315375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:17.315375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] PATH_INFO: `/v3/projects/36232471e01742eab6cd5fc0d870e0c0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:17.317889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=36232471e01742eab6cd5fc0d870e0c0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:17.320197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:17.530500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36232471e01742eab6cd5fc0d870e0c0', 'request_id': 'req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:17.545415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36232471e01742eab6cd5fc0d870e0c0', 'request_id': 'req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:17.616098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36232471e01742eab6cd5fc0d870e0c0', 'request_id': 'req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:17.637459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] The token cache is being invalidate because project 36232471e01742eab6cd5fc0d870e0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:17.638154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:17.646183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0b5c6f05-fa1e-480d-b4e7-a273320d68aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:17.654258 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2256/4486] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:17 2022] DELETE /identity/v3/projects/36232471e01742eab6cd5fc0d870e0c0 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:17.659421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006eaa-1271-490d-bcce-b24fb7f52052 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:17.659971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006eaa-1271-490d-bcce-b24fb7f52052 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:17.659971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006eaa-1271-490d-bcce-b24fb7f52052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:17.703430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3d006eaa-1271-490d-bcce-b24fb7f52052 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:17.711121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d006eaa-1271-490d-bcce-b24fb7f52052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:17.793950 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:17.871021 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2231/4487] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:17.879947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac459d-9b82-4da5-b931-8497766485ba None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:17.880307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac459d-9b82-4da5-b931-8497766485ba None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:17.880635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac459d-9b82-4da5-b931-8497766485ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:17.927259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-95ac459d-9b82-4da5-b931-8497766485ba None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:17.929348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-95ac459d-9b82-4da5-b931-8497766485ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:17.977600 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2257/4488] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:17.978983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006eaa-1271-490d-bcce-b24fb7f52052 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:17.997420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006eaa-1271-490d-bcce-b24fb7f52052 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:18.005866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:18.006496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:18.006781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:18.007057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:18.008276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:18.008572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:18.011858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:18.032398 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2232/4489] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:28:18.037455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac459d-9b82-4da5-b931-8497766485ba None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:18.093672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac459d-9b82-4da5-b931-8497766485ba None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:18.111484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:18.112985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:18.113467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:18.114067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:18.114920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:18.131777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:18.205476 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:18.282645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:18.291693 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2258/4490] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:18 2022] POST /identity/v3/projects => generated 391 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:18.308390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff817906-b528-4b41-8fa5-ee73bc945b7e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:18.447533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:18.448544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:18.449003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:18.449445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:18.450314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:18.452414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:18.603955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2233/4491] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:18 2022] POST /identity/v3/users => generated 296 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:18.608153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:18.620145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6c32-3581-4524-b105-9edac20dd960 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:18.628026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:18.629919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:18.629919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:18.629919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:18.629919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:18.631754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:18.657895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2259/4492] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:28:18.661765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:18.675165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a8b4-6e26-4fdb-88c8-e9706e74d86e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:18.687516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a5a2-8938-4fa8-85bf-d591b784720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:18.688448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a5a2-8938-4fa8-85bf-d591b784720f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:18.691107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a5a2-8938-4fa8-85bf-d591b784720f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:18.691509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a5a2-8938-4fa8-85bf-d591b784720f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:18.692321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a5a2-8938-4fa8-85bf-d591b784720f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:18.696783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a5a2-8938-4fa8-85bf-d591b784720f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:18.726463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:18.727305 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2234/4493] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:18.745126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ec7e7-9cab-45de-98c6-d9f31464a079 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:18.753680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:18.754800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:18.755720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:18.756305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] PATH_INFO: `/v3/projects/d6b3340e21974cd582fcab2c5009be3f/users/bccc151a3d104bf7b392b7638f3fb916/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:18.814972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b3340e21974cd582fcab2c5009be3f, user_id=bccc151a3d104bf7b392b7638f3fb916, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:18.822849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:18.919283 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2260/4494] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:18 2022] PUT /identity/v3/projects/d6b3340e21974cd582fcab2c5009be3f/users/bccc151a3d104bf7b392b7638f3fb916/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:18.931523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de010-f54a-4d06-aa53-909ec2935f93 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:18.932195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de010-f54a-4d06-aa53-909ec2935f93 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:18.932195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de010-f54a-4d06-aa53-909ec2935f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:18.965229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f42de010-f54a-4d06-aa53-909ec2935f93 None None] MFA Rules not processed for user `bccc151a3d104bf7b392b7638f3fb916`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:18.966618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f42de010-f54a-4d06-aa53-909ec2935f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:19.057045 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2235/4495] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:19.061857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:19.249995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e44257-c5aa-4a7d-b2a5-9f05fd1160af admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:19.270148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:19.270798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:19.271081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:19.271353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:19.281623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:19.281623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:19.401387 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2261/4496] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:19 2022] POST /identity/v3/projects => generated 391 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:19.402419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de010-f54a-4d06-aa53-909ec2935f93 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:19.446581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de010-f54a-4d06-aa53-909ec2935f93 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:19.582763 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:19.582763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:19.582763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:19.582763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:19.584651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:19.584651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:19.584651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:19.974325 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2236/4497] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:19 2022] POST /identity/v3/users => generated 302 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:19.975674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:19.988849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4385b4-cd4e-4ca4-85ae-f531304a5440 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:20.005146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:20.005905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:20.006280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:20.006756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:20.008158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:20.010022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:20.044315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2262/4498] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:20.045596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:20.060108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299402a-5b77-4cc0-a349-a5e6864ca545 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:20.069126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:20.070591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:20.070885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:20.073696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] PATH_INFO: `/v3/projects/558daae95bf2495798d192b42d2d920c/users/49d80ffbd5fa4953820f0e15e1995a27/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:20.112374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558daae95bf2495798d192b42d2d920c, user_id=49d80ffbd5fa4953820f0e15e1995a27, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:20.120511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:20.207549 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2237/4499] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:20 2022] PUT /identity/v3/projects/558daae95bf2495798d192b42d2d920c/users/49d80ffbd5fa4953820f0e15e1995a27/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:28:20.211718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:20.223610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf20bd4-6d25-44fe-9d43-dbf281153194 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:20.358880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bf12e-dcf5-4ac6-a5ea-84cab42e83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:20.360435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bf12e-dcf5-4ac6-a5ea-84cab42e83e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:20.360911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bf12e-dcf5-4ac6-a5ea-84cab42e83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:20.361492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bf12e-dcf5-4ac6-a5ea-84cab42e83e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:20.362496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bf12e-dcf5-4ac6-a5ea-84cab42e83e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:20.364312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bf12e-dcf5-4ac6-a5ea-84cab42e83e6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:20.381798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2263/4500] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:20.386883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:20.479857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413073d-5f0e-4165-8f8d-70b0eb84e146 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:20.502735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:20.502735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:20.502735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:20.502735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] PATH_INFO: `/v3/projects/558daae95bf2495798d192b42d2d920c/users/49d80ffbd5fa4953820f0e15e1995a27/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:20.517318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558daae95bf2495798d192b42d2d920c, user_id=49d80ffbd5fa4953820f0e15e1995a27, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:20.530098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:20.572107 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2238/4501] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:20 2022] PUT /identity/v3/projects/558daae95bf2495798d192b42d2d920c/users/49d80ffbd5fa4953820f0e15e1995a27/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:20.582075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10734e69-2c33-4bff-afd2-6a3c7220f599 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:20.582367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10734e69-2c33-4bff-afd2-6a3c7220f599 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:20.582720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10734e69-2c33-4bff-afd2-6a3c7220f599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:20.705442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-10734e69-2c33-4bff-afd2-6a3c7220f599 None None] MFA Rules not processed for user `49d80ffbd5fa4953820f0e15e1995a27`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:20.706799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-10734e69-2c33-4bff-afd2-6a3c7220f599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:20.766076 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:20.941092 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2264/4502] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:20.985701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:20.990727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:21.154427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9d346-151d-4454-b929-51cf871e4556 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:21.164183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5022c-58da-4d6c-9a7c-d23739a37013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:21.165643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5022c-58da-4d6c-9a7c-d23739a37013 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:21.170135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5022c-58da-4d6c-9a7c-d23739a37013 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:21.170135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5022c-58da-4d6c-9a7c-d23739a37013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:21.197584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5022c-58da-4d6c-9a7c-d23739a37013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:21.208007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5022c-58da-4d6c-9a7c-d23739a37013 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:21.242584 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2239/4503] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:31.064936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10734e69-2c33-4bff-afd2-6a3c7220f599 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:31.203971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10734e69-2c33-4bff-afd2-6a3c7220f599 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:31.210647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:31.211880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:31.212445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:31.212983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] PATH_INFO: `/v3/users/bccc151a3d104bf7b392b7638f3fb916` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:31.214876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bccc151a3d104bf7b392b7638f3fb916)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:31.217886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:31.226340 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=58,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:31.492341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bccc151a3d104bf7b392b7638f3fb916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:31.496395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bccc151a3d104bf7b392b7638f3fb916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:31.561373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bccc151a3d104bf7b392b7638f3fb916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:31.592647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bccc151a3d104bf7b392b7638f3fb916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:31.593598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bccc151a3d104bf7b392b7638f3fb916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:31.723546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2265/4504] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:31 2022] DELETE /identity/v3/users/bccc151a3d104bf7b392b7638f3fb916 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:31.723674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:31.723674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:31.723674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:31.776996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:31.778344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:31.966438 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2240/4505] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:32.056429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:32.060461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:32.143226 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:32.204924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d91ef3-f3c0-47b1-a3d9-1800f08050c0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:32.214962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:32.216020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:32.217097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:32.217539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:32.234793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:32.237193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:32.256310 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2266/4506] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:33.285734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:33.290959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:33.321585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c463-3431-4c15-a178-6ceff95e62e8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:33.354202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:33.356687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:33.368714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:33.370260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:33.372545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:33.373647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] PATH_INFO: `/v3/projects/d6b3340e21974cd582fcab2c5009be3f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:33.391322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b3340e21974cd582fcab2c5009be3f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:33.393262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:33.628084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b3340e21974cd582fcab2c5009be3f', 'request_id': 'req-928708a5-e31c-4615-bf54-4cf1e7149d94'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:33.646173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b3340e21974cd582fcab2c5009be3f', 'request_id': 'req-928708a5-e31c-4615-bf54-4cf1e7149d94'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:33.649362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e777a9-d73a-48ca-b367-e2f23a2ead2d service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:33.769864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b3340e21974cd582fcab2c5009be3f', 'request_id': 'req-928708a5-e31c-4615-bf54-4cf1e7149d94'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:33.795876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] The token cache is being invalidate because project d6b3340e21974cd582fcab2c5009be3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:33.800181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:33.805624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:33.806192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:33.807115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:33.807585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:33.808225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:33.810481 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2241/4507] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:33 2022] DELETE /identity/v3/projects/d6b3340e21974cd582fcab2c5009be3f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:28:33.814842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:33.820213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:33.836064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:33.838164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:33.838529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:33.870508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2267/4508] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:28:34.132343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928708a5-e31c-4615-bf54-4cf1e7149d94 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:34.146825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:34.148211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:34.148609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:34.148967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] PATH_INFO: `/v3/users/49d80ffbd5fa4953820f0e15e1995a27` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:34.152591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d80ffbd5fa4953820f0e15e1995a27)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:34.154948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:34.341648 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:34.460583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d80ffbd5fa4953820f0e15e1995a27'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:34.497879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d80ffbd5fa4953820f0e15e1995a27'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:34.520482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d80ffbd5fa4953820f0e15e1995a27'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:34.522405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d80ffbd5fa4953820f0e15e1995a27'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:34.646572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b23eb651-a66a-4f73-a6cd-c478679f1ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d80ffbd5fa4953820f0e15e1995a27'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:34.655308 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2242/4509] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:33 2022] DELETE /identity/v3/users/49d80ffbd5fa4953820f0e15e1995a27 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:35.857912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:35.871600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3bd85-acc5-468e-9d3e-c1098ae626c3 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:36.038836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:36.038836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:36.038836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:36.038836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] PATH_INFO: `/v3/projects/558daae95bf2495798d192b42d2d920c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:36.039495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=558daae95bf2495798d192b42d2d920c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:36.041570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:36.048900 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:36.293670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558daae95bf2495798d192b42d2d920c', 'request_id': 'req-78e7d732-ed20-438f-bbf1-bcba652a65ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:36.307737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558daae95bf2495798d192b42d2d920c', 'request_id': 'req-78e7d732-ed20-438f-bbf1-bcba652a65ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:36.426363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558daae95bf2495798d192b42d2d920c', 'request_id': 'req-78e7d732-ed20-438f-bbf1-bcba652a65ad'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:36.447310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] The token cache is being invalidate because project 558daae95bf2495798d192b42d2d920c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:36.447606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:36.449033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78e7d732-ed20-438f-bbf1-bcba652a65ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:36.450685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2268/4510] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:35 2022] DELETE /identity/v3/projects/558daae95bf2495798d192b42d2d920c => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:36.455656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb20e2f-8a5d-4e8d-82b1-2a40f95d47e9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:36.460718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb20e2f-8a5d-4e8d-82b1-2a40f95d47e9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:36.460718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb20e2f-8a5d-4e8d-82b1-2a40f95d47e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:36.486356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1eb20e2f-8a5d-4e8d-82b1-2a40f95d47e9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:36.488844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1eb20e2f-8a5d-4e8d-82b1-2a40f95d47e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:36.578156 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2243/4511] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:36.582625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf29f95-a29f-43f6-a95f-99fcd9277db3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:36.583009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf29f95-a29f-43f6-a95f-99fcd9277db3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:36.583308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf29f95-a29f-43f6-a95f-99fcd9277db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:36.640767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4cf29f95-a29f-43f6-a95f-99fcd9277db3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:36.642060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4cf29f95-a29f-43f6-a95f-99fcd9277db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:36.658928 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2269/4512] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:36.663071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb20e2f-8a5d-4e8d-82b1-2a40f95d47e9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:36.676295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb20e2f-8a5d-4e8d-82b1-2a40f95d47e9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:36.692004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:36.692004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:36.692004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:36.692004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:36.693034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:36.693589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:36.696203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:36.729702 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2244/4513] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:28:36.733876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf29f95-a29f-43f6-a95f-99fcd9277db3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:36.755546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf29f95-a29f-43f6-a95f-99fcd9277db3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:36.771105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:36.772009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:36.772420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:36.772738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:36.773594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:36.775846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:36.902821 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2270/4514] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:36 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:36.903971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:36.932520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df51e6-2a5c-4162-b346-1276a7d0f350 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:37.069433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:37.070370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:37.070659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:37.070938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:37.071603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:37.073623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:37.187258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2245/4515] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:36 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:37.191204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:37.209601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6192b35-ee23-4e4a-94d3-4160b4c27928 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:37.225277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:37.226805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:37.227305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:37.227764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:37.228593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:37.230558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:37.247627 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2271/4516] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:37.249290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:37.264361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a410c40-f852-435e-a5fc-6e4e2c67d6f9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:37.275973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af0aa5-f3cf-44a9-a2b4-9163eea6eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:37.276597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af0aa5-f3cf-44a9-a2b4-9163eea6eab6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:37.276885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af0aa5-f3cf-44a9-a2b4-9163eea6eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:37.277161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af0aa5-f3cf-44a9-a2b4-9163eea6eab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:37.277858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af0aa5-f3cf-44a9-a2b4-9163eea6eab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:37.280770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af0aa5-f3cf-44a9-a2b4-9163eea6eab6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:37.313682 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2246/4517] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:37.314956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:37.326462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645cdc4-4895-4954-89b0-dc6f3dd3e982 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:37.345455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:37.346181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:37.346469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:37.347150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] PATH_INFO: `/v3/projects/094939fb8cbf496eb9ba9bf67ab579c1/users/cf47a3a5d2db40bf96dfa4c0a16edf6c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:37.390972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094939fb8cbf496eb9ba9bf67ab579c1, user_id=cf47a3a5d2db40bf96dfa4c0a16edf6c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:37.395580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:37.518003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2272/4518] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:37 2022] PUT /identity/v3/projects/094939fb8cbf496eb9ba9bf67ab579c1/users/cf47a3a5d2db40bf96dfa4c0a16edf6c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:37.530178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985f26-323f-4799-937e-361573dde7d0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:37.530720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985f26-323f-4799-937e-361573dde7d0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:37.530720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985f26-323f-4799-937e-361573dde7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:37.593303 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:37.613353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-84985f26-323f-4799-937e-361573dde7d0 None None] MFA Rules not processed for user `cf47a3a5d2db40bf96dfa4c0a16edf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:37.633254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84985f26-323f-4799-937e-361573dde7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:37.801160 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2247/4519] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:38.010442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:38.013873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:38.142974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297e27e-3e60-4e0c-982f-419f7e11d1a7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:38.149049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:38.149742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:38.150127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:38.150405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:38.168974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:38.171016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:38.202487 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2273/4520] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:39.030478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bcda-2957-4303-b112-0b94a65b3529 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:39.031036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bcda-2957-4303-b112-0b94a65b3529 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:39.031036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bcda-2957-4303-b112-0b94a65b3529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:39.071741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9b93bcda-2957-4303-b112-0b94a65b3529 None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:39.075755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9b93bcda-2957-4303-b112-0b94a65b3529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:39.279456 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2248/4521] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:40.602462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:40.645668 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:40.681668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508990-33b5-4602-8fbd-692472167ed0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:40.682897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508990-33b5-4602-8fbd-692472167ed0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:40.683394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508990-33b5-4602-8fbd-692472167ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:40.740797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-33508990-33b5-4602-8fbd-692472167ed0 None None] MFA Rules not processed for user `c10295ee56f14f8b9eb6bea840a6610c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:40.745238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-33508990-33b5-4602-8fbd-692472167ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:40.755979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48edfb6-294f-464f-a8e1-461de10dcf09 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:40.779968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:40.780732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:40.781153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:40.781787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] PATH_INFO: `/v3/users/cf47a3a5d2db40bf96dfa4c0a16edf6c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:40.784798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf47a3a5d2db40bf96dfa4c0a16edf6c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:40.787352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:40.869759 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2249/4522] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 01:28:40.888290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d053c6-f0e1-41fe-952a-885c994c7578 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:40.888582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d053c6-f0e1-41fe-952a-885c994c7578 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:40.888855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d053c6-f0e1-41fe-952a-885c994c7578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:40.927146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-02d053c6-f0e1-41fe-952a-885c994c7578 None None] MFA Rules not processed for user `c10295ee56f14f8b9eb6bea840a6610c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:40.928829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02d053c6-f0e1-41fe-952a-885c994c7578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:40.942135 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2250/4523] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:41.044132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf47a3a5d2db40bf96dfa4c0a16edf6c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:41.048638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf47a3a5d2db40bf96dfa4c0a16edf6c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:41.139777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf47a3a5d2db40bf96dfa4c0a16edf6c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:41.151851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf47a3a5d2db40bf96dfa4c0a16edf6c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:41.153433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf47a3a5d2db40bf96dfa4c0a16edf6c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:41.193096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2274/4524] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:40 2022] DELETE /identity/v3/users/cf47a3a5d2db40bf96dfa4c0a16edf6c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:41.202142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:41.203130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:41.203641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:41.232377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:41.234300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:41.342543 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:41.403658 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2251/4525] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:41.467728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:41.468975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:41.625382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916442bb-5c75-47ce-90c2-2eeddcf75bd4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:41.630412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9a640-0f0f-4af5-a1d0-a60969d901b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:41.631455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9a640-0f0f-4af5-a1d0-a60969d901b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:41.632461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9a640-0f0f-4af5-a1d0-a60969d901b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:41.633032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9a640-0f0f-4af5-a1d0-a60969d901b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:41.644452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9a640-0f0f-4af5-a1d0-a60969d901b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:41.646662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9a640-0f0f-4af5-a1d0-a60969d901b6 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:41.659367 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2275/4526] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:42.951422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:42.953545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:42.979007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d418-a9d2-4df2-a158-b3d2290be197 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:43.008146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:43.008843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:43.009136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:43.009405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] PATH_INFO: `/v3/projects/094939fb8cbf496eb9ba9bf67ab579c1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:43.013171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094939fb8cbf496eb9ba9bf67ab579c1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:43.015165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:43.187970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094939fb8cbf496eb9ba9bf67ab579c1', 'request_id': 'req-76205968-12b6-4e9f-a87d-02fadf4e5b00'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:43.203427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094939fb8cbf496eb9ba9bf67ab579c1', 'request_id': 'req-76205968-12b6-4e9f-a87d-02fadf4e5b00'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:43.301860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094939fb8cbf496eb9ba9bf67ab579c1', 'request_id': 'req-76205968-12b6-4e9f-a87d-02fadf4e5b00'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:43.324284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] The token cache is being invalidate because project 094939fb8cbf496eb9ba9bf67ab579c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:43.324501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:43.325216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76205968-12b6-4e9f-a87d-02fadf4e5b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:43.334168 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2252/4527] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:42 2022] DELETE /identity/v3/projects/094939fb8cbf496eb9ba9bf67ab579c1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:43.338366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64768-1f91-4999-ad05-eba8758c7e2f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:43.339257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64768-1f91-4999-ad05-eba8758c7e2f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:43.339748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64768-1f91-4999-ad05-eba8758c7e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:43.371756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c8f64768-1f91-4999-ad05-eba8758c7e2f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:43.374932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c8f64768-1f91-4999-ad05-eba8758c7e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:43.471881 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:43.549934 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2276/4528] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:43.556302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d38cd-92b4-4afc-9ce1-89a157cfadd0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:43.556864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d38cd-92b4-4afc-9ce1-89a157cfadd0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:43.557443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d38cd-92b4-4afc-9ce1-89a157cfadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:43.630643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ee2d38cd-92b4-4afc-9ce1-89a157cfadd0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:43.632794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee2d38cd-92b4-4afc-9ce1-89a157cfadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:43.644545 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2253/4529] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:43.651308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f64768-1f91-4999-ad05-eba8758c7e2f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:43.667109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f64768-1f91-4999-ad05-eba8758c7e2f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:43.680440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:43.682215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:43.683071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:43.683966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:43.701068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:43.701750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:43.705876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:43.745741 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2277/4530] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:28:43.746777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d38cd-92b4-4afc-9ce1-89a157cfadd0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:43.768188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d38cd-92b4-4afc-9ce1-89a157cfadd0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:43.776858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:43.777789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:43.778147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:43.778423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:43.779660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:43.782765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:44.141513 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2254/4531] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:43 2022] POST /identity/v3/projects => generated 375 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:44.146740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:44.157878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babab6cd-16ec-4424-b744-595e2b77687e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:44.171999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:44.174742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:44.267108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:44.268073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:44.268551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:44.269046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:44.270265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:44.272887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:44.296210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31e63e-f9f6-40c1-9643-e42e4b56983c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:44.301746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:44.303106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:44.304086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:44.304464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] PATH_INFO: `/v3/users/fcabfd40b20e4e89af56ca21c6f87008` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:44.306350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcabfd40b20e4e89af56ca21c6f87008)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:44.309060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:44.496975 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2278/4532] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:44 2022] POST /identity/v3/users => generated 288 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:44.515476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:44.541451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7dac9-8af6-4d78-8d72-7deb481d66e4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:44.558416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:44.559543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:44.560470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:44.560969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:44.561915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:44.563806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:44.592121 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2279/4533] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:44.601368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:44.614595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92346d-3deb-4007-856f-8224e875ec50 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:44.630873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:44.632378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:44.632782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:44.633202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:44.636421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:44.639010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:44.645950 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:44.658212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcabfd40b20e4e89af56ca21c6f87008'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:44.664017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2280/4534] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:28:44.666375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:44.685501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7921c77-2fb6-46d2-b25b-a2f94d727ed0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:44.689936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcabfd40b20e4e89af56ca21c6f87008'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:44.698609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa151e-6f87-413b-90a9-1685849047cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:44.699437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa151e-6f87-413b-90a9-1685849047cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:44.705976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa151e-6f87-413b-90a9-1685849047cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:44.705976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa151e-6f87-413b-90a9-1685849047cb admin admin] PATH_INFO: `/v3/projects/d1f14aa4017d400db2192b5ea3f72459/users/ba9c3206610f4a2e83dd9ac185d991d9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:44.725854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa151e-6f87-413b-90a9-1685849047cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f14aa4017d400db2192b5ea3f72459, user_id=ba9c3206610f4a2e83dd9ac185d991d9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:44.726096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcabfd40b20e4e89af56ca21c6f87008'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:44.726767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcabfd40b20e4e89af56ca21c6f87008'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:44.731746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa151e-6f87-413b-90a9-1685849047cb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:44.850406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcabfd40b20e4e89af56ca21c6f87008'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:44.866903 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2281/4535] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:44 2022] PUT /identity/v3/projects/d1f14aa4017d400db2192b5ea3f72459/users/ba9c3206610f4a2e83dd9ac185d991d9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:44.876284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2255/4536] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:44 2022] DELETE /identity/v3/users/fcabfd40b20e4e89af56ca21c6f87008 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:44.956216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:44.956498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:44.956773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:44.988025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] MFA Rules not processed for user `ba9c3206610f4a2e83dd9ac185d991d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:44.989678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:45.113878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2282/4537] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:45.214480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:45.217945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:45.412012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8762-09b8-45d5-a4c4-111a6b990cea admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:45.426672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:45.427320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:45.427865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:45.428144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:45.451337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:45.453530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:45.483425 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2256/4538] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:45.502088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:45.504262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:45.533758 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:45.650805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5679e1-7bfc-46c6-b6a3-94a92d60f97e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:45.667252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:45.668017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:45.668303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:45.668682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] PATH_INFO: `/v3/users/ba9c3206610f4a2e83dd9ac185d991d9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:45.670003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9c3206610f4a2e83dd9ac185d991d9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:45.672163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:45.932568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:45.934134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:45.963368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b1d57-3b49-48a0-b06e-003ee431a56a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:45.976872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:45.977832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:45.978132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:45.978872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] PATH_INFO: `/v3/projects/021a0b7054904163becc1aa9ccf2e601` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:45.984712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021a0b7054904163becc1aa9ccf2e601)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:45.986431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9c3206610f4a2e83dd9ac185d991d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:45.987087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:45.987312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9c3206610f4a2e83dd9ac185d991d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.123106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9c3206610f4a2e83dd9ac185d991d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.135262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9c3206610f4a2e83dd9ac185d991d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.138201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62ee5920-fa85-429b-ba05-3e03faafd706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9c3206610f4a2e83dd9ac185d991d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.179300 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2283/4539] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:45 2022] DELETE /identity/v3/users/ba9c3206610f4a2e83dd9ac185d991d9 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:46.184266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.184266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.184266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.230310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:46.231653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:46.321381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021a0b7054904163becc1aa9ccf2e601', 'request_id': 'req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.344683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021a0b7054904163becc1aa9ccf2e601', 'request_id': 'req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.384468 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2284/4540] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:46.453181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021a0b7054904163becc1aa9ccf2e601', 'request_id': 'req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.472484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] The token cache is being invalidate because project 021a0b7054904163becc1aa9ccf2e601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:46.472689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.473247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7d1fa92-58b2-4e0a-9595-a1a084ce7be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.480035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:46.484212 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2257/4541] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:45 2022] DELETE /identity/v3/projects/021a0b7054904163becc1aa9ccf2e601 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:28:46.484396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:46.486202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db34da-2e70-4815-a4ba-94344b8a7ddf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.491355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db34da-2e70-4815-a4ba-94344b8a7ddf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.491355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db34da-2e70-4815-a4ba-94344b8a7ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.547363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-09db34da-2e70-4815-a4ba-94344b8a7ddf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:46.548654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-09db34da-2e70-4815-a4ba-94344b8a7ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:46.649667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d8976-0435-4020-85f7-770f1ec3c9cd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:46.655159 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:46.671851 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:46.747909 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2258/4542] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:46.755240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a829-8fe3-43b6-b686-0af977bb0b3e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.755817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a829-8fe3-43b6-b686-0af977bb0b3e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.755995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a829-8fe3-43b6-b686-0af977bb0b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.796757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1616a829-8fe3-43b6-b686-0af977bb0b3e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:46.798171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1616a829-8fe3-43b6-b686-0af977bb0b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:46.811683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:46.812531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.812917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.813081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.815827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:46.838854 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2259/4543] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:46.840013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a829-8fe3-43b6-b686-0af977bb0b3e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:46.846306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:46.847737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:46.858263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a829-8fe3-43b6-b686-0af977bb0b3e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:46.878202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:46.878202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.878202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.878623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.879203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:46.880287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:46.883028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:46.908802 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2285/4544] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:28:46.917612 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2260/4545] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:28:46.921041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:46.947750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d43d-7110-45d1-8838-068e3b3d9141 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:46.971280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:46.972295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.978669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.979510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.988537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:46.989285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.215282 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2286/4546] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:46 2022] POST /identity/v3/projects => generated 387 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:47.219952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.243923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d27dc-5b0a-414b-855b-4c15cf1193e3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.467589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.470319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.471080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.474153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.476029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.481340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.606225 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2261/4547] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:47 2022] POST /identity/v3/users => generated 294 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:47.613906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.635751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054fbfc-09f1-49e5-bbf6-8df772583bcc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.653990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.654773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.655292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.660666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.661448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.667006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.734780 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2287/4548] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:28:47.740183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.754938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752d7f-d51c-4bf6-af35-417cf57e1450 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.777856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c95b6e-3373-496a-a5a2-6530356b3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.779063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95b6e-3373-496a-a5a2-6530356b3839 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.779690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95b6e-3373-496a-a5a2-6530356b3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.780256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c95b6e-3373-496a-a5a2-6530356b3839 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.781096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c95b6e-3373-496a-a5a2-6530356b3839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.794815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c95b6e-3373-496a-a5a2-6530356b3839 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.838058 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2262/4549] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:47.840184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.865546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5e1b-d984-46b1-bf9e-dcb84bb8daca admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.880476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.882887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.883641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.886410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] PATH_INFO: `/v3/projects/f96a2f55ba5a4e7a9f80ee3cafd321f1/users/44fb1088492c4310b7a08e32c1324372/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.932044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96a2f55ba5a4e7a9f80ee3cafd321f1, user_id=44fb1088492c4310b7a08e32c1324372, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.934863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:48.095677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:48.097408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:48.098161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:48.102320 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2288/4550] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:47 2022] PUT /identity/v3/projects/f96a2f55ba5a4e7a9f80ee3cafd321f1/users/44fb1088492c4310b7a08e32c1324372/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:48.196519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:48.197606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:48.200239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:48.219654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:48.393259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2263/4551] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:48.396205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:48.401220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:48.411019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d54c4-5946-4b9b-976a-105775ea5e8b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:48.425863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:48.426458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:48.426743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:48.427023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] PATH_INFO: `/v3/projects/d1f14aa4017d400db2192b5ea3f72459` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:48.448298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f14aa4017d400db2192b5ea3f72459)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:48.450675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:48.551543 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:48.578981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a2323-3cf1-46aa-8114-4980d955029e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:48.588167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec7609-a9a2-427a-add5-02173f45364b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:48.590935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec7609-a9a2-427a-add5-02173f45364b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:48.590935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec7609-a9a2-427a-add5-02173f45364b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:48.590935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec7609-a9a2-427a-add5-02173f45364b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:48.604703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec7609-a9a2-427a-add5-02173f45364b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:48.606703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec7609-a9a2-427a-add5-02173f45364b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:48.621514 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2264/4552] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:48.681969 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:48.718859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f14aa4017d400db2192b5ea3f72459', 'request_id': 'req-008f4242-6999-4ce6-86e3-e8892bb03c9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:48.730064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f14aa4017d400db2192b5ea3f72459', 'request_id': 'req-008f4242-6999-4ce6-86e3-e8892bb03c9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:48.866538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f14aa4017d400db2192b5ea3f72459', 'request_id': 'req-008f4242-6999-4ce6-86e3-e8892bb03c9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:48.887926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] The token cache is being invalidate because project d1f14aa4017d400db2192b5ea3f72459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:48.888419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:48.889711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-008f4242-6999-4ce6-86e3-e8892bb03c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:48.891260 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2289/4553] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:48 2022] DELETE /identity/v3/projects/d1f14aa4017d400db2192b5ea3f72459 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:48.899606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448313-58fd-4a7c-ad6a-5ecb9c00de65 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:48.899976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448313-58fd-4a7c-ad6a-5ecb9c00de65 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:48.900389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448313-58fd-4a7c-ad6a-5ecb9c00de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:48.950425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fd448313-58fd-4a7c-ad6a-5ecb9c00de65 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:48.950425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fd448313-58fd-4a7c-ad6a-5ecb9c00de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:49.013848 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2265/4554] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:49.019873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d9a5c-58f5-4adf-99b8-45d4ebb44972 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.020089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d9a5c-58f5-4adf-99b8-45d4ebb44972 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.020394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d9a5c-58f5-4adf-99b8-45d4ebb44972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.073338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-778d9a5c-58f5-4adf-99b8-45d4ebb44972 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:49.075554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-778d9a5c-58f5-4adf-99b8-45d4ebb44972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:49.086508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2290/4555] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:49.092372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448313-58fd-4a7c-ad6a-5ecb9c00de65 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:49.110453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448313-58fd-4a7c-ad6a-5ecb9c00de65 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:49.124479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:49.125255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.125544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.125972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.126779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:49.127257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:49.129083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:49.152488 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2266/4556] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:28:49.154925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d9a5c-58f5-4adf-99b8-45d4ebb44972 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:49.174669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d9a5c-58f5-4adf-99b8-45d4ebb44972 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:49.186106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:49.187264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.187755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.188437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.189389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:49.192271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:49.375827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2291/4557] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:49 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:49.380228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:49.396927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959d2a-cf47-46c1-986d-894a4d14ddbe admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:49.568173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:49.569704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.570280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.570803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.571983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:49.574180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:49.721673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:49.723433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:49.798890 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2267/4558] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:49 2022] POST /identity/v3/users => generated 290 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:49.801308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:49.814833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87223f52-8bf6-426a-96ee-1a77d0c195f4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:49.823402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:49.829385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.830195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.831168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.834306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:49.836320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca490-cae3-49a7-a557-221614a87907 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:49.840913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:49.841597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aa5c3-f3eb-496c-90f5-7af8d51caf8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:49.842438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aa5c3-f3eb-496c-90f5-7af8d51caf8d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.842936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aa5c3-f3eb-496c-90f5-7af8d51caf8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.843373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aa5c3-f3eb-496c-90f5-7af8d51caf8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.845744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dd6aa5c3-f3eb-496c-90f5-7af8d51caf8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:49.874281 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2268/4559] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:28:49.875543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:49.892716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed720a-cacf-483e-b568-4d1baaecbd02 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:49.899841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:49.900712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.901279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.901693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.902529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:49.905515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:49.926487 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2269/4560] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:49.929942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:49.941657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c528-0c3f-459a-b469-636f8512a746 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:49.949033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c2d58-89d1-4335-bab0-ee9b8ebc6b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:49.950108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c2d58-89d1-4335-bab0-ee9b8ebc6b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:49.950567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c2d58-89d1-4335-bab0-ee9b8ebc6b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:49.951028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c2d58-89d1-4335-bab0-ee9b8ebc6b48 admin admin] PATH_INFO: `/v3/projects/dd7d60542ccb4071a9ad104260bdcc83/users/6023fae72a4e4ef488209552004b8e3c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:49.970531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c2d58-89d1-4335-bab0-ee9b8ebc6b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7d60542ccb4071a9ad104260bdcc83, user_id=6023fae72a4e4ef488209552004b8e3c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:49.975382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c2d58-89d1-4335-bab0-ee9b8ebc6b48 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:50.003292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aa5c3-f3eb-496c-90f5-7af8d51caf8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:50.009250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aa5c3-f3eb-496c-90f5-7af8d51caf8d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:50.054392 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2292/4561] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:50.056267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9559ee-841f-47d8-9fd1-977a3ec68852 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:50.057227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9559ee-841f-47d8-9fd1-977a3ec68852 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:50.061852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9559ee-841f-47d8-9fd1-977a3ec68852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:50.123171 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2270/4562] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:49 2022] PUT /identity/v3/projects/dd7d60542ccb4071a9ad104260bdcc83/users/6023fae72a4e4ef488209552004b8e3c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:50.138713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91899f86-46e6-421e-86b0-009f04e24d10 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:50.139006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91899f86-46e6-421e-86b0-009f04e24d10 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:50.139280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91899f86-46e6-421e-86b0-009f04e24d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:50.160743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dd9559ee-841f-47d8-9fd1-977a3ec68852 None None] MFA Rules not processed for user `44fb1088492c4310b7a08e32c1324372`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:50.166502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dd9559ee-841f-47d8-9fd1-977a3ec68852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:50.187700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-91899f86-46e6-421e-86b0-009f04e24d10 None None] MFA Rules not processed for user `6023fae72a4e4ef488209552004b8e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:50.189251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-91899f86-46e6-421e-86b0-009f04e24d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:50.195257 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:50.318285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2271/4563] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:50.321017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91899f86-46e6-421e-86b0-009f04e24d10 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:50.346481 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2293/4564] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:50.348632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:50.348931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:50.349216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:50.431409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] MFA Rules not processed for user `44fb1088492c4310b7a08e32c1324372`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:50.433606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:50.447067 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2294/4565] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:50.455296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:50.457788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:50.580985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91899f86-46e6-421e-86b0-009f04e24d10 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:50.599365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:50.600207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:50.600631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:50.601003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:50.601748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:50.604014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:50.607924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336f2e8-eb0b-4b0f-8e55-d68a444c6258 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:50.614999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:50.615411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:50.616299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:50.616717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:50.630608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:50.637512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:50.687246 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2295/4566] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:50.777447 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2272/4567] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:50 2022] POST /identity/v3/projects => generated 379 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:50.781624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:50.795778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844d71-01b5-4e5d-93ea-05c7ded03ce7 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:50.889523 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:50.915186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:50.915825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:50.916107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:50.916728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:50.920499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:50.922821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:51.071219 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2296/4568] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:50 2022] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:51.072503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:51.084188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbf475-6b25-485c-ae15-28286f0161da admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:51.090943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:51.091704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:51.091974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:51.092368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:51.093020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:51.094653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:51.108948 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2273/4569] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:51.113514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:51.138059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfbae6-f863-4d28-8b0f-262e8b4e9869 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:51.145508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:51.146568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:51.147852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:51.148816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] PATH_INFO: `/v3/projects/3e34d00af00742f592a5f3094326667a/users/bfa9936928f941c29fe36e39aa112ab2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:51.183646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e34d00af00742f592a5f3094326667a, user_id=bfa9936928f941c29fe36e39aa112ab2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:51.189372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:51.330294 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2297/4570] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:51 2022] PUT /identity/v3/projects/3e34d00af00742f592a5f3094326667a/users/bfa9936928f941c29fe36e39aa112ab2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:28:51.335328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:51.360482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e650496-11ae-49dc-88f2-3f341582897d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:51.466270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b7ec2-40db-4283-8af7-045fa68a61c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:51.466917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7ec2-40db-4283-8af7-045fa68a61c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:51.467197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7ec2-40db-4283-8af7-045fa68a61c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:51.467466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7ec2-40db-4283-8af7-045fa68a61c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:51.468121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b7ec2-40db-4283-8af7-045fa68a61c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:51.469733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b7ec2-40db-4283-8af7-045fa68a61c0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:51.501912 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2274/4571] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:51.512558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:51.525598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81d394-e20a-4bdd-8064-3e9289433b13 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:51.543885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:51.545011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:51.545492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:51.545784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] PATH_INFO: `/v3/projects/3e34d00af00742f592a5f3094326667a/users/bfa9936928f941c29fe36e39aa112ab2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:51.551995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e34d00af00742f592a5f3094326667a, user_id=bfa9936928f941c29fe36e39aa112ab2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:51.556388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:51.590177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2298/4572] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:51 2022] PUT /identity/v3/projects/3e34d00af00742f592a5f3094326667a/users/bfa9936928f941c29fe36e39aa112ab2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:51.592658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:51.593207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:51.593304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:51.665063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] MFA Rules not processed for user `bfa9936928f941c29fe36e39aa112ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:51.666440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:51.714224 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:51.820407 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2275/4573] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:51.837929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:51.840864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:51.933994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26e7d9-d92d-48d7-9d58-7c2189eca4bc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:51.939738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:51.940236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:51.940663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:51.940955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.041006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:52.042916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:52.057674 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2299/4574] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:52.972610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:52.975771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:53.058391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0bad-d525-42c9-84b9-7635d6d434e6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:53.063905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:53.064519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:53.064808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:53.065093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] PATH_INFO: `/v3/users/44fb1088492c4310b7a08e32c1324372` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:53.066442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fb1088492c4310b7a08e32c1324372)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:53.068414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:53.431145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fb1088492c4310b7a08e32c1324372'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:53.463630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fb1088492c4310b7a08e32c1324372'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:53.476293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fb1088492c4310b7a08e32c1324372'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:53.477065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fb1088492c4310b7a08e32c1324372'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:53.634874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-739f18f9-b3d3-4097-a1d2-3b1ce452522f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fb1088492c4310b7a08e32c1324372'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:53.634874 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2276/4575] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:52 2022] DELETE /identity/v3/users/44fb1088492c4310b7a08e32c1324372 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:54.016115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:54.053885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5b718-44b9-4eb9-bbb2-19a6a2d92fa0 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:54.126687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:54.127412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:54.128615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:54.128615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] PATH_INFO: `/v3/projects/f96a2f55ba5a4e7a9f80ee3cafd321f1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:54.129951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96a2f55ba5a4e7a9f80ee3cafd321f1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:54.133547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:54.394736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96a2f55ba5a4e7a9f80ee3cafd321f1', 'request_id': 'req-75710402-8d39-403c-84f4-b9effd4b3db2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:54.407175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96a2f55ba5a4e7a9f80ee3cafd321f1', 'request_id': 'req-75710402-8d39-403c-84f4-b9effd4b3db2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:54.551094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96a2f55ba5a4e7a9f80ee3cafd321f1', 'request_id': 'req-75710402-8d39-403c-84f4-b9effd4b3db2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:54.580370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] The token cache is being invalidate because project f96a2f55ba5a4e7a9f80ee3cafd321f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:54.580833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:54.586690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75710402-8d39-403c-84f4-b9effd4b3db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:54.599484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee4ee-fd09-49fb-adb7-f904c2c33d05 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:54.599484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee4ee-fd09-49fb-adb7-f904c2c33d05 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:54.600346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bee4ee-fd09-49fb-adb7-f904c2c33d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:54.603087 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2300/4576] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:54 2022] DELETE /identity/v3/projects/f96a2f55ba5a4e7a9f80ee3cafd321f1 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:54.655907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a3bee4ee-fd09-49fb-adb7-f904c2c33d05 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:54.658446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a3bee4ee-fd09-49fb-adb7-f904c2c33d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:54.784117 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2277/4577] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:54.796850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713f6b-77bd-4ba7-958b-0086cbbe1882 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:54.797160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713f6b-77bd-4ba7-958b-0086cbbe1882 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:54.797449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713f6b-77bd-4ba7-958b-0086cbbe1882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:54.825542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2c713f6b-77bd-4ba7-958b-0086cbbe1882 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:54.826944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c713f6b-77bd-4ba7-958b-0086cbbe1882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:54.853120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2301/4578] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:54.859382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bee4ee-fd09-49fb-adb7-f904c2c33d05 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:54.882119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bee4ee-fd09-49fb-adb7-f904c2c33d05 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:54.899261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:54.901961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:54.902260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:54.902547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:54.907697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:54.908024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:54.918566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:54.937442 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2278/4579] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:28:54.938618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713f6b-77bd-4ba7-958b-0086cbbe1882 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:54.950435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713f6b-77bd-4ba7-958b-0086cbbe1882 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:54.956744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:54.958193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:54.958543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:54.958882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:54.961012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:54.963057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:55.169531 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2302/4580] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:54 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:55.174691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:55.186858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505700bc-59a6-4175-8115-55b283505b70 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:55.250988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:55.251830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:55.252204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:55.252626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:55.253359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:55.255408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:55.501480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:55.513686 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2279/4581] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:55 2022] POST /identity/v3/users => generated 287 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:28:55.518563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dff4c-de8a-4edd-b24a-1f9aaa3c7c4d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:55.524777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:55.528103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:55.528823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:55.529307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:55.530464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:55.532336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:55.548273 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2303/4582] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:55.555107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:55.574442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da4e9b-c305-4110-ae5c-63e212b9a82d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:55.590135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:55.590884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:55.591434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:55.592804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:55.594010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:55.596033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:55.614913 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2280/4583] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:55.619645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:55.632523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55414-020d-484c-944d-9f68688d9808 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:55.641979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aa7ee-37cd-4dda-9f23-ea6db1f54241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:55.643650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa7ee-37cd-4dda-9f23-ea6db1f54241 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:55.644040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa7ee-37cd-4dda-9f23-ea6db1f54241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:55.644587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa7ee-37cd-4dda-9f23-ea6db1f54241 admin admin] PATH_INFO: `/v3/projects/d059b9687ce34cc4b79d88fac1863e83/users/74e3121ebe26417585da5cf7f484f096/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:55.674668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aa7ee-37cd-4dda-9f23-ea6db1f54241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d059b9687ce34cc4b79d88fac1863e83, user_id=74e3121ebe26417585da5cf7f484f096, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:55.681279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aa7ee-37cd-4dda-9f23-ea6db1f54241 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:55.733542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:55.736241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:55.812403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad0139-1e0a-408c-8cc3-f03d2198eb24 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:55.818065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:55.818789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:55.819081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:55.819354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:55.821938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:55.841742 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2304/4584] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:55 2022] PUT /identity/v3/projects/d059b9687ce34cc4b79d88fac1863e83/users/74e3121ebe26417585da5cf7f484f096/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:55.845515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe0e5c-2eba-4929-ab10-078527583b53 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:55.846341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe0e5c-2eba-4929-ab10-078527583b53 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:55.846835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe0e5c-2eba-4929-ab10-078527583b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:55.889125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9cbe0e5c-2eba-4929-ab10-078527583b53 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:55.890446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9cbe0e5c-2eba-4929-ab10-078527583b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:55.950692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:55.952471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:55.965402 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2281/4585] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:28:56.004957 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2305/4586] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:56.015078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:56.030051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:56.144330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85647c-386e-4cf1-92b0-8f06aab5f285 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:56.294123 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:56.299872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:56.300583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:56.300872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:56.301157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:56.330408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:56.331801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:56.348259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2282/4587] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:56.572261 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:57.276168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:57.276458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:57.278144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:57.332153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:57.334984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:57.501930 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2306/4588] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:28:57.783098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:57.785271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:57.966366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e925eb7-3538-4030-b7a8-1879b8b225a5 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:57.979980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90af96-fa50-4492-8f7c-794459b2e193 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:57.981460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90af96-fa50-4492-8f7c-794459b2e193 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:57.981753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90af96-fa50-4492-8f7c-794459b2e193 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:57.982074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90af96-fa50-4492-8f7c-794459b2e193 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:58.005686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90af96-fa50-4492-8f7c-794459b2e193 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:58.009127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90af96-fa50-4492-8f7c-794459b2e193 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:58.029867 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2283/4589] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:28:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:28:59.838202 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:01.244829 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:12.778166 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=83 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:13.653341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:13.656108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:13.712981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a342-e205-432f-adfd-7d0fd6537ef3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:13.721827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:13.722496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:13.722774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:13.723246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] PATH_INFO: `/v3/users/6023fae72a4e4ef488209552004b8e3c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:13.725151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6023fae72a4e4ef488209552004b8e3c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:13.733615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:13.891666 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:13.971465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6023fae72a4e4ef488209552004b8e3c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:13.974067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6023fae72a4e4ef488209552004b8e3c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:14.070588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6023fae72a4e4ef488209552004b8e3c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:14.081151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6023fae72a4e4ef488209552004b8e3c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:14.082017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6023fae72a4e4ef488209552004b8e3c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:14.119197 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2307/4590] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:29:13 2022] DELETE /identity/v3/users/6023fae72a4e4ef488209552004b8e3c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:14.121059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0917-d382-4730-ba6d-7f777a21f9cf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:14.121349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0917-d382-4730-ba6d-7f777a21f9cf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:14.124898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0917-d382-4730-ba6d-7f777a21f9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:14.145869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ef4f0917-d382-4730-ba6d-7f777a21f9cf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:14.147632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ef4f0917-d382-4730-ba6d-7f777a21f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:14.300190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2284/4591] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:14.404917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:14.407232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:14.656881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287265cb-73b0-4f4f-9613-65b83b27d198 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:14.667329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:14.672866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:14.673340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:14.673965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:14.711934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:14.713673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:14.746459 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2308/4592] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:23.481292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:23.490672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:23.490672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:23.543268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] MFA Rules not processed for user `74e3121ebe26417585da5cf7f484f096`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:23.547158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:23.716141 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2285/4593] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:24.004460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:24.016817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:24.279971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:24.281891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:24.329709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f755a1-d4d2-4798-8e91-0e251e73ba3e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:24.361618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:24.362631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:24.363996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:24.368897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] PATH_INFO: `/v3/projects/dd7d60542ccb4071a9ad104260bdcc83` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:24.374852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7d60542ccb4071a9ad104260bdcc83)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:24.387096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:24.394042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf333-a2a2-4be0-8f66-4d30bedec8fe service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:24.446992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:24.447843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:24.454250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:24.459044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:24.499418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:24.501176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:24.512448 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:24.543124 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2309/4594] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:24.637929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7d60542ccb4071a9ad104260bdcc83', 'request_id': 'req-030207c9-9acf-40f8-a584-8fb9ec463e90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:24.661133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7d60542ccb4071a9ad104260bdcc83', 'request_id': 'req-030207c9-9acf-40f8-a584-8fb9ec463e90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:24.753789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7d60542ccb4071a9ad104260bdcc83', 'request_id': 'req-030207c9-9acf-40f8-a584-8fb9ec463e90'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:24.775945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] The token cache is being invalidate because project dd7d60542ccb4071a9ad104260bdcc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:29:24.782260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:24.784550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-030207c9-9acf-40f8-a584-8fb9ec463e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:24.793501 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2286/4595] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:29:24 2022] DELETE /identity/v3/projects/dd7d60542ccb4071a9ad104260bdcc83 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:24.797671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:24.828417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce147661-fbfc-49f4-aad7-713d3545af5b service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:24.864115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:24.871044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:24.871044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:24.905779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:24.909788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:24.947448 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:24.991670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:24.992511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:24.992886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:24.993430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] PATH_INFO: `/v3/users/bfa9936928f941c29fe36e39aa112ab2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:24.994915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa9936928f941c29fe36e39aa112ab2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:24.997100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:25.095273 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2287/4596] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:25.327019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa9936928f941c29fe36e39aa112ab2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:25.330223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa9936928f941c29fe36e39aa112ab2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:25.447000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa9936928f941c29fe36e39aa112ab2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:25.457198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa9936928f941c29fe36e39aa112ab2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:25.461724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9183b8cf-012b-4f19-835c-181413e605e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa9936928f941c29fe36e39aa112ab2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:25.517046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2310/4597] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:29:24 2022] DELETE /identity/v3/users/bfa9936928f941c29fe36e39aa112ab2 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:25.963825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:25.969949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:26.008019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170009-c7a5-42e5-a11b-8da7e601fae4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:26.135992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:26.148612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:26.148612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:26.148612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] PATH_INFO: `/v3/users/14315dd3cb094342a3601f41b606eb15` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:26.148612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] RBAC: Authorizing `identity:delete_user(user_id=14315dd3cb094342a3601f41b606eb15)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:26.148612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:26.704322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14315dd3cb094342a3601f41b606eb15'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:26.720779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14315dd3cb094342a3601f41b606eb15'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:26.731280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14315dd3cb094342a3601f41b606eb15'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:26.732092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14315dd3cb094342a3601f41b606eb15'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:26.839882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14315dd3cb094342a3601f41b606eb15'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:26.851797 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2288/4598] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:29:25 2022] DELETE /identity/v3/users/14315dd3cb094342a3601f41b606eb15 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:29:26.856821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:26.857321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:26.857588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:26.890767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:26.899237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:27.158250 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2311/4599] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:27.163545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:27.167335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:27.248530 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:27.273576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c57f2-a450-4a41-91b4-44b7d78a10af admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:27.278127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:27.279035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:27.279483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:27.279939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:27.328587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:27.333921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:27.365895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2289/4600] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:28.793205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:28.794731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:28.836265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60a587-cb3b-4a89-9835-9972bf90374c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:28.863825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:28.864821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:28.865960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:28.868011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] PATH_INFO: `/v3/projects/3e34d00af00742f592a5f3094326667a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:28.871201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e34d00af00742f592a5f3094326667a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:28.877711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:28.937469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:28.939212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:28.964198 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:28.965948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc9d5c-f620-4808-95c0-eada4bfd1459 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:28.978153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:28.979499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:28.981054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:28.981728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] PATH_INFO: `/v3/projects/e15ccc47a360435a8d80c8247e2b8744` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:28.996904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15ccc47a360435a8d80c8247e2b8744)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:29.052323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:29.234854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15ccc47a360435a8d80c8247e2b8744', 'request_id': 'req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.236847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e34d00af00742f592a5f3094326667a', 'request_id': 'req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.252465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e34d00af00742f592a5f3094326667a', 'request_id': 'req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.253350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15ccc47a360435a8d80c8247e2b8744', 'request_id': 'req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.374923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15ccc47a360435a8d80c8247e2b8744', 'request_id': 'req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.407218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] The token cache is being invalidate because project e15ccc47a360435a8d80c8247e2b8744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:29:29.416787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.416787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3329f1b8-29f6-4aaf-8c71-c92767aa15e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.421923 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2290/4601] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:29:28 2022] DELETE /identity/v3/projects/e15ccc47a360435a8d80c8247e2b8744 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:29.424454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498d51-e15b-4cb3-bb34-6f74b15f6786 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:29.427953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498d51-e15b-4cb3-bb34-6f74b15f6786 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:29.428508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498d51-e15b-4cb3-bb34-6f74b15f6786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:29.467786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e34d00af00742f592a5f3094326667a', 'request_id': 'req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.518558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] The token cache is being invalidate because project 3e34d00af00742f592a5f3094326667a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:29:29.534187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.538586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2cc6938b-f7a3-4332-9b49-f0f2b34f84fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:29.544308 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2312/4602] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:29:28 2022] DELETE /identity/v3/projects/3e34d00af00742f592a5f3094326667a => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:29.549158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3c22-486d-4618-8af2-0e47bd8da4d8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:29.552623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3c22-486d-4618-8af2-0e47bd8da4d8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:29.552907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3c22-486d-4618-8af2-0e47bd8da4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:29.568750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-61498d51-e15b-4cb3-bb34-6f74b15f6786 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:29.568750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-61498d51-e15b-4cb3-bb34-6f74b15f6786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:29.609185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1c9c3c22-486d-4618-8af2-0e47bd8da4d8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:29.612306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1c9c3c22-486d-4618-8af2-0e47bd8da4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:29.725931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2291/4603] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:29.728008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c4ebc-53f7-4820-b542-e2ed669387ed None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:29.729010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c4ebc-53f7-4820-b542-e2ed669387ed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:29.729292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c4ebc-53f7-4820-b542-e2ed669387ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:29.759417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2313/4604] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:29.761327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f3751-ddd3-42ea-9765-aa047bcdc4c9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:29.761540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f3751-ddd3-42ea-9765-aa047bcdc4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:29.761785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f3751-ddd3-42ea-9765-aa047bcdc4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:29.804281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-357c4ebc-53f7-4820-b542-e2ed669387ed None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:29.805899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-357c4ebc-53f7-4820-b542-e2ed669387ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:29.826807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-704f3751-ddd3-42ea-9765-aa047bcdc4c9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:29.828022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-704f3751-ddd3-42ea-9765-aa047bcdc4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:29.841069 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2292/4605] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:29.842077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c4ebc-53f7-4820-b542-e2ed669387ed None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:29.861028 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2314/4606] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:29:29.866833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f3751-ddd3-42ea-9765-aa047bcdc4c9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:29.877691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c4ebc-53f7-4820-b542-e2ed669387ed None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:29.893260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:29.897420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:29.897713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:29.898015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:29.902757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:29:29.904274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:29.907961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:29.909263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f3751-ddd3-42ea-9765-aa047bcdc4c9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:29.918277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:29.918277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:29.918277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:29.918277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:29.919087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:29:29.919614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:29.927750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:29.956813 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2293/4607] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:29:29.961723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:29.978865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794dd29-3743-46d1-9f41-6591117aa02d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:29.979959 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2315/4608] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:29:29.982808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:29.997979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:29.998944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.005647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.005647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.005647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.005647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.016184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e561a0-b918-48c0-b227-3c4ca22f7802 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.032174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.032892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.034303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.034303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.034303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.045040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.207531 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2294/4609] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:29:29 2022] POST /identity/v3/projects => generated 383 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:29:30.211849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.236236 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2316/4610] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:29:29 2022] POST /identity/v3/projects => generated 387 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:30.244810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.290316 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:30.470029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4141f4-ab7d-4ece-9dd2-e661f056fe27 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.496334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb6c71-79e6-4a14-a1c6-b09d85e6f4d1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.502544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.503186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.503348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.503478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.503726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.503956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.504243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.504518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.505912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.506098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.508351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.513522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.603314 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:30.622183 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2317/4611] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:29:30 2022] POST /identity/v3/users => generated 294 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:30.632129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.649543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b92e4-5e46-4c9f-b8cd-5987da9aec3b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.657467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.658159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.658438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.658778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.659441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.661168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.675286 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2295/4612] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:29:30 2022] POST /identity/v3/users => generated 292 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:29:30.679834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.701331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb0732-69df-4c8b-becb-7a50e0dd94d8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.714308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.715088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.715370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.715642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.720687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.722391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.732921 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2318/4613] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:30.738351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.754150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8f386-fd82-4619-b84f-3854a3edb355 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.757716 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2296/4614] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:30.760417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.780786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.782181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.782474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.782756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.783415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.784450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61624b-4580-450d-9be2-2d2dd14dff49 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.786164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.809039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.809678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.810000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.810274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.810927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.817980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.820812 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2319/4615] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:30.825181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.856224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d6423-8610-418b-8b74-5e504394fe53 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.858201 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2297/4616] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:30.859147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:30.877306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875231c6-53cb-4a65-b8e2-70e06908dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.880483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875231c6-53cb-4a65-b8e2-70e06908dca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.883236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65d70d-dce9-4f79-96a1-7023d6d2113d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:30.883457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875231c6-53cb-4a65-b8e2-70e06908dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.883626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875231c6-53cb-4a65-b8e2-70e06908dca1 admin admin] PATH_INFO: `/v3/projects/512a857e960a47cc8899d18f2067186d/users/f5f7953451d34ff2a31bfa8420f61004/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.893632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0e5e1-8702-4f6c-a1b3-491dd5271553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:30.894396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0e5e1-8702-4f6c-a1b3-491dd5271553 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:30.894672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0e5e1-8702-4f6c-a1b3-491dd5271553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:30.894947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0e5e1-8702-4f6c-a1b3-491dd5271553 admin admin] PATH_INFO: `/v3/projects/58fef77047524332a0d9dc95399c464e/users/f1f58945132b4a90881dfe7a397c94c1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:30.924085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0e5e1-8702-4f6c-a1b3-491dd5271553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fef77047524332a0d9dc95399c464e, user_id=f1f58945132b4a90881dfe7a397c94c1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.928235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0e5e1-8702-4f6c-a1b3-491dd5271553 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:30.941415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875231c6-53cb-4a65-b8e2-70e06908dca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512a857e960a47cc8899d18f2067186d, user_id=f5f7953451d34ff2a31bfa8420f61004, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:30.945156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875231c6-53cb-4a65-b8e2-70e06908dca1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:31.043723 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2320/4617] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:30 2022] PUT /identity/v3/projects/512a857e960a47cc8899d18f2067186d/users/f5f7953451d34ff2a31bfa8420f61004/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:31.054167 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2298/4618] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:30 2022] PUT /identity/v3/projects/58fef77047524332a0d9dc95399c464e/users/f1f58945132b4a90881dfe7a397c94c1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:31.056037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ae24-b787-4a3f-96bb-0617e7d85986 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:31.056037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ae24-b787-4a3f-96bb-0617e7d85986 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:31.056294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ae24-b787-4a3f-96bb-0617e7d85986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:31.056511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a470ac4-489f-4b36-9bde-82f40d76411b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:31.057027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a470ac4-489f-4b36-9bde-82f40d76411b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:31.057477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a470ac4-489f-4b36-9bde-82f40d76411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:31.099787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0a470ac4-489f-4b36-9bde-82f40d76411b None None] MFA Rules not processed for user `f5f7953451d34ff2a31bfa8420f61004`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:31.101517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0a470ac4-489f-4b36-9bde-82f40d76411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:31.122533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1918ae24-b787-4a3f-96bb-0617e7d85986 None None] MFA Rules not processed for user `f1f58945132b4a90881dfe7a397c94c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:31.128696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1918ae24-b787-4a3f-96bb-0617e7d85986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:31.226036 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2299/4619] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:29:31.227961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a470ac4-489f-4b36-9bde-82f40d76411b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:31.318494 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2321/4620] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:31.322169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918ae24-b787-4a3f-96bb-0617e7d85986 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:31.395689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a470ac4-489f-4b36-9bde-82f40d76411b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:31.416511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:31.417942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:31.418227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:31.418506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:31.429303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:31.431556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:31.472510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918ae24-b787-4a3f-96bb-0617e7d85986 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:31.488007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:31.490746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:31.491038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:31.496587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:31.496587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:31.499384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:31.602300 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2300/4621] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:29:31 2022] POST /identity/v3/projects => generated 387 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:31.612811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:31.655759 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2322/4622] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:29:31 2022] POST /identity/v3/projects => generated 381 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:31.655759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:31.885276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a0fda-0896-4015-a626-8e49f21bce99 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:31.900762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:31.901760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:31.902334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:31.903924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:31.905955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:31.908672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986ed1-3de5-4b80-affd-073ed372534d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:31.912049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:31.929492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:31.931481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:31.932127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:31.933962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:31.934856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:31.940975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.084535 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2301/4623] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:29:31 2022] POST /identity/v3/users => generated 300 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:32.090376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.108250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af70872-04d0-4ae1-b460-4538171d0022 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.121091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.122201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.122556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.123028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.123910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.127785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2323/4624] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:29:31 2022] POST /identity/v3/users => generated 297 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:32.127977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.128933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.147735 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2302/4625] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:32.154862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.175400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844117-86f7-46df-86d6-df0b8eac249f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.175789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c85f-67f0-4ebd-8405-b29e40e57261 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.191698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.191698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.191698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.191698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.192084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.192183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.194815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.195509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.195801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.196206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] PATH_INFO: `/v3/projects/66b3f4f3cf8e4b7aa5b849f110a36db9/users/93bdca2654b0467f8ef0583b88e0f58e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.222086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2324/4626] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:32.230476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.234574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b3f4f3cf8e4b7aa5b849f110a36db9, user_id=93bdca2654b0467f8ef0583b88e0f58e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.237631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.257241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4922d7d-5254-4b6f-80c3-17ba250d69cc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.265616 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:32.283541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.285562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.286145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.288109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] PATH_INFO: `/v3/projects/d0b8fa98ef434360bdebdb0976045168/users/ba5f292d7d464b1b84ebf5ec23aa6daa/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.308961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b8fa98ef434360bdebdb0976045168, user_id=ba5f292d7d464b1b84ebf5ec23aa6daa, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.312990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.378406 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2303/4627] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:32 2022] PUT /identity/v3/projects/66b3f4f3cf8e4b7aa5b849f110a36db9/users/93bdca2654b0467f8ef0583b88e0f58e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:32.387492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.455544 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2325/4628] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:32 2022] PUT /identity/v3/projects/d0b8fa98ef434360bdebdb0976045168/users/ba5f292d7d464b1b84ebf5ec23aa6daa/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:32.464011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.641970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014c71-130e-45af-b91d-858319a1b413 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.644940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01433d9-e1c2-4d88-b193-de316a18875a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.655261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.656175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.656634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.657649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.658514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.660852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.662725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.663358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.663642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.663921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.664578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.668158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.696836 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2326/4629] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:32.697840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.717931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2304/4630] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:32.721059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd4f55-2192-42b8-b056-774809689cb8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.722186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:32.739149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2535091-f91e-4da1-bfed-4180ce441186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.739641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535091-f91e-4da1-bfed-4180ce441186 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.739966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535091-f91e-4da1-bfed-4180ce441186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.740505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2535091-f91e-4da1-bfed-4180ce441186 admin admin] PATH_INFO: `/v3/projects/d0b8fa98ef434360bdebdb0976045168/users/ba5f292d7d464b1b84ebf5ec23aa6daa/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.741087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cd045-b8df-4117-bfd6-0bb41b6f6fc3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:32.742937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535091-f91e-4da1-bfed-4180ce441186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b8fa98ef434360bdebdb0976045168, user_id=ba5f292d7d464b1b84ebf5ec23aa6daa, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.746066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2535091-f91e-4da1-bfed-4180ce441186 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.753592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c7379-2a2f-4963-9351-bcabd9d2cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:32.754312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7379-2a2f-4963-9351-bcabd9d2cf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.754606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7379-2a2f-4963-9351-bcabd9d2cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.755427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7379-2a2f-4963-9351-bcabd9d2cf0e admin admin] PATH_INFO: `/v3/projects/66b3f4f3cf8e4b7aa5b849f110a36db9/users/93bdca2654b0467f8ef0583b88e0f58e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.767791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c7379-2a2f-4963-9351-bcabd9d2cf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b3f4f3cf8e4b7aa5b849f110a36db9, user_id=93bdca2654b0467f8ef0583b88e0f58e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:32.770192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c7379-2a2f-4963-9351-bcabd9d2cf0e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:32.779361 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2327/4631] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:32 2022] PUT /identity/v3/projects/d0b8fa98ef434360bdebdb0976045168/users/ba5f292d7d464b1b84ebf5ec23aa6daa/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:32.785229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72128d07-1e97-4ba1-946c-e61a3786f27c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.785844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72128d07-1e97-4ba1-946c-e61a3786f27c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.785844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72128d07-1e97-4ba1-946c-e61a3786f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.801772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2305/4632] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:32 2022] PUT /identity/v3/projects/66b3f4f3cf8e4b7aa5b849f110a36db9/users/93bdca2654b0467f8ef0583b88e0f58e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:29:32.811596 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:32.812577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84439296-6fc8-4165-be33-0312757178a8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:32.812868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84439296-6fc8-4165-be33-0312757178a8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:32.813150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84439296-6fc8-4165-be33-0312757178a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:32.851437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-72128d07-1e97-4ba1-946c-e61a3786f27c None None] MFA Rules not processed for user `ba5f292d7d464b1b84ebf5ec23aa6daa`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:32.855004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-72128d07-1e97-4ba1-946c-e61a3786f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:32.877510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-84439296-6fc8-4165-be33-0312757178a8 None None] MFA Rules not processed for user `93bdca2654b0467f8ef0583b88e0f58e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:32.878753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84439296-6fc8-4165-be33-0312757178a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:32.977979 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2328/4633] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:29:33.010701 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2306/4634] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:33.691623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:33.695413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:33.695413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:33.714983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] MFA Rules not processed for user `74e3121ebe26417585da5cf7f484f096`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:33.716263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:33.751391 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:33.809931 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2329/4635] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:34.082451 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:34.947849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84439296-6fc8-4165-be33-0312757178a8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:34.950302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84439296-6fc8-4165-be33-0312757178a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:35.081428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84439296-6fc8-4165-be33-0312757178a8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:35.086581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494d83f-07db-48a5-93bd-d181594fff3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:35.088459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d83f-07db-48a5-93bd-d181594fff3e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:35.088954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d83f-07db-48a5-93bd-d181594fff3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:35.089446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494d83f-07db-48a5-93bd-d181594fff3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:35.092089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a494d83f-07db-48a5-93bd-d181594fff3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:35.107140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494d83f-07db-48a5-93bd-d181594fff3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:35.112970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494d83f-07db-48a5-93bd-d181594fff3e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:35.123187 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2307/4636] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:35.878269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:35.880835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:35.966471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf093d-68e8-4e9c-836e-38165dda4d0b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:35.976798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dfefb-3a73-4244-94a3-a654392257c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:35.978538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfefb-3a73-4244-94a3-a654392257c4 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:35.979068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfefb-3a73-4244-94a3-a654392257c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:35.979592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dfefb-3a73-4244-94a3-a654392257c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:36.049365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dfefb-3a73-4244-94a3-a654392257c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:36.051416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dfefb-3a73-4244-94a3-a654392257c4 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:36.076186 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2330/4637] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:36.400397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39113b3-3ac7-40d3-a2d9-0a30f38f3c1e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:36.400939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39113b3-3ac7-40d3-a2d9-0a30f38f3c1e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:36.400939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39113b3-3ac7-40d3-a2d9-0a30f38f3c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:36.452071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d39113b3-3ac7-40d3-a2d9-0a30f38f3c1e None None] MFA Rules not processed for user `25c450da892f47a6a31149f0796fb363`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:36.454211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d39113b3-3ac7-40d3-a2d9-0a30f38f3c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:36.545187 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2308/4638] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:36.555916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:36.556399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:36.558484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:36.582378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] MFA Rules not processed for user `25c450da892f47a6a31149f0796fb363`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:36.584638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:36.594175 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2331/4639] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:36.876248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39113b3-3ac7-40d3-a2d9-0a30f38f3c1e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:36.890743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39113b3-3ac7-40d3-a2d9-0a30f38f3c1e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:36.901021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d9d17-575f-416a-b4e7-e3c2b4f0ab95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:36.902054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9d17-575f-416a-b4e7-e3c2b4f0ab95 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:36.902595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9d17-575f-416a-b4e7-e3c2b4f0ab95 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:36.903099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d9d17-575f-416a-b4e7-e3c2b4f0ab95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:36.928143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d9d17-575f-416a-b4e7-e3c2b4f0ab95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:36.930392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d9d17-575f-416a-b4e7-e3c2b4f0ab95 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:36.980575 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2309/4640] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:37.035792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:37.038220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:37.112655 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:37.229190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6f88b-6f8f-42bc-8160-768bdced1083 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:37.236537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:37.237653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:37.238244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:37.238684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:37.241158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:37.267768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:37.269328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:37.308284 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2332/4641] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:37.781285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:37.782061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:37.782061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:37.811759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:37.826215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:37.827438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:37.890476 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:37.920474 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2310/4642] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:29:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:37.935551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:37.939409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:37.974752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d97927-437f-4a12-8b13-b900027c2820 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:37.981306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:37.982369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:37.982937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:37.983709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] PATH_INFO: `/v3/users/f5f7953451d34ff2a31bfa8420f61004` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:37.985508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f7953451d34ff2a31bfa8420f61004)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:37.990552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:38.107714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230191a-d56d-4514-aaa9-1b548d068838 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:38.113970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba061b4-afa4-4997-a609-4709ff62ce51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:38.114654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba061b4-afa4-4997-a609-4709ff62ce51 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:38.126433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba061b4-afa4-4997-a609-4709ff62ce51 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:38.126787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba061b4-afa4-4997-a609-4709ff62ce51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:38.140268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba061b4-afa4-4997-a609-4709ff62ce51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:38.152981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba061b4-afa4-4997-a609-4709ff62ce51 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:38.165277 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2311/4643] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:29:38.306475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f7953451d34ff2a31bfa8420f61004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:38.311060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f7953451d34ff2a31bfa8420f61004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:38.383889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f7953451d34ff2a31bfa8420f61004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:38.397569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f7953451d34ff2a31bfa8420f61004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:38.398333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f7953451d34ff2a31bfa8420f61004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:38.479093 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2333/4644] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:29:37 2022] DELETE /identity/v3/users/f5f7953451d34ff2a31bfa8420f61004 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:29:38.483525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:38.484073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:38.484543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:38.526641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:38.528721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:38.779129 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2312/4645] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:38.791358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:38.797649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:38.909752 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:39.009698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9df85-a6c6-46d1-9a6a-461ebedf9e7e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:39.017793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:39.018772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:39.019367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:39.019945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:39.032227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:39.034457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:39.054763 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2334/4646] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:41.673251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:41.675578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:41.704273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65392dde-f95c-4cfb-aad5-923b26115bc4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:41.713774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:41.714879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:41.716214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:41.719119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] PATH_INFO: `/v3/projects/512a857e960a47cc8899d18f2067186d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:41.720653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512a857e960a47cc8899d18f2067186d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:41.724898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:42.000004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512a857e960a47cc8899d18f2067186d', 'request_id': 'req-44763cce-e696-4281-bb20-701a720a3c33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.012922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512a857e960a47cc8899d18f2067186d', 'request_id': 'req-44763cce-e696-4281-bb20-701a720a3c33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.109248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512a857e960a47cc8899d18f2067186d', 'request_id': 'req-44763cce-e696-4281-bb20-701a720a3c33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.112394 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:42.136094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] The token cache is being invalidate because project 512a857e960a47cc8899d18f2067186d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:29:42.136399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.137250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.139878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2313/4647] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:29:41 2022] DELETE /identity/v3/projects/512a857e960a47cc8899d18f2067186d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:42.143667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:42.155841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51a1cc-7040-43e4-9b97-fe158048e581 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:42.302674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:42.303330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:42.304570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:42.305653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] PATH_INFO: `/v3/users/93bdca2654b0467f8ef0583b88e0f58e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:42.309933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bdca2654b0467f8ef0583b88e0f58e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:42.315929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:42.596791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bdca2654b0467f8ef0583b88e0f58e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.597667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bdca2654b0467f8ef0583b88e0f58e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.759658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bdca2654b0467f8ef0583b88e0f58e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.778957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bdca2654b0467f8ef0583b88e0f58e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.779861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bdca2654b0467f8ef0583b88e0f58e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:42.813527 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2335/4648] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:29:42 2022] DELETE /identity/v3/users/93bdca2654b0467f8ef0583b88e0f58e => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:43.703687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:43.706671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:43.829269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763cce-e696-4281-bb20-701a720a3c33 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:43.956465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1357789-b56c-4c32-b6a5-158c5fd871e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:43.958317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357789-b56c-4c32-b6a5-158c5fd871e9 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:43.959685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357789-b56c-4c32-b6a5-158c5fd871e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:43.960202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357789-b56c-4c32-b6a5-158c5fd871e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:43.964179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1357789-b56c-4c32-b6a5-158c5fd871e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:43.984041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:43.985544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:44.065193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357789-b56c-4c32-b6a5-158c5fd871e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:44.068387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357789-b56c-4c32-b6a5-158c5fd871e9 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:44.086135 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2314/4649] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:44.096597 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:44.116813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb58b96-7fd0-4058-aa8d-e2b1bb3081e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:44.142616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:44.143285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:44.143567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:44.143842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] PATH_INFO: `/v3/projects/66b3f4f3cf8e4b7aa5b849f110a36db9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:44.145705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b3f4f3cf8e4b7aa5b849f110a36db9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:44.148195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:44.325897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b3f4f3cf8e4b7aa5b849f110a36db9', 'request_id': 'req-d1f71cec-474b-4cac-a673-e4e94b7d948b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:44.341427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b3f4f3cf8e4b7aa5b849f110a36db9', 'request_id': 'req-d1f71cec-474b-4cac-a673-e4e94b7d948b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:44.690884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b3f4f3cf8e4b7aa5b849f110a36db9', 'request_id': 'req-d1f71cec-474b-4cac-a673-e4e94b7d948b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:44.726091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] The token cache is being invalidate because project 66b3f4f3cf8e4b7aa5b849f110a36db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:29:44.726091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:44.727021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f71cec-474b-4cac-a673-e4e94b7d948b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:29:44.736294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497779-1fb0-4d17-856c-3cb9b93833db None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:44.736928 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2336/4650] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:29:43 2022] DELETE /identity/v3/projects/66b3f4f3cf8e4b7aa5b849f110a36db9 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:44.737560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497779-1fb0-4d17-856c-3cb9b93833db None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:44.738090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497779-1fb0-4d17-856c-3cb9b93833db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:44.789917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-57497779-1fb0-4d17-856c-3cb9b93833db None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:44.793383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-57497779-1fb0-4d17-856c-3cb9b93833db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:45.032541 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2315/4651] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:29:45.033712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be200-aaea-4d5b-845e-b70bf4fed93e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:45.034240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be200-aaea-4d5b-845e-b70bf4fed93e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:45.034346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be200-aaea-4d5b-845e-b70bf4fed93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:45.078735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-078be200-aaea-4d5b-845e-b70bf4fed93e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:45.078961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-078be200-aaea-4d5b-845e-b70bf4fed93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:45.091577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2337/4652] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:45.093111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497779-1fb0-4d17-856c-3cb9b93833db None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:45.100905 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:45.112685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497779-1fb0-4d17-856c-3cb9b93833db None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:45.127158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:45.127950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:45.128242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:45.128517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:45.129414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:29:45.133996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:45.136872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:45.174409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2316/4653] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:29:45.175383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be200-aaea-4d5b-845e-b70bf4fed93e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:45.202460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be200-aaea-4d5b-845e-b70bf4fed93e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:45.228668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:45.229374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:45.229727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:45.230091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:45.230808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:45.233796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:45.454552 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2338/4654] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:29:45 2022] POST /identity/v3/projects => generated 367 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:45.456116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:45.488209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783a946-5da2-4be5-bb18-753dc0a467fd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:45.680302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:45.682302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:45.683714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:45.685268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:45.687301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:45.693179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:45.827706 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2317/4655] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:29:45 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:45.831566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:45.863170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baec863-631f-4eca-946e-4fd531761f57 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:45.870312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:45.871126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:45.871498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:45.871869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:45.872618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:45.874411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:45.914907 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2339/4656] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:45.916931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:45.929848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6f528-c398-4081-b400-ebdd519d9e20 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:45.935553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58746d3-d61d-4974-ab57-610b3f530c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:45.936474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58746d3-d61d-4974-ab57-610b3f530c90 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:45.936980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58746d3-d61d-4974-ab57-610b3f530c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:45.937574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58746d3-d61d-4974-ab57-610b3f530c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:45.938488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58746d3-d61d-4974-ab57-610b3f530c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:45.940335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58746d3-d61d-4974-ab57-610b3f530c90 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:45.956593 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2318/4657] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:45.961305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:45.973979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e5552-b9a5-458a-be19-8f93eb00eedf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:46.015414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:46.016490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:46.018856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:46.018856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] PATH_INFO: `/v3/projects/620b9ccce83d4fd1a85b07aec1d081a4/users/2b47f739a5b546bcb7808b928986a1c9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:46.081444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=620b9ccce83d4fd1a85b07aec1d081a4, user_id=2b47f739a5b546bcb7808b928986a1c9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:46.085757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:46.190269 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2340/4658] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:45 2022] PUT /identity/v3/projects/620b9ccce83d4fd1a85b07aec1d081a4/users/2b47f739a5b546bcb7808b928986a1c9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:46.199515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f758-5d45-4ed8-ad49-29055c697397 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:46.199515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f758-5d45-4ed8-ad49-29055c697397 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:46.199515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f758-5d45-4ed8-ad49-29055c697397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:46.330106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-48a3f758-5d45-4ed8-ad49-29055c697397 None None] MFA Rules not processed for user `2b47f739a5b546bcb7808b928986a1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:46.331806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-48a3f758-5d45-4ed8-ad49-29055c697397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:46.442373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:46.444067 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2319/4659] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:46.570887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd72fa-aace-4073-a9a1-a5e785691b20 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:46.583563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:46.584181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:46.584473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:46.584753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:46.585514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:46.593469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:46.737591 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2341/4660] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:29:46 2022] POST /identity/v3/projects => generated 367 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:29:46.738964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f758-5d45-4ed8-ad49-29055c697397 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:46.756184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f758-5d45-4ed8-ad49-29055c697397 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:46.950038 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:46.970505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:46.974781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:46.975189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:46.976287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:46.977380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:46.982484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:47.113386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:47.114070 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2320/4661] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:29:46 2022] POST /identity/v3/users => generated 290 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:29:47.123990 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:47.134039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06356c-d5f0-4890-9330-1d28cafd247f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:47.150995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:47.151998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:47.152483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:47.153121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:47.153978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:47.155782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:47.185797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2342/4662] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:47.189992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:47.213236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c77111-4955-498e-9a8a-87863a2175ac admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:47.227907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:47.229654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:47.229654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:47.229654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] PATH_INFO: `/v3/projects/42762ae298104cd59ac61a65d6b9b1b3/users/2d53dba800b04f2181e8c522abd98812/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:47.264063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42762ae298104cd59ac61a65d6b9b1b3, user_id=2d53dba800b04f2181e8c522abd98812, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:47.267890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:47.378814 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2321/4663] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:47 2022] PUT /identity/v3/projects/42762ae298104cd59ac61a65d6b9b1b3/users/2d53dba800b04f2181e8c522abd98812/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:47.385884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:47.438163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41618-6622-4f6a-a68a-8ece6477ef5c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:47.591084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9b7f-2c49-400f-92fe-9bf7c12a8ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:47.592040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9b7f-2c49-400f-92fe-9bf7c12a8ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:47.592325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9b7f-2c49-400f-92fe-9bf7c12a8ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:47.592609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9b7f-2c49-400f-92fe-9bf7c12a8ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:47.593246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9b7f-2c49-400f-92fe-9bf7c12a8ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:47.595189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9b7f-2c49-400f-92fe-9bf7c12a8ad9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:47.624785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2343/4664] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:29:47.629347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:47.645982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5fb49-0522-4a1c-8f9a-e76bf11aad5c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:47.657010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:47.658549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:47.659391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:47.670151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] PATH_INFO: `/v3/projects/42762ae298104cd59ac61a65d6b9b1b3/users/2d53dba800b04f2181e8c522abd98812/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:47.670151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=42762ae298104cd59ac61a65d6b9b1b3, user_id=2d53dba800b04f2181e8c522abd98812, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:47.673196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:47.711304 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2322/4665] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:29:47 2022] PUT /identity/v3/projects/42762ae298104cd59ac61a65d6b9b1b3/users/2d53dba800b04f2181e8c522abd98812/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:29:47.716266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:47.717331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:47.718071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:47.779609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] MFA Rules not processed for user `2d53dba800b04f2181e8c522abd98812`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:47.781559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:47.926771 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2344/4666] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:47.959662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:47.959662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:48.145789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f73a2-d824-4ee6-8645-10647d9477ba admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:48.151956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f48b7e-0240-4f48-8313-ce084f8a5138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:48.152898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f48b7e-0240-4f48-8313-ce084f8a5138 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:48.153369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f48b7e-0240-4f48-8313-ce084f8a5138 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:48.153764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f48b7e-0240-4f48-8313-ce084f8a5138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:48.171858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f48b7e-0240-4f48-8313-ce084f8a5138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:48.174512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f48b7e-0240-4f48-8313-ce084f8a5138 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:48.196645 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2323/4667] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:48.553190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:48.555636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:48.585028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872902c4-d959-4993-8d8a-6ce9863f9e03 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:48.613270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:48.616783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:48.619515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:48.620002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:48.750147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:48.751355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:48.784918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2345/4668] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:57.022364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e957b-4921-4e1d-a924-1c3446e82890 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:57.023528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e957b-4921-4e1d-a924-1c3446e82890 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:57.024043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e957b-4921-4e1d-a924-1c3446e82890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:57.060770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-675e957b-4921-4e1d-a924-1c3446e82890 None None] MFA Rules not processed for user `341614326cee4db394f89ba476a30d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:57.062651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-675e957b-4921-4e1d-a924-1c3446e82890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:57.211311 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2324/4669] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:58.770307 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:03.376744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:03.378720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:03.538858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3b42-eb37-4459-bde8-030bdc0f994c service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:03.545093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:03.550897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:03.550897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:03.550897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] PATH_INFO: `/v3/users/f1f58945132b4a90881dfe7a397c94c1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:03.550897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f58945132b4a90881dfe7a397c94c1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:03.552883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:03.879393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f58945132b4a90881dfe7a397c94c1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:03.880717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f58945132b4a90881dfe7a397c94c1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:03.989275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f58945132b4a90881dfe7a397c94c1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:04.001579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f58945132b4a90881dfe7a397c94c1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:04.002461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f58945132b4a90881dfe7a397c94c1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:04.069909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2346/4670] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:30:03 2022] DELETE /identity/v3/users/f1f58945132b4a90881dfe7a397c94c1 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:04.072850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:04.073370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:04.073480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:04.143606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:04.148240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:04.263705 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:04.280697 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2325/4671] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:30:04.314960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:04.317470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:04.422780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3aca1-1ecc-4ef2-a5e7-3d27ae963624 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:04.428045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd0b11-b817-490d-9047-3c3eb7f6f1a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:04.428677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd0b11-b817-490d-9047-3c3eb7f6f1a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:04.428951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd0b11-b817-490d-9047-3c3eb7f6f1a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:04.429223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd0b11-b817-490d-9047-3c3eb7f6f1a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:04.454159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd0b11-b817-490d-9047-3c3eb7f6f1a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:04.458401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd0b11-b817-490d-9047-3c3eb7f6f1a2 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:04.492525 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2347/4672] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:30:04.602528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:04.604184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:04.628387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc523e-115a-4894-bc88-e90fc5a87c56 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:04.650541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:04.651206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:04.651484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:04.651756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] PATH_INFO: `/v3/users/2b47f739a5b546bcb7808b928986a1c9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:04.652950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b47f739a5b546bcb7808b928986a1c9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:04.654924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:04.943583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b47f739a5b546bcb7808b928986a1c9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:04.982259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b47f739a5b546bcb7808b928986a1c9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:05.000005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b47f739a5b546bcb7808b928986a1c9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:05.001069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b47f739a5b546bcb7808b928986a1c9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:05.114604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b47f739a5b546bcb7808b928986a1c9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:05.127301 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2326/4673] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:30:04 2022] DELETE /identity/v3/users/2b47f739a5b546bcb7808b928986a1c9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:05.131283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:05.131500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:05.131774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:05.178487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:05.179771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:05.202969 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:05.277927 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2348/4674] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:05.343874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:05.350235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:05.507884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2755ba-b818-4bb7-b71e-a79f00a97175 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:05.516820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:05.517461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:05.519799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:05.520085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:05.541181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:05.544829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:05.569049 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2327/4675] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:30:06.283550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:06.285744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:06.310569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f9be1-e78a-4a30-b1d2-e3298ec0cd49 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:06.324472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:06.325138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:06.325411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:06.325717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] PATH_INFO: `/v3/projects/58fef77047524332a0d9dc95399c464e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:06.335037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fef77047524332a0d9dc95399c464e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:06.337053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:06.480586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fef77047524332a0d9dc95399c464e', 'request_id': 'req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:06.510901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fef77047524332a0d9dc95399c464e', 'request_id': 'req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:06.663354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fef77047524332a0d9dc95399c464e', 'request_id': 'req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:06.679305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] The token cache is being invalidate because project 58fef77047524332a0d9dc95399c464e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:30:06.679867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:06.680687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:06.685346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2349/4676] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:30:06 2022] DELETE /identity/v3/projects/58fef77047524332a0d9dc95399c464e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:06.689085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:06.719966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf22e3-424e-494e-9115-85732033c171 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:06.843370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:06.844397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:06.844846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:06.845280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] PATH_INFO: `/v3/users/ba5f292d7d464b1b84ebf5ec23aa6daa` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:06.846897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5f292d7d464b1b84ebf5ec23aa6daa)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:06.850115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:06.871471 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:07.138622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5f292d7d464b1b84ebf5ec23aa6daa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:07.187357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5f292d7d464b1b84ebf5ec23aa6daa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:07.206062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5f292d7d464b1b84ebf5ec23aa6daa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:07.208010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5f292d7d464b1b84ebf5ec23aa6daa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:07.329076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5f292d7d464b1b84ebf5ec23aa6daa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:07.343019 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2328/4677] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:30:06 2022] DELETE /identity/v3/users/ba5f292d7d464b1b84ebf5ec23aa6daa => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:07.591384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:07.592859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:07.619659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5e9c1-84a7-4e0e-a366-dbbd4d65a7a8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:07.739063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:07.739063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:07.739063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:07.739063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] PATH_INFO: `/v3/projects/620b9ccce83d4fd1a85b07aec1d081a4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:07.739656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620b9ccce83d4fd1a85b07aec1d081a4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:07.739656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:07.885716 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:07.885716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620b9ccce83d4fd1a85b07aec1d081a4', 'request_id': 'req-10c29c1f-1c65-438e-9ad9-bb771a4b1456'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:07.898415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620b9ccce83d4fd1a85b07aec1d081a4', 'request_id': 'req-10c29c1f-1c65-438e-9ad9-bb771a4b1456'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:07.981489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620b9ccce83d4fd1a85b07aec1d081a4', 'request_id': 'req-10c29c1f-1c65-438e-9ad9-bb771a4b1456'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.020313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] The token cache is being invalidate because project 620b9ccce83d4fd1a85b07aec1d081a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:30:08.020595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.022868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.036718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2350/4678] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:30:07 2022] DELETE /identity/v3/projects/620b9ccce83d4fd1a85b07aec1d081a4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:08.037118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:08.039095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:08.067200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566ade7-f6c9-49de-952a-728fbc76e9a4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:08.254322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:08.255316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:08.255580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:08.256107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] PATH_INFO: `/v3/users/2d53dba800b04f2181e8c522abd98812` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:08.258092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d53dba800b04f2181e8c522abd98812)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:08.260271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:08.518749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d53dba800b04f2181e8c522abd98812'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.541363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d53dba800b04f2181e8c522abd98812'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.563309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d53dba800b04f2181e8c522abd98812'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.567213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d53dba800b04f2181e8c522abd98812'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.649158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e71f86f-1278-4be8-8e8a-72789f3d0824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d53dba800b04f2181e8c522abd98812'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.660491 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2329/4679] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:30:08 2022] DELETE /identity/v3/users/2d53dba800b04f2181e8c522abd98812 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:08.660666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:08.661630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:08.677567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c29c1f-1c65-438e-9ad9-bb771a4b1456 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:08.778936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:08.780515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:08.780964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:08.781387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] PATH_INFO: `/v3/projects/d0b8fa98ef434360bdebdb0976045168` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:08.783307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b8fa98ef434360bdebdb0976045168)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:08.787210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:08.975543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b8fa98ef434360bdebdb0976045168', 'request_id': 'req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:08.989431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b8fa98ef434360bdebdb0976045168', 'request_id': 'req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.069248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b8fa98ef434360bdebdb0976045168', 'request_id': 'req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.098868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] The token cache is being invalidate because project d0b8fa98ef434360bdebdb0976045168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:30:09.099227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.099994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-20f6e0d4-7aca-4b5c-8e9c-4bc52222ed8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.105513 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2351/4680] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:30:08 2022] DELETE /identity/v3/projects/d0b8fa98ef434360bdebdb0976045168 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:09.107209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3d38-9632-452c-8d4b-7b2ebae3c829 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:09.107693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3d38-9632-452c-8d4b-7b2ebae3c829 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:09.107826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3d38-9632-452c-8d4b-7b2ebae3c829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:09.139011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4efb3d38-9632-452c-8d4b-7b2ebae3c829 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:09.140467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4efb3d38-9632-452c-8d4b-7b2ebae3c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:09.147748 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:09.280795 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2330/4681] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:09.289727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:09.294830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:09.294830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:09.316388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:09.318356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:09.326110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2352/4682] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:09.330369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb3d38-9632-452c-8d4b-7b2ebae3c829 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:09.341126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb3d38-9632-452c-8d4b-7b2ebae3c829 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:09.349391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:09.349391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:09.349391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:09.349391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:09.350150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:30:09.350555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:09.352261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:09.364535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:09.368388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:09.398250 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2331/4683] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:30:09.403027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:09.441735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8412f-307f-42eb-be8b-0b70cd9eac97 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:09.461896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c8eec-0a4d-432c-8938-6f2a3355af7e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:09.463201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:09.466061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:09.466356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:09.466623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] PATH_INFO: `/v3/projects/42762ae298104cd59ac61a65d6b9b1b3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:09.467567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:09.468175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:09.468324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=42762ae298104cd59ac61a65d6b9b1b3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:09.468447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:09.468709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:09.469389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:09.471324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:09.476712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:09.578531 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2332/4684] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:30:09 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:09.583474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:09.625497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42762ae298104cd59ac61a65d6b9b1b3', 'request_id': 'req-f8170150-44dd-40ca-9a4b-7026a790aeba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.652271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42762ae298104cd59ac61a65d6b9b1b3', 'request_id': 'req-f8170150-44dd-40ca-9a4b-7026a790aeba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.654648 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:09.678281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86a03f-9f74-4c1d-abaa-aecef025b882 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:09.748369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42762ae298104cd59ac61a65d6b9b1b3', 'request_id': 'req-f8170150-44dd-40ca-9a4b-7026a790aeba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.765201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] The token cache is being invalidate because project 42762ae298104cd59ac61a65d6b9b1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:30:09.765509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.769027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f8170150-44dd-40ca-9a4b-7026a790aeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:09.775785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2353/4685] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:30:09 2022] DELETE /identity/v3/projects/42762ae298104cd59ac61a65d6b9b1b3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:09.781664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef83c16-2dae-4860-b165-a25ba15ddb3c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:09.781988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef83c16-2dae-4860-b165-a25ba15ddb3c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:09.782323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef83c16-2dae-4860-b165-a25ba15ddb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.041755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.041755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.041755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.041755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.052235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.052235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.053264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8ef83c16-2dae-4860-b165-a25ba15ddb3c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:10.053264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ef83c16-2dae-4860-b165-a25ba15ddb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:10.053264 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2354/4686] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:30:10.053264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69493743-1e7e-4ab3-8226-907b54c3a83e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.053264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69493743-1e7e-4ab3-8226-907b54c3a83e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.053264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69493743-1e7e-4ab3-8226-907b54c3a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.054798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-69493743-1e7e-4ab3-8226-907b54c3a83e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:10.054798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-69493743-1e7e-4ab3-8226-907b54c3a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:10.054798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2355/4687] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:10.054798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69493743-1e7e-4ab3-8226-907b54c3a83e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.054798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69493743-1e7e-4ab3-8226-907b54c3a83e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.055469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.055469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.055469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.055469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.055842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:30:10.055842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.055842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.055842 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2356/4688] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:30:10.056225 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2333/4689] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:30:09 2022] POST /identity/v3/users => generated 289 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:10.056391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.056467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.056542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:10.056695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a5de-eadb-4968-8d0a-69c0f53b3e10 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.056695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.056919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d515-471b-4356-9618-b9504531c84a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.056994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.056994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.056994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.056994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.056994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.057480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.057480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.057480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.057480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.059653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.059653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.059855 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:10.059939 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2357/4690] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:10.059939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.059939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39919f5-d4ec-4e79-912c-9e47b2f0da4e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.059939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.060197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.060482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.060763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.061421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.063047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.077722 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2358/4691] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:10.087562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.100806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412313f0-29dd-48a3-9081-6fd9320aec59 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.109225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaff34-8fd5-476f-aa34-b294d5c99683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.110165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaff34-8fd5-476f-aa34-b294d5c99683 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.110543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaff34-8fd5-476f-aa34-b294d5c99683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.110891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaff34-8fd5-476f-aa34-b294d5c99683 admin admin] PATH_INFO: `/v3/projects/53a45221073d4858a67b9b00d10c636d/users/0295ff794d8e40c7bbe4e0dead2686d3/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.132085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaff34-8fd5-476f-aa34-b294d5c99683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a45221073d4858a67b9b00d10c636d, user_id=0295ff794d8e40c7bbe4e0dead2686d3, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.135159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaff34-8fd5-476f-aa34-b294d5c99683 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.234891 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2334/4692] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:30:09 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:10.236427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.290744 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2359/4693] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:10 2022] PUT /identity/v3/projects/53a45221073d4858a67b9b00d10c636d/users/0295ff794d8e40c7bbe4e0dead2686d3/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:30:10.296957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596099-d4d0-4196-bedd-aa9a4b8dd34e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.297256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596099-d4d0-4196-bedd-aa9a4b8dd34e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.297539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0596099-d4d0-4196-bedd-aa9a4b8dd34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.339872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b0596099-d4d0-4196-bedd-aa9a4b8dd34e None None] MFA Rules not processed for user `0295ff794d8e40c7bbe4e0dead2686d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:10.341293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b0596099-d4d0-4196-bedd-aa9a4b8dd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:10.359840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c554b-9d6c-4060-aabb-db8ba61ebbb6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.462833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.463733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.464164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.464603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.465366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.468140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.498146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2360/4694] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:30:10.502442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0596099-d4d0-4196-bedd-aa9a4b8dd34e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.516497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0596099-d4d0-4196-bedd-aa9a4b8dd34e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.523258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.524223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.524563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.524854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.525481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.527688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.568901 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2335/4695] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:30:10 2022] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:10.580796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.604309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f053-d453-4f2e-9f3b-cb135889cbcf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.613714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.615351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.615629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.616067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.617461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.618380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.632887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2336/4696] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:10.635809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.651963 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2361/4697] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:30:10 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:10.655722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.657121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58bc99-e956-4298-9da0-f8c4d61f18e5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.766469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.770158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.770821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.771298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.772747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.774929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.780100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeaf2d-7c04-4e25-a783-b2c746fe42e2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.785906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.786832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.787057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.787404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.788060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.790195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.794166 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2337/4698] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:30:10.799082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.813003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3e34-7638-47e3-bf27-9cd6f602d7f9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.819726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a2b17-dc6a-4d46-a5c4-ca103183bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.820471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2b17-dc6a-4d46-a5c4-ca103183bee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.820804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2b17-dc6a-4d46-a5c4-ca103183bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.821085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2b17-dc6a-4d46-a5c4-ca103183bee3 admin admin] PATH_INFO: `/v3/projects/7fc445099f9f44d894a034409709cd4d/users/991a745818694b54bb51edb8174592a9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.860823 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:10.875901 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:10.884479 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2362/4699] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:30:10 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:10.886775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a2b17-dc6a-4d46-a5c4-ca103183bee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc445099f9f44d894a034409709cd4d, user_id=991a745818694b54bb51edb8174592a9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.888658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:10.915721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a2b17-dc6a-4d46-a5c4-ca103183bee3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:10.958772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53efd-6136-4479-8d56-e0228cac4f8a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:10.965132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:10.966120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:10.967937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:10.968433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:10.969853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:10.976718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.001252 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2363/4700] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:11.006016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.025734 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2338/4701] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:10 2022] PUT /identity/v3/projects/7fc445099f9f44d894a034409709cd4d/users/991a745818694b54bb51edb8174592a9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:11.027695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01838-5bb1-44cc-a223-f87811e9fa23 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.027990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01838-5bb1-44cc-a223-f87811e9fa23 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.028259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca01838-5bb1-44cc-a223-f87811e9fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.043631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ccc83-e5cb-4d04-872a-01bf93c2a0c9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.120737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aca01838-5bb1-44cc-a223-f87811e9fa23 None None] MFA Rules not processed for user `991a745818694b54bb51edb8174592a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:11.122080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aca01838-5bb1-44cc-a223-f87811e9fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:11.153903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.154693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.155066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.155420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] PATH_INFO: `/v3/projects/d85cab8124aa4519bfa154712c2c2aa1/users/7bffc0fd82e242a99e7061aabf089eb6/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.184987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85cab8124aa4519bfa154712c2c2aa1, user_id=7bffc0fd82e242a99e7061aabf089eb6, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.188957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.215407 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2339/4702] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:11.222002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01838-5bb1-44cc-a223-f87811e9fa23 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.239006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca01838-5bb1-44cc-a223-f87811e9fa23 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.247185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.248636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.249095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.249510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.250501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.254475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.333942 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2364/4703] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:11 2022] PUT /identity/v3/projects/d85cab8124aa4519bfa154712c2c2aa1/users/7bffc0fd82e242a99e7061aabf089eb6/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:11.337552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.369800 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2340/4704] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:30:11 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:11.381884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.427583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96f51-8be6-4900-93ec-db9c0763352d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.517084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.518253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.519496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.519788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.520492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.523059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e124cf5-e3c9-4f79-ac69-8f450161d7bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.528085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.528262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.529013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.529307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.529585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.530305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.532649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.562882 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2365/4705] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:11.562882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.573688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7bb12-ea1e-4852-bfe3-a8f70c9a7dde admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.581785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624a74-38e4-4145-bbf8-4fd83ba38468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.582945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624a74-38e4-4145-bbf8-4fd83ba38468 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.584005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624a74-38e4-4145-bbf8-4fd83ba38468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.584386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624a74-38e4-4145-bbf8-4fd83ba38468 admin admin] PATH_INFO: `/v3/projects/d85cab8124aa4519bfa154712c2c2aa1/users/7bffc0fd82e242a99e7061aabf089eb6/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.587794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624a74-38e4-4145-bbf8-4fd83ba38468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85cab8124aa4519bfa154712c2c2aa1, user_id=7bffc0fd82e242a99e7061aabf089eb6, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.593222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624a74-38e4-4145-bbf8-4fd83ba38468 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.619866 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2341/4706] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:30:11 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:11.623536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.638596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2366/4707] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:11 2022] PUT /identity/v3/projects/d85cab8124aa4519bfa154712c2c2aa1/users/7bffc0fd82e242a99e7061aabf089eb6/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:30:11.640829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.641091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.641497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.651990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dd8af-40a8-46fe-b288-dd21d0c27311 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.679072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] MFA Rules not processed for user `7bffc0fd82e242a99e7061aabf089eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:11.680625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:11.748319 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:11.763179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.763954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.764372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.764740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.765578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.767656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.783562 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2342/4708] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:30:11.785489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.802258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0dd6c-73bf-4b2f-8062-9c81c09fb44f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.807561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.808341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.808721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.809088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.810033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.812217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:11.821396 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:11.830410 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2343/4709] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:11.832038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.843248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5152-7fda-4e3b-85e0-d7b75240c602 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:11.851281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2b16e-3502-46a3-8083-91b13ec864cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:11.852198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2b16e-3502-46a3-8083-91b13ec864cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:11.852609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2b16e-3502-46a3-8083-91b13ec864cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:11.852953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2b16e-3502-46a3-8083-91b13ec864cb admin admin] PATH_INFO: `/v3/projects/64b25f595ad14cb483bc4798271937f4/users/d641a406403d4e0aa35af4a6b68d7eae/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:11.878421 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2367/4710] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:11.889730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:11.891792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:11.897321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2b16e-3502-46a3-8083-91b13ec864cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b25f595ad14cb483bc4798271937f4, user_id=d641a406403d4e0aa35af4a6b68d7eae, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:11.900693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2b16e-3502-46a3-8083-91b13ec864cb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:12.001455 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2344/4711] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:11 2022] PUT /identity/v3/projects/64b25f595ad14cb483bc4798271937f4/users/d641a406403d4e0aa35af4a6b68d7eae/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:12.004134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cab078-3c4c-4bfe-853e-c35e801a0d82 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:12.004134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cab078-3c4c-4bfe-853e-c35e801a0d82 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:12.004418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cab078-3c4c-4bfe-853e-c35e801a0d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:12.022435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0ec32-63a8-4281-8de0-6c06031f4b44 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:12.038627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b2cab078-3c4c-4bfe-853e-c35e801a0d82 None None] MFA Rules not processed for user `d641a406403d4e0aa35af4a6b68d7eae`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:12.040850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2cab078-3c4c-4bfe-853e-c35e801a0d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:12.095593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:12.100020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:12.100020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:12.100020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:12.142846 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2345/4712] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:12.145353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cab078-3c4c-4bfe-853e-c35e801a0d82 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:12.177030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:12.178847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:12.190410 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2368/4713] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:30:12.315731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cab078-3c4c-4bfe-853e-c35e801a0d82 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:12.327245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:12.329189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:12.329581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:12.331906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:12.331906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:12.339138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:12.458275 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2346/4714] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:30:12 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:12.461616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:12.482856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb6fe-99b3-4f28-ab85-624dca317d8c service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:12.563562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:12.564520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:12.564917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:12.565298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:12.566650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:12.569354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:12.580882 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:12.720209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:12.731516 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2369/4715] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:30:12 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:12.735389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817430b-a884-4a46-9141-a2804913e723 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:12.767425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:12.769615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:12.769615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:12.775230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:12.775230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:12.775581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:12.819261 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2347/4716] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:12.823530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:12.835595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ac9ee-f897-45b4-9c73-17dda74dc748 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:12.841511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:12.842645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:12.843074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:12.843596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] PATH_INFO: `/v3/projects/22555d7b786c472d83167ce25a7b7b9c/users/e993f5b2ae164d02afc472ec79d27221/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:12.883878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22555d7b786c472d83167ce25a7b7b9c, user_id=e993f5b2ae164d02afc472ec79d27221, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:12.884636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:13.058334 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2370/4717] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:12 2022] PUT /identity/v3/projects/22555d7b786c472d83167ce25a7b7b9c/users/e993f5b2ae164d02afc472ec79d27221/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:13.062084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:13.081983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3379d1-6c8a-4a02-b208-898933099cdb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:13.104106 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:13.223893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b17e-eef3-4757-b8e3-13799813c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:13.236925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b17e-eef3-4757-b8e3-13799813c25a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:13.242160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b17e-eef3-4757-b8e3-13799813c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:13.242513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b17e-eef3-4757-b8e3-13799813c25a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:13.245957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b17e-eef3-4757-b8e3-13799813c25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:13.250767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b17e-eef3-4757-b8e3-13799813c25a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:13.285929 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2348/4718] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:30:13.287190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:13.305059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9db9-ede6-462b-8b0f-be2732127a9f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:13.320546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:13.321315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:13.321749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:13.322051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] PATH_INFO: `/v3/projects/22555d7b786c472d83167ce25a7b7b9c/users/e993f5b2ae164d02afc472ec79d27221/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:13.327237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22555d7b786c472d83167ce25a7b7b9c, user_id=e993f5b2ae164d02afc472ec79d27221, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:13.333802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:13.388918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2371/4719] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:13 2022] PUT /identity/v3/projects/22555d7b786c472d83167ce25a7b7b9c/users/e993f5b2ae164d02afc472ec79d27221/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:13.391117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a3df-0cb6-4716-b1a4-81cabb56f3a7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:13.391117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a3df-0cb6-4716-b1a4-81cabb56f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:13.391571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039a3df-0cb6-4716-b1a4-81cabb56f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:13.520952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2039a3df-0cb6-4716-b1a4-81cabb56f3a7 None None] MFA Rules not processed for user `e993f5b2ae164d02afc472ec79d27221`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:13.528865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2039a3df-0cb6-4716-b1a4-81cabb56f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:13.896723 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2349/4720] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:13.929252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:14.127421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0721a-a670-40e9-831d-763ad53c5c5b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:14.133986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:14.134680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:14.135335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:14.135335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:14.265919 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:14.306972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:14.308539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:14.323951 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2372/4721] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:30:15.880451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:15.881005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:15.881180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:15.917011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:15.919706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:16.016976 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2350/4722] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:16.031289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:16.033399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:16.141290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6381f-fe82-4198-9002-3a3387bf15cb service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:16.156142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:16.156811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:16.157092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:16.157366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:16.168400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:16.170664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:16.181452 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2373/4723] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:30:19.101604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:19.103548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:19.134684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c8cc0-9e09-45dd-ac30-45496fdb2fa2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:19.153438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:19.154400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:19.154824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:19.155236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:19.290245 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:19.338778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:19.339869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:19.353200 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2351/4724] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:30:21.438865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:21.452516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6091b8-2de8-4562-af42-ec85c179a8f3 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:21.457944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:21.458807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:21.459296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:21.459814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:21.561527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:21.563381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:21.583404 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2374/4725] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:30:22.146872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:22.158076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556792b-adfe-4a7b-bef7-290bf8f25a02 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:22.167913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22904a61-e8f8-44b1-a495-a3a1f55de8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:22.168821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904a61-e8f8-44b1-a495-a3a1f55de8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:22.169584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904a61-e8f8-44b1-a495-a3a1f55de8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:22.170090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904a61-e8f8-44b1-a495-a3a1f55de8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:22.198507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22904a61-e8f8-44b1-a495-a3a1f55de8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:22.202325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22904a61-e8f8-44b1-a495-a3a1f55de8e1 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:22.224615 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2352/4726] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:30:31.575381 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=75 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:32.219533 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=17 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:37.835395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:38.064788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8227cb3-054e-400a-b811-92aa370d1580 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:38.076565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:38.077542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:38.078440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:38.078811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] PATH_INFO: `/v3/users/991a745818694b54bb51edb8174592a9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:38.080604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991a745818694b54bb51edb8174592a9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:38.085756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:38.367970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991a745818694b54bb51edb8174592a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:38.370699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991a745818694b54bb51edb8174592a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:38.509644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991a745818694b54bb51edb8174592a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:38.541404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991a745818694b54bb51edb8174592a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:38.543845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991a745818694b54bb51edb8174592a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:38.601774 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2375/4727] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:30:37 2022] DELETE /identity/v3/users/991a745818694b54bb51edb8174592a9 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:38.606449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:38.606925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:38.607017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:38.696345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:38.714930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:38.877077 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2353/4728] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:38.901730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:38.903218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:39.110919 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:39.153573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8546084-ffef-492c-b2bc-8b822e8e3cb3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:39.157172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:39.158120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:39.196038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:39.196883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:39.243087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:39.258419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:39.300574 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2376/4729] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:30:40.234334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:40.243640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:40.282842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfedf0-de14-42fd-b034-11fd98e762da None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:40.310904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:40.311388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:40.311723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:40.311868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] PATH_INFO: `/v3/projects/7fc445099f9f44d894a034409709cd4d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:40.320988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc445099f9f44d894a034409709cd4d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:40.323905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:40.648652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc445099f9f44d894a034409709cd4d', 'request_id': 'req-0cd0ea8b-0674-4884-b652-9184c8091802'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:40.661256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc445099f9f44d894a034409709cd4d', 'request_id': 'req-0cd0ea8b-0674-4884-b652-9184c8091802'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.047404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc445099f9f44d894a034409709cd4d', 'request_id': 'req-0cd0ea8b-0674-4884-b652-9184c8091802'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.047404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] The token cache is being invalidate because project 7fc445099f9f44d894a034409709cd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:30:41.047404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.047404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0cd0ea8b-0674-4884-b652-9184c8091802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.047404 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2354/4730] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:30:40 2022] DELETE /identity/v3/projects/7fc445099f9f44d894a034409709cd4d => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:41.048372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:41.063474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41117a-795d-43c7-ab06-5047abae0a55 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:41.149192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:41.149925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:41.150502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:41.150502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] PATH_INFO: `/v3/users/d641a406403d4e0aa35af4a6b68d7eae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:41.151633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d641a406403d4e0aa35af4a6b68d7eae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:41.153569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:41.562966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd641a406403d4e0aa35af4a6b68d7eae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.564807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd641a406403d4e0aa35af4a6b68d7eae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.713475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd641a406403d4e0aa35af4a6b68d7eae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.719228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd641a406403d4e0aa35af4a6b68d7eae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.720046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd641a406403d4e0aa35af4a6b68d7eae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:41.747503 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2377/4731] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:30:41 2022] DELETE /identity/v3/users/d641a406403d4e0aa35af4a6b68d7eae => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:42.519438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:42.519438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:42.519438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:42.592729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:42.595724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:42.708822 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2355/4732] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:30:42.732079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:42.734213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:42.747853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:42.749621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:42.807688 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:42.847547 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:42.856697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d300044-a45e-4414-b67c-e1d99603642e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:42.864297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:42.866387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:42.867040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:42.869408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:42.911201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:42.914696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:42.942034 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2378/4733] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:30:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:30:42.966140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252bebb-dc0e-4983-b82b-2a86ea4d3120 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:42.978158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:42.981225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:42.981366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:42.981578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] PATH_INFO: `/v3/projects/64b25f595ad14cb483bc4798271937f4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:43.002715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b25f595ad14cb483bc4798271937f4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:43.002715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:43.135085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b25f595ad14cb483bc4798271937f4', 'request_id': 'req-51c99d84-957c-4c1e-8bcc-275c174847c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:43.162264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b25f595ad14cb483bc4798271937f4', 'request_id': 'req-51c99d84-957c-4c1e-8bcc-275c174847c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:43.252347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b25f595ad14cb483bc4798271937f4', 'request_id': 'req-51c99d84-957c-4c1e-8bcc-275c174847c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:43.308121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] The token cache is being invalidate because project 64b25f595ad14cb483bc4798271937f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:30:43.308507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:43.311741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:43.320585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2356/4734] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:30:42 2022] DELETE /identity/v3/projects/64b25f595ad14cb483bc4798271937f4 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:43.327987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:43.362990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e87de-c7af-4739-a9ba-40164b1bd40a service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:43.613921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:43.615680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:43.617109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:43.617400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] PATH_INFO: `/v3/users/e993f5b2ae164d02afc472ec79d27221` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:43.626665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e993f5b2ae164d02afc472ec79d27221)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:43.628761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:43.892687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e993f5b2ae164d02afc472ec79d27221'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:43.896798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e993f5b2ae164d02afc472ec79d27221'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:44.016684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e993f5b2ae164d02afc472ec79d27221'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:44.030825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e993f5b2ae164d02afc472ec79d27221'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:44.031668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-be612257-2ff6-4f59-bdac-d1a2ad7e4333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e993f5b2ae164d02afc472ec79d27221'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:44.070504 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2379/4735] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:30:43 2022] DELETE /identity/v3/users/e993f5b2ae164d02afc472ec79d27221 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:44.663185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:44.664770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:44.701214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c99d84-957c-4c1e-8bcc-275c174847c1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:44.782943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:44.783893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:44.784154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:44.785201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] PATH_INFO: `/v3/projects/22555d7b786c472d83167ce25a7b7b9c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:44.786430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22555d7b786c472d83167ce25a7b7b9c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:44.789337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:44.918166 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:44.921798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22555d7b786c472d83167ce25a7b7b9c', 'request_id': 'req-ef1c856c-0cdc-4783-af15-cecff8def98d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:44.929604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22555d7b786c472d83167ce25a7b7b9c', 'request_id': 'req-ef1c856c-0cdc-4783-af15-cecff8def98d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:45.103925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22555d7b786c472d83167ce25a7b7b9c', 'request_id': 'req-ef1c856c-0cdc-4783-af15-cecff8def98d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:45.124719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] The token cache is being invalidate because project 22555d7b786c472d83167ce25a7b7b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:30:45.125021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:45.127771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ef1c856c-0cdc-4783-af15-cecff8def98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:30:45.133827 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2357/4736] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:30:44 2022] DELETE /identity/v3/projects/22555d7b786c472d83167ce25a7b7b9c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:30:45.134995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8b0d-bc78-40bc-977a-bc09d9799fcd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:45.135464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8b0d-bc78-40bc-977a-bc09d9799fcd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:45.135541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea8b0d-bc78-40bc-977a-bc09d9799fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:45.173054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f3ea8b0d-bc78-40bc-977a-bc09d9799fcd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:45.174403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f3ea8b0d-bc78-40bc-977a-bc09d9799fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:45.339350 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2380/4737] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:45.342923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff56c-fb7c-409b-9300-25026bdfaefd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:45.347910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff56c-fb7c-409b-9300-25026bdfaefd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:45.347910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccff56c-fb7c-409b-9300-25026bdfaefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:45.398718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5ccff56c-fb7c-409b-9300-25026bdfaefd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:45.416775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5ccff56c-fb7c-409b-9300-25026bdfaefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:45.454024 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2358/4738] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:45.460880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8b0d-bc78-40bc-977a-bc09d9799fcd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:45.468987 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:45.479587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea8b0d-bc78-40bc-977a-bc09d9799fcd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:45.493768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:45.497484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:45.498989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:45.502162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:45.504625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:30:45.510919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:45.515624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:45.550743 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2381/4739] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:30:45.555346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccff56c-fb7c-409b-9300-25026bdfaefd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:45.572983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccff56c-fb7c-409b-9300-25026bdfaefd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:45.578525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f3fb5-dd9b-4fcb-8215-0fdf6cbabad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:45.579992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3fb5-dd9b-4fcb-8215-0fdf6cbabad4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:45.579992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3fb5-dd9b-4fcb-8215-0fdf6cbabad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:45.583306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f3fb5-dd9b-4fcb-8215-0fdf6cbabad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:45.584340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3fb5-dd9b-4fcb-8215-0fdf6cbabad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:45.588244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f3fb5-dd9b-4fcb-8215-0fdf6cbabad4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:45.712572 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2359/4740] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:30:45 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:45.715737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:45.731333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01950-c97f-46e5-bf8b-cc6375b04445 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:45.825172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:45.825800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:45.826139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:45.826601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:45.827343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:45.829310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:45.939858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:45.940156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:45.940465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:45.949631 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2382/4741] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:30:45 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:30:45.954555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:45.971003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7b50-bf7f-42ee-8d73-1e567cb1ad12 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:45.978937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:45.979812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:45.980300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:45.980728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:45.981420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:45.981698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:45.982683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:45.983680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:46.001443 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2383/4742] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:30:46.005437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:46.030070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d698b-0256-4048-9021-033974d45a0e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:46.046160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:46.046795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:46.047077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:46.047363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:46.048170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:46.050016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:46.089631 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2384/4743] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:30:46.093374 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2360/4744] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:30:46.109301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:46.110614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:46.112977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:46.122083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b4f2f-1b4f-42fb-87e1-4cf87d8b9b4d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:46.127510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2172-7e6b-401c-8098-24ce73732dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:46.129726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2172-7e6b-401c-8098-24ce73732dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:46.129726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2172-7e6b-401c-8098-24ce73732dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:46.129726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2172-7e6b-401c-8098-24ce73732dcd admin admin] PATH_INFO: `/v3/projects/27f074d61391492e81391b37ac207c4d/users/533ecba41d7f4b119ea20a5c6bdb5e73/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:46.148992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2172-7e6b-401c-8098-24ce73732dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f074d61391492e81391b37ac207c4d, user_id=533ecba41d7f4b119ea20a5c6bdb5e73, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:46.152688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2172-7e6b-401c-8098-24ce73732dcd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:46.225114 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2385/4745] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:30:46 2022] PUT /identity/v3/projects/27f074d61391492e81391b37ac207c4d/users/533ecba41d7f4b119ea20a5c6bdb5e73/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:30:46.242864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:46.243214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:46.243429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:46.298365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4acec6-fab8-4b7a-93a4-89baba276e1e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:46.300582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] MFA Rules not processed for user `533ecba41d7f4b119ea20a5c6bdb5e73`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:46.301837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:46.447151 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:46.455952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2386/4746] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:46.477521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:46.477521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:46.477890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:46.477890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:46.478721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:46.479631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:46.530281 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:30:46.625611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19251b47-d03e-4a8f-a395-bc3833d35ef2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:46.643413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc3e6d-315c-4395-81c6-55bb4d350b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:46.643413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3e6d-315c-4395-81c6-55bb4d350b7c service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:46.643413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3e6d-315c-4395-81c6-55bb4d350b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:46.643413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3e6d-315c-4395-81c6-55bb4d350b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:46.654874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc3e6d-315c-4395-81c6-55bb4d350b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:46.656873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc3e6d-315c-4395-81c6-55bb4d350b7c service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:46.668659 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2387/4747] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:30:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:30:46.671436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:46.676145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:46.686119 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2361/4748] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:30:47.953873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18dee-8dae-4857-b0b1-b9560dff7be4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:47.954851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18dee-8dae-4857-b0b1-b9560dff7be4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:47.955588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18dee-8dae-4857-b0b1-b9560dff7be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:47.983071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-45e18dee-8dae-4857-b0b1-b9560dff7be4 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:47.984579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-45e18dee-8dae-4857-b0b1-b9560dff7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:48.009341 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2388/4749] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:48.009720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:30:48.021619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572926cf-dea3-40e6-8ee7-76865bcbed6c service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:30:48.039698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126044d-585f-438e-9230-8dda2613064f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:30:48.053601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126044d-585f-438e-9230-8dda2613064f service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:48.053601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126044d-585f-438e-9230-8dda2613064f service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:48.053601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126044d-585f-438e-9230-8dda2613064f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:48.057625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126044d-585f-438e-9230-8dda2613064f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:30:48.059776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126044d-585f-438e-9230-8dda2613064f service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:30:48.071054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2362/4750] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:30:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:30:56.394264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2fc2-48c8-49f6-b324-474c0ee4ec42 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:30:56.394797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2fc2-48c8-49f6-b324-474c0ee4ec42 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:30:56.395003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e2fc2-48c8-49f6-b324-474c0ee4ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:30:56.442744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-902e2fc2-48c8-49f6-b324-474c0ee4ec42 None None] MFA Rules not processed for user `a239a0dd4451431aa7e3beea2d4b37aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:30:56.444420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-902e2fc2-48c8-49f6-b324-474c0ee4ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:30:56.532935 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2389/4751] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:30:58.071111 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=37 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:00.332461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126044d-585f-438e-9230-8dda2613064f service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:00.335356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6126044d-585f-438e-9230-8dda2613064f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:00.490179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126044d-585f-438e-9230-8dda2613064f service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:00.497186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:00.498092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:00.501702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:00.501702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:00.501702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:00.522028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:00.525692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:00.545286 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2363/4752] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:31:02.514145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e2fc2-48c8-49f6-b324-474c0ee4ec42 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:02.531961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e2fc2-48c8-49f6-b324-474c0ee4ec42 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:02.537309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabac7d-f6c0-40c1-9396-00872436162e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:02.537971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabac7d-f6c0-40c1-9396-00872436162e service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:02.538257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabac7d-f6c0-40c1-9396-00872436162e service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:02.538532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabac7d-f6c0-40c1-9396-00872436162e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:02.546911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabac7d-f6c0-40c1-9396-00872436162e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:02.548510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabac7d-f6c0-40c1-9396-00872436162e service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:02.558007 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2390/4753] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:31:06.523831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:06.525243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:06.683816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948584-ac9e-49ee-89dd-71b492f0919c service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:06.689993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:06.691734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:06.692341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:06.693217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] PATH_INFO: `/v3/users/0295ff794d8e40c7bbe4e0dead2686d3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:06.694538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0295ff794d8e40c7bbe4e0dead2686d3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:06.696760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:06.907957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0295ff794d8e40c7bbe4e0dead2686d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:06.938960 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:06.941674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0295ff794d8e40c7bbe4e0dead2686d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:06.955645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0295ff794d8e40c7bbe4e0dead2686d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:06.957380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0295ff794d8e40c7bbe4e0dead2686d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:07.080315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0295ff794d8e40c7bbe4e0dead2686d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:07.090427 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2364/4754] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:06 2022] DELETE /identity/v3/users/0295ff794d8e40c7bbe4e0dead2686d3 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:07.096760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:07.100199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:07.100636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:07.158954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:07.160320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:07.252765 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2391/4755] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:07.263511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:07.266262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:07.362191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b85ee7-af89-4ae7-a2ba-5b8d52ceb048 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:07.366954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:07.367587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:07.367873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:07.371307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:07.395050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:07.396513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:07.438195 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2365/4756] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:08.132372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:08.134162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:08.153996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ccfcf-7344-40d7-a850-6b45d3047ca1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:08.162108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:08.162887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:08.163344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:08.163818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] PATH_INFO: `/v3/projects/53a45221073d4858a67b9b00d10c636d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:08.165255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a45221073d4858a67b9b00d10c636d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:08.167496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:08.296294 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:08.304773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a45221073d4858a67b9b00d10c636d', 'request_id': 'req-8965c35f-4ae0-46ed-a03d-c6475bc9637e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.311566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a45221073d4858a67b9b00d10c636d', 'request_id': 'req-8965c35f-4ae0-46ed-a03d-c6475bc9637e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.370856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a45221073d4858a67b9b00d10c636d', 'request_id': 'req-8965c35f-4ae0-46ed-a03d-c6475bc9637e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.384407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] The token cache is being invalidate because project 53a45221073d4858a67b9b00d10c636d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:08.384710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.385378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.387070 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2392/4757] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:08 2022] DELETE /identity/v3/projects/53a45221073d4858a67b9b00d10c636d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:08.391387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:08.402387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb0e0-1ca7-4868-b94e-7bb567b7ebf3 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:08.475325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:08.475978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:08.476437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:08.476711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] PATH_INFO: `/v3/users/7bffc0fd82e242a99e7061aabf089eb6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:08.477887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bffc0fd82e242a99e7061aabf089eb6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:08.479929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:08.755801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bffc0fd82e242a99e7061aabf089eb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.821273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bffc0fd82e242a99e7061aabf089eb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.821273 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:08.829485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bffc0fd82e242a99e7061aabf089eb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.829485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bffc0fd82e242a99e7061aabf089eb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.917983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0f3d2d10-23c9-484f-aec4-95a08799ebaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bffc0fd82e242a99e7061aabf089eb6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:08.928700 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2366/4758] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:08 2022] DELETE /identity/v3/users/7bffc0fd82e242a99e7061aabf089eb6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:31:09.624883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:09.627037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:09.641581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965c35f-4ae0-46ed-a03d-c6475bc9637e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:09.711906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:09.712569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:09.712845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:09.713113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] PATH_INFO: `/v3/projects/d85cab8124aa4519bfa154712c2c2aa1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:09.714414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85cab8124aa4519bfa154712c2c2aa1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:09.716428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:09.837558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85cab8124aa4519bfa154712c2c2aa1', 'request_id': 'req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:09.844706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85cab8124aa4519bfa154712c2c2aa1', 'request_id': 'req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:09.959468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85cab8124aa4519bfa154712c2c2aa1', 'request_id': 'req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:09.973243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] The token cache is being invalidate because project d85cab8124aa4519bfa154712c2c2aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:09.973728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:09.974845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:09.976470 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2393/4759] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:09 2022] DELETE /identity/v3/projects/d85cab8124aa4519bfa154712c2c2aa1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:09.981940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee86ac-8b53-4551-a99d-99e733f64aa2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:09.985205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee86ac-8b53-4551-a99d-99e733f64aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:09.985205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee86ac-8b53-4551-a99d-99e733f64aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.028598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2bee86ac-8b53-4551-a99d-99e733f64aa2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:10.030014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2bee86ac-8b53-4551-a99d-99e733f64aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:10.066178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:10.074057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:10.113440 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2367/4760] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:10.126432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf38d9c-f61e-40b9-b887-8d9909dd135d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.126432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf38d9c-f61e-40b9-b887-8d9909dd135d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.126698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf38d9c-f61e-40b9-b887-8d9909dd135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.162266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ebf38d9c-f61e-40b9-b887-8d9909dd135d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:10.163564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ebf38d9c-f61e-40b9-b887-8d9909dd135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:10.175096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2368/4761] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:10.179037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224530-9a99-4cc1-9df4-39ee1f9de5b2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:10.181137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf38d9c-f61e-40b9-b887-8d9909dd135d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:10.183999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:10.184614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.185079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.185361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.187443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:10.192383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf38d9c-f61e-40b9-b887-8d9909dd135d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:10.197556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:10.198266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.198548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.198824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.199485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:31:10.199911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:10.201550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:10.202434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:10.204063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:10.211115 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:10.215030 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2369/4762] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:31:10.217342 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2394/4763] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:31:10.219449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:10.233637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555d0c-8c18-46b0-8802-80e6b7d3c789 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:10.239500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:10.240160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.240534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.240840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.241619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:10.244140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:10.341871 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2370/4764] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:10 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:10.344857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:10.355816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d07660-0845-40a0-b584-c96670b303f6 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:10.453914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:10.455029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.455368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.455619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.456359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:10.458589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:10.569536 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2395/4765] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:10 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:10.570845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:10.590882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd123b-a9e9-47fa-a0c5-e1db70ccffeb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:10.596057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:10.596678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.597796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.598119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.598947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:10.600632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:10.613329 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2371/4766] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:10.617796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:10.632083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437fd61-0e6a-4a11-a611-bb3c954c9cc6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:10.635762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d2434-46e9-46e9-b181-925949e377bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:10.636799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d2434-46e9-46e9-b181-925949e377bb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.637084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d2434-46e9-46e9-b181-925949e377bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.637358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d2434-46e9-46e9-b181-925949e377bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.638090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d2434-46e9-46e9-b181-925949e377bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:10.639821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d2434-46e9-46e9-b181-925949e377bb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:10.655582 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2396/4767] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:10.656492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:10.668365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e3604-573d-45aa-aaee-dbfb143c1b98 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:10.689607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:10.690335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.691607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.691809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] PATH_INFO: `/v3/projects/8080264be3e941df8bb9ad86adb6e944/users/8ccd2c4c631f412695262edd8ba5911d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:10.712964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8080264be3e941df8bb9ad86adb6e944, user_id=8ccd2c4c631f412695262edd8ba5911d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:10.715723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:10.871502 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2372/4768] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:10 2022] PUT /identity/v3/projects/8080264be3e941df8bb9ad86adb6e944/users/8ccd2c4c631f412695262edd8ba5911d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:31:10.985956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5c800-90a2-4263-924f-5e8cff7fb241 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:10.992949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5c800-90a2-4263-924f-5e8cff7fb241 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:10.992949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5c800-90a2-4263-924f-5e8cff7fb241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:11.023424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ddb5c800-90a2-4263-924f-5e8cff7fb241 None None] MFA Rules not processed for user `8ccd2c4c631f412695262edd8ba5911d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:11.025087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ddb5c800-90a2-4263-924f-5e8cff7fb241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:11.119075 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2397/4769] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:11.123362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:11.208269 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:11.213194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33d7e-4d82-4528-9441-cc214170d018 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:11.218260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:11.219065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:11.219489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:11.219773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:11.220786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:11.223894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:11.365375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2373/4770] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:11 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:11.366907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5c800-90a2-4263-924f-5e8cff7fb241 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:11.379121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5c800-90a2-4263-924f-5e8cff7fb241 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:11.485990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:11.486693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:11.487043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:11.488652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:11.489437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:11.498131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:11.590114 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:11.601189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2398/4771] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:11 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:11.604073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:11.636750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea603c-1fbe-4b41-b3b9-0dc258b6ef06 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:11.647783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:11.648922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:11.650064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:11.650876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:11.652045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:11.654237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:11.677522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:11.678176 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2374/4772] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:11.695308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90c43-b088-4d64-bc3d-8232d34a84e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:11.703600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:11.704285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:11.704658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:11.705014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] PATH_INFO: `/v3/projects/eb351f1f85d941619286a2a3d2744651/users/029151d4e12548289a29174a81d337d8/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:11.732145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb351f1f85d941619286a2a3d2744651, user_id=029151d4e12548289a29174a81d337d8, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:11.736244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:11.827215 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2399/4773] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:11 2022] PUT /identity/v3/projects/eb351f1f85d941619286a2a3d2744651/users/029151d4e12548289a29174a81d337d8/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:11.831108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:11.847075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022d4c-d11c-4d3a-b854-e7b7ce920627 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:11.971268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be7fc8-d341-4b44-b2e8-87317fdeb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:11.972639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7fc8-d341-4b44-b2e8-87317fdeb616 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:11.973237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7fc8-d341-4b44-b2e8-87317fdeb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:11.975351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7fc8-d341-4b44-b2e8-87317fdeb616 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:11.976635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be7fc8-d341-4b44-b2e8-87317fdeb616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:11.978982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be7fc8-d341-4b44-b2e8-87317fdeb616 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:11.995626 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2375/4774] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:12.008528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:12.026245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10def01-b2a1-485b-bf17-58c58716a9d0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:12.033931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:12.035137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:12.035589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:12.035929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] PATH_INFO: `/v3/projects/eb351f1f85d941619286a2a3d2744651/users/029151d4e12548289a29174a81d337d8/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:12.040091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb351f1f85d941619286a2a3d2744651, user_id=029151d4e12548289a29174a81d337d8, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:12.047012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:12.066991 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2400/4775] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:12 2022] PUT /identity/v3/projects/eb351f1f85d941619286a2a3d2744651/users/029151d4e12548289a29174a81d337d8/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:12.078991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54782f-44a7-4be5-8111-e7ac5d8da81a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:12.079707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54782f-44a7-4be5-8111-e7ac5d8da81a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:12.080077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54782f-44a7-4be5-8111-e7ac5d8da81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:12.125916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cf54782f-44a7-4be5-8111-e7ac5d8da81a None None] MFA Rules not processed for user `029151d4e12548289a29174a81d337d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:12.127776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cf54782f-44a7-4be5-8111-e7ac5d8da81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:12.236938 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2376/4776] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:12.247513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:12.249751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:12.356191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167713e-5b92-415c-8d9c-ed0370206d48 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:12.370498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c4ee-f617-4d67-b29b-d14536e550b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:12.371239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c4ee-f617-4d67-b29b-d14536e550b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:12.371592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c4ee-f617-4d67-b29b-d14536e550b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:12.371936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c4ee-f617-4d67-b29b-d14536e550b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:12.384067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c4ee-f617-4d67-b29b-d14536e550b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:12.385537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c4ee-f617-4d67-b29b-d14536e550b0 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:12.430520 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2401/4777] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:13.345920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54782f-44a7-4be5-8111-e7ac5d8da81a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:13.431412 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:13.454458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54782f-44a7-4be5-8111-e7ac5d8da81a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:13.469119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:13.471864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:13.471864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:13.471864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] PATH_INFO: `/v3/users/8ccd2c4c631f412695262edd8ba5911d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:13.471864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ccd2c4c631f412695262edd8ba5911d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:13.476115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:13.829328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ccd2c4c631f412695262edd8ba5911d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:13.861692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ccd2c4c631f412695262edd8ba5911d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:13.883623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ccd2c4c631f412695262edd8ba5911d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:13.884462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ccd2c4c631f412695262edd8ba5911d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:13.993248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ccd2c4c631f412695262edd8ba5911d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:14.024009 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2377/4778] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:13 2022] DELETE /identity/v3/users/8ccd2c4c631f412695262edd8ba5911d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:31:14.030269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:14.030722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:14.030722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:14.085144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:14.086917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:14.235580 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2402/4779] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:14.256778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:14.258507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:14.398510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd1b-45d9-4803-a405-ca0596c65c32 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:14.418704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:14.418704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:14.418704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:14.418965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:14.445004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:14.446604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:14.476596 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2378/4780] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:15.276460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:15.279267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:15.291863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7138-62a3-42d7-a3d4-1cc852e04d2a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:15.298456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:15.300733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:15.301257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:15.301697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] PATH_INFO: `/v3/projects/8080264be3e941df8bb9ad86adb6e944` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:15.303082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8080264be3e941df8bb9ad86adb6e944)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:15.306179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:15.524516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8080264be3e941df8bb9ad86adb6e944', 'request_id': 'req-997e205b-6a81-4104-a958-fbda6632041e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:15.524516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8080264be3e941df8bb9ad86adb6e944', 'request_id': 'req-997e205b-6a81-4104-a958-fbda6632041e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:15.524516 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:15.616912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8080264be3e941df8bb9ad86adb6e944', 'request_id': 'req-997e205b-6a81-4104-a958-fbda6632041e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:15.631130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] The token cache is being invalidate because project 8080264be3e941df8bb9ad86adb6e944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:15.631430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:15.632973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:15.634726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2403/4781] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:15 2022] DELETE /identity/v3/projects/8080264be3e941df8bb9ad86adb6e944 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:15.638883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:15.649987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd2a30-d8bf-441c-b25e-c56f9ef789fd service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:15.738499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:15.740051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:15.740576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:15.741120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] PATH_INFO: `/v3/users/029151d4e12548289a29174a81d337d8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:15.743620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029151d4e12548289a29174a81d337d8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:15.746168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:15.774620 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:16.028941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029151d4e12548289a29174a81d337d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:16.056053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029151d4e12548289a29174a81d337d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:16.068795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029151d4e12548289a29174a81d337d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:16.069874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029151d4e12548289a29174a81d337d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:16.167523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029151d4e12548289a29174a81d337d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:16.174695 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2379/4782] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:15 2022] DELETE /identity/v3/users/029151d4e12548289a29174a81d337d8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:16.791583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:16.793079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:16.807067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e205b-6a81-4104-a958-fbda6632041e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:16.870341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:16.871982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:16.872673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:16.872963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:16.873070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:16.873239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] PATH_INFO: `/v3/users/341614326cee4db394f89ba476a30d9a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:16.874420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=341614326cee4db394f89ba476a30d9a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:16.876353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:16.888278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77597601-fe52-4e1a-860f-155066dd28b7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:16.899918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:16.901178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:16.901674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:16.902321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] PATH_INFO: `/v3/projects/eb351f1f85d941619286a2a3d2744651` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:16.903772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb351f1f85d941619286a2a3d2744651)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:16.906749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:17.134649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb351f1f85d941619286a2a3d2744651', 'request_id': 'req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.135444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341614326cee4db394f89ba476a30d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.136115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341614326cee4db394f89ba476a30d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.140848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb351f1f85d941619286a2a3d2744651', 'request_id': 'req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.246427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341614326cee4db394f89ba476a30d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.256186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341614326cee4db394f89ba476a30d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.256890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db59cc83-ec52-4f15-a94f-daa1a05bbaf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341614326cee4db394f89ba476a30d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.275969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2404/4783] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:16 2022] DELETE /identity/v3/users/341614326cee4db394f89ba476a30d9a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:17.346385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb351f1f85d941619286a2a3d2744651', 'request_id': 'req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.361890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] The token cache is being invalidate because project eb351f1f85d941619286a2a3d2744651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:17.362687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.364095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1c5e8dc-fbba-469f-b3f8-35e9126d61a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.366462 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2380/4784] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:16 2022] DELETE /identity/v3/projects/eb351f1f85d941619286a2a3d2744651 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:31:17.381580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7e825-cea2-47f0-b912-3bfd98a261d3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:17.381899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7e825-cea2-47f0-b912-3bfd98a261d3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:17.382176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7e825-cea2-47f0-b912-3bfd98a261d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:17.405133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9ca7e825-cea2-47f0-b912-3bfd98a261d3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:17.410132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ca7e825-cea2-47f0-b912-3bfd98a261d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:17.521290 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2405/4785] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:17.544787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f3c5-4704-4b13-9c8f-b2e3b3925a28 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:17.545412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f3c5-4704-4b13-9c8f-b2e3b3925a28 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:17.545945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f3c5-4704-4b13-9c8f-b2e3b3925a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:17.573639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e966f3c5-4704-4b13-9c8f-b2e3b3925a28 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:17.575382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e966f3c5-4704-4b13-9c8f-b2e3b3925a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:17.587444 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2381/4786] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:17.592423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7e825-cea2-47f0-b912-3bfd98a261d3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:17.604936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7e825-cea2-47f0-b912-3bfd98a261d3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:17.610152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:17.610882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:17.611168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:17.611444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:17.612078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:31:17.612924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:17.614658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:17.616611 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:17.630016 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2406/4787] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:31:17.634492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f3c5-4704-4b13-9c8f-b2e3b3925a28 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:17.644967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f3c5-4704-4b13-9c8f-b2e3b3925a28 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:17.652240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:17.653636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:17.654668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:17.655663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:17.658233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:17.660642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:17.661264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:17.663206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:17.686491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc815bf-ae87-4256-9acb-df37acba8b41 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:17.693755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:17.694527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:17.694812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:17.695089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] PATH_INFO: `/v3/projects/7f7b2419381d4a15877f415beaa7e435` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:17.696570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7b2419381d4a15877f415beaa7e435)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:17.698564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:17.849893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2382/4788] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:17 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:17.851883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:17.903726 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:17.906194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7b2419381d4a15877f415beaa7e435', 'request_id': 'req-3b2cd741-f3e3-4e51-826a-26461fee3429'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.913800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7b2419381d4a15877f415beaa7e435', 'request_id': 'req-3b2cd741-f3e3-4e51-826a-26461fee3429'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:17.917597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756d14-ea7e-409d-8cad-2fd9bb098d11 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:17.976901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:17.977654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:17.977918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:17.978197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:17.978888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:17.980915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.016255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7b2419381d4a15877f415beaa7e435', 'request_id': 'req-3b2cd741-f3e3-4e51-826a-26461fee3429'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:18.028652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] The token cache is being invalidate because project 7f7b2419381d4a15877f415beaa7e435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:18.028945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:18.029604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3b2cd741-f3e3-4e51-826a-26461fee3429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:18.031530 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2407/4789] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:17 2022] DELETE /identity/v3/projects/7f7b2419381d4a15877f415beaa7e435 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:18.036277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283234-27cd-4144-b6c9-b54704f3d468 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.036559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283234-27cd-4144-b6c9-b54704f3d468 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.036833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283234-27cd-4144-b6c9-b54704f3d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.060128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d1283234-27cd-4144-b6c9-b54704f3d468 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:18.061742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d1283234-27cd-4144-b6c9-b54704f3d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:18.072201 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2408/4790] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:31:18.079826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f4e1-146d-49d5-bcc7-457a7b46c2cc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.080116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f4e1-146d-49d5-bcc7-457a7b46c2cc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.080392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f4e1-146d-49d5-bcc7-457a7b46c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.098815 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2383/4791] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:17 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:18.102984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f9a4f4e1-146d-49d5-bcc7-457a7b46c2cc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:18.103753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.104518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f9a4f4e1-146d-49d5-bcc7-457a7b46c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:18.105437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:18.114860 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2409/4792] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:31:18.118566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f4e1-146d-49d5-bcc7-457a7b46c2cc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.122058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea8005-8481-4f7f-b10c-8454277219c8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.127122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.127741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.128079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.128916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.129570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.131318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.131726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f4e1-146d-49d5-bcc7-457a7b46c2cc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.137096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.137617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.138106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.138508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.139160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:31:18.139587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.141898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.145687 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2384/4793] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:18.146564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.165246 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2410/4794] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:31:18.165447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2be9a1-d1d8-4c90-9f1b-bcc5cf3c5221 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.168663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.169130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.173578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.173578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.173578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.173578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.174217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.184309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed084c-898e-4550-82dd-e59a2dda5bef admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.190340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.194927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.194927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.194927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.194927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.195569 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2385/4795] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:18.197794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.200156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.213269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520bf5-604d-408a-a568-228d5a86794c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.219989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afa2de-0a7a-456e-857f-5c3a744e9f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.220672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa2de-0a7a-456e-857f-5c3a744e9f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.220895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa2de-0a7a-456e-857f-5c3a744e9f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.221437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa2de-0a7a-456e-857f-5c3a744e9f75 admin admin] PATH_INFO: `/v3/projects/e1364249b1c5440ca15618ef8cbe516e/users/c3c645840ba54cb28fdf2bbce5887510/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.240894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afa2de-0a7a-456e-857f-5c3a744e9f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1364249b1c5440ca15618ef8cbe516e, user_id=c3c645840ba54cb28fdf2bbce5887510, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.251518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afa2de-0a7a-456e-857f-5c3a744e9f75 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.350007 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2411/4796] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:18 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:31:18.354092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.385109 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2386/4797] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:18 2022] PUT /identity/v3/projects/e1364249b1c5440ca15618ef8cbe516e/users/c3c645840ba54cb28fdf2bbce5887510/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:18.391954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ef5f1-a70b-47a1-b6f7-b44e1125c138 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.391954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ef5f1-a70b-47a1-b6f7-b44e1125c138 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.391954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ef5f1-a70b-47a1-b6f7-b44e1125c138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.421266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7f3ef5f1-a70b-47a1-b6f7-b44e1125c138 None None] MFA Rules not processed for user `c3c645840ba54cb28fdf2bbce5887510`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:18.422501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7f3ef5f1-a70b-47a1-b6f7-b44e1125c138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:18.456975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ccc81-125a-44cd-93e4-aff5b0595ce0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.528368 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2387/4798] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:31:18.537257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ef5f1-a70b-47a1-b6f7-b44e1125c138 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.580313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.581988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.583226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.583685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.584487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.586745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.625071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ef5f1-a70b-47a1-b6f7-b44e1125c138 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.631679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.632304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.632599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.633492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.634177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.636095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.719172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2412/4799] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:18 2022] POST /identity/v3/users => generated 286 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:31:18.722298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.732479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37552da-c427-4cde-83f6-036026447a8a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.737041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.739223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.743411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.743411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.743411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.743411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.750555 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2388/4800] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:18 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:18.756505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2413/4801] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:18.757651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.757797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.767903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c037af-195b-4ed6-a06d-2252aa717cb6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.825234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1b3eb-9789-48b7-8212-2a1d389a0bb8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.830093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.830719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.831036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.831982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.832710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.833000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.833604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.833916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.834189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.834662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.834845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.836632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.847676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2414/4802] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:18.851786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.861274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba79ea1-880c-4724-9acf-1bf4b999ac79 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.865861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143229b-6e21-4633-a836-6ecc7fb42901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.866526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143229b-6e21-4633-a836-6ecc7fb42901 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.866867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143229b-6e21-4633-a836-6ecc7fb42901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.867145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143229b-6e21-4633-a836-6ecc7fb42901 admin admin] PATH_INFO: `/v3/projects/ca9796cdb59e40eeb9acf376c18b44a3/users/1854fc431ddb4675ab630d923b9ef8fb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.882752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143229b-6e21-4633-a836-6ecc7fb42901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9796cdb59e40eeb9acf376c18b44a3, user_id=1854fc431ddb4675ab630d923b9ef8fb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.885385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143229b-6e21-4633-a836-6ecc7fb42901 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:18.910242 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:18.966149 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2389/4803] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:18 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:18.969626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:18.980146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd471e6-bed3-482e-962f-e29c9ed79ddd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:18.985894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:18.991218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:18.991218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:18.991218 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:18.991218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:18.991600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:18.993199 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2415/4804] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:18 2022] PUT /identity/v3/projects/ca9796cdb59e40eeb9acf376c18b44a3/users/1854fc431ddb4675ab630d923b9ef8fb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:31:18.994090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:19.004194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7218ba-c70a-416d-a57b-898531448332 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.004576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7218ba-c70a-416d-a57b-898531448332 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.004923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7218ba-c70a-416d-a57b-898531448332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.005914 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2390/4805] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:19.009800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:19.020947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98f7e-4652-4bec-beae-4831a1f078bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:19.045562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7c7218ba-c70a-416d-a57b-898531448332 None None] MFA Rules not processed for user `1854fc431ddb4675ab630d923b9ef8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:19.046983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c7218ba-c70a-416d-a57b-898531448332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:19.088016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:19.088758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.089049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.089333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.090098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:19.091821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:19.105633 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2391/4806] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:19.109791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:19.120466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2028-acc0-4a17-943f-b100a51440e2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:19.125265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dbd8c-7f46-4070-b7f1-5c2172ebb14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:19.125695 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2416/4807] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:31:19.129742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbd8c-7f46-4070-b7f1-5c2172ebb14e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.130070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbd8c-7f46-4070-b7f1-5c2172ebb14e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.130350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbd8c-7f46-4070-b7f1-5c2172ebb14e admin admin] PATH_INFO: `/v3/projects/6e513996828641ab9d75f3425c76a213/users/b0f06089728a492bbcd18da248c3720c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.135903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.136288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.136574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.151411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dbd8c-7f46-4070-b7f1-5c2172ebb14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e513996828641ab9d75f3425c76a213, user_id=b0f06089728a492bbcd18da248c3720c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:19.154284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dbd8c-7f46-4070-b7f1-5c2172ebb14e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:19.157609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] MFA Rules not processed for user `1854fc431ddb4675ab630d923b9ef8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:19.159215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:19.167718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2417/4808] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:19.179269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:19.180527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:19.273633 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2392/4809] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:19 2022] PUT /identity/v3/projects/6e513996828641ab9d75f3425c76a213/users/b0f06089728a492bbcd18da248c3720c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:19.275149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688ea8-eaab-4807-aa38-e5b97beb4559 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.275438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688ea8-eaab-4807-aa38-e5b97beb4559 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.275728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688ea8-eaab-4807-aa38-e5b97beb4559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.294828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b89f00-4d2c-44b0-9f82-cf4b87393cab None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:19.306590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cc688ea8-eaab-4807-aa38-e5b97beb4559 None None] MFA Rules not processed for user `b0f06089728a492bbcd18da248c3720c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:19.308036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc688ea8-eaab-4807-aa38-e5b97beb4559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:19.375633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:19.385781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.385781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.385781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.390838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2393/4810] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:19.391678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688ea8-eaab-4807-aa38-e5b97beb4559 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:19.456655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:19.458709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:19.469011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688ea8-eaab-4807-aa38-e5b97beb4559 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:19.473997 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2418/4811] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:31:19.474333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:19.474946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.475222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.475492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.476253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:19.478474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:19.553213 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:19.595736 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2394/4812] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:19 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:31:19.601466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:19.613996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a635ab0-0d59-44d6-895c-6527b4c87c41 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:19.630192 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:19.680544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:19.681331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.681594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.681973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.687562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:19.687562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:19.848235 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2419/4813] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:19 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:19.852869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:19.887024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793477f8-5a75-492d-8c47-5e6afd56f39f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:19.894773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:19.896533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.896533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.897223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:19.898176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:19.901132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:19.936833 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:19.957025 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2395/4814] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:19.961263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:19.980126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a223744-a3bf-4728-982d-6af13fd23ff0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:19.993234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:19.994168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:19.999964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:19.999964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] PATH_INFO: `/v3/projects/b56c8cdeda7b4bfe8d83a31c09528a76/users/ee2729da2a9649c0aebd45228e486e0c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:20.019492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56c8cdeda7b4bfe8d83a31c09528a76, user_id=ee2729da2a9649c0aebd45228e486e0c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:20.022779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:20.124990 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2420/4815] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:19 2022] PUT /identity/v3/projects/b56c8cdeda7b4bfe8d83a31c09528a76/users/ee2729da2a9649c0aebd45228e486e0c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:20.129398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:20.139944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509dd00-b901-467f-acd4-16f24e15dcf7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:20.210495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68cbd1-2e01-44ba-910e-827212e7a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:20.211556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68cbd1-2e01-44ba-910e-827212e7a734 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:20.211848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68cbd1-2e01-44ba-910e-827212e7a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:20.212126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68cbd1-2e01-44ba-910e-827212e7a734 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:20.212810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68cbd1-2e01-44ba-910e-827212e7a734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:20.214441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68cbd1-2e01-44ba-910e-827212e7a734 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:20.225607 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2396/4816] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:20.235351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:20.241471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442b592-364f-4727-a06e-fb84d8208368 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:20.246602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:20.247324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:20.247632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:20.247979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] PATH_INFO: `/v3/projects/b56c8cdeda7b4bfe8d83a31c09528a76/users/ee2729da2a9649c0aebd45228e486e0c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:20.250065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56c8cdeda7b4bfe8d83a31c09528a76, user_id=ee2729da2a9649c0aebd45228e486e0c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:20.252920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:20.266036 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2421/4817] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:20 2022] PUT /identity/v3/projects/b56c8cdeda7b4bfe8d83a31c09528a76/users/ee2729da2a9649c0aebd45228e486e0c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:20.279754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:20.280077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:20.280368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:20.289298 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:20.312771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] MFA Rules not processed for user `ee2729da2a9649c0aebd45228e486e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:20.315529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:20.391858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2397/4818] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:20.403798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:20.405596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:20.468235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fdff-df3d-4495-909c-40ba8260b02c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:20.472266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:20.477760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:20.477760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:20.477760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:20.543165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:20.544691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:20.558615 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2422/4819] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:21.979216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:21.983063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:22.102518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5901-c1f4-4f70-87f0-1f0ae1671e78 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:22.112303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:22.116264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:22.117587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:22.118071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:22.122989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:22.156114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:22.162726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:22.188301 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2398/4820] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:23.985835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:23.997560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3443f-bf73-4852-a06d-8de04c013ab8 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:24.003906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:24.004880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:24.005221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:24.005549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:24.050915 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:24.081337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:24.083003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:24.092240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2423/4821] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:25.801111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:25.818641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe01289-59fe-4e6c-8965-86423868ed07 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:25.840003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:25.840623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:25.840901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:25.841173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:25.863080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:25.864645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:25.877752 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2399/4822] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:34.336552 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=13 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:35.776136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:35.791483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908603ad-67f9-411d-8b0c-bda1ff491a8d service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:35.797694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:35.798535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:35.798820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:35.799092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:35.802462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:35.817191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:35.819834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:35.832309 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2424/4823] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:35.871757 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=70 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:35.933909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:35.935895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:36.020141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ea2c-7a25-43b1-a100-2ba700016a81 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:36.026044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:36.026701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:36.027034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:36.027318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] PATH_INFO: `/v3/users/17fbb660ff0c4b81af9397a3abc665c3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:36.028456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fbb660ff0c4b81af9397a3abc665c3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:36.031338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:36.338980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fbb660ff0c4b81af9397a3abc665c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:36.359522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fbb660ff0c4b81af9397a3abc665c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:36.368046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fbb660ff0c4b81af9397a3abc665c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:36.368796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fbb660ff0c4b81af9397a3abc665c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:36.451933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fbb660ff0c4b81af9397a3abc665c3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:36.459874 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2400/4824] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:35 2022] DELETE /identity/v3/users/17fbb660ff0c4b81af9397a3abc665c3 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:36.574505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:36.595921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c979550-15b4-474f-84f6-ef8880bd360a service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:36.714693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:36.715526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:36.716044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:36.716396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] PATH_INFO: `/v3/users/c3c645840ba54cb28fdf2bbce5887510` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:36.717622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c645840ba54cb28fdf2bbce5887510)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:36.720192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:36.951278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:36.952770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:36.971534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f3233-a155-43e9-b467-dd2ea8ab6218 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:36.979130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:36.983138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:36.983722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:36.984069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] PATH_INFO: `/v3/projects/37dfcd92b40d47f98b774ce6a8aff2a6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:36.985565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dfcd92b40d47f98b774ce6a8aff2a6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:36.987654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:37.013785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c645840ba54cb28fdf2bbce5887510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.014769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c645840ba54cb28fdf2bbce5887510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.110832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dfcd92b40d47f98b774ce6a8aff2a6', 'request_id': 'req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.117496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dfcd92b40d47f98b774ce6a8aff2a6', 'request_id': 'req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.160594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c645840ba54cb28fdf2bbce5887510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.170524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c645840ba54cb28fdf2bbce5887510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.171268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c57f1c7f-7ed0-4a52-9430-317700badea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c645840ba54cb28fdf2bbce5887510'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.191978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2425/4825] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:36 2022] DELETE /identity/v3/users/c3c645840ba54cb28fdf2bbce5887510 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:37.196688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.197446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.197446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.217221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:37.218428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:37.250579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dfcd92b40d47f98b774ce6a8aff2a6', 'request_id': 'req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.265394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] The token cache is being invalidate because project 37dfcd92b40d47f98b774ce6a8aff2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:37.265851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.266630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c79f6e21-a912-404a-9cf4-6b1a9ee81ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:37.268502 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2401/4826] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:36 2022] DELETE /identity/v3/projects/37dfcd92b40d47f98b774ce6a8aff2a6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:37.274032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e61df-00c8-407f-aa5b-28440ad09583 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.274384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e61df-00c8-407f-aa5b-28440ad09583 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.274732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e61df-00c8-407f-aa5b-28440ad09583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.284052 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:37.288962 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2426/4827] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:31:37.296062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:37.298744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:37.308453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e84e61df-00c8-407f-aa5b-28440ad09583 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:37.309697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e84e61df-00c8-407f-aa5b-28440ad09583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:37.312523 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:37.325045 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2402/4828] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:37.326977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1492-8290-45e1-b76b-3fbddcdf4d81 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.327265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1492-8290-45e1-b76b-3fbddcdf4d81 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.329474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1492-8290-45e1-b76b-3fbddcdf4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.360958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-56eb1492-8290-45e1-b76b-3fbddcdf4d81 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:37.362308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-56eb1492-8290-45e1-b76b-3fbddcdf4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:37.371236 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2403/4829] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:31:37.376618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1492-8290-45e1-b76b-3fbddcdf4d81 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:37.385660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e3aa-710e-4c8f-8fc5-090edcfd815f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:37.388336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1492-8290-45e1-b76b-3fbddcdf4d81 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:37.389717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:37.390471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.390755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.391031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.394037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:37.396764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.396764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.396764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.396764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:31:37.396764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:37.398157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:37.417158 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2404/4830] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:31:37.418385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:37.418615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:37.423090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:37.433685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2427/4831] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:31:37.442093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453036f4-7d66-457d-a558-5551ac07ba7f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:37.447645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:37.448348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.448770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.449124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.450748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:37.454059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:37.544589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2405/4832] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:37 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:37.548841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:37.560514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f87934-c319-4744-bdd0-ca28906ba92f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:37.640107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:37.640107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.640107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.640107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.640387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:37.640387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:37.819373 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2428/4833] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:37 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:37.825775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:37.837836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63bd0-7374-4a68-8ff5-a91d17e5169e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:37.843074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:37.843802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.844144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.844486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.845159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:37.847027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:37.858782 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2406/4834] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:37.863687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:37.875118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86c9b-a61b-42cd-9856-16420cbbfdcd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:37.881444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:37.883313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.883735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.884260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.885152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:37.886954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:37.899699 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2429/4835] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:31:37.907112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:37.918480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d878e0-11cf-4f51-afda-b7c102cb9145 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:37.923112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9b885-df1f-4b74-9107-bac363920ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:37.927569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9b885-df1f-4b74-9107-bac363920ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:37.927569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9b885-df1f-4b74-9107-bac363920ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:37.927569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9b885-df1f-4b74-9107-bac363920ec2 admin admin] PATH_INFO: `/v3/projects/171a5316d3264797a95a2ba66da1b4c9/users/5cc06c467eb8468dba45af3d1dcf808d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:37.945009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9b885-df1f-4b74-9107-bac363920ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171a5316d3264797a95a2ba66da1b4c9, user_id=5cc06c467eb8468dba45af3d1dcf808d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:37.948955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9b885-df1f-4b74-9107-bac363920ec2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:38.057046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:38.058870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:38.072591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce51e51-1468-4bd2-b9ee-a0f6eda6a892 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:38.079564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:38.080518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:38.080799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:38.081446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] PATH_INFO: `/v3/projects/e1364249b1c5440ca15618ef8cbe516e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:38.082940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1364249b1c5440ca15618ef8cbe516e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:38.085331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:38.106393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2407/4836] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:37 2022] PUT /identity/v3/projects/171a5316d3264797a95a2ba66da1b4c9/users/5cc06c467eb8468dba45af3d1dcf808d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:38.111180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:38.111469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:38.111744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:38.137153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:38.138791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:38.202029 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2408/4837] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:38.212306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:38.213625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:38.277054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569489d8-152b-4b50-b539-6b9caf73c0eb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:38.278344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1364249b1c5440ca15618ef8cbe516e', 'request_id': 'req-24783a5f-f5b4-477c-8cbe-0810e6c76e25'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.286484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1364249b1c5440ca15618ef8cbe516e', 'request_id': 'req-24783a5f-f5b4-477c-8cbe-0810e6c76e25'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.312332 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:38.330799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:38.332551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:38.332844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:38.333123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:38.400950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:38.402496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:38.411223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1364249b1c5440ca15618ef8cbe516e', 'request_id': 'req-24783a5f-f5b4-477c-8cbe-0810e6c76e25'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.414691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2409/4838] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:31:38.441601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] The token cache is being invalidate because project e1364249b1c5440ca15618ef8cbe516e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:38.442000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.442640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.444189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2430/4839] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:38 2022] DELETE /identity/v3/projects/e1364249b1c5440ca15618ef8cbe516e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:31:38.450051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:38.460454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406c7d-0495-45f7-a7b0-775f21377139 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:38.465151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:38.465792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:38.466128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:38.466406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] PATH_INFO: `/v3/users/b0f06089728a492bbcd18da248c3720c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:38.470188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f06089728a492bbcd18da248c3720c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:38.470188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:38.711036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f06089728a492bbcd18da248c3720c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.723645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f06089728a492bbcd18da248c3720c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.730813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f06089728a492bbcd18da248c3720c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.731510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f06089728a492bbcd18da248c3720c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.823837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f06089728a492bbcd18da248c3720c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:38.831790 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2410/4840] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:38 2022] DELETE /identity/v3/users/b0f06089728a492bbcd18da248c3720c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:39.451262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:39.453520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:39.468727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783a5f-f5b4-477c-8cbe-0810e6c76e25 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:39.480627 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:39.536922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:39.537697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:39.538206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:39.538476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] PATH_INFO: `/v3/projects/6e513996828641ab9d75f3425c76a213` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:39.539645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e513996828641ab9d75f3425c76a213)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:39.541851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:39.665440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e513996828641ab9d75f3425c76a213', 'request_id': 'req-13222771-8424-4191-a5b0-8d8944226441'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:39.673378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e513996828641ab9d75f3425c76a213', 'request_id': 'req-13222771-8424-4191-a5b0-8d8944226441'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:39.789240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e513996828641ab9d75f3425c76a213', 'request_id': 'req-13222771-8424-4191-a5b0-8d8944226441'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:39.805376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] The token cache is being invalidate because project 6e513996828641ab9d75f3425c76a213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:39.805805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:39.806605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:39.808240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2431/4841] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:39 2022] DELETE /identity/v3/projects/6e513996828641ab9d75f3425c76a213 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:39.812272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:39.813956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:39.827535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dc9ff-c05a-4c98-b4f2-0d36cab3ed7c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:39.881225 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:39.887174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:39.887812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:39.888093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:39.888369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] PATH_INFO: `/v3/users/ee2729da2a9649c0aebd45228e486e0c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:39.889555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2729da2a9649c0aebd45228e486e0c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:39.891587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:40.148172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2729da2a9649c0aebd45228e486e0c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:40.206038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2729da2a9649c0aebd45228e486e0c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:40.226973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2729da2a9649c0aebd45228e486e0c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:40.229333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2729da2a9649c0aebd45228e486e0c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:40.354272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5085aea2-ff12-4ac2-bf2f-59f68dbb6906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2729da2a9649c0aebd45228e486e0c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:40.363875 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2411/4842] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:31:39 2022] DELETE /identity/v3/users/ee2729da2a9649c0aebd45228e486e0c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:41.145148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:41.146688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:41.164812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13222771-8424-4191-a5b0-8d8944226441 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:41.282468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:41.283257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:41.283608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:41.283947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] PATH_INFO: `/v3/projects/b56c8cdeda7b4bfe8d83a31c09528a76` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:41.286039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56c8cdeda7b4bfe8d83a31c09528a76)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:41.288321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:41.455697 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:41.463760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56c8cdeda7b4bfe8d83a31c09528a76', 'request_id': 'req-8245298d-93b2-4c29-b883-bef818ad0a25'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:41.483346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56c8cdeda7b4bfe8d83a31c09528a76', 'request_id': 'req-8245298d-93b2-4c29-b883-bef818ad0a25'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:41.577641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56c8cdeda7b4bfe8d83a31c09528a76', 'request_id': 'req-8245298d-93b2-4c29-b883-bef818ad0a25'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:41.610877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] The token cache is being invalidate because project b56c8cdeda7b4bfe8d83a31c09528a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:31:41.611194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:41.614767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8245298d-93b2-4c29-b883-bef818ad0a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:31:41.619357 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2432/4843] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:31:41 2022] DELETE /identity/v3/projects/b56c8cdeda7b4bfe8d83a31c09528a76 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:41.624389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d164-7412-49ac-b944-664d8d2c2cb5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:41.630527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d164-7412-49ac-b944-664d8d2c2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:41.630527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d164-7412-49ac-b944-664d8d2c2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:41.677679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3559d164-7412-49ac-b944-664d8d2c2cb5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:41.687596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3559d164-7412-49ac-b944-664d8d2c2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:41.789180 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2412/4844] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:31:41.791186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377944-02d4-4029-ac56-80e134c71a7d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:41.791595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377944-02d4-4029-ac56-80e134c71a7d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:41.791968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377944-02d4-4029-ac56-80e134c71a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:41.814469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8a377944-02d4-4029-ac56-80e134c71a7d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:41.815879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8a377944-02d4-4029-ac56-80e134c71a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:41.830689 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2433/4845] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:41.843561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559d164-7412-49ac-b944-664d8d2c2cb5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:41.846336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559d164-7412-49ac-b944-664d8d2c2cb5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:41.861017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:41.866039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:41.866039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:41.866564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:41.867417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:31:41.867871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:41.871225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:41.896434 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2413/4846] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:31:41.900862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377944-02d4-4029-ac56-80e134c71a7d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:41.912991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377944-02d4-4029-ac56-80e134c71a7d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:41.921829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:41.922614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:41.923469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:41.923469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:41.924144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:41.927299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:42.078113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2434/4847] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:41 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:31:42.079599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:42.091357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6f8b-c849-4ddf-806e-1cff41413660 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:42.173139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:42.174073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:42.174577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:42.175134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:42.176271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:42.178302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:42.189403 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:42.281269 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2414/4848] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:42 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:42.290477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:42.306972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025345c4-3328-49a2-97bd-e183aa356706 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:42.325163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:42.325952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:42.330118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:42.330454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:42.331760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:42.333907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:42.351940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:42.352584 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2435/4849] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:42.366663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158c19-e7e2-481d-b2fd-d844434f4e1c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:42.371671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d6261-a386-42d5-8718-425ac85c7158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:42.372325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6261-a386-42d5-8718-425ac85c7158 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:42.372655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6261-a386-42d5-8718-425ac85c7158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:42.373055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6261-a386-42d5-8718-425ac85c7158 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:42.373651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d6261-a386-42d5-8718-425ac85c7158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:42.375370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d6261-a386-42d5-8718-425ac85c7158 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:42.388108 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2415/4850] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:42.392549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:42.407052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6457e42-39d4-4d98-be46-c18514d7874f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:42.415062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:42.415782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:42.416091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:42.418841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] PATH_INFO: `/v3/projects/e38c16049b6d46859df817b45131e7a6/users/a8d5c1c4fa6f4f978fb3435ce93aee7c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:42.434461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38c16049b6d46859df817b45131e7a6, user_id=a8d5c1c4fa6f4f978fb3435ce93aee7c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:42.437130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:42.516252 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2436/4851] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:42 2022] PUT /identity/v3/projects/e38c16049b6d46859df817b45131e7a6/users/a8d5c1c4fa6f4f978fb3435ce93aee7c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:42.528705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806212-e247-4d8b-971f-29b77c78d4c4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:42.528995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806212-e247-4d8b-971f-29b77c78d4c4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:42.541998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806212-e247-4d8b-971f-29b77c78d4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:42.572537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d7806212-e247-4d8b-971f-29b77c78d4c4 None None] MFA Rules not processed for user `a8d5c1c4fa6f4f978fb3435ce93aee7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:42.573793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d7806212-e247-4d8b-971f-29b77c78d4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:42.657085 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2416/4852] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:42.664236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:42.747898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aa350-d4a9-4a9c-ae33-a9763c7f814f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:42.752873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:42.754373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:42.754829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:42.755203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:42.756301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:42.758054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:42.915430 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2437/4853] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:42 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:42.917046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806212-e247-4d8b-971f-29b77c78d4c4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:42.942535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806212-e247-4d8b-971f-29b77c78d4c4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:43.070563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:43.071189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:43.072636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:43.072974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:43.074256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:43.076386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:43.216645 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2417/4854] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:42 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:31:43.221419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:43.239580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54ab0-93a8-499e-bfd6-d020cf47b0d1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:43.254295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:43.255036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:43.255483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:43.255609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:43.258304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:43.260543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:43.277479 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2438/4855] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:43.281704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:43.297008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b901dd2-80d8-47b9-b126-c700ebb1d900 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:43.302923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996535e-4d6d-4ae2-ab32-5a9c1843fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:43.303594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996535e-4d6d-4ae2-ab32-5a9c1843fb1b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:43.303889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996535e-4d6d-4ae2-ab32-5a9c1843fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:43.304211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996535e-4d6d-4ae2-ab32-5a9c1843fb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:43.305272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996535e-4d6d-4ae2-ab32-5a9c1843fb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:43.306516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996535e-4d6d-4ae2-ab32-5a9c1843fb1b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:43.320582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2418/4856] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:43.328302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:43.339816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d5450-8f0f-4837-9af4-a65a18459d07 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:43.360278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:43.360278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:43.360278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:43.360278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] PATH_INFO: `/v3/projects/04dac421515344fabf3cc2f332c0a1b9/users/c4834044adec4af6919f5361a069a580/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:43.380949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04dac421515344fabf3cc2f332c0a1b9, user_id=c4834044adec4af6919f5361a069a580, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:43.384818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:43.506177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2439/4857] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:43 2022] PUT /identity/v3/projects/04dac421515344fabf3cc2f332c0a1b9/users/c4834044adec4af6919f5361a069a580/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:43.516387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c141-6bc2-4efd-aaea-1d5711ca7751 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:43.516682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c141-6bc2-4efd-aaea-1d5711ca7751 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:43.517022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c141-6bc2-4efd-aaea-1d5711ca7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:43.571959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4bd7c141-6bc2-4efd-aaea-1d5711ca7751 None None] MFA Rules not processed for user `c4834044adec4af6919f5361a069a580`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:43.573201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4bd7c141-6bc2-4efd-aaea-1d5711ca7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:43.651823 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:43.682400 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2419/4858] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:43.686660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:43.714263 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:43.780515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a36b6-7952-4585-ac93-90cf9b41f805 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:43.786778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:43.788706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:43.789098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:43.789474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:43.790267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:43.792558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:43.930222 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2440/4859] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:31:43 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:31:43.931386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c141-6bc2-4efd-aaea-1d5711ca7751 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:43.943248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c141-6bc2-4efd-aaea-1d5711ca7751 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:44.007845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:44.008463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:44.008743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:44.009014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:44.009674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:44.011631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:44.145788 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2420/4860] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:31:43 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:31:44.149899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:44.162394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042bf09-647f-40fa-a098-9ae7a9c9c7e2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:44.180200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:44.180200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:44.180200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:44.180200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:44.180979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:44.180979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:44.207568 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2441/4861] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:44.212403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:44.226084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ff6dc-4b54-4c76-9376-e710de723c68 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:44.232057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:44.234033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:44.239697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:44.239697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] PATH_INFO: `/v3/projects/a737e6e983af4f1db5d054a1b02d08ad/users/20c99bb32bd74413aef50fa93d2df091/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:44.264742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a737e6e983af4f1db5d054a1b02d08ad, user_id=20c99bb32bd74413aef50fa93d2df091, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:44.268159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:44.364059 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2421/4862] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:44 2022] PUT /identity/v3/projects/a737e6e983af4f1db5d054a1b02d08ad/users/20c99bb32bd74413aef50fa93d2df091/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:44.368293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:44.386892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cabae-90a8-4aac-b2bc-237b81562aab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:44.501781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7ba6c-1729-4315-9327-a30d89bf50ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:44.504115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7ba6c-1729-4315-9327-a30d89bf50ac admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:44.504410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7ba6c-1729-4315-9327-a30d89bf50ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:44.504689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7ba6c-1729-4315-9327-a30d89bf50ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:44.505342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7ba6c-1729-4315-9327-a30d89bf50ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:44.508190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7ba6c-1729-4315-9327-a30d89bf50ac admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:44.524993 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2442/4863] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:31:44.530124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:44.548483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447ef9c-5f69-41b0-bec2-fe210248f17d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:44.554953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:44.555639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:44.555909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:44.556180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] PATH_INFO: `/v3/projects/a737e6e983af4f1db5d054a1b02d08ad/users/20c99bb32bd74413aef50fa93d2df091/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:44.558265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a737e6e983af4f1db5d054a1b02d08ad, user_id=20c99bb32bd74413aef50fa93d2df091, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:44.562574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:44.581837 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2422/4864] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:31:44 2022] PUT /identity/v3/projects/a737e6e983af4f1db5d054a1b02d08ad/users/20c99bb32bd74413aef50fa93d2df091/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:31:44.594729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cb84-4373-4226-a967-4cfa5b1e6409 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:44.596025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cb84-4373-4226-a967-4cfa5b1e6409 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:44.598869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cb84-4373-4226-a967-4cfa5b1e6409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:44.652367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fb34cb84-4373-4226-a967-4cfa5b1e6409 None None] MFA Rules not processed for user `20c99bb32bd74413aef50fa93d2df091`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:44.653753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fb34cb84-4373-4226-a967-4cfa5b1e6409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:44.761561 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2443/4865] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:44.769996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:44.771976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:44.856019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23cd6f-c59c-4acf-bb61-098a503301a8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:44.859831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a68d58-5fe1-49c7-83a8-aa62a6a35e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:44.860497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a68d58-5fe1-49c7-83a8-aa62a6a35e6e service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:44.860814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a68d58-5fe1-49c7-83a8-aa62a6a35e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:44.861105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a68d58-5fe1-49c7-83a8-aa62a6a35e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:44.919306 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:44.940825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a68d58-5fe1-49c7-83a8-aa62a6a35e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:44.942311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a68d58-5fe1-49c7-83a8-aa62a6a35e6e service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:44.953157 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2423/4866] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:45.536616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:45.537116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:45.537116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:45.592788 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:31:45.592788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] MFA Rules not processed for user `5cc06c467eb8468dba45af3d1dcf808d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:45.605539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:45.814813 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2444/4867] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:45.815705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b825f-ccab-4a00-b9cc-6117bf30a58e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:45.815705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b825f-ccab-4a00-b9cc-6117bf30a58e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:45.815705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b825f-ccab-4a00-b9cc-6117bf30a58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:45.851335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ea3b825f-ccab-4a00-b9cc-6117bf30a58e None None] MFA Rules not processed for user `5cc06c467eb8468dba45af3d1dcf808d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:45.879888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea3b825f-ccab-4a00-b9cc-6117bf30a58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:45.898503 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2424/4868] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:45.928760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:45.930981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:46.048715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081eade-dc45-4fde-bd96-7bc462b9b0cd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:46.055854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:46.056756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:46.057126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:46.057649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:46.072551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:46.077539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:46.103596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2445/4869] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:47.608747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a536-9aa5-4b3c-8df5-6edf4e2e80d9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:47.609713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a536-9aa5-4b3c-8df5-6edf4e2e80d9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:47.610212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a536-9aa5-4b3c-8df5-6edf4e2e80d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:47.645062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2669a536-9aa5-4b3c-8df5-6edf4e2e80d9 None None] MFA Rules not processed for user `a239a0dd4451431aa7e3beea2d4b37aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:31:47.646548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2669a536-9aa5-4b3c-8df5-6edf4e2e80d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:31:47.737711 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2425/4870] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:31:48.555712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:48.571394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407acf31-4fc6-4e6a-a986-a10ba15d7b46 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:48.578230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:48.579551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:48.580085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:48.580553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:48.692294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:48.693879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:48.702631 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2446/4871] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:51.100032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669a536-9aa5-4b3c-8df5-6edf4e2e80d9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:31:51.113909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669a536-9aa5-4b3c-8df5-6edf4e2e80d9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:31:51.131329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf942-1500-4c59-8436-5aaa69eaf1b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:31:51.131965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf942-1500-4c59-8436-5aaa69eaf1b6 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:31:51.132246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf942-1500-4c59-8436-5aaa69eaf1b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:31:51.132520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf942-1500-4c59-8436-5aaa69eaf1b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:31:51.144339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cf942-1500-4c59-8436-5aaa69eaf1b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:31:51.154126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cf942-1500-4c59-8436-5aaa69eaf1b6 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:31:51.185953 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2426/4872] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:31:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:31:58.698692 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:01.179731 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=40 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:02.995189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:03.100585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924683-346b-4af7-bc38-d237dfd9a19b service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:03.108221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:03.122981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:03.123296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:03.123609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] PATH_INFO: `/v3/users/a8d5c1c4fa6f4f978fb3435ce93aee7c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:03.127377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d5c1c4fa6f4f978fb3435ce93aee7c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:03.129451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:03.461099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d5c1c4fa6f4f978fb3435ce93aee7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:03.461953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d5c1c4fa6f4f978fb3435ce93aee7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:03.565149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d5c1c4fa6f4f978fb3435ce93aee7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:03.577347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d5c1c4fa6f4f978fb3435ce93aee7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:03.578422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d5c1c4fa6f4f978fb3435ce93aee7c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:03.607739 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2447/4873] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:32:02 2022] DELETE /identity/v3/users/a8d5c1c4fa6f4f978fb3435ce93aee7c => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:03.611851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:03.613738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:03.614168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:03.640216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:03.641930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:03.758670 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2427/4874] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:03.774462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:03.776106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:03.852885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:03.855501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:03.881197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc302ade-126c-47f7-b3bd-e8d61f789b49 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:03.890570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028548-fbed-46ed-afd4-e0a4aadb1e2f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:03.890570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275042c-c3e9-4028-9cd8-4801b2bd686e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:03.890774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:03.890874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275042c-c3e9-4028-9cd8-4801b2bd686e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:03.890874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275042c-c3e9-4028-9cd8-4801b2bd686e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:03.891043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:03.891180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:03.891282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275042c-c3e9-4028-9cd8-4801b2bd686e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:03.891464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] PATH_INFO: `/v3/users/1854fc431ddb4675ab630d923b9ef8fb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:03.896730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1854fc431ddb4675ab630d923b9ef8fb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:03.898746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:03.904739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275042c-c3e9-4028-9cd8-4801b2bd686e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:03.906274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275042c-c3e9-4028-9cd8-4801b2bd686e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:03.925133 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2448/4875] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:04.280252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1854fc431ddb4675ab630d923b9ef8fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:04.295948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1854fc431ddb4675ab630d923b9ef8fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:04.305600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1854fc431ddb4675ab630d923b9ef8fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:04.306787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1854fc431ddb4675ab630d923b9ef8fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:04.394109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1854fc431ddb4675ab630d923b9ef8fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:04.415302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2428/4876] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:32:03 2022] DELETE /identity/v3/users/1854fc431ddb4675ab630d923b9ef8fb => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:04.419546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:04.421971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:04.422416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:04.466338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:04.472644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:04.502615 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:04.561209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2449/4877] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:04.580838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:04.586437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:04.655053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6c54d-a360-4bca-a2d7-7ed4a9a0e7c9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:04.658753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:04.659913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:04.660204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:04.660478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:04.670002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:04.671374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:04.683578 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2429/4878] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:04.691844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:04.692980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:04.707323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a9bc2-1f33-439e-852b-f7b83beab89f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:04.713277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:04.714305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:04.714692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:04.715404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] PATH_INFO: `/v3/projects/e38c16049b6d46859df817b45131e7a6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:04.716527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38c16049b6d46859df817b45131e7a6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:04.718735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:04.890069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38c16049b6d46859df817b45131e7a6', 'request_id': 'req-c9117343-d79c-49eb-b795-e9cb1f28c36a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:04.897427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38c16049b6d46859df817b45131e7a6', 'request_id': 'req-c9117343-d79c-49eb-b795-e9cb1f28c36a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:04.988659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38c16049b6d46859df817b45131e7a6', 'request_id': 'req-c9117343-d79c-49eb-b795-e9cb1f28c36a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.006987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] The token cache is being invalidate because project e38c16049b6d46859df817b45131e7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:32:05.007394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.008322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.010277 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2450/4879] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:32:04 2022] DELETE /identity/v3/projects/e38c16049b6d46859df817b45131e7a6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:05.020118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:05.039865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93e4b5-a598-42ce-a4be-94d65ded3104 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:05.068689 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:05.145595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:05.147223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:05.147762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:05.148387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] PATH_INFO: `/v3/users/c4834044adec4af6919f5361a069a580` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:05.151035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4834044adec4af6919f5361a069a580)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:05.153350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:05.386810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:05.388470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:05.401281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4834044adec4af6919f5361a069a580'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.414087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9117343-d79c-49eb-b795-e9cb1f28c36a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:05.429428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4834044adec4af6919f5361a069a580'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.430760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:05.432527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:05.433163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:05.433590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] PATH_INFO: `/v3/projects/ca9796cdb59e40eeb9acf376c18b44a3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:05.435033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9796cdb59e40eeb9acf376c18b44a3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:05.437199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:05.444858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4834044adec4af6919f5361a069a580'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.447885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4834044adec4af6919f5361a069a580'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.588529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78efa765-9afd-43fb-a6e9-9945b5d37255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4834044adec4af6919f5361a069a580'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.598231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2430/4880] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:32:05 2022] DELETE /identity/v3/users/c4834044adec4af6919f5361a069a580 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:05.608489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9796cdb59e40eeb9acf376c18b44a3', 'request_id': 'req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.617230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9796cdb59e40eeb9acf376c18b44a3', 'request_id': 'req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.736389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9796cdb59e40eeb9acf376c18b44a3', 'request_id': 'req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.759388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] The token cache is being invalidate because project ca9796cdb59e40eeb9acf376c18b44a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:32:05.759732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.760453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e92a397-b7ba-48b2-95b2-875f6c29b2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:05.762474 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2451/4881] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:32:05 2022] DELETE /identity/v3/projects/ca9796cdb59e40eeb9acf376c18b44a3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:32:05.767177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f1a27-9eb8-4968-b68f-cfbc2c400038 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:05.767645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f1a27-9eb8-4968-b68f-cfbc2c400038 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:05.767907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f1a27-9eb8-4968-b68f-cfbc2c400038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:05.794210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1f8f1a27-9eb8-4968-b68f-cfbc2c400038 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:05.798689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1f8f1a27-9eb8-4968-b68f-cfbc2c400038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:05.879521 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2431/4882] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:05.888640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6a9c-024d-48d4-856a-7e1d102da880 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:05.888947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6a9c-024d-48d4-856a-7e1d102da880 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:05.889199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6a9c-024d-48d4-856a-7e1d102da880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:05.926413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-425a6a9c-024d-48d4-856a-7e1d102da880 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:05.928589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-425a6a9c-024d-48d4-856a-7e1d102da880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:05.940626 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2452/4883] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:05.945454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f1a27-9eb8-4968-b68f-cfbc2c400038 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:05.960987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f1a27-9eb8-4968-b68f-cfbc2c400038 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:05.966734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:05.967326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:05.967605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:05.973543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:05.973543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:32:05.973543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:05.973543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:05.990587 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2432/4884] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:32:06.000548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6a9c-024d-48d4-856a-7e1d102da880 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.011215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6a9c-024d-48d4-856a-7e1d102da880 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.016681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.019576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.019576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.019576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.019576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.021994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.132421 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:06.143082 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2453/4885] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:32:05 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:06.145112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.156787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce7b17-1683-44b5-bd35-3da2842919c0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.184283 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:06.221016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.221642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.222041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.222500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.223123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.225082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.230919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.232753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:06.257164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55281063-c00f-4007-9ba2-b90a0434a28c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.262299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.262934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.263215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.263493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] PATH_INFO: `/v3/projects/04dac421515344fabf3cc2f332c0a1b9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.264670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=04dac421515344fabf3cc2f332c0a1b9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.266686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.372033 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2433/4886] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:32:06 2022] POST /identity/v3/users => generated 302 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:06.375968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.388895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8976b5-728c-425f-9838-175fd46df80c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.394651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.395454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.396071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.396071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.396786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.398447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.422107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04dac421515344fabf3cc2f332c0a1b9', 'request_id': 'req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.428594 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2434/4887] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:32:06.432087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.433591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04dac421515344fabf3cc2f332c0a1b9', 'request_id': 'req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.445186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741fc40-e9ff-43dd-9109-1b1f86daacde admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.510182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04dac421515344fabf3cc2f332c0a1b9', 'request_id': 'req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.524301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] The token cache is being invalidate because project 04dac421515344fabf3cc2f332c0a1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:32:06.524940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.526651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.532110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.532608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.532893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.533170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.533645 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2454/4888] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:32:06 2022] DELETE /identity/v3/projects/04dac421515344fabf3cc2f332c0a1b9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:06.533901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.536518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.549382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.552147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:06.562158 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2435/4889] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:32:06.565558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.568385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82a5e-6ffd-407c-8903-d7f6795fc51b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.568989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:06.573839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.574499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.574783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.575038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] PATH_INFO: `/v3/users/20c99bb32bd74413aef50fa93d2df091` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.576188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c99bb32bd74413aef50fa93d2df091)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.578123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.585560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b02b-77a0-4306-a405-0b68eeee3926 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.598245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50223edc-0117-4590-8a1a-a4e6b440eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.606413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223edc-0117-4590-8a1a-a4e6b440eb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.606854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223edc-0117-4590-8a1a-a4e6b440eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.607292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223edc-0117-4590-8a1a-a4e6b440eb35 admin admin] PATH_INFO: `/v3/projects/a47b6734fa4347ee932431e4119ea93a/users/62107b75e0c747278869f00fd01c5d7c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.625426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50223edc-0117-4590-8a1a-a4e6b440eb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47b6734fa4347ee932431e4119ea93a, user_id=62107b75e0c747278869f00fd01c5d7c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.629548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50223edc-0117-4590-8a1a-a4e6b440eb35 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.777379 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2436/4890] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:32:06 2022] PUT /identity/v3/projects/a47b6734fa4347ee932431e4119ea93a/users/62107b75e0c747278869f00fd01c5d7c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:32:06.782243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.782537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.782813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.801850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:06.803061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:06.850172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c99bb32bd74413aef50fa93d2df091'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.851428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c99bb32bd74413aef50fa93d2df091'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.876386 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2437/4891] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:32:06.887401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:06.889078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:06.952909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eee39-ced4-403d-b345-2367c6a63e98 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:06.957259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:06.957932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:06.958225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:06.958499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:06.967776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:06.969215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:06.971509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c99bb32bd74413aef50fa93d2df091'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.982164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c99bb32bd74413aef50fa93d2df091'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.983237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8e0c7b8e-a4e6-40dc-9a7b-2674f8727a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c99bb32bd74413aef50fa93d2df091'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:06.995410 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2438/4892] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:32:07.031382 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2455/4893] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:32:06 2022] DELETE /identity/v3/users/20c99bb32bd74413aef50fa93d2df091 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:07.544865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:07.560676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671384c-4353-4b86-9cf8-86a6a5f1dd38 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:07.646999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:07.647709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:07.647997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:07.648275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] PATH_INFO: `/v3/projects/a737e6e983af4f1db5d054a1b02d08ad` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:07.649503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a737e6e983af4f1db5d054a1b02d08ad)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:07.651435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:07.802256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a737e6e983af4f1db5d054a1b02d08ad', 'request_id': 'req-b41f89b2-c667-4e54-953c-e68332f79bc6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:07.810693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a737e6e983af4f1db5d054a1b02d08ad', 'request_id': 'req-b41f89b2-c667-4e54-953c-e68332f79bc6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:07.905239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a737e6e983af4f1db5d054a1b02d08ad', 'request_id': 'req-b41f89b2-c667-4e54-953c-e68332f79bc6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:07.929777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] The token cache is being invalidate because project a737e6e983af4f1db5d054a1b02d08ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:32:07.930116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:07.931538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b41f89b2-c667-4e54-953c-e68332f79bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:07.939061 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2439/4894] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:32:07 2022] DELETE /identity/v3/projects/a737e6e983af4f1db5d054a1b02d08ad => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:07.943873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59623-385d-4eda-8e7f-4864de83331e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:07.944336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59623-385d-4eda-8e7f-4864de83331e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:07.944450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59623-385d-4eda-8e7f-4864de83331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:07.964808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-deb59623-385d-4eda-8e7f-4864de83331e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:07.966030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-deb59623-385d-4eda-8e7f-4864de83331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:08.018279 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:08.030948 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2456/4895] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:08.039158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228330-82dc-40d0-8815-8c7940406648 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.039462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228330-82dc-40d0-8815-8c7940406648 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.039746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228330-82dc-40d0-8815-8c7940406648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.061246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5e228330-82dc-40d0-8815-8c7940406648 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:08.062674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5e228330-82dc-40d0-8815-8c7940406648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:08.078115 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2440/4896] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:08.079335 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:08.083921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59623-385d-4eda-8e7f-4864de83331e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:08.093854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59623-385d-4eda-8e7f-4864de83331e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:08.099264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:08.101179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.101179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.101179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.101179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:32:08.102192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:08.103095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:08.116386 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2457/4897] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:32:08.130183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e228330-82dc-40d0-8815-8c7940406648 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:08.143477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e228330-82dc-40d0-8815-8c7940406648 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:08.151319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:08.152097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.152392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.152673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.153315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:08.155258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:08.335419 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2441/4898] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:32:08 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:08.338839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:08.350096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb29f54-fc32-41a6-a088-331f1f793dae admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:08.418452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:08.419145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.419636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.420197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.421003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:08.423152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:08.563960 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2458/4899] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:32:08 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:08.568527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:08.578555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02114e4c-38f4-4655-9bba-d6219f89f16b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:08.584342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:08.584934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.585211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.585491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.586194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:08.587938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:08.600312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2442/4900] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:32:08.610932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:08.623139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fe6a2-92a2-4277-a13e-3810cca1a12b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:08.628145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500257-34e5-4431-9038-19b2a0001b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:08.629406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500257-34e5-4431-9038-19b2a0001b87 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.629406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500257-34e5-4431-9038-19b2a0001b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.629406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500257-34e5-4431-9038-19b2a0001b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.630060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500257-34e5-4431-9038-19b2a0001b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:08.631654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500257-34e5-4431-9038-19b2a0001b87 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:08.643311 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2459/4901] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:32:08.648405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:08.658625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15a37b-2e4d-4060-a384-b458f522d7ee admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:08.663916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:08.664574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.664853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.665126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] PATH_INFO: `/v3/projects/8fa7a9085f114d6c8b1473fd22cb32b4/users/03a8a1c2acff44b493e2e94ee2ab968d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.680072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa7a9085f114d6c8b1473fd22cb32b4, user_id=03a8a1c2acff44b493e2e94ee2ab968d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:08.682829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:08.763131 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2443/4902] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:32:08 2022] PUT /identity/v3/projects/8fa7a9085f114d6c8b1473fd22cb32b4/users/03a8a1c2acff44b493e2e94ee2ab968d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:08.768229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6e98-5fb5-4fb6-8eff-ecd693244a68 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.768587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6e98-5fb5-4fb6-8eff-ecd693244a68 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.768932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6e98-5fb5-4fb6-8eff-ecd693244a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.790648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-059e6e98-5fb5-4fb6-8eff-ecd693244a68 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:08.791904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-059e6e98-5fb5-4fb6-8eff-ecd693244a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:08.858162 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2460/4903] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:32:08.872727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:08.874925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:08.949932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39741-1208-4845-a847-7b53dd194cb9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:08.961150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:08.961790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:08.962113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:08.962393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:08.973916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:08.975739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:08.986489 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2444/4904] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:09.172812 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:10.711080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0979509-ef36-4f49-9e0d-2b69b62af28e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:10.711582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0979509-ef36-4f49-9e0d-2b69b62af28e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:10.711677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0979509-ef36-4f49-9e0d-2b69b62af28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:10.763857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c0979509-ef36-4f49-9e0d-2b69b62af28e None None] MFA Rules not processed for user `03a8a1c2acff44b493e2e94ee2ab968d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:10.767013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c0979509-ef36-4f49-9e0d-2b69b62af28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:10.848441 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:10.882089 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2461/4905] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:10.890367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:10.892001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:10.994076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41971fde-7268-408b-b248-5139ac7c6db4 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:10.998532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571b0f1-17f8-441d-a888-defa5eb475de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:10.999161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b0f1-17f8-441d-a888-defa5eb475de service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:10.999507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b0f1-17f8-441d-a888-defa5eb475de service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:10.999783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571b0f1-17f8-441d-a888-defa5eb475de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:11.012058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571b0f1-17f8-441d-a888-defa5eb475de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:11.013565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571b0f1-17f8-441d-a888-defa5eb475de service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:11.026154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2445/4906] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:14.164371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.165379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.165839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.179240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9a454-f928-46c7-8f29-c3b41d2387c6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.180071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9a454-f928-46c7-8f29-c3b41d2387c6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.180530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9a454-f928-46c7-8f29-c3b41d2387c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.203480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] MFA Rules not processed for user `03a8a1c2acff44b493e2e94ee2ab968d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:14.206716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:14.220788 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2462/4907] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:32:14.235915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-45e9a454-f928-46c7-8f29-c3b41d2387c6 None None] MFA Rules not processed for user `62107b75e0c747278869f00fd01c5d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:14.237429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-45e9a454-f928-46c7-8f29-c3b41d2387c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:14.342937 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2446/4908] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:14.347446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:14.348884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:14.362591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b4976-f5ec-4d25-96d3-74b7bcc21143 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:14.371620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:14.371620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.371620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.371620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.371967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:14.371967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:14.461475 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2463/4909] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:32:14 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:14.462820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9a454-f928-46c7-8f29-c3b41d2387c6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:14.480343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9a454-f928-46c7-8f29-c3b41d2387c6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:14.495735 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:14.507599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:14.555947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:14.556618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.556907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.557184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.557912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:14.560142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:14.582676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35464d06-2cf9-4661-b244-e2622d5239bc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:14.586915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:14.587594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.588072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.588421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.590332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:14.603394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:14.604654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:14.615248 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2464/4910] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:14.669064 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2447/4911] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:32:14 2022] POST /identity/v3/users => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:14.669799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:14.682568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321dcd0-eaa0-4a26-a192-dc478c70b034 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:14.687484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:14.688093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.688371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.688669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.689305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:14.691048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:14.706739 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2465/4912] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:32:14.712980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:14.732002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03b10-88a7-4153-90b0-1f2f19dda352 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:14.737294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d9fa-3ebf-444a-b95e-bcb23990d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:14.738103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d9fa-3ebf-444a-b95e-bcb23990d2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.738387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d9fa-3ebf-444a-b95e-bcb23990d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.738752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d9fa-3ebf-444a-b95e-bcb23990d2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.740731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d9fa-3ebf-444a-b95e-bcb23990d2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:14.741778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d9fa-3ebf-444a-b95e-bcb23990d2e1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:14.757843 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2448/4913] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:32:14.761430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:14.770025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120ed5-b56a-40d0-8c36-2090d4dabf65 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:14.784068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851a641-5c62-4888-b3b6-e818f71a6316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:14.790046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851a641-5c62-4888-b3b6-e818f71a6316 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:14.790046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851a641-5c62-4888-b3b6-e818f71a6316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:14.790046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851a641-5c62-4888-b3b6-e818f71a6316 admin admin] PATH_INFO: `/v3/projects/eaaf82197e764b0b9103f3703afa2b71/users/6f5c187e80a04aa8a0cad9f807e7af40/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:14.811314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851a641-5c62-4888-b3b6-e818f71a6316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaf82197e764b0b9103f3703afa2b71, user_id=6f5c187e80a04aa8a0cad9f807e7af40, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:14.815193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851a641-5c62-4888-b3b6-e818f71a6316 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:14.890960 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2466/4914] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:32:14 2022] PUT /identity/v3/projects/eaaf82197e764b0b9103f3703afa2b71/users/6f5c187e80a04aa8a0cad9f807e7af40/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:24.234859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:24.235388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:24.235388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:24.268664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] MFA Rules not processed for user `6f5c187e80a04aa8a0cad9f807e7af40`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:24.269934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:24.357334 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2449/4915] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:24.369952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:24.370439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:24.370529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:24.397198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] MFA Rules not processed for user `62107b75e0c747278869f00fd01c5d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:24.398446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:24.475344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2467/4916] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:24.490934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:24.494927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:24.575203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131cb24-f7b5-4f2c-86e8-5076323b63fd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:24.580647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0797f-a0d1-4e9f-8dca-f0866a91409e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:24.581257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0797f-a0d1-4e9f-8dca-f0866a91409e service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:24.581537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0797f-a0d1-4e9f-8dca-f0866a91409e service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:24.581826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0797f-a0d1-4e9f-8dca-f0866a91409e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:24.590966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0797f-a0d1-4e9f-8dca-f0866a91409e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:24.592596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0797f-a0d1-4e9f-8dca-f0866a91409e service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:24.602950 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2450/4917] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:24 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:25.178934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:25.180441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:25.231398 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:25.262855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d71173-8d06-49ce-a27e-333a6b7fce5d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:25.268502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:25.272085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:25.272085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:25.272085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] PATH_INFO: `/v3/users/533ecba41d7f4b119ea20a5c6bdb5e73` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:25.272085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533ecba41d7f4b119ea20a5c6bdb5e73)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:25.274117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:25.533936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533ecba41d7f4b119ea20a5c6bdb5e73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:25.534957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533ecba41d7f4b119ea20a5c6bdb5e73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:25.637643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533ecba41d7f4b119ea20a5c6bdb5e73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:25.647011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533ecba41d7f4b119ea20a5c6bdb5e73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:25.647772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533ecba41d7f4b119ea20a5c6bdb5e73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:25.685086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2468/4918] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:32:25 2022] DELETE /identity/v3/users/533ecba41d7f4b119ea20a5c6bdb5e73 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:25.689559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:25.690028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:25.690166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:25.727656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:25.727656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:25.732610 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:25.807605 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2451/4919] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:25.817897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:25.819564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:25.884576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631c469-6824-40bf-9a4f-458ce93074c1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:25.888221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a9fe5-6331-4d7e-9b7a-bd0e06bf9159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:25.888833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9fe5-6331-4d7e-9b7a-bd0e06bf9159 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:25.889241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9fe5-6331-4d7e-9b7a-bd0e06bf9159 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:25.889517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9fe5-6331-4d7e-9b7a-bd0e06bf9159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:25.899772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a9fe5-6331-4d7e-9b7a-bd0e06bf9159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:25.901291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a9fe5-6331-4d7e-9b7a-bd0e06bf9159 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:25.912204 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2469/4920] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:26.558194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:26.558194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:26.574988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af254b7b-2481-4d4a-9799-3c11de62c839 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:26.583022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:26.583774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:26.591351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:26.595042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] PATH_INFO: `/v3/projects/27f074d61391492e81391b37ac207c4d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:26.606918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f074d61391492e81391b37ac207c4d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:26.606918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:26.775146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f074d61391492e81391b37ac207c4d', 'request_id': 'req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:26.781401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f074d61391492e81391b37ac207c4d', 'request_id': 'req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:26.965718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f074d61391492e81391b37ac207c4d', 'request_id': 'req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:26.987751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] The token cache is being invalidate because project 27f074d61391492e81391b37ac207c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:32:26.988047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:26.988718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16676cfe-ee61-4599-9ca6-bd4c1e2d76a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:32:26.990982 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2452/4921] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:32:26 2022] DELETE /identity/v3/projects/27f074d61391492e81391b37ac207c4d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:26.999490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf936a-25b5-4caf-a35a-0b13a3d78e46 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:26.999996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf936a-25b5-4caf-a35a-0b13a3d78e46 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.000098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf936a-25b5-4caf-a35a-0b13a3d78e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.034992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a5cf936a-25b5-4caf-a35a-0b13a3d78e46 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:27.041708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a5cf936a-25b5-4caf-a35a-0b13a3d78e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:27.095011 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:27.104513 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2470/4922] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:27.112433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9bc28-d6e4-42de-a3fc-33bd046beea0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.113169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9bc28-d6e4-42de-a3fc-33bd046beea0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.114681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9bc28-d6e4-42de-a3fc-33bd046beea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.136577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ace9bc28-d6e4-42de-a3fc-33bd046beea0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:27.137915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ace9bc28-d6e4-42de-a3fc-33bd046beea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:27.146875 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2453/4923] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:27.150924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf936a-25b5-4caf-a35a-0b13a3d78e46 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:27.161497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf936a-25b5-4caf-a35a-0b13a3d78e46 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:27.167346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:27.168080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.168369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.168643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.169297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:32:27.169604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:27.171262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:27.185276 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2471/4924] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:32:27.193125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9bc28-d6e4-42de-a3fc-33bd046beea0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:27.203066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9bc28-d6e4-42de-a3fc-33bd046beea0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:27.211400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:27.235660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.235660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.235660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.235660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:27.235660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:27.374924 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2454/4925] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:32:27 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:27.379197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:27.395014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e738a71-b99d-4a6b-845c-a84a15fe47c8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:27.494970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:27.495538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.495817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.496092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.496821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:27.498988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:27.611575 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2472/4926] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:32:27 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:32:27.615328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:27.627792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a13e-9a3b-4d09-85f2-a84ebbe83b8e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:27.634003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:27.635040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.635320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.635593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.636315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:27.638064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:27.651052 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2455/4927] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:32:27.655617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:27.666006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5a858-0c87-481c-8441-1ffd5c2a2f33 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:27.676923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b5414-d738-4b94-b44f-44c459791efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:27.678934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5414-d738-4b94-b44f-44c459791efe admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.679293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5414-d738-4b94-b44f-44c459791efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.679638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b5414-d738-4b94-b44f-44c459791efe admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.680372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b5414-d738-4b94-b44f-44c459791efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:27.682262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b5414-d738-4b94-b44f-44c459791efe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:27.702135 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2473/4928] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:32:27.710524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:27.726642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0352d08-94a2-4750-a183-96c5fbb3c69b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:27.731952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:27.732863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.733370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.733743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] PATH_INFO: `/v3/projects/9f3fa74c24ce41f5baf1e5f83ed46261/users/dfa2333d691647f387b6600c0ba12944/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.753415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3fa74c24ce41f5baf1e5f83ed46261, user_id=dfa2333d691647f387b6600c0ba12944, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:27.756988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:27.830120 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2456/4929] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:32:27 2022] PUT /identity/v3/projects/9f3fa74c24ce41f5baf1e5f83ed46261/users/dfa2333d691647f387b6600c0ba12944/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:32:27.835584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:27.835876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:27.836156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:27.870898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] MFA Rules not processed for user `dfa2333d691647f387b6600c0ba12944`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:27.872218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:28.016017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2474/4930] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:28.034323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:28.037035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:28.084947 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:28.112774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c64665-3ead-4e81-abad-d0e8d85e7461 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:28.117606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:28.118266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:28.118736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:28.119034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:28.131224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:28.132824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:28.148347 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2457/4931] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:30.891072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:30.892759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:30.956023 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:30.980290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd6b5-9d1a-456b-83f5-d4b82e9ac9e4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:30.986524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9dfe3-806b-49b3-a9f8-e3bdf752ae97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:30.987289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9dfe3-806b-49b3-a9f8-e3bdf752ae97 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:30.987679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9dfe3-806b-49b3-a9f8-e3bdf752ae97 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:30.988061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9dfe3-806b-49b3-a9f8-e3bdf752ae97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:30.990693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bbf9dfe3-806b-49b3-a9f8-e3bdf752ae97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:31.062086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9dfe3-806b-49b3-a9f8-e3bdf752ae97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:31.064165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9dfe3-806b-49b3-a9f8-e3bdf752ae97 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:31.077437 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2475/4932] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:34.809297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:34.810862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:34.884048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977174bd-dd74-4172-b503-8268bfa67d69 service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:34.887888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:34.888501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:34.888775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:34.889080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:34.890927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:34.908785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:34.910301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:34.929483 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2458/4933] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:39.171298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:39.171298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:39.171298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:39.191440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] MFA Rules not processed for user `03a8a1c2acff44b493e2e94ee2ab968d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:39.192733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:39.265488 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2476/4934] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:40.498385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:40.500772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:40.521022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662afd6-36b5-442e-be0d-a13ef0171588 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:40.525406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:40.526066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:40.526366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:40.527981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:40.530854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:40.558201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:40.558201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:40.571688 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2459/4935] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:41.436436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:41.438557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:41.457758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8af91-7a4e-4c28-a8dd-0227ec7028db None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:41.464998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:41.465614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:41.465928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:41.466205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:41.468150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:41.536774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:41.539010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:41.550974 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2477/4936] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:46.372378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:46.391559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6762-7bc6-4947-85ec-c13f159cf051 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:46.402283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44362786-1d8c-45b4-8201-224e3bdae07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:46.403092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44362786-1d8c-45b4-8201-224e3bdae07d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:46.403372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44362786-1d8c-45b4-8201-224e3bdae07d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:46.403655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44362786-1d8c-45b4-8201-224e3bdae07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:46.407271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44362786-1d8c-45b4-8201-224e3bdae07d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:46.430155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44362786-1d8c-45b4-8201-224e3bdae07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:46.441602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44362786-1d8c-45b4-8201-224e3bdae07d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:46.465148 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2460/4937] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:50.026228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:50.040442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063b77-0e7a-4db5-92cf-cdaa57bfe1d5 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:50.046486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:50.047326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:50.047785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:50.048220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:50.050240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:50.110970 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:50.141281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:50.143792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:50.164262 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2478/4938] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:50.734102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7dfe4-9f3e-49ae-92b3-5c3801b1e7e1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:50.734650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7dfe4-9f3e-49ae-92b3-5c3801b1e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:50.734650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7dfe4-9f3e-49ae-92b3-5c3801b1e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:50.755104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e6b7dfe4-9f3e-49ae-92b3-5c3801b1e7e1 None None] MFA Rules not processed for user `5cc06c467eb8468dba45af3d1dcf808d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:50.756921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6b7dfe4-9f3e-49ae-92b3-5c3801b1e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:50.819324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2461/4939] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:51.651691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:51.653318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:51.757333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1207f-cdf4-4178-b01e-387861b84705 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:51.763061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6668f84-e3c8-4133-949b-bbce6d86243f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:51.763773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668f84-e3c8-4133-949b-bbce6d86243f service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:51.764154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668f84-e3c8-4133-949b-bbce6d86243f service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:51.764525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668f84-e3c8-4133-949b-bbce6d86243f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:51.766645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c6668f84-e3c8-4133-949b-bbce6d86243f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:51.780691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6668f84-e3c8-4133-949b-bbce6d86243f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:51.782734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6668f84-e3c8-4133-949b-bbce6d86243f service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:51.801328 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2479/4940] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:54.970661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac79950-6fd6-4ae9-b6b4-7b77a509ac3e None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:54.971272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac79950-6fd6-4ae9-b6b4-7b77a509ac3e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:54.971272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac79950-6fd6-4ae9-b6b4-7b77a509ac3e None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:54.972916 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2462/4941] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:32:54.980910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232771d8-0119-4caa-b3ab-4a5b696fca67 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:54.981307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232771d8-0119-4caa-b3ab-4a5b696fca67 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:54.981307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232771d8-0119-4caa-b3ab-4a5b696fca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:55.056945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-232771d8-0119-4caa-b3ab-4a5b696fca67 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:55.056945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-232771d8-0119-4caa-b3ab-4a5b696fca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:55.064950 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2480/4942] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:55.077718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac79950-6fd6-4ae9-b6b4-7b77a509ac3e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:55.090878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac79950-6fd6-4ae9-b6b4-7b77a509ac3e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:55.095534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:55.096307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:55.103240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:55.103240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:55.107197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:55.109320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:55.120030 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2463/4943] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:32:59.431719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232771d8-0119-4caa-b3ab-4a5b696fca67 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:59.449719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232771d8-0119-4caa-b3ab-4a5b696fca67 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:59.456738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:59.457735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:59.458309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:59.458831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:59.461621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:59.479466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:59.481519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:59.499472 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2481/4944] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:00.988054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:00.990312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:00.996983 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=82 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:01.116566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f0adf-2a8e-408f-aa87-286c0c48ad06 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:01.125236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:01.126047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:01.126542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:01.127465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] PATH_INFO: `/v3/users/62107b75e0c747278869f00fd01c5d7c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:01.128676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=62107b75e0c747278869f00fd01c5d7c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:01.135327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:01.440880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62107b75e0c747278869f00fd01c5d7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:01.453765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62107b75e0c747278869f00fd01c5d7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:01.462023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62107b75e0c747278869f00fd01c5d7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:01.462867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62107b75e0c747278869f00fd01c5d7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:01.654465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62107b75e0c747278869f00fd01c5d7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:01.662229 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2464/4945] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:00 2022] DELETE /identity/v3/users/62107b75e0c747278869f00fd01c5d7c => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:01.997306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:02.008576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f974df-4c3c-4df1-b440-33f88058f230 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:02.072194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:02.072825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:02.073106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:02.073404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] PATH_INFO: `/v3/projects/a47b6734fa4347ee932431e4119ea93a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:02.074526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47b6734fa4347ee932431e4119ea93a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:02.076410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:02.269032 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:02.283001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47b6734fa4347ee932431e4119ea93a', 'request_id': 'req-b0fe35f1-c152-440f-b3b0-28662d519f0f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.290670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47b6734fa4347ee932431e4119ea93a', 'request_id': 'req-b0fe35f1-c152-440f-b3b0-28662d519f0f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.463523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47b6734fa4347ee932431e4119ea93a', 'request_id': 'req-b0fe35f1-c152-440f-b3b0-28662d519f0f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.475594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] The token cache is being invalidate because project a47b6734fa4347ee932431e4119ea93a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:02.476040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.476523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.478199 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2482/4946] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:01 2022] DELETE /identity/v3/projects/a47b6734fa4347ee932431e4119ea93a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:02.482384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:02.483826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:02.496858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea389cb-05a8-4683-bc20-f88d211674cf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:02.561787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466df675-3281-4272-b421-61892b141f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:02.563769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466df675-3281-4272-b421-61892b141f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:02.563769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466df675-3281-4272-b421-61892b141f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:02.563769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466df675-3281-4272-b421-61892b141f57 admin admin] PATH_INFO: `/v3/users/6f5c187e80a04aa8a0cad9f807e7af40` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:02.564387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466df675-3281-4272-b421-61892b141f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5c187e80a04aa8a0cad9f807e7af40)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:02.569081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466df675-3281-4272-b421-61892b141f57 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:02.618300 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:02.933985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-466df675-3281-4272-b421-61892b141f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5c187e80a04aa8a0cad9f807e7af40'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.947972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-466df675-3281-4272-b421-61892b141f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5c187e80a04aa8a0cad9f807e7af40'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.956619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-466df675-3281-4272-b421-61892b141f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5c187e80a04aa8a0cad9f807e7af40'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:02.957351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-466df675-3281-4272-b421-61892b141f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5c187e80a04aa8a0cad9f807e7af40'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:03.063180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-466df675-3281-4272-b421-61892b141f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5c187e80a04aa8a0cad9f807e7af40'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:03.075246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2465/4947] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:02 2022] DELETE /identity/v3/users/6f5c187e80a04aa8a0cad9f807e7af40 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:03.516004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:03.517528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:03.535224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe35f1-c152-440f-b3b0-28662d519f0f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:03.640529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:03.641265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:03.641616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:03.642001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] PATH_INFO: `/v3/projects/eaaf82197e764b0b9103f3703afa2b71` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:03.643231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaaf82197e764b0b9103f3703afa2b71)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:03.645292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:03.853635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaaf82197e764b0b9103f3703afa2b71', 'request_id': 'req-df48860d-6427-4993-aa09-62fbd51a96e8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:03.860582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaaf82197e764b0b9103f3703afa2b71', 'request_id': 'req-df48860d-6427-4993-aa09-62fbd51a96e8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:04.062378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaaf82197e764b0b9103f3703afa2b71', 'request_id': 'req-df48860d-6427-4993-aa09-62fbd51a96e8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:04.075205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] The token cache is being invalidate because project eaaf82197e764b0b9103f3703afa2b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:04.075495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:04.076148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df48860d-6427-4993-aa09-62fbd51a96e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:04.078637 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2483/4948] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:03 2022] DELETE /identity/v3/projects/eaaf82197e764b0b9103f3703afa2b71 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:04.086328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dcf06-32d4-44df-85c5-6a0e507eadfd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.086328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dcf06-32d4-44df-85c5-6a0e507eadfd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.086328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dcf06-32d4-44df-85c5-6a0e507eadfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.115540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-814dcf06-32d4-44df-85c5-6a0e507eadfd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:04.115540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-814dcf06-32d4-44df-85c5-6a0e507eadfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:04.187166 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2466/4949] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:04.195570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7557-9155-40ba-bbf7-4763cfeebe11 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.196062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7557-9155-40ba-bbf7-4763cfeebe11 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.196344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7557-9155-40ba-bbf7-4763cfeebe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.216603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0f2d7557-9155-40ba-bbf7-4763cfeebe11 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:04.217820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f2d7557-9155-40ba-bbf7-4763cfeebe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:04.225997 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2484/4950] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:04.230322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dcf06-32d4-44df-85c5-6a0e507eadfd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:04.240785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dcf06-32d4-44df-85c5-6a0e507eadfd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:04.258416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:04.258416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.258416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.258416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.258732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:04.258732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:04.258732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:04.266283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2467/4951] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:04.267424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7557-9155-40ba-bbf7-4763cfeebe11 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:04.277325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7557-9155-40ba-bbf7-4763cfeebe11 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:04.282707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:04.286815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.286815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.289556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.294617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:04.296839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:04.439067 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2485/4952] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:04 2022] POST /identity/v3/projects => generated 359 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:04.446840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:04.466984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854acf6-7961-4d8a-a9d4-fc02a1762145 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:04.543153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:04.543775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.544062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.544342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.544982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:04.546979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:04.694396 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2468/4953] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:04 2022] POST /identity/v3/users => generated 280 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:04.695324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:04.713406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633319d-a96b-46be-a9ef-a2c9e81e14c8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:04.719138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:04.719274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.719507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.719785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.720443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:04.722226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:04.730053 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:04.736004 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2486/4954] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:04.739846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:04.754371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8e93b-04d0-44ab-8c99-ef80ff69319e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:04.760142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66d78-a42c-4112-b0ef-9e2bfd54953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:04.760749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66d78-a42c-4112-b0ef-9e2bfd54953a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.767924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66d78-a42c-4112-b0ef-9e2bfd54953a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.767924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66d78-a42c-4112-b0ef-9e2bfd54953a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.767924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66d78-a42c-4112-b0ef-9e2bfd54953a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:04.767924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66d78-a42c-4112-b0ef-9e2bfd54953a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:04.777606 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2469/4955] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:04.781556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:04.793328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4a64b-9b1e-440a-99b2-4c6f5ef48594 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:04.797967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:04.798615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.798897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.799178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] PATH_INFO: `/v3/projects/ef1a347636c24ec9b4072e66b1d8a0fa/users/6114536ea7534135b5b23b4aaa439313/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.818505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1a347636c24ec9b4072e66b1d8a0fa, user_id=6114536ea7534135b5b23b4aaa439313, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:04.818505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:04.913842 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2487/4956] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:04 2022] PUT /identity/v3/projects/ef1a347636c24ec9b4072e66b1d8a0fa/users/6114536ea7534135b5b23b4aaa439313/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:04.924704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c89f37-83a4-433e-8930-b1ec82b34920 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:04.924989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c89f37-83a4-433e-8930-b1ec82b34920 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:04.925259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c89f37-83a4-433e-8930-b1ec82b34920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:04.972762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-27c89f37-83a4-433e-8930-b1ec82b34920 None None] MFA Rules not processed for user `6114536ea7534135b5b23b4aaa439313`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:04.974265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-27c89f37-83a4-433e-8930-b1ec82b34920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:05.050959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2470/4957] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:05.106281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:05.179616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698a9a-f623-4695-9a16-76bbcd6da4f4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:05.185100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:05.185974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:05.186146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:05.186419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] PATH_INFO: `/v3/users/6114536ea7534135b5b23b4aaa439313` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:05.187963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6114536ea7534135b5b23b4aaa439313)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:05.189495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:05.403426 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:05.530702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6114536ea7534135b5b23b4aaa439313'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:05.531363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6114536ea7534135b5b23b4aaa439313'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:05.637547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6114536ea7534135b5b23b4aaa439313'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:05.647832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6114536ea7534135b5b23b4aaa439313'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:05.648641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6114536ea7534135b5b23b4aaa439313'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:05.669630 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2488/4958] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:05 2022] DELETE /identity/v3/users/6114536ea7534135b5b23b4aaa439313 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:05.674619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257035db-338a-4530-8d67-9d34000e77bb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:05.675174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257035db-338a-4530-8d67-9d34000e77bb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:05.675683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257035db-338a-4530-8d67-9d34000e77bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:05.699022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-257035db-338a-4530-8d67-9d34000e77bb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:05.700685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-257035db-338a-4530-8d67-9d34000e77bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:05.784187 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2471/4959] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:05.797557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:05.799270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:05.877680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71f17-67eb-4ee2-a684-c45eb874f496 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:05.883096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:05.884051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:05.884051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:05.884377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:05.895291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:05.897373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:05.907818 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2489/4960] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:06.651538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:06.651995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:06.652086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:06.672655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:06.673800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:06.698492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:06.699965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:06.722633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8bed-cb0e-4126-8428-b4c3a9719af1 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:06.729129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:06.732735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:06.732735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:06.732735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] PATH_INFO: `/v3/projects/ef1a347636c24ec9b4072e66b1d8a0fa` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:06.733165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1a347636c24ec9b4072e66b1d8a0fa)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:06.735449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:06.738852 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2472/4961] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:06.904559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1a347636c24ec9b4072e66b1d8a0fa', 'request_id': 'req-a547f0da-f280-4327-ba85-8dd2116b4b5d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:06.912194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1a347636c24ec9b4072e66b1d8a0fa', 'request_id': 'req-a547f0da-f280-4327-ba85-8dd2116b4b5d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:06.965109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:06.966647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:07.033528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1a347636c24ec9b4072e66b1d8a0fa', 'request_id': 'req-a547f0da-f280-4327-ba85-8dd2116b4b5d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:07.044193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be07092-6574-48d1-9b49-9fe1b0110122 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:07.046676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] The token cache is being invalidate because project ef1a347636c24ec9b4072e66b1d8a0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:07.046979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:07.047826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a547f0da-f280-4327-ba85-8dd2116b4b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:07.050796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2490/4962] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:06 2022] DELETE /identity/v3/projects/ef1a347636c24ec9b4072e66b1d8a0fa => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:07.058604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f50ed-4782-40d2-b97c-05d67bc764b5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.058997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f50ed-4782-40d2-b97c-05d67bc764b5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.059285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f50ed-4782-40d2-b97c-05d67bc764b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.084659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fc7f50ed-4782-40d2-b97c-05d67bc764b5 None None] MFA Rules not processed for user `74e3121ebe26417585da5cf7f484f096`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:07.084659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fc7f50ed-4782-40d2-b97c-05d67bc764b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:07.108308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b41e93-6b25-442a-88c5-58754da24ce0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:07.108944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b41e93-6b25-442a-88c5-58754da24ce0 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.109234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b41e93-6b25-442a-88c5-58754da24ce0 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.109515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b41e93-6b25-442a-88c5-58754da24ce0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.111410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-61b41e93-6b25-442a-88c5-58754da24ce0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:07.141460 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2491/4963] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:07.143105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb23eba-ba76-4b26-80cc-1c2126901d14 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.143396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb23eba-ba76-4b26-80cc-1c2126901d14 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.143675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb23eba-ba76-4b26-80cc-1c2126901d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.166904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8bb23eba-ba76-4b26-80cc-1c2126901d14 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:07.170601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8bb23eba-ba76-4b26-80cc-1c2126901d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:07.180411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b41e93-6b25-442a-88c5-58754da24ce0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:07.182180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b41e93-6b25-442a-88c5-58754da24ce0 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:07.191640 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2473/4964] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:33:07.253473 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2492/4965] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:07.255566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43345a-f22f-4825-82ee-d955a950f380 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.255934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43345a-f22f-4825-82ee-d955a950f380 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.256819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43345a-f22f-4825-82ee-d955a950f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.298030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0c43345a-f22f-4825-82ee-d955a950f380 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:07.300422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c43345a-f22f-4825-82ee-d955a950f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:07.314857 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2474/4966] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:07.321707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb23eba-ba76-4b26-80cc-1c2126901d14 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:07.333655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb23eba-ba76-4b26-80cc-1c2126901d14 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:07.349420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:07.349420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.349420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.349420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.349938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:07.349938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:07.349938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:07.364881 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2493/4967] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:07.369915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43345a-f22f-4825-82ee-d955a950f380 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:07.383955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43345a-f22f-4825-82ee-d955a950f380 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:07.389005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:07.389951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.396286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.397852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.398548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:07.415359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:07.579031 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2475/4968] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:07 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:07.583175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:07.608067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34272c-cb82-4b9f-ab57-49176889579d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:07.709038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:07.710737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.711025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.711815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.711963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:07.714735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:07.780855 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:07.899489 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2494/4969] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:07 2022] POST /identity/v3/users => generated 292 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:07.903631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:07.917484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9bab4-366f-4049-a53a-e3425016bfb1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:07.924272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:07.925804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.926486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.926769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.927810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:07.930636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:07.942216 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2476/4970] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:07.946946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:07.957478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb082bc-0bb8-4674-a335-2d00c70005fe admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:07.968445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26615053-2e5d-4651-9e13-f7be4d741f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:07.969123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26615053-2e5d-4651-9e13-f7be4d741f91 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.969375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26615053-2e5d-4651-9e13-f7be4d741f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.969648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26615053-2e5d-4651-9e13-f7be4d741f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.970486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26615053-2e5d-4651-9e13-f7be4d741f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:07.972595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26615053-2e5d-4651-9e13-f7be4d741f91 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:07.985983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2495/4971] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:07.990216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:08.000888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfca5-d463-4b7f-8894-705a7c0beb00 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:08.005449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:08.006665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:08.006947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:08.007321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] PATH_INFO: `/v3/projects/462755f90f664c7bb8b029d8300a2bc5/users/8787da99b9aa44fc8091aa311008df0d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:08.024535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] RBAC: Authorizing `identity:create_grant(project_id=462755f90f664c7bb8b029d8300a2bc5, user_id=8787da99b9aa44fc8091aa311008df0d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:08.027391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:08.182163 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2477/4972] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:07 2022] PUT /identity/v3/projects/462755f90f664c7bb8b029d8300a2bc5/users/8787da99b9aa44fc8091aa311008df0d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:08.184172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7049ba5-a5a2-4d4c-8d01-25effbf7726a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:08.203305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7049ba5-a5a2-4d4c-8d01-25effbf7726a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:08.203597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7049ba5-a5a2-4d4c-8d01-25effbf7726a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:08.274122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b7049ba5-a5a2-4d4c-8d01-25effbf7726a None None] MFA Rules not processed for user `8787da99b9aa44fc8091aa311008df0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:08.278315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b7049ba5-a5a2-4d4c-8d01-25effbf7726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:08.384275 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2496/4973] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:08.388797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:08.498097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fa5a6-dc6e-4802-9174-79e18f9f976b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:08.505057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:08.505788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:08.506649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:08.506937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:08.507615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:08.509545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:08.699949 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:08.706663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2478/4974] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:08 2022] POST /identity/v3/projects => generated 381 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:08.711603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7049ba5-a5a2-4d4c-8d01-25effbf7726a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:08.736241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7049ba5-a5a2-4d4c-8d01-25effbf7726a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:08.877012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:08.882112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:08.883473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:08.883793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:08.885549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:08.887850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.023355 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2497/4975] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:08 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:09.027494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.038507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cbab4-5fcc-4196-872f-c50988f94cf6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:09.044266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:09.044912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.045194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.045469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.046165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:09.047987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.060327 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2479/4976] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:09.064398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.075767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c241-54cd-45fe-9407-e9a2025e9918 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:09.080637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:09.081289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.081571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.081874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] PATH_INFO: `/v3/projects/bdb2bcfc501041abac52278ea41bfe9c/users/7d84edb477d54266a7083498b28bbb61/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.097627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb2bcfc501041abac52278ea41bfe9c, user_id=7d84edb477d54266a7083498b28bbb61, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:09.100548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.211496 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2498/4977] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:09 2022] PUT /identity/v3/projects/bdb2bcfc501041abac52278ea41bfe9c/users/7d84edb477d54266a7083498b28bbb61/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:09.215496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.232946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce53c2-7a1a-4dbb-bf03-6580a947e70f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:09.352918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9f287-5681-418a-a79e-cc433c43a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:09.353972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f287-5681-418a-a79e-cc433c43a911 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.354277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f287-5681-418a-a79e-cc433c43a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.354544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f287-5681-418a-a79e-cc433c43a911 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.355554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9f287-5681-418a-a79e-cc433c43a911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:09.357168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9f287-5681-418a-a79e-cc433c43a911 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.376657 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2480/4978] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:09.380640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.395037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46456f9-bb5c-4370-911d-78b4700023ab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:09.410734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:09.411581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.411866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.412146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] PATH_INFO: `/v3/projects/bdb2bcfc501041abac52278ea41bfe9c/users/7d84edb477d54266a7083498b28bbb61/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.415114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb2bcfc501041abac52278ea41bfe9c, user_id=7d84edb477d54266a7083498b28bbb61, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:09.417805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.457152 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2499/4979] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:09 2022] PUT /identity/v3/projects/bdb2bcfc501041abac52278ea41bfe9c/users/7d84edb477d54266a7083498b28bbb61/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:09.466855 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:09.469986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7004d8-0f86-4057-9b54-8007d5e5ea2e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.478335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7004d8-0f86-4057-9b54-8007d5e5ea2e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.478593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7004d8-0f86-4057-9b54-8007d5e5ea2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.523181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fb7004d8-0f86-4057-9b54-8007d5e5ea2e None None] MFA Rules not processed for user `7d84edb477d54266a7083498b28bbb61`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:09.524457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fb7004d8-0f86-4057-9b54-8007d5e5ea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:09.622693 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2481/4980] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:09.623935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.639428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38312-6054-4c16-bdc2-a09ebfd64bb6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:09.644517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:09.651955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.651955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.651955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.651955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:09.651955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invalid input for field 'name': '' is too short Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: On instance['name']: Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: On instance['name']: Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: '' Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise error Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application '' Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:09.655232 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:33:09.656643 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application '' Aug 28 01:33:09.657673 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:09.661232 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2500/4981] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:09 2022] POST /identity/v3/domains => generated 283 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:33:09.662212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7004d8-0f86-4057-9b54-8007d5e5ea2e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.672693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7004d8-0f86-4057-9b54-8007d5e5ea2e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:09.680698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:09.682169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.682530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.683064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.683671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:09.685591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: On instance['name']: Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: On instance['name']: Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise error Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.693145 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 01:33:09.701893 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application On instance['name']: Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:09.702938 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2482/4982] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:09 2022] POST /identity/v3/domains => generated 412 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 01:33:09.705527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.716136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589073-ad33-4614-909c-77f1c5043af8 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:09.721328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:09.726455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:09.726799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:09.727666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:09.728577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:09.733019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:09.863733 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2501/4983] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:09 2022] POST /identity/v3/domains => generated 277 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:09.873160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:09.884376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1f2f-f62d-4a66-ab62-672dc58f2c8b tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:10.053397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:10.054300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:10.054824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:10.055321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains/8f40bd18e0504df38d8c5c09170857df` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:10.071473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8f40bd18e0504df38d8c5c09170857df)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:10.073759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 28 01:33:10.096555 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 01:33:10.097480 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:10.105419 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2483/4984] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:09 2022] DELETE /identity/v3/domains/8f40bd18e0504df38d8c5c09170857df => generated 120 bytes in 227 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:10.106742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:10.128848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36dc5e-31dd-41cd-a844-b46acd395e81 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:10.134755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:10.135403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:10.135693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:10.136048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains/8f40bd18e0504df38d8c5c09170857df` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:10.137297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8f40bd18e0504df38d8c5c09170857df)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:10.139034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:10.165783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8f40bd18e0504df38d8c5c09170857df'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.166814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8f40bd18e0504df38d8c5c09170857df'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.272848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8f40bd18e0504df38d8c5c09170857df'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.273481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8f40bd18e0504df38d8c5c09170857df'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.275956 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2502/4985] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:33:10 2022] PATCH /identity/v3/domains/8f40bd18e0504df38d8c5c09170857df => generated 278 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:10.279955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:10.281640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:10.296946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e75d9-34fe-4f38-aac4-58c82eeae859 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:10.310306 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:10.384320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:10.385226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:10.385513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:10.385853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains/8f40bd18e0504df38d8c5c09170857df` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:10.412164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8f40bd18e0504df38d8c5c09170857df)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:10.413940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:10.452501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8f40bd18e0504df38d8c5c09170857df'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.458844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8f40bd18e0504df38d8c5c09170857df'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.617363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f40bd18e0504df38d8c5c09170857df', 'request_id': 'req-b94a88ea-7493-4501-813d-77b5f9547466'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.632953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f40bd18e0504df38d8c5c09170857df', 'request_id': 'req-b94a88ea-7493-4501-813d-77b5f9547466'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.706567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f40bd18e0504df38d8c5c09170857df', 'request_id': 'req-b94a88ea-7493-4501-813d-77b5f9547466'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.709043 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:10.743655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] The token cache is being invalidate because project 8f40bd18e0504df38d8c5c09170857df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:10.744071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.746329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.756544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8f40bd18e0504df38d8c5c09170857df', 'request_id': 'req-b94a88ea-7493-4501-813d-77b5f9547466'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.757573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8f40bd18e0504df38d8c5c09170857df', 'request_id': 'req-b94a88ea-7493-4501-813d-77b5f9547466'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.758513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8f40bd18e0504df38d8c5c09170857df', 'request_id': 'req-b94a88ea-7493-4501-813d-77b5f9547466'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:10.790264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2484/4986] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:10 2022] DELETE /identity/v3/domains/8f40bd18e0504df38d8c5c09170857df => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:10.792831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:10.808896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882322-d2fc-4a31-ab93-686d7e016e7a tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:10.906455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:10.907176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:10.907538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:10.907874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains/dee14bfa49d0414db37f2cdcd14dd400` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:10.918120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Could not find domain: dee14bfa49d0414db37f2cdcd14dd400.: keystone.exception.DomainNotFound: Could not find domain: dee14bfa49d0414db37f2cdcd14dd400. Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dee14bfa49d0414db37f2cdcd14dd400. Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:10.923448 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:10.924436 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:33:10.925384 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dee14bfa49d0414db37f2cdcd14dd400. Aug 28 01:33:10.926749 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:10.926749 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2503/4987] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:10 2022] DELETE /identity/v3/domains/dee14bfa49d0414db37f2cdcd14dd400 => generated 112 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:10.932751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:10.934277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:10.952970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a88ea-7493-4501-813d-77b5f9547466 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:10.959985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:10.960620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:10.961173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:10.961476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:10.962389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:10.964139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:11.078530 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2485/4988] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:10 2022] POST /identity/v3/domains => generated 253 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:11.082276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:11.103342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697bcb-cab9-44f1-b5de-df9d758a3f1d tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:11.277484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:11.278875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:11.279317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:11.279774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:11.281099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:11.283306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:11.348297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.sql.core [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1850067721' for key 'project.ixu_project_name_domain_id'") Aug 28 01:33:11.348297 n-d-master-1 devstack@keystone.service[82007]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 01:33:11.348297 n-d-master-1 devstack@keystone.service[82007]: [parameters: {'id': '1fc60217271646c9a3bdf5da67b557b9', 'name': 'tempest-domain-dup-1850067721', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 01:33:11.348297 n-d-master-1 devstack@keystone.service[82007]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82007) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1850067721.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1850067721. Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application conn.query(q) Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 01:33:11.387231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result.read() Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1850067721' for key 'project.ixu_project_name_domain_id'") Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 01:33:11.388220 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application yield resource Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise self.value Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application session.commit() Aug 28 01:33:11.389254 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.flush() Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application compat.raise_( Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 01:33:11.391054 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 01:33:11.392957 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application conn.query(q) Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application result.read() Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 01:33:11.394222 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1850067721' for key 'project.ixu_project_name_domain_id'") Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [parameters: {'id': '1fc60217271646c9a3bdf5da67b557b9', 'name': 'tempest-domain-dup-1850067721', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:11.395465 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1850067721. Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:11.396515 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1850067721. Aug 28 01:33:11.403433 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:11.408112 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2504/4989] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:11 2022] POST /identity/v3/domains => generated 212 bytes in 326 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 01:33:11.412383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:11.439007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec13e-720a-42dd-ab10-4fcc8bd0377f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:11.449683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:11.450338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:11.450628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:11.451135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains/e1652d21df4e4bb886999026737373c0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:11.473757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e1652d21df4e4bb886999026737373c0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:11.481689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:11.529405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e1652d21df4e4bb886999026737373c0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:11.530327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e1652d21df4e4bb886999026737373c0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:11.534704 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:11.662832 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:11.714288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e1652d21df4e4bb886999026737373c0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:11.715818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e1652d21df4e4bb886999026737373c0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:11.723353 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2486/4990] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:33:11 2022] PATCH /identity/v3/domains/e1652d21df4e4bb886999026737373c0 => generated 254 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:11.728532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:11.730983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:11.779999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e9dfb-9a91-43be-ad93-bb4deeca21d6 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:11.920230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:11.920949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:11.922738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:11.923880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains/e1652d21df4e4bb886999026737373c0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:11.951456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e1652d21df4e4bb886999026737373c0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:11.955865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:12.016227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e1652d21df4e4bb886999026737373c0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.031164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e1652d21df4e4bb886999026737373c0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.292668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1652d21df4e4bb886999026737373c0', 'request_id': 'req-93e6e399-40e5-40a6-b972-cd054014529f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.304454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1652d21df4e4bb886999026737373c0', 'request_id': 'req-93e6e399-40e5-40a6-b972-cd054014529f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.388379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1652d21df4e4bb886999026737373c0', 'request_id': 'req-93e6e399-40e5-40a6-b972-cd054014529f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.422709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] The token cache is being invalidate because project e1652d21df4e4bb886999026737373c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:12.422991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.425967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.436353 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:12.458686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e1652d21df4e4bb886999026737373c0', 'request_id': 'req-93e6e399-40e5-40a6-b972-cd054014529f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.477907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e1652d21df4e4bb886999026737373c0', 'request_id': 'req-93e6e399-40e5-40a6-b972-cd054014529f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.481849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e1652d21df4e4bb886999026737373c0', 'request_id': 'req-93e6e399-40e5-40a6-b972-cd054014529f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:12.499949 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2505/4991] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:11 2022] DELETE /identity/v3/domains/e1652d21df4e4bb886999026737373c0 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:12.504579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:12.524154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a4a47-7212-4757-a90e-1a59c85294cc tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:12.672252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d84edb477d54266a7083498b28bbb61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdb2bcfc501041abac52278ea41bfe9c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:12.673270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:12.673905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:12.674574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] PATH_INFO: `/v3/domains/8f40bd18e0504df38d8c5c09170857df` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:12.701325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Could not find domain: 8f40bd18e0504df38d8c5c09170857df.: keystone.exception.DomainNotFound: Could not find domain: 8f40bd18e0504df38d8c5c09170857df. Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8f40bd18e0504df38d8c5c09170857df. Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:12.711800 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:12.713601 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:33:12.714796 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8f40bd18e0504df38d8c5c09170857df. Aug 28 01:33:12.716034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:12.719965 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2487/4992] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:33:12 2022] PATCH /identity/v3/domains/8f40bd18e0504df38d8c5c09170857df => generated 112 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:12.723786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:12.725750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:12.792599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:12.796757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:12.932910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6e399-40e5-40a6-b972-cd054014529f tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:12.941421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:12.941421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:12.941421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:12.941421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] PATH_INFO: `/v3/users/8787da99b9aa44fc8091aa311008df0d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:12.941999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8787da99b9aa44fc8091aa311008df0d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:12.944144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:13.038852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be877c6-4293-4b48-832b-278321b14747 tempest-DomainsNegativeTestJSON-997150680 tempest-DomainsNegativeTestJSON-997150680-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:13.049988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0640931-7d35-454c-a466-5ff807e0db85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:13.050699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640931-7d35-454c-a466-5ff807e0db85 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:13.051058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640931-7d35-454c-a466-5ff807e0db85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:13.061686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0640931-7d35-454c-a466-5ff807e0db85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:13.063966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a0640931-7d35-454c-a466-5ff807e0db85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:13.081860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0640931-7d35-454c-a466-5ff807e0db85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:13.083489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0640931-7d35-454c-a466-5ff807e0db85 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:13.108574 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2488/4993] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:33:13.325786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8787da99b9aa44fc8091aa311008df0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:13.327863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8787da99b9aa44fc8091aa311008df0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:13.547866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8787da99b9aa44fc8091aa311008df0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:13.559435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8787da99b9aa44fc8091aa311008df0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:13.559435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8787da99b9aa44fc8091aa311008df0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:13.576675 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:13.581375 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2506/4994] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:12 2022] DELETE /identity/v3/users/8787da99b9aa44fc8091aa311008df0d => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:13.585945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:13.586488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:13.586587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:13.607874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:13.609359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:13.620278 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:13.680970 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2489/4995] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:13.691084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:13.692907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:13.791041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bb02e-ba05-4bb0-89d1-bc869b3f629e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:13.805404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:13.806133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:13.806540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:13.806928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:13.831424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:13.833487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:13.855028 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2507/4996] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:14.865500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:14.868026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:14.889538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d3d76-73b1-47f2-a30c-6d5f7543280b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:14.901731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:14.904970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:14.904970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:14.905678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] PATH_INFO: `/v3/projects/462755f90f664c7bb8b029d8300a2bc5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:14.913432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462755f90f664c7bb8b029d8300a2bc5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:14.917755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:15.065267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462755f90f664c7bb8b029d8300a2bc5', 'request_id': 'req-74f9f54a-4ddb-4f24-987a-1af1e08989e6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.087825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462755f90f664c7bb8b029d8300a2bc5', 'request_id': 'req-74f9f54a-4ddb-4f24-987a-1af1e08989e6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.185760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462755f90f664c7bb8b029d8300a2bc5', 'request_id': 'req-74f9f54a-4ddb-4f24-987a-1af1e08989e6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.206911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] The token cache is being invalidate because project 462755f90f664c7bb8b029d8300a2bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:15.206911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.217547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.222699 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2490/4997] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:14 2022] DELETE /identity/v3/projects/462755f90f664c7bb8b029d8300a2bc5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:15.225078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:15.245326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134d6f-df7c-4dbd-ae2d-0ef89720effe service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:15.481324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:15.486200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:15.486200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:15.486200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] PATH_INFO: `/v3/users/7d84edb477d54266a7083498b28bbb61` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:15.486200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d84edb477d54266a7083498b28bbb61)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:15.487005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:15.516063 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:15.731116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d84edb477d54266a7083498b28bbb61'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.732305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d84edb477d54266a7083498b28bbb61'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.820242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d84edb477d54266a7083498b28bbb61'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.831200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d84edb477d54266a7083498b28bbb61'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.832228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2e9d4a2c-393c-4006-a6a6-b85029dc92ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d84edb477d54266a7083498b28bbb61'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:15.893073 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2508/4998] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:15 2022] DELETE /identity/v3/users/7d84edb477d54266a7083498b28bbb61 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:16.668671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:16.670144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:16.703642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9f54a-4ddb-4f24-987a-1af1e08989e6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:16.790125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:16.791334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:16.791718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:16.792102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] PATH_INFO: `/v3/projects/bdb2bcfc501041abac52278ea41bfe9c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:16.793480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb2bcfc501041abac52278ea41bfe9c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:16.796000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:16.945608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb2bcfc501041abac52278ea41bfe9c', 'request_id': 'req-8c2870cd-760d-483a-928e-1b2d1473dcca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:16.949699 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:16.952466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb2bcfc501041abac52278ea41bfe9c', 'request_id': 'req-8c2870cd-760d-483a-928e-1b2d1473dcca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:17.060754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb2bcfc501041abac52278ea41bfe9c', 'request_id': 'req-8c2870cd-760d-483a-928e-1b2d1473dcca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:17.082602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] The token cache is being invalidate because project bdb2bcfc501041abac52278ea41bfe9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:17.083634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:17.085235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c2870cd-760d-483a-928e-1b2d1473dcca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:17.091540 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2491/4999] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:16 2022] DELETE /identity/v3/projects/bdb2bcfc501041abac52278ea41bfe9c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:17.092986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4386-dbb8-403f-8f43-a418910068ce None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.093459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4386-dbb8-403f-8f43-a418910068ce None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.093548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4386-dbb8-403f-8f43-a418910068ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.142053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-31eb4386-dbb8-403f-8f43-a418910068ce None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:17.145550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-31eb4386-dbb8-403f-8f43-a418910068ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:17.264571 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2509/5000] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:17.273665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c33b5-8c7a-4d7f-a65b-63f1ed88eb8d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.274084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c33b5-8c7a-4d7f-a65b-63f1ed88eb8d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.274442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c33b5-8c7a-4d7f-a65b-63f1ed88eb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.297352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b23c33b5-8c7a-4d7f-a65b-63f1ed88eb8d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:17.298776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b23c33b5-8c7a-4d7f-a65b-63f1ed88eb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:17.307973 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2492/5001] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:17.313507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb4386-dbb8-403f-8f43-a418910068ce None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:17.323879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb4386-dbb8-403f-8f43-a418910068ce None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:17.328419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:17.329051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.329327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.329598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.330271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:17.330573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:17.332149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:17.347033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2510/5002] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:17.351934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c33b5-8c7a-4d7f-a65b-63f1ed88eb8d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:17.368822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c33b5-8c7a-4d7f-a65b-63f1ed88eb8d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:17.374452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:17.375068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.375349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.375622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.376257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:17.378163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:17.495148 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2493/5003] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:17 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:17.499375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:17.515192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47573df6-70a0-424b-b01a-18418cb44c86 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:17.657079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:17.660009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.661234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.661980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.666801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:17.671690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:17.818189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2511/5004] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:17 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:17.823360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:17.836348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ef506-57ad-4bbb-af0f-1a14b1ec0c57 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:17.843100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:17.843972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.844640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.845314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.846738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:17.849280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:17.877772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2494/5005] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:17.882248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:17.899474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aab9f0-77e4-44e5-909c-d8f875d93d1a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:17.907190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d20c0-2fca-4855-8d7d-3943247fa618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:17.907814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d20c0-2fca-4855-8d7d-3943247fa618 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.908094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d20c0-2fca-4855-8d7d-3943247fa618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.908381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d20c0-2fca-4855-8d7d-3943247fa618 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.909017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d20c0-2fca-4855-8d7d-3943247fa618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:17.910654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d20c0-2fca-4855-8d7d-3943247fa618 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:17.912889 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:17.923326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2512/5006] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:17.927956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:17.941437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c70c-c644-4c76-a7d7-841d2039b29a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:17.947247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:17.948545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:17.948925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:17.949272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] PATH_INFO: `/v3/projects/8797f3c4639148a3a13afce793fe4c57/users/78cb3d6b9a6645329869059056443db1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:17.972128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8797f3c4639148a3a13afce793fe4c57, user_id=78cb3d6b9a6645329869059056443db1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:17.975488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:18.055351 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2495/5007] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:17 2022] PUT /identity/v3/projects/8797f3c4639148a3a13afce793fe4c57/users/78cb3d6b9a6645329869059056443db1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:18.066075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f386ca1-c43c-436a-96bc-5d8ffcd12a9f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:18.072084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f386ca1-c43c-436a-96bc-5d8ffcd12a9f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:18.072084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f386ca1-c43c-436a-96bc-5d8ffcd12a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:18.102895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4f386ca1-c43c-436a-96bc-5d8ffcd12a9f None None] MFA Rules not processed for user `78cb3d6b9a6645329869059056443db1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:18.104117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f386ca1-c43c-436a-96bc-5d8ffcd12a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:18.204381 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2513/5008] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:18.205714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:18.321706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970d42d-50fe-4e9d-bd79-4887fd2f91b5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:18.345938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:18.345938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:18.345938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:18.345938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:18.346840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:18.346840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:18.493864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2496/5009] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:18 2022] POST /identity/v3/projects => generated 377 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:18.498204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f386ca1-c43c-436a-96bc-5d8ffcd12a9f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:18.510574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f386ca1-c43c-436a-96bc-5d8ffcd12a9f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:18.600662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:18.601405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:18.601692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:18.602003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:18.602655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:18.604738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:18.693872 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2514/5010] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:18 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:18.698787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:18.715499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bad83c-7d6e-46b5-8021-aa300fe6817e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:18.723556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:18.724201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:18.724485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:18.724826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:18.725495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:18.727809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:18.742138 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2497/5011] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:18.751791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:18.763920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b3318-c216-40e2-9bb6-aff58f28fa90 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:18.769325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:18.770035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:18.770388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:18.770715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] PATH_INFO: `/v3/projects/94f73210dd7843c6b5e96018f9ea9c9b/users/8715b9ca246448478da676900438ce16/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:18.790729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f73210dd7843c6b5e96018f9ea9c9b, user_id=8715b9ca246448478da676900438ce16, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:18.793648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:19.096886 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2515/5012] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:18 2022] PUT /identity/v3/projects/94f73210dd7843c6b5e96018f9ea9c9b/users/8715b9ca246448478da676900438ce16/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:19.104076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:19.118982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df096e-e9fd-45bc-86e5-b65a5c4af758 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:19.154770 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:19.180415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b44b5f-0f8f-42fb-9e12-f4c6be7d3e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:19.181096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b44b5f-0f8f-42fb-9e12-f4c6be7d3e00 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:19.181383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b44b5f-0f8f-42fb-9e12-f4c6be7d3e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:19.181694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b44b5f-0f8f-42fb-9e12-f4c6be7d3e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:19.182383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b44b5f-0f8f-42fb-9e12-f4c6be7d3e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:19.184016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b44b5f-0f8f-42fb-9e12-f4c6be7d3e00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:19.204099 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2498/5013] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:19.208293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:19.231674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7928dc-4f9f-44b0-9695-ec96ba21c2b4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:19.247391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:19.248628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:19.248964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:19.249665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] PATH_INFO: `/v3/projects/94f73210dd7843c6b5e96018f9ea9c9b/users/8715b9ca246448478da676900438ce16/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:19.251837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f73210dd7843c6b5e96018f9ea9c9b, user_id=8715b9ca246448478da676900438ce16, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:19.255940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:19.280799 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2516/5014] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:19 2022] PUT /identity/v3/projects/94f73210dd7843c6b5e96018f9ea9c9b/users/8715b9ca246448478da676900438ce16/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:19.283329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4964445-8847-4126-a9ac-c98ae9a168c4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:19.283821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4964445-8847-4126-a9ac-c98ae9a168c4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:19.284114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4964445-8847-4126-a9ac-c98ae9a168c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:19.322208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c4964445-8847-4126-a9ac-c98ae9a168c4 None None] MFA Rules not processed for user `8715b9ca246448478da676900438ce16`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:19.323442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c4964445-8847-4126-a9ac-c98ae9a168c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:19.457963 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2499/5015] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:19.463276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:19.481434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def477b-3710-4c7d-846e-94e10bbecc50 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:19.492294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:19.493110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:19.493403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:19.493685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:19.494370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:19.495539 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:19.495539 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:19.495539 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:19.499814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:19.609337 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2517/5016] 10.222.0.59 () {60 vars in 1185 bytes} [Sun Aug 28 01:33:19 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:19.612584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4964445-8847-4126-a9ac-c98ae9a168c4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:19.627640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4964445-8847-4126-a9ac-c98ae9a168c4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:19.634577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:19.636578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:19.637089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:19.637666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f94b29b085d64288bdaacd95ca5129e8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:19.638538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f94b29b085d64288bdaacd95ca5129e8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:19.639888 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:19.639888 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:19.639888 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:19.641376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:19.651609 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2500/5017] 10.222.0.59 () {58 vars in 1263 bytes} [Sun Aug 28 01:33:19 2022] GET /identity/v3/OS-OAUTH1/consumers/f94b29b085d64288bdaacd95ca5129e8 => generated 221 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:19.655271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:19.675298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3a2ac-929d-4af9-a482-26d65660d270 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:19.687548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:19.688479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:19.688921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:19.689316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f94b29b085d64288bdaacd95ca5129e8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:19.690033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f94b29b085d64288bdaacd95ca5129e8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:19.691156 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:19.691156 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:19.691156 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:19.694267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:19.697366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invalidating token cache because consumer f94b29b085d64288bdaacd95ca5129e8 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:19.697786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:19.702008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:19.844766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f94b29b085d64288bdaacd95ca5129e8', 'request_id': 'req-a2acce7a-863a-4133-9a7f-e867a9a65577'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:19.946752 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:19.954998 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2518/5018] 10.222.0.59 () {58 vars in 1266 bytes} [Sun Aug 28 01:33:19 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f94b29b085d64288bdaacd95ca5129e8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:19.960810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:19.963204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:19.979973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89357c-4c42-402e-8228-475dd10c1d87 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:19.985941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:19.986847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:19.987641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:19.988160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:19.989040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:19.990353 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:19.990353 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:19.990353 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:19.992088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:20.118592 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2501/5019] 10.222.0.59 () {60 vars in 1185 bytes} [Sun Aug 28 01:33:19 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:20.119308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:20.130469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acce7a-863a-4133-9a7f-e867a9a65577 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:20.143794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:20.145085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:20.146323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:20.147681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:20.148726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=fee7e65b5a044bf4832adccbe21ad4dd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:20.151915 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:20.151915 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:20.151915 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:20.153659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:20.164481 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2519/5020] 10.222.0.59 () {58 vars in 1263 bytes} [Sun Aug 28 01:33:20 2022] GET /identity/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd => generated 220 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:20.168617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:20.201840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9fa46-ce3d-423c-8be0-927dac8d842c tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:20.224841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:20.226895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:20.227191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:20.227479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:20.231738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fee7e65b5a044bf4832adccbe21ad4dd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:20.232899 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:20.232899 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:20.232899 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:20.233863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:20.234148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invalidating token cache because consumer fee7e65b5a044bf4832adccbe21ad4dd has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:20.239197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:20.243003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:20.382294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'fee7e65b5a044bf4832adccbe21ad4dd', 'request_id': 'req-b134c0f8-774a-4d8a-bac9-52627f0e18a2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:20.490980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2502/5021] 10.222.0.59 () {58 vars in 1266 bytes} [Sun Aug 28 01:33:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:20.492270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:20.494144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:20.534885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad61a0-b932-406f-8064-553f4daf7c47 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:20.554334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:20.555187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:20.555605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:20.555998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:20.556724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=fee7e65b5a044bf4832adccbe21ad4dd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:20.559743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 28 01:33:20.600965 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 01:33:20.602440 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:20.603253 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2520/5022] 10.222.0.59 () {58 vars in 1263 bytes} [Sun Aug 28 01:33:20 2022] GET /identity/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd => generated 74 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 01:33:20.611310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:20.632151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134c0f8-774a-4d8a-bac9-52627f0e18a2 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:20.645758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:20.646476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:20.647348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:20.647631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:20.648572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fee7e65b5a044bf4832adccbe21ad4dd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:20.650245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:20.650520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invalidating token cache because consumer fee7e65b5a044bf4832adccbe21ad4dd has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:20.650806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:20.654279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 28 01:33:20.689722 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 01:33:20.691010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:20.694738 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2503/5023] 10.222.0.59 () {58 vars in 1266 bytes} [Sun Aug 28 01:33:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fee7e65b5a044bf4832adccbe21ad4dd => generated 74 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 01:33:20.699946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:20.702310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:20.727850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f4ac-e652-4b9e-be70-de5e4c390c7a tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:20.743936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:20.744839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:20.745420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:20.745894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:20.746730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:20.748575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:20.863243 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2521/5024] 10.222.0.59 () {60 vars in 1185 bytes} [Sun Aug 28 01:33:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:20.867218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:20.878272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2cbcf-4815-47ff-9ae3-bf62dc263983 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:20.883826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:20.884441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:20.884658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:20.884940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:20.885581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:20.887864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.001452 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2504/5025] 10.222.0.59 () {60 vars in 1185 bytes} [Sun Aug 28 01:33:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:21.003484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:21.017275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09104dfe-7218-48d1-bcec-351a6d4f2862 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:21.021994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:21.022597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:21.022878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:21.023150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:21.023718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:21.024772 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:21.024772 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:21.024772 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:21.026001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.032469 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2522/5026] 10.222.0.59 () {58 vars in 1164 bytes} [Sun Aug 28 01:33:21 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:21.036654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:21.047665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df19d-571e-4111-a9b7-8dd148f69cb3 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:21.054898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:21.055630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:21.056743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:21.057880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/79fa3c45ba454c6c8f8cc34db924353e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:21.058201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=79fa3c45ba454c6c8f8cc34db924353e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:21.059866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.060143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invalidating token cache because consumer 79fa3c45ba454c6c8f8cc34db924353e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:21.060432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:21.062221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:21.171827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '79fa3c45ba454c6c8f8cc34db924353e', 'request_id': 'req-33758bf6-d45e-4135-931b-480fbc4167be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:21.341054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2505/5027] 10.222.0.59 () {58 vars in 1266 bytes} [Sun Aug 28 01:33:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/79fa3c45ba454c6c8f8cc34db924353e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:21.345598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:21.347433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:21.393086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26294-d339-4371-9764-2a9eefe0022d tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:21.413829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:21.414181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:21.414725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:21.415002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9e75bcd678ac443292860a41b4586e5d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:21.415624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9e75bcd678ac443292860a41b4586e5d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:21.417307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.417604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invalidating token cache because consumer 9e75bcd678ac443292860a41b4586e5d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:21.418357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:21.419095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:21.513284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9e75bcd678ac443292860a41b4586e5d', 'request_id': 'req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:21.609621 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2523/5028] 10.222.0.59 () {58 vars in 1266 bytes} [Sun Aug 28 01:33:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9e75bcd678ac443292860a41b4586e5d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:21.615074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:21.627330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33758bf6-d45e-4135-931b-480fbc4167be tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:21.633340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:21.637420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:21.637420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:21.637420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:21.637420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:21.637420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.731575 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2506/5029] 10.222.0.59 () {60 vars in 1185 bytes} [Sun Aug 28 01:33:21 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:21.735722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:21.737196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:21.753057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44bed-9e4c-4ddd-a53c-d6e8485c8e8f tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:21.760004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:21.760885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:21.761180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:21.761449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d43e9c4b15984bbea9bdb57e70b27e83` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:21.763257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=d43e9c4b15984bbea9bdb57e70b27e83)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:21.764281 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:21.764281 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:21.764281 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:21.765186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.888421 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2524/5030] 10.222.0.59 () {60 vars in 1285 bytes} [Sun Aug 28 01:33:21 2022] PATCH /identity/v3/OS-OAUTH1/consumers/d43e9c4b15984bbea9bdb57e70b27e83 => generated 220 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:21.892428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:21.899866 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:21.906515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960b8b-3eba-4f25-862f-e33027bb145b tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:21.921463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:21.922248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:21.922587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:21.922932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d43e9c4b15984bbea9bdb57e70b27e83` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:21.923596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d43e9c4b15984bbea9bdb57e70b27e83)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:21.925253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.939123 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2507/5031] 10.222.0.59 () {58 vars in 1263 bytes} [Sun Aug 28 01:33:21 2022] GET /identity/v3/OS-OAUTH1/consumers/d43e9c4b15984bbea9bdb57e70b27e83 => generated 220 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:21.943601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:21.967118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f23ca-ad8a-4c32-aa09-ae1ecd072bf8 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:21.980443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8715b9ca246448478da676900438ce16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f73210dd7843c6b5e96018f9ea9c9b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:21.982427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:21.984006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:21.984859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d43e9c4b15984bbea9bdb57e70b27e83` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:21.987181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d43e9c4b15984bbea9bdb57e70b27e83)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:21.992510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:21.992510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invalidating token cache because consumer d43e9c4b15984bbea9bdb57e70b27e83 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:21.992510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:21.993399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:22.108061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5b0d1679-57db-4c01-bc61-756cb1e408a4 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd43e9c4b15984bbea9bdb57e70b27e83', 'request_id': 'req-5b0d1679-57db-4c01-bc61-756cb1e408a4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:22.219544 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2525/5032] 10.222.0.59 () {58 vars in 1266 bytes} [Sun Aug 28 01:33:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d43e9c4b15984bbea9bdb57e70b27e83 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:22.229475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:22.231239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:22.344609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976dd1-46bf-4200-bf09-fbe582b54404 tempest-OAUTHConsumersV3Test-1409842466 tempest-OAUTHConsumersV3Test-1409842466-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:22.351555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:22.352298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:22.352656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:22.353009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] PATH_INFO: `/v3/users/78cb3d6b9a6645329869059056443db1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:22.355755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78cb3d6b9a6645329869059056443db1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:22.357865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:22.641589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78cb3d6b9a6645329869059056443db1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:22.657423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78cb3d6b9a6645329869059056443db1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:22.667113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78cb3d6b9a6645329869059056443db1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:22.668057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78cb3d6b9a6645329869059056443db1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:22.748080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78cb3d6b9a6645329869059056443db1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:22.758954 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2508/5033] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:22 2022] DELETE /identity/v3/users/78cb3d6b9a6645329869059056443db1 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:22.763567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:22.764041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:22.764267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:22.795165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:22.798439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:22.898068 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2526/5034] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:22.904318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:22.905862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:23.012072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74e96-ca1f-47e4-bf6e-75a453309f31 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:23.016138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:23.016754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:23.017032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:23.017302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:23.028323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:23.029954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:23.055015 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2509/5035] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:23.623531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:23.625486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:23.659756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e013eba-11e2-46d3-b916-4f667c8259a0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:23.666418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:23.667230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:23.667615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:23.668023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] PATH_INFO: `/v3/projects/8797f3c4639148a3a13afce793fe4c57` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:23.670104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8797f3c4639148a3a13afce793fe4c57)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:23.672357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:23.876171 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:23.879041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8797f3c4639148a3a13afce793fe4c57', 'request_id': 'req-a115653d-4b67-42f0-a135-6da3d2f402c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:23.886883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8797f3c4639148a3a13afce793fe4c57', 'request_id': 'req-a115653d-4b67-42f0-a135-6da3d2f402c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:23.997054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8797f3c4639148a3a13afce793fe4c57', 'request_id': 'req-a115653d-4b67-42f0-a135-6da3d2f402c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.009416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] The token cache is being invalidate because project 8797f3c4639148a3a13afce793fe4c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:24.009727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.011251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.017353 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2527/5036] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:23 2022] DELETE /identity/v3/projects/8797f3c4639148a3a13afce793fe4c57 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:24.018026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:24.031602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d683f4-ed25-4178-805e-66525781d436 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:24.047308 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:24.104848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:24.105493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:24.105785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:24.106306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] PATH_INFO: `/v3/users/8715b9ca246448478da676900438ce16` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:24.107615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8715b9ca246448478da676900438ce16)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:24.109603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:24.287041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8715b9ca246448478da676900438ce16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.309005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8715b9ca246448478da676900438ce16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.321430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8715b9ca246448478da676900438ce16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.322280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8715b9ca246448478da676900438ce16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.422572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-85017a5a-f0eb-4d09-8e86-72772dabe813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8715b9ca246448478da676900438ce16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:24.422942 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2510/5037] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:24 2022] DELETE /identity/v3/users/8715b9ca246448478da676900438ce16 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:25.128658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:25.130251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:25.157722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115653d-4b67-42f0-a135-6da3d2f402c9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:25.294377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:25.302676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:25.303485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:25.304783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] PATH_INFO: `/v3/projects/94f73210dd7843c6b5e96018f9ea9c9b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:25.307620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f73210dd7843c6b5e96018f9ea9c9b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:25.312772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:25.715987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f73210dd7843c6b5e96018f9ea9c9b', 'request_id': 'req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:25.728475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f73210dd7843c6b5e96018f9ea9c9b', 'request_id': 'req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:25.845202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f73210dd7843c6b5e96018f9ea9c9b', 'request_id': 'req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:25.861116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] The token cache is being invalidate because project 94f73210dd7843c6b5e96018f9ea9c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:25.861415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:25.864194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b358f9b2-d7d7-48c1-a5af-1b81515d94a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:25.864579 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2528/5038] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:25 2022] DELETE /identity/v3/projects/94f73210dd7843c6b5e96018f9ea9c9b => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:25.869313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648ab0-f99f-4b95-ac56-0476022068e2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:25.870244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648ab0-f99f-4b95-ac56-0476022068e2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:25.870574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d648ab0-f99f-4b95-ac56-0476022068e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:25.897758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7d648ab0-f99f-4b95-ac56-0476022068e2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:25.899234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d648ab0-f99f-4b95-ac56-0476022068e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:26.039568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2511/5039] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:26.047212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25856d99-f214-490d-bb75-bc50739bd93a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.047831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25856d99-f214-490d-bb75-bc50739bd93a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.048266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25856d99-f214-490d-bb75-bc50739bd93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.095481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-25856d99-f214-490d-bb75-bc50739bd93a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:26.097180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25856d99-f214-490d-bb75-bc50739bd93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:26.117319 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2529/5040] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:26.117646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648ab0-f99f-4b95-ac56-0476022068e2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:26.129116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d648ab0-f99f-4b95-ac56-0476022068e2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:26.134590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:26.135471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.135926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.136715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.137551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:26.138070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:26.139893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:26.158728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2512/5041] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:26.164052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25856d99-f214-490d-bb75-bc50739bd93a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:26.176063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25856d99-f214-490d-bb75-bc50739bd93a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:26.183569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:26.184397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.184861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.185302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.186193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:26.189698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:26.286352 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2530/5042] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:26 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:26.290854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:26.307658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab850-5f65-4ff1-b4a9-15cea622c774 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:26.338135 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:26.384159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:26.384875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.385257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.385754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.386762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:26.388814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:26.508970 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2513/5043] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:26 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:26.510165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:26.525593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c549e-47fa-4efd-a036-eb4461be5f64 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:26.539300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:26.541142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.541430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.541706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.542384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:26.543985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:26.561178 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2531/5044] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:26.562599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:26.585804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03337f9-6dfc-4660-b739-cc167df701bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:26.597261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa7448-8cc0-469b-8e38-5b150c9a5a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:26.598064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa7448-8cc0-469b-8e38-5b150c9a5a2d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.598349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa7448-8cc0-469b-8e38-5b150c9a5a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.598627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa7448-8cc0-469b-8e38-5b150c9a5a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.599285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa7448-8cc0-469b-8e38-5b150c9a5a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:26.601563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa7448-8cc0-469b-8e38-5b150c9a5a2d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:26.630194 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2514/5045] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:26.633076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:26.654984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5687c46-620a-49d8-9f64-0ae12ca8e4c7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:26.668221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:26.668905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.669190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.669989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] PATH_INFO: `/v3/projects/6df99105b73c43e48defaa12cee41fde/users/3b01cc09ae464b7ea54596baf63b8af0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.705647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df99105b73c43e48defaa12cee41fde, user_id=3b01cc09ae464b7ea54596baf63b8af0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:26.713652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:26.830419 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:26.848519 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2532/5046] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:26 2022] PUT /identity/v3/projects/6df99105b73c43e48defaa12cee41fde/users/3b01cc09ae464b7ea54596baf63b8af0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:26.850698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428a202-f1a4-4eb6-a517-92a245c45935 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:26.851314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428a202-f1a4-4eb6-a517-92a245c45935 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:26.855630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428a202-f1a4-4eb6-a517-92a245c45935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:26.932528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3428a202-f1a4-4eb6-a517-92a245c45935 None None] MFA Rules not processed for user `3b01cc09ae464b7ea54596baf63b8af0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:26.941746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3428a202-f1a4-4eb6-a517-92a245c45935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:27.229691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2515/5047] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:27.230978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:27.357572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f93b6-f2b5-4b64-a34c-2527143d44d2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:27.363227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:27.364178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:27.364636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:27.365062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:27.366325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:27.376082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:27.539546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428a202-f1a4-4eb6-a517-92a245c45935 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:27.547720 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2533/5048] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:27 2022] POST /identity/v3/projects => generated 385 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:27.554643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428a202-f1a4-4eb6-a517-92a245c45935 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:27.685630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:27.686652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:27.687092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:27.689281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:27.692824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:27.702594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:27.824510 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2516/5049] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:27 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:27.828461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:27.841805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4455a2a-88a1-415f-80f5-719075171818 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:27.849930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:27.851463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:27.852248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:27.852741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:27.854006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:27.857161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:27.874172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2534/5050] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:27.877536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:27.894735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125098b-95c6-4d3d-becd-bbbe87c0f30d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:27.906459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:27.907465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:27.908283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:27.908767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] PATH_INFO: `/v3/projects/7550d24b94b34b43ab5c73b32aef943b/users/369760651ff640f9af9ce4407174af3b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:27.927980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7550d24b94b34b43ab5c73b32aef943b, user_id=369760651ff640f9af9ce4407174af3b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:27.931328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:28.026890 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:28.035712 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2517/5051] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:27 2022] PUT /identity/v3/projects/7550d24b94b34b43ab5c73b32aef943b/users/369760651ff640f9af9ce4407174af3b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:28.036895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:28.052699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbece3c-972f-4979-a74d-c478257b5bbf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:28.147509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:28.148231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:28.148578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:28.148917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:28.149634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:28.151467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:28.170738 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2535/5052] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:28.171324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:28.183791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:28.187112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:28.191019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8451b47-11fa-4d95-8e13-f3ca54792da2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:28.202267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6971-2016-475e-b45b-e3bdde265e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:28.202966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6971-2016-475e-b45b-e3bdde265e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:28.203326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6971-2016-475e-b45b-e3bdde265e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:28.207434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6971-2016-475e-b45b-e3bdde265e00 admin admin] PATH_INFO: `/v3/projects/7550d24b94b34b43ab5c73b32aef943b/users/369760651ff640f9af9ce4407174af3b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:28.213520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de6971-2016-475e-b45b-e3bdde265e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7550d24b94b34b43ab5c73b32aef943b, user_id=369760651ff640f9af9ce4407174af3b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:28.219046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de6971-2016-475e-b45b-e3bdde265e00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:28.242990 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2518/5053] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:28 2022] PUT /identity/v3/projects/7550d24b94b34b43ab5c73b32aef943b/users/369760651ff640f9af9ce4407174af3b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:28.245079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e2c1-317f-41c2-a5f7-0f4da5000c2e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:28.248385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e2c1-317f-41c2-a5f7-0f4da5000c2e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:28.248789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e2c1-317f-41c2-a5f7-0f4da5000c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:28.319099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d7f2e2c1-317f-41c2-a5f7-0f4da5000c2e None None] MFA Rules not processed for user `369760651ff640f9af9ce4407174af3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:28.319538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d7f2e2c1-317f-41c2-a5f7-0f4da5000c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:28.400996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38886170-beae-4f79-860b-dda811d4b02f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:28.410482 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:28.480428 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2519/5054] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:28.485768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2e2c1-317f-41c2-a5f7-0f4da5000c2e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:28.499305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2e2c1-317f-41c2-a5f7-0f4da5000c2e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:28.505123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369760651ff640f9af9ce4407174af3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7550d24b94b34b43ab5c73b32aef943b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:28.505756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:28.506288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:28.506475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:28.507252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:28.510106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:28.602689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:28.606551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:28.606874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:28.607190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:28.611533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:28.663755 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2520/5055] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:28 2022] POST /identity/v3/projects => generated 359 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:28.669192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:28.789188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:28.794696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:28.819415 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2536/5056] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:28.861198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eefe6-5567-419d-941a-662a17a88c4a tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:28.866089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b01cc09ae464b7ea54596baf63b8af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6df99105b73c43e48defaa12cee41fde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:28.866883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:28.867322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:28.867727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] PATH_INFO: `/v3/projects/fcaea568b1364644bc36be80e0b4046f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:28.868999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] RBAC: Authorizing `identity:delete_project(project_id=fcaea568b1364644bc36be80e0b4046f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 28 01:33:28.876220 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 28 01:33:28.877440 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:28.881865 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2521/5057] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:28 2022] DELETE /identity/v3/projects/fcaea568b1364644bc36be80e0b4046f => generated 136 bytes in 211 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:28.883787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:28.910739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281cea-ca3b-4a63-bf45-515380b5d0f4 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:29.029307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '369760651ff640f9af9ce4407174af3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7550d24b94b34b43ab5c73b32aef943b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:29.030001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:29.031246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:29.031246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] PATH_INFO: `/v3/projects/fcaea568b1364644bc36be80e0b4046f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:29.031680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fcaea568b1364644bc36be80e0b4046f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:29.033618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:29.222007 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:29.224308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcaea568b1364644bc36be80e0b4046f', 'request_id': 'req-c533ede9-85a0-45e1-9102-4b22ee3e54f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.241602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcaea568b1364644bc36be80e0b4046f', 'request_id': 'req-c533ede9-85a0-45e1-9102-4b22ee3e54f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.344050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcaea568b1364644bc36be80e0b4046f', 'request_id': 'req-c533ede9-85a0-45e1-9102-4b22ee3e54f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.367006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] The token cache is being invalidate because project fcaea568b1364644bc36be80e0b4046f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:29.367006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.367006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c533ede9-85a0-45e1-9102-4b22ee3e54f8 tempest-ProjectsNegativeTestJSON-1376015396 tempest-ProjectsNegativeTestJSON-1376015396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.367006 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2537/5058] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:28 2022] DELETE /identity/v3/projects/fcaea568b1364644bc36be80e0b4046f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:29.367750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:29.369613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:29.472214 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:29.478005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981f6f-bbb4-4c98-acb9-23926a804c61 tempest-ProjectsNegativeTestJSON-948390327 tempest-ProjectsNegativeTestJSON-948390327-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:29.536276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:29.536711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:29.536933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:29.537238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] PATH_INFO: `/v3/users/3b01cc09ae464b7ea54596baf63b8af0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:29.538443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b01cc09ae464b7ea54596baf63b8af0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:29.540804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:29.814872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b01cc09ae464b7ea54596baf63b8af0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.834283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b01cc09ae464b7ea54596baf63b8af0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.847916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b01cc09ae464b7ea54596baf63b8af0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.851824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b01cc09ae464b7ea54596baf63b8af0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.974679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b01cc09ae464b7ea54596baf63b8af0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:29.983135 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2522/5059] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:29 2022] DELETE /identity/v3/users/3b01cc09ae464b7ea54596baf63b8af0 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:29.987371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:29.988248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:29.988530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:30.024472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:30.025710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:30.190763 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2538/5060] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:30.203441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:30.205036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:30.282204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c4f0-5ad0-44ca-b72b-da0c8f6430d7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:30.288123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:30.289216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:30.289506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:30.289870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:30.302377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:30.304526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:30.332243 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2523/5061] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:30.839307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:30.841532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:30.862450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d4761-4b7a-4bdf-9a66-368e891ea451 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:30.871314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:30.872062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:30.872162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:30.872846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] PATH_INFO: `/v3/projects/6df99105b73c43e48defaa12cee41fde` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:30.874004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df99105b73c43e48defaa12cee41fde)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:30.876565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:31.045276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df99105b73c43e48defaa12cee41fde', 'request_id': 'req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.052460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df99105b73c43e48defaa12cee41fde', 'request_id': 'req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.181997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df99105b73c43e48defaa12cee41fde', 'request_id': 'req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.203855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] The token cache is being invalidate because project 6df99105b73c43e48defaa12cee41fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:31.204181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.204839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-87c55d32-408b-4d12-b5c8-d2fd08dd5a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.210152 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2539/5062] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:30 2022] DELETE /identity/v3/projects/6df99105b73c43e48defaa12cee41fde => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:31.214231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:31.227887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f31e5-c4ba-4ff0-90a6-e37b68c9afeb service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:31.275445 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:31.332361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:31.333146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:31.333471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:31.333771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] PATH_INFO: `/v3/users/369760651ff640f9af9ce4407174af3b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:31.336247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] RBAC: Authorizing `identity:delete_user(user_id=369760651ff640f9af9ce4407174af3b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:31.339282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:31.377149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a935066-7ad3-425a-b079-2a89397efe14 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:31.378370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a935066-7ad3-425a-b079-2a89397efe14 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:31.378601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a935066-7ad3-425a-b079-2a89397efe14 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:31.381407 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2540/5063] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:33:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:33:31.393299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:31.393591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:31.393904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:31.458160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:31.460403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:31.537546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2541/5064] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:33:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:31.559446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:31.561547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:31.579026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369760651ff640f9af9ce4407174af3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.584452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eaf7f-e5c5-4d52-9df9-13c8e0df1e14 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:31.603941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369760651ff640f9af9ce4407174af3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.609723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:31.612029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:31.612296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:31.612581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:31.620394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369760651ff640f9af9ce4407174af3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.621447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369760651ff640f9af9ce4407174af3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.636909 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:31.641482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:31.643061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:31.655366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2542/5065] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:33:31.719481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7d7b551-aaa1-4a33-acad-311388b8211a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369760651ff640f9af9ce4407174af3b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:31.730482 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2524/5066] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:31 2022] DELETE /identity/v3/users/369760651ff640f9af9ce4407174af3b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:32.433674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:32.435210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:32.469476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c3035-4d91-4a4c-97e6-da52b280b04b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:32.554637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:32.555355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:32.555773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:32.556055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] PATH_INFO: `/v3/projects/7550d24b94b34b43ab5c73b32aef943b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:32.557351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7550d24b94b34b43ab5c73b32aef943b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:32.559298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:32.746414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7550d24b94b34b43ab5c73b32aef943b', 'request_id': 'req-5c74864c-2197-4542-a01f-1abda556724b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:32.756413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7550d24b94b34b43ab5c73b32aef943b', 'request_id': 'req-5c74864c-2197-4542-a01f-1abda556724b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:32.825431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7550d24b94b34b43ab5c73b32aef943b', 'request_id': 'req-5c74864c-2197-4542-a01f-1abda556724b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:32.842833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] The token cache is being invalidate because project 7550d24b94b34b43ab5c73b32aef943b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:32.843162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:32.843782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c74864c-2197-4542-a01f-1abda556724b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:32.845602 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2543/5067] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:32 2022] DELETE /identity/v3/projects/7550d24b94b34b43ab5c73b32aef943b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:32.850326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0266c-d364-4f8c-931d-909ccd4482b5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:32.851677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0266c-d364-4f8c-931d-909ccd4482b5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:32.851972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0266c-d364-4f8c-931d-909ccd4482b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:32.887073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cdf0266c-d364-4f8c-931d-909ccd4482b5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:32.889017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cdf0266c-d364-4f8c-931d-909ccd4482b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:32.983692 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2525/5068] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:32.991494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d096bb8-d593-4977-aff9-599b6474b7a6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:32.991865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d096bb8-d593-4977-aff9-599b6474b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:32.992169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d096bb8-d593-4977-aff9-599b6474b7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.015467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5d096bb8-d593-4977-aff9-599b6474b7a6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:33.016727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d096bb8-d593-4977-aff9-599b6474b7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:33.025075 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2544/5069] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:33.029471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0266c-d364-4f8c-931d-909ccd4482b5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:33.041268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0266c-d364-4f8c-931d-909ccd4482b5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:33.047364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:33.048500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:33.048791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:33.049067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.049721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:33.050060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:33.052009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:33.067330 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2526/5070] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:33.071693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d096bb8-d593-4977-aff9-599b6474b7a6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:33.082336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d096bb8-d593-4977-aff9-599b6474b7a6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:33.088068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:33.088683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:33.089022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:33.089312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.089984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:33.092338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:33.212462 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2545/5071] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:33 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:33.215205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:33.246329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869d45a-0327-4366-98f9-21b1687fc97f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:33.319972 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:33.365463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:33.366684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:33.367167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:33.367723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.368691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:33.371457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:33.494776 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2527/5072] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:33 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:33.498303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:33.512627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cca22-e493-43c8-b280-2287777094cd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:33.519980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:33.520596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:33.520893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:33.521788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.522518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:33.525249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:33.549002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:33.550673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2546/5073] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:33.585678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373fcc2-6539-4fcd-891c-48cfff1c49bb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:33.604165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78538b92-efef-450d-9a61-f2ecbc1cdef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:33.604801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538b92-efef-450d-9a61-f2ecbc1cdef2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:33.605082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538b92-efef-450d-9a61-f2ecbc1cdef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:33.605355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78538b92-efef-450d-9a61-f2ecbc1cdef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.606052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538b92-efef-450d-9a61-f2ecbc1cdef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:33.607974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78538b92-efef-450d-9a61-f2ecbc1cdef2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:33.626021 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2528/5074] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:33.630502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:33.642854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe6e12-b4ee-4261-b725-8bafc21cffa7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:33.653143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:33.653871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:33.654161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:33.656340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] PATH_INFO: `/v3/projects/b2748aa17a91444aa9dca5952b133267/users/5f588d197abc42ddb63742b79f5c9dd9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.699354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2748aa17a91444aa9dca5952b133267, user_id=5f588d197abc42ddb63742b79f5c9dd9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:33.702372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:33.817356 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2547/5075] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:33 2022] PUT /identity/v3/projects/b2748aa17a91444aa9dca5952b133267/users/5f588d197abc42ddb63742b79f5c9dd9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:33.927148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf3a6d-c26a-4a32-99a8-e666dfd15fd5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:33.928319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf3a6d-c26a-4a32-99a8-e666dfd15fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:33.928319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf3a6d-c26a-4a32-99a8-e666dfd15fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:33.999116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-afcf3a6d-c26a-4a32-99a8-e666dfd15fd5 None None] MFA Rules not processed for user `5f588d197abc42ddb63742b79f5c9dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:34.000344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-afcf3a6d-c26a-4a32-99a8-e666dfd15fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:34.149997 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2529/5076] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:34.157972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:34.266578 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:34.319257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec5f46-5f17-4590-8c78-9d06d4e728dc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:34.330814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:34.342053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:34.342053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:34.342053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:34.342053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:34.342053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:34.472839 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2548/5077] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:34 2022] POST /identity/v3/projects => generated 363 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:34.476712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf3a6d-c26a-4a32-99a8-e666dfd15fd5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:34.493437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf3a6d-c26a-4a32-99a8-e666dfd15fd5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:34.585310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:34.586172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:34.586500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:34.586781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:34.587420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:34.590050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:34.695123 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2530/5078] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:34 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:34.696277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:34.712414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247ed35-031a-40cb-baeb-25d54ad59bfd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:34.719537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:34.720327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:34.720715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:34.721093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:34.722024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:34.723949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:34.753406 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2549/5079] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:34.757788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:34.769863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa55d1-92cd-4461-ad1d-73a0a5b52a3b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:34.782264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:34.783518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:34.784793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:34.786228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] PATH_INFO: `/v3/projects/24286c36cd1c43958f2411e8cf953900/users/704aa84a695046cd8f23019f5925973c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:34.829269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24286c36cd1c43958f2411e8cf953900, user_id=704aa84a695046cd8f23019f5925973c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:34.834655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:34.931815 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2531/5080] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:34 2022] PUT /identity/v3/projects/24286c36cd1c43958f2411e8cf953900/users/704aa84a695046cd8f23019f5925973c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:34.935870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:34.951679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0650b-1c80-4ed3-a38a-810da356db25 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:35.093663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be36446-3037-4e03-9470-02f7d027f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:35.093663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36446-3037-4e03-9470-02f7d027f703 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:35.093663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36446-3037-4e03-9470-02f7d027f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:35.093663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36446-3037-4e03-9470-02f7d027f703 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:35.094202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be36446-3037-4e03-9470-02f7d027f703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:35.095605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be36446-3037-4e03-9470-02f7d027f703 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:35.129764 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2550/5081] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:35.130658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:35.144905 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:35.158691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c873cbe-82e1-4d15-8ed3-e2a42441f79b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:35.172243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:35.172995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:35.173483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:35.173768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] PATH_INFO: `/v3/projects/24286c36cd1c43958f2411e8cf953900/users/704aa84a695046cd8f23019f5925973c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:35.176443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24286c36cd1c43958f2411e8cf953900, user_id=704aa84a695046cd8f23019f5925973c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:35.182066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:35.198979 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2532/5082] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:35 2022] PUT /identity/v3/projects/24286c36cd1c43958f2411e8cf953900/users/704aa84a695046cd8f23019f5925973c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:35.216447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0254613-f313-4f80-a1f2-beef22fbe70d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:35.219957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0254613-f313-4f80-a1f2-beef22fbe70d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:35.221447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0254613-f313-4f80-a1f2-beef22fbe70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:35.297694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f0254613-f313-4f80-a1f2-beef22fbe70d None None] MFA Rules not processed for user `704aa84a695046cd8f23019f5925973c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:35.299724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f0254613-f313-4f80-a1f2-beef22fbe70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:35.436790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2551/5083] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:35.440037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:35.476117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18d177-e6bb-47dc-b7b2-95e3f390aa3f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:35.485424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:35.486041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:35.486335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:35.488566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:35.489243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:35.492180 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:35.492180 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:35.492180 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:35.493112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:35.598134 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2533/5084] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:35 2022] POST /identity/v3/regions => generated 222 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:35.602380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0254613-f313-4f80-a1f2-beef22fbe70d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:35.621372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0254613-f313-4f80-a1f2-beef22fbe70d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:35.647778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:35.648801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:35.656351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:35.657019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:35.658028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:35.659879 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:35.659879 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:35.659879 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:35.661223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:35.671357 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:35.763633 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2552/5085] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:35 2022] POST /identity/v3/regions => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:35.780324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:35.795630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758227c1-69a3-4c1f-a53f-fcee9268824d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:35.821907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:35.822887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:35.823351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:35.823775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/99f4cfdd-9ac7-4ef6-952f-c9ff752c41cb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:35.824593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:create_region(region_id=99f4cfdd-9ac7-4ef6-952f-c9ff752c41cb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:35.826475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:35.916623 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2534/5086] 10.222.0.59 () {60 vars in 1259 bytes} [Sun Aug 28 01:33:35 2022] PUT /identity/v3/regions/99f4cfdd-9ac7-4ef6-952f-c9ff752c41cb => generated 231 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:35.920661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:35.947268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d6da-a662-4d8d-aba7-6ec1fa4aed6d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:36.006713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:36.006713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:36.006713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:36.007138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/99f4cfdd-9ac7-4ef6-952f-c9ff752c41cb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:36.007138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:delete_region(region_id=99f4cfdd-9ac7-4ef6-952f-c9ff752c41cb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:36.007138 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:36.007138 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:36.007138 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:36.007138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:36.274299 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2553/5087] 10.222.0.59 () {58 vars in 1242 bytes} [Sun Aug 28 01:33:35 2022] DELETE /identity/v3/regions/99f4cfdd-9ac7-4ef6-952f-c9ff752c41cb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:36.278973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:36.294372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33616d4a-3a76-4f3a-b447-f478fd0bc0c0 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:36.323048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:36.323682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:36.323978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:36.324247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:36.324916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:36.328156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:36.437245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2535/5088] 10.222.0.59 () {60 vars in 1150 bytes} [Sun Aug 28 01:33:36 2022] POST /identity/v3/regions => generated 254 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:36.449230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:36.465639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333425c7-2dae-416c-90e8-15e2cc624203 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:36.503429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:36.504669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:36.505187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:36.505721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/22a56416f6d0484091bdad5084ce4ded` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:36.507274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:update_region(region_id=22a56416f6d0484091bdad5084ce4ded)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:36.508559 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:36.508559 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:36.508559 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:36.510720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:36.689861 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2554/5089] 10.222.0.59 () {60 vars in 1250 bytes} [Sun Aug 28 01:33:36 2022] PATCH /identity/v3/regions/22a56416f6d0484091bdad5084ce4ded => generated 253 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:36.692587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:36.712867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0e93f-8009-41ce-8fde-a3fd73086baf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:36.736895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:36.737617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:36.737935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:36.738218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/22a56416f6d0484091bdad5084ce4ded` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:36.738824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:get_region(region_id=22a56416f6d0484091bdad5084ce4ded)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:36.739977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:36.749565 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2536/5090] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:33:36 2022] GET /identity/v3/regions/22a56416f6d0484091bdad5084ce4ded => generated 253 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:36.753475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:36.769860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f276ea-b175-47dc-93d4-fd89071b2889 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:36.777613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:36.778540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:36.779679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:36.781524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/22a56416f6d0484091bdad5084ce4ded` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:36.782680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:delete_region(region_id=22a56416f6d0484091bdad5084ce4ded)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:36.786795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:36.899519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:36.900361 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2555/5091] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:36 2022] DELETE /identity/v3/regions/22a56416f6d0484091bdad5084ce4ded => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:36.913890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e4ce-a1e4-4222-afe1-e7366e7d27cf tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:36.944124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:36.945096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:36.945474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:36.945883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:36.946588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:36.948211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:36.961459 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2537/5092] 10.222.0.59 () {58 vars in 1128 bytes} [Sun Aug 28 01:33:36 2022] GET /identity/v3/regions => generated 667 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:36.963407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:36.980243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171338-56fc-4d90-a51e-80b7e7a9b71a tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:36.994711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:36.995375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:36.995670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:36.997409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/22a56416f6d0484091bdad5084ce4ded` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:36.998026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:delete_region(region_id=22a56416f6d0484091bdad5084ce4ded)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.002010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Could not find region: 22a56416f6d0484091bdad5084ce4ded.: keystone.exception.RegionNotFound: Could not find region: 22a56416f6d0484091bdad5084ce4ded. Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 22a56416f6d0484091bdad5084ce4ded. Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:37.026520 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 22a56416f6d0484091bdad5084ce4ded. Aug 28 01:33:37.027836 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:37.034113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2556/5093] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:36 2022] DELETE /identity/v3/regions/22a56416f6d0484091bdad5084ce4ded => generated 112 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:37.039545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:37.053324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baca99-1bdc-40d8-8884-8b8dc8d3e8d5 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:37.063315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:37.064263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:37.064754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:37.065265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:37.066134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.067467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.075034 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2538/5094] 10.222.0.59 () {58 vars in 1128 bytes} [Sun Aug 28 01:33:37 2022] GET /identity/v3/regions => generated 667 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:37.079624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:37.092312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb181869-5976-404a-9cda-4ce887bb892d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:37.097464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:37.104138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:37.104138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:37.104138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:37.104138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.104138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.182834 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2557/5095] 10.222.0.59 () {60 vars in 1150 bytes} [Sun Aug 28 01:33:37 2022] POST /identity/v3/regions => generated 253 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:37.187010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:37.199806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ac762-3a29-42e9-9681-1083fab58d7e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:37.219088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:37.219846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:37.220259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:37.220633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:37.222067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Adding query filter params (parent_region_id=68c5de00dd0f4d559c8c1ebd6d7a36a7) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:37.222483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.223737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.228981 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2539/5096] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:33:37 2022] GET /identity/v3/regions?parent_region_id=68c5de00dd0f4d559c8c1ebd6d7a36a7 => generated 399 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:37.233357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:37.245533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0f57d-6dbc-4382-85ea-554fa195d564 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:37.250457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:37.251225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:37.251614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:37.251993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/679d146059ca423db9552ee7c318e259` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:37.252689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:delete_region(region_id=679d146059ca423db9552ee7c318e259)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.254545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.427743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:37.428493 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2558/5097] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:37 2022] DELETE /identity/v3/regions/679d146059ca423db9552ee7c318e259 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:37.444286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e502e-1d41-426f-9740-dfda259d1d9d tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:37.462845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:37.463893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:37.464240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:37.464619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/600c5b276c0b4d0eb27107fe507c6117` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:37.465323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:delete_region(region_id=600c5b276c0b4d0eb27107fe507c6117)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.467059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.545393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2540/5098] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:37 2022] DELETE /identity/v3/regions/600c5b276c0b4d0eb27107fe507c6117 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:37.549527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:37.572750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755d5e-b62a-4546-a242-7db1096ab8a1 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:37.591346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcf1d3-72e8-49f4-b352-8748003a632e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '704aa84a695046cd8f23019f5925973c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24286c36cd1c43958f2411e8cf953900', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:37.592098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcf1d3-72e8-49f4-b352-8748003a632e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:37.592483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcf1d3-72e8-49f4-b352-8748003a632e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:37.592855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcf1d3-72e8-49f4-b352-8748003a632e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] PATH_INFO: `/v3/regions/68c5de00dd0f4d559c8c1ebd6d7a36a7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:37.593548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcf1d3-72e8-49f4-b352-8748003a632e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorizing `identity:delete_region(region_id=68c5de00dd0f4d559c8c1ebd6d7a36a7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.595339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcf1d3-72e8-49f4-b352-8748003a632e tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.674818 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2559/5099] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:37 2022] DELETE /identity/v3/regions/68c5de00dd0f4d559c8c1ebd6d7a36a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:37.679881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:37.742798 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:37.769270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21719867-91bc-4bef-abbc-cbcbc5dd7853 tempest-RegionsTestJSON-31630058 tempest-RegionsTestJSON-31630058-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:37.784752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:37.785681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:37.786128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:37.786493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] PATH_INFO: `/v3/users/5f588d197abc42ddb63742b79f5c9dd9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:37.788159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f588d197abc42ddb63742b79f5c9dd9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:37.790202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:37.982661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f588d197abc42ddb63742b79f5c9dd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:37.996943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f588d197abc42ddb63742b79f5c9dd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.004663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f588d197abc42ddb63742b79f5c9dd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.005430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f588d197abc42ddb63742b79f5c9dd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.067557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f588d197abc42ddb63742b79f5c9dd9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.074671 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2541/5100] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:37 2022] DELETE /identity/v3/users/5f588d197abc42ddb63742b79f5c9dd9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:38.079246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:38.079751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:38.079874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:38.101685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:38.101685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:38.147508 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:38.163196 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2560/5101] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:38.173688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:38.177376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:38.246032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a936933-b906-4c07-ac25-0f81c26c3389 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:38.250318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:38.250933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:38.251216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:38.251494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:38.262280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:38.264114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:38.274284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2542/5102] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:33:38.713436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:38.714849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:38.727489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62563eb-f79c-4e45-95ec-e666e09cf930 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:38.732257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:38.732947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:38.733229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:38.733940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] PATH_INFO: `/v3/projects/b2748aa17a91444aa9dca5952b133267` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:38.735123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2748aa17a91444aa9dca5952b133267)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:38.737112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:38.870353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2748aa17a91444aa9dca5952b133267', 'request_id': 'req-51b9f988-a20a-4616-9882-6c0167a779b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.878330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2748aa17a91444aa9dca5952b133267', 'request_id': 'req-51b9f988-a20a-4616-9882-6c0167a779b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.952014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:38.953654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:38.962355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2748aa17a91444aa9dca5952b133267', 'request_id': 'req-51b9f988-a20a-4616-9882-6c0167a779b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.970067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a4b3c-f5af-454e-9d82-3cbf8147b9a7 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:38.984268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] The token cache is being invalidate because project b2748aa17a91444aa9dca5952b133267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:38.985032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.994451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51b9f988-a20a-4616-9882-6c0167a779b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:38.997445 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2561/5103] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:38 2022] DELETE /identity/v3/projects/b2748aa17a91444aa9dca5952b133267 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:38.998634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:38.998990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:38.999372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:39.030954 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:39.049210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:39.050117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:39.050575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:39.051008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] PATH_INFO: `/v3/users/dfa2333d691647f387b6600c0ba12944` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:39.052600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa2333d691647f387b6600c0ba12944)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:39.054587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:39.060664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:39.062875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:39.133670 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2562/5104] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:39.134555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:39.135808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:39.157403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83bfdf-bead-495c-ad3a-d848db671d86 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:39.162089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:39.163351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:39.163819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:39.164096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] PATH_INFO: `/v3/users/704aa84a695046cd8f23019f5925973c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:39.165218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] RBAC: Authorizing `identity:delete_user(user_id=704aa84a695046cd8f23019f5925973c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:39.167155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:39.235501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa2333d691647f387b6600c0ba12944'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.247844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa2333d691647f387b6600c0ba12944'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.257241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa2333d691647f387b6600c0ba12944'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.258040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa2333d691647f387b6600c0ba12944'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.343472 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:39.346077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa2333d691647f387b6600c0ba12944'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.352232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704aa84a695046cd8f23019f5925973c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.352987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704aa84a695046cd8f23019f5925973c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.357258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2543/5105] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:38 2022] DELETE /identity/v3/users/dfa2333d691647f387b6600c0ba12944 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:39.357258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:39.357524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:39.442510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704aa84a695046cd8f23019f5925973c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.450747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704aa84a695046cd8f23019f5925973c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.451602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8c32a3ac-13e0-4a6d-a0ee-f7b5d948966f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704aa84a695046cd8f23019f5925973c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:39.455537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef8d8f-2275-4179-a262-33d0bc48e23c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:39.462109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:39.463031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:39.463473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:39.463904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:39.466150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:39.471261 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2563/5106] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:39 2022] DELETE /identity/v3/users/704aa84a695046cd8f23019f5925973c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:39.476241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:39.476618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:39.477066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:39.507236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:39.508560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:39.523512 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:39.541771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:39.543803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:39.558810 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2544/5107] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:33:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:33:39.588577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2564/5108] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:39.598942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:39.601397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:39.665733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d53e2-2113-45dd-93e9-f403eb3f843a service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:39.732483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:39.733139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:39.733427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:39.733704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:39.746852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:39.748293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:39.758908 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2545/5109] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:40.021921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.026461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.052668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245dc91-46a8-40ab-b5ce-c007ae1671d5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.062966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.063910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.064383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.064831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] PATH_INFO: `/v3/projects/24286c36cd1c43958f2411e8cf953900` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.067027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24286c36cd1c43958f2411e8cf953900)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.070026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.178268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24286c36cd1c43958f2411e8cf953900', 'request_id': 'req-f63084ff-9a42-4034-9940-be780ee5609c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.186239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24286c36cd1c43958f2411e8cf953900', 'request_id': 'req-f63084ff-9a42-4034-9940-be780ee5609c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.216530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.218072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.236445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058715-032c-4657-ac2f-e3bb9ad35fb3 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.256225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24286c36cd1c43958f2411e8cf953900', 'request_id': 'req-f63084ff-9a42-4034-9940-be780ee5609c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.270175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] The token cache is being invalidate because project 24286c36cd1c43958f2411e8cf953900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:40.270350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.270946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f63084ff-9a42-4034-9940-be780ee5609c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.273063 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2565/5110] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:40 2022] DELETE /identity/v3/projects/24286c36cd1c43958f2411e8cf953900 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:40.277849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3430-d18f-420a-ac51-465604c41949 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.282471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3430-d18f-420a-ac51-465604c41949 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.282471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3430-d18f-420a-ac51-465604c41949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.300751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-766e3430-d18f-420a-ac51-465604c41949 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:40.302337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-766e3430-d18f-420a-ac51-465604c41949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.303220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.304050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.304339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.304621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] PATH_INFO: `/v3/projects/9f3fa74c24ce41f5baf1e5f83ed46261` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.305760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3fa74c24ce41f5baf1e5f83ed46261)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.307738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.310997 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2566/5111] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:40.318423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb21f-b026-478f-a248-3043d5de401d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.318720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb21f-b026-478f-a248-3043d5de401d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.319011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effb21f-b026-478f-a248-3043d5de401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.340404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2effb21f-b026-478f-a248-3043d5de401d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:40.341613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2effb21f-b026-478f-a248-3043d5de401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.349491 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2567/5112] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:40.353668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effb21f-b026-478f-a248-3043d5de401d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.362690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effb21f-b026-478f-a248-3043d5de401d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.367671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.371244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.371244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.371244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.371244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:40.371244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.371244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.385688 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2568/5113] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:40.389901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.400365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041831-354d-4d8d-a394-0c032fc422f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.405009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.405605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.405916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.406194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.406829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.408759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.421708 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:40.438689 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:40.442405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3fa74c24ce41f5baf1e5f83ed46261', 'request_id': 'req-af9f24f1-41d6-43e8-bf2e-45909f64a299'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.448618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3fa74c24ce41f5baf1e5f83ed46261', 'request_id': 'req-af9f24f1-41d6-43e8-bf2e-45909f64a299'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.511095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3fa74c24ce41f5baf1e5f83ed46261', 'request_id': 'req-af9f24f1-41d6-43e8-bf2e-45909f64a299'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.518297 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2569/5114] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:40.522577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.524108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] The token cache is being invalidate because project 9f3fa74c24ce41f5baf1e5f83ed46261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:40.524422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.525047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-af9f24f1-41d6-43e8-bf2e-45909f64a299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:40.526568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2546/5115] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:40 2022] DELETE /identity/v3/projects/9f3fa74c24ce41f5baf1e5f83ed46261 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:40.530986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6134b-78d2-4567-9568-85484481394e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.531267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6134b-78d2-4567-9568-85484481394e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.531544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6134b-78d2-4567-9568-85484481394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.553249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d8e6134b-78d2-4567-9568-85484481394e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:40.555008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d8e6134b-78d2-4567-9568-85484481394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.588393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50163f2-3ae7-4144-8c7e-2a445c960b91 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.593790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.594464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.594742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.595016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.595638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.597625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.615203 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2547/5116] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:40.623642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef2e8-adec-432a-96cc-09dc2c46cf40 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.623935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef2e8-adec-432a-96cc-09dc2c46cf40 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.624208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef2e8-adec-432a-96cc-09dc2c46cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.643714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-06aef2e8-adec-432a-96cc-09dc2c46cf40 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:40.644929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-06aef2e8-adec-432a-96cc-09dc2c46cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.656421 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2548/5117] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:40.657131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aef2e8-adec-432a-96cc-09dc2c46cf40 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.666191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aef2e8-adec-432a-96cc-09dc2c46cf40 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.670863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.671452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.671781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.672062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.672706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:40.673014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.674641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.687096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2549/5118] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:40.691575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.701203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59818a-043e-43d3-9ee2-47a4e8a8c6a4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.705778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.706374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.706656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.706932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.707547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.709398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.719722 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2570/5119] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:40.724987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.727197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.739561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb5b3-0065-4aea-b9a2-00da3cf4f160 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.745714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.746400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.746816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.747094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.748109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.749388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.764369 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2571/5120] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:40.765327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.777214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347856-6982-4533-8d36-8662b44f8bc1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.780853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.781446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.781728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.782171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.782812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.784464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.795967 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2572/5121] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:40.800105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.810146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b81f-5e3c-4b4c-ae18-f6eeec52d026 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.814947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a0b78-8501-4d39-87d0-d58163a5f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.815566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a0b78-8501-4d39-87d0-d58163a5f13a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.815847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a0b78-8501-4d39-87d0-d58163a5f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.816124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a0b78-8501-4d39-87d0-d58163a5f13a admin admin] PATH_INFO: `/v3/projects/9f0297eaa02c477a9c4e93a95a6d14aa/users/03f3076433054dc6b0bc6e558694964d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.830874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a0b78-8501-4d39-87d0-d58163a5f13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0297eaa02c477a9c4e93a95a6d14aa, user_id=03f3076433054dc6b0bc6e558694964d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.837638 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2550/5122] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:40.837781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a0b78-8501-4d39-87d0-d58163a5f13a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:40.839311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:40.902804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d167ee-11e6-43ae-aab8-3e99fe941e64 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:40.906155 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2573/5123] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:40 2022] PUT /identity/v3/projects/9f0297eaa02c477a9c4e93a95a6d14aa/users/03f3076433054dc6b0bc6e558694964d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:40.918054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013be5d-ce0b-4028-b0a0-3e7e1c208dce None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.918342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013be5d-ce0b-4028-b0a0-3e7e1c208dce None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.918613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013be5d-ce0b-4028-b0a0-3e7e1c208dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.940852 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:40.950426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6013be5d-ce0b-4028-b0a0-3e7e1c208dce None None] MFA Rules not processed for user `03f3076433054dc6b0bc6e558694964d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:40.951688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6013be5d-ce0b-4028-b0a0-3e7e1c208dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:40.969043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:40.969720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:40.970040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:40.971251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:40.972096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:40.974944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.021760 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2574/5124] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:41.026812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013be5d-ce0b-4028-b0a0-3e7e1c208dce None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.037225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013be5d-ce0b-4028-b0a0-3e7e1c208dce None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.043370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983588-c478-4878-92c0-1171125f511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.043969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983588-c478-4878-92c0-1171125f511f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.044250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983588-c478-4878-92c0-1171125f511f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.044524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983588-c478-4878-92c0-1171125f511f admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.045158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42983588-c478-4878-92c0-1171125f511f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.047143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42983588-c478-4878-92c0-1171125f511f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.072874 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2551/5125] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:40 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:41.074071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.084102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896400-2fa4-4da7-865b-e027621e3493 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.089180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.090689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.090689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.090689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.091107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.092693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.105379 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2552/5126] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:41.109223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.119627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a05fe-be12-4978-a80b-db42b2d2b444 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.124271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.124852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.125129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.125398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.126123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.127703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.138937 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2553/5127] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:41.143689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.152838 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2575/5128] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:41 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:41.153881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983588-c478-4878-92c0-1171125f511f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.160609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2e37a-10e1-4982-a5ae-0f05bc5a649a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.160758 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:41.216672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e465a-e6fd-4a96-989d-826bca5cedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.217253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e465a-e6fd-4a96-989d-826bca5cedde admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.217439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e465a-e6fd-4a96-989d-826bca5cedde admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.217704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e465a-e6fd-4a96-989d-826bca5cedde admin admin] PATH_INFO: `/v3/projects/f35c89df33cb486b80245d5a39e65f90/users/6a04391740ee4398bcced22404a02eed/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.229324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983588-c478-4878-92c0-1171125f511f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.232212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.233079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.233456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.234140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e465a-e6fd-4a96-989d-826bca5cedde admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35c89df33cb486b80245d5a39e65f90, user_id=6a04391740ee4398bcced22404a02eed, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.234277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.234934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.236919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e465a-e6fd-4a96-989d-826bca5cedde admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.237403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.336261 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2576/5129] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:41 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:41.340239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.348560 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2554/5130] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:41 2022] PUT /identity/v3/projects/f35c89df33cb486b80245d5a39e65f90/users/6a04391740ee4398bcced22404a02eed/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:41.354872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31402f79-36d2-4ef1-8e92-33eab01fcbbf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.361444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.361729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.362038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.407029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] MFA Rules not processed for user `6a04391740ee4398bcced22404a02eed`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:41.408673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:41.471926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.472843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.473313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.473620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.474576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.476566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.492233 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2577/5131] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:41.493486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.494023 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2555/5132] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:41.504530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.505915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:41.506317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839feaa-96d4-48a3-9174-5f7a37f9f31c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.512951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.513732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.514150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.514507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] PATH_INFO: `/v3/projects/60d2e666760f42c6b2872dafe6f0591d/users/500b15b0627e4cfdb22be593ac90c646/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.526732 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:41.533647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d2e666760f42c6b2872dafe6f0591d, user_id=500b15b0627e4cfdb22be593ac90c646, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.536357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.577613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0485b6d-96b0-410b-8c58-ce2d9e4d787b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.586048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.586048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.586048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.586048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.591436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.592979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.603311 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2556/5133] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:33:41.640634 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2578/5134] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:41 2022] PUT /identity/v3/projects/60d2e666760f42c6b2872dafe6f0591d/users/500b15b0627e4cfdb22be593ac90c646/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:41.647137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.659132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520b0f-bd8c-4d78-b54c-71d754ca4f4b service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.732946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626c1f5-5596-42d9-bba4-34727d6b1548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.733561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626c1f5-5596-42d9-bba4-34727d6b1548 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.734181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626c1f5-5596-42d9-bba4-34727d6b1548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.734181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626c1f5-5596-42d9-bba4-34727d6b1548 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.734769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626c1f5-5596-42d9-bba4-34727d6b1548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.736363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626c1f5-5596-42d9-bba4-34727d6b1548 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.750242 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2557/5135] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:41.751476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.763003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778234-b672-4379-a460-055f834efdb4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.767725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.768463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.768802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.769034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] PATH_INFO: `/v3/projects/60d2e666760f42c6b2872dafe6f0591d/users/500b15b0627e4cfdb22be593ac90c646/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.771353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d2e666760f42c6b2872dafe6f0591d, user_id=500b15b0627e4cfdb22be593ac90c646, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.774175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:41.785405 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2579/5136] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:41 2022] PUT /identity/v3/projects/60d2e666760f42c6b2872dafe6f0591d/users/500b15b0627e4cfdb22be593ac90c646/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:41.796779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e3f0-ae93-471f-b4cf-0a50f5c550c7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.797452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e3f0-ae93-471f-b4cf-0a50f5c550c7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.798649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e3f0-ae93-471f-b4cf-0a50f5c550c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.831764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a649e3f0-ae93-471f-b4cf-0a50f5c550c7 None None] MFA Rules not processed for user `500b15b0627e4cfdb22be593ac90c646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:41.832966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a649e3f0-ae93-471f-b4cf-0a50f5c550c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:41.904750 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2558/5137] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:41.909058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:41.920629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85786ebc-c813-40bc-8f22-8e65077134a2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:41.925422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:41.926135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:41.926747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:41.927111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:41.927837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:41.929571 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:41.929571 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:41.929571 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:41.930644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.015388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2580/5138] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:41 2022] POST /identity/v3/roles => generated 235 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:42.016785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e3f0-ae93-471f-b4cf-0a50f5c550c7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.028133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e3f0-ae93-471f-b4cf-0a50f5c550c7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.033369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.034042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.034425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.034795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.035588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.036622 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:42.036622 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:42.036622 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:42.037515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.138456 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2559/5139] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/roles => generated 234 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:42.139544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.150378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3ce8-ebcd-4950-8e3f-9a9e5c65f53e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.154998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.155638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.155962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.156152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.156815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.158611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.249857 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2581/5140] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/roles => generated 235 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:42.253631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.264870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dd298-230d-4370-8109-acafaa5a033c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.281721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.282566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.282890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.283116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.283880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.285428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.372311 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2560/5141] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/domains => generated 275 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:42.376510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.389238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270088f4-be6c-43f9-a558-057e8e6b546a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.433065 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:42.468350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.468976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.469260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.469545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.470268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.472246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.600596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2582/5142] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/projects => generated 401 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:42.604733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.617260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad263-73f6-4b1d-ac5d-a0dd335eab10 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.627869 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:42.685761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.686411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.686696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.686977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.687626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.689578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.754098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2561/5143] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/groups => generated 301 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:42.758087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.769219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad72e18-2319-4669-a54a-f3473cd30c19 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.774500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.775113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.775392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.775669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.776443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.778114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.855206 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2583/5144] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/roles => generated 235 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:42.859499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.871078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6d7f-230b-4681-a688-afc695b77e62 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.875855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.884592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.884592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.884592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.884592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.884592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:42.967283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2562/5145] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/users => generated 439 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:42.971810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:42.986470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f95f41-3468-4f0f-82db-d8841b1e3783 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:42.991832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:42.992592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:42.992877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:42.993152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:42.993859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:42.994888 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:42.994888 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:42.994888 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:42.995770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:43.070839 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2584/5146] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:42 2022] POST /identity/v3/roles => generated 270 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:43.076571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:43.088296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76365252-9f20-43a6-9a82-61d8a54c3808 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:43.094643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:43.095435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:43.097609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:43.097609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/4d40468582ba44f1b12c73baefa90c89` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:43.114508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=4d40468582ba44f1b12c73baefa90c89)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:43.117890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:43.222347 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2563/5147] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:43 2022] PUT /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/4d40468582ba44f1b12c73baefa90c89 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:43.230056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:43.240403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf2ce-89aa-463b-b4db-5fa9babdb34f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:43.303660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:43.305091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:43.305435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:43.305740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:43.306539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Adding query filter params (scope.project.id=d59ffeb8e46945e78f55fbebb4ac7788, user.id=c3bedb7bbdd0469486e064ad14c54adc) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:43.306844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:43.307853 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:43.307853 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:43.307853 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:43.308985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:43.361909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2585/5148] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:33:43 2022] GET /identity/v3/role_assignments?scope.project.id=d59ffeb8e46945e78f55fbebb4ac7788&user.id=c3bedb7bbdd0469486e064ad14c54adc&effective => generated 228 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:43.365868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:43.378037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c92e2-4486-45ee-9a40-4ccb785683d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:43.383495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:43.384164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:43.386307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:43.386659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/4d40468582ba44f1b12c73baefa90c89` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:43.389491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=4d40468582ba44f1b12c73baefa90c89)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:43.390492 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:43.390492 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:43.390492 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:43.392401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:43.410662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 4d40468582ba44f1b12c73baefa90c89 was removed from user c3bedb7bbdd0469486e064ad14c54adc on project d59ffeb8e46945e78f55fbebb4ac7788. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:43.410662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:43.411282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:43.502206 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2564/5149] 10.222.0.59 () {58 vars in 1467 bytes} [Sun Aug 28 01:33:43 2022] DELETE /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/4d40468582ba44f1b12c73baefa90c89 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:43.506293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:43.509255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:43.524007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928ca80-5de9-4c07-ba3d-fdacaade8430 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:43.560376 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:43.588597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:43.589274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:43.589736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:43.594250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/4d40468582ba44f1b12c73baefa90c89` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:43.595856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=4d40468582ba44f1b12c73baefa90c89)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:43.596964 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:43.596964 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:43.596964 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:43.598076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:43.714842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 4d40468582ba44f1b12c73baefa90c89 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:43.715173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:43.715956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:43.722100 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2586/5150] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:43 2022] DELETE /identity/v3/roles/4d40468582ba44f1b12c73baefa90c89 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:43.723621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:43.735747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b294-e147-42d3-990a-a7796d0e28f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:43.798487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:43.799268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:43.799656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:43.800044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/31a662b412ec4b6085391140baa97696` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:43.802918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=31a662b412ec4b6085391140baa97696)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:43.807281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:43.877288 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2565/5151] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:43 2022] PUT /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/31a662b412ec4b6085391140baa97696 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:43.881432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:43.882918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:43.895811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f2434-86d6-4c45-9107-474712608399 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:43.951227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:43.951870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:43.952155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:43.952450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:43.954098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:43.955114 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:43.955114 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:43.955114 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:43.955983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.052675 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2587/5152] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:43 2022] PUT /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 520 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:44.055059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.065319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250059-2b99-49bb-8f65-ec76e05ac73c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.098885 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:44.123771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.124379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.124659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.124930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.125648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Adding query filter params (scope.project.id=d59ffeb8e46945e78f55fbebb4ac7788, user.id=c3bedb7bbdd0469486e064ad14c54adc) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:44.125989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.126996 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:44.126996 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:44.126996 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:44.128130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.184842 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2566/5153] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:33:44 2022] GET /identity/v3/role_assignments?scope.project.id=d59ffeb8e46945e78f55fbebb4ac7788&user.id=c3bedb7bbdd0469486e064ad14c54adc&effective => generated 1061 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:44.186076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.197842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132228c-8498-48a6-ab89-040ee39c89ac tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.203249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.203899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.204322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.204604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.206497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.207646 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:44.207646 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:44.207646 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:44.208529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.314848 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2588/5154] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:44 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:44.318819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.330507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f25908-bd60-4597-8f3a-16cdf8f30e9f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.396360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.397024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.397241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.398117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.398901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Adding query filter params (scope.project.id=d59ffeb8e46945e78f55fbebb4ac7788, user.id=c3bedb7bbdd0469486e064ad14c54adc) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:44.399210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.401040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.501844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2567/5155] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:33:44 2022] GET /identity/v3/role_assignments?scope.project.id=d59ffeb8e46945e78f55fbebb4ac7788&user.id=c3bedb7bbdd0469486e064ad14c54adc&effective => generated 577 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:44.506017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.520195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3d0f3-ac3e-4705-9f9d-a6c287148c05 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.526536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.527192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.527516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.527798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.529449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.531151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2.: keystone.exception.ImpliedRoleNotFound: 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2. Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = query.one() Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:44.542805 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 01:33:44.543866 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 01:33:44.544855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 01:33:44.544855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 01:33:44.544855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 01:33:44.544855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2. Aug 28 01:33:44.544855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:44.544855 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2589/5156] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:44 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 137 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:44.548134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.559995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64bd45-0b1e-4011-a4ea-963cf5d59ff5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.565915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.566572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.566814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.567092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/31a662b412ec4b6085391140baa97696` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.570878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=31a662b412ec4b6085391140baa97696)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.573627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.583775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 31a662b412ec4b6085391140baa97696 was removed from user c3bedb7bbdd0469486e064ad14c54adc on project d59ffeb8e46945e78f55fbebb4ac7788. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:44.584248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:44.585185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:44.666447 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2568/5157] 10.222.0.59 () {58 vars in 1467 bytes} [Sun Aug 28 01:33:44 2022] DELETE /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/31a662b412ec4b6085391140baa97696 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:44.671022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.672954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:44.695194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa7e9d-5bc1-462c-b075-5c044c686c18 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.764097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.764097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.764097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.764525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.764525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.765012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.765124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.766535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:44.768947 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:44.805276 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:44.852925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d9c3c-de5b-4057-b3f7-315862ca7ebb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.858341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.858948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.859251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.859495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.861215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:44.876342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.877979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.883237 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2590/5158] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:44 2022] POST /identity/v3/roles => generated 272 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:44.885319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.898715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0279c-bfb9-4fca-8ed8-799bb7121d2e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.900959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2569/5159] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:44.906849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.917060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.917060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.917060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.917060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Adding query filter params (domain_id=3969f428f4ff420899c7964d36e0d138) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:44.917060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.917732 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:44.917732 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:44.917732 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:44.917732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:44.925223 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2591/5160] 10.222.0.59 () {58 vars in 1207 bytes} [Sun Aug 28 01:33:44 2022] GET /identity/v3/roles?domain_id=3969f428f4ff420899c7964d36e0d138 => generated 409 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:44.926811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.938194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:44.938866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4291f-9fdf-42dd-892e-4dbe6032f298 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:44.940256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:44.943722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:44.945755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:44.945755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:44.945755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/158ddcbaf30645c4b0f3c516886ec966` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:44.950800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=158ddcbaf30645c4b0f3c516886ec966)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:44.951964 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:44.951964 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:44.951964 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:44.953560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.021964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacb88a-1ebf-4bad-934f-f435dc004c9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.028648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.029360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.029643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.030599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] PATH_INFO: `/v3/users/03a8a1c2acff44b493e2e94ee2ab968d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.031806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a8a1c2acff44b493e2e94ee2ab968d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.033782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.089375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 158ddcbaf30645c4b0f3c516886ec966 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:45.089587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.090282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.092182 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2570/5161] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:44 2022] DELETE /identity/v3/roles/158ddcbaf30645c4b0f3c516886ec966 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:45.096073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.097512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:45.172425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dd84a-14e0-467c-a3d5-51948614ea25 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.178244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.178923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.179208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.179597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.180243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Adding query filter params (domain_id=3969f428f4ff420899c7964d36e0d138) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:45.180743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.181760 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:45.181760 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:45.181760 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:45.182668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.188827 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2571/5162] 10.222.0.59 () {58 vars in 1207 bytes} [Sun Aug 28 01:33:45 2022] GET /identity/v3/roles?domain_id=3969f428f4ff420899c7964d36e0d138 => generated 148 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:45.195060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.204979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd358d-efda-41ad-ac17-bef991d57891 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.209773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.211188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.211662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.211946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/158ddcbaf30645c4b0f3c516886ec966` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.223364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Could not find role: 158ddcbaf30645c4b0f3c516886ec966.: keystone.exception.RoleNotFound: Could not find role: 158ddcbaf30645c4b0f3c516886ec966. Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 28 01:33:45.229573 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:33:45.230723 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 158ddcbaf30645c4b0f3c516886ec966. Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:45.232050 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2572/5163] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:45 2022] DELETE /identity/v3/roles/158ddcbaf30645c4b0f3c516886ec966 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:33:45.237674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.248085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2355bbe-c795-4e84-a8c4-264181cb065b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.260530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.261226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.262932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.263209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.266006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a8a1c2acff44b493e2e94ee2ab968d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.266807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a8a1c2acff44b493e2e94ee2ab968d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.275737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3969f428f4ff420899c7964d36e0d138, group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.285092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.330329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a8a1c2acff44b493e2e94ee2ab968d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.338810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a8a1c2acff44b493e2e94ee2ab968d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.339509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a8a1c2acff44b493e2e94ee2ab968d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.356645 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2592/5164] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:44 2022] DELETE /identity/v3/users/03a8a1c2acff44b493e2e94ee2ab968d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:45.395376 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2573/5165] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:45 2022] PUT /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:45.400566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.402395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:45.491298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632189-7321-473d-805d-80404c941c78 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.560149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.561620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.562126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.562562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.564693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3969f428f4ff420899c7964d36e0d138, group_id=6c9728b22825442891afd93252e9ad47)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.566563 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:45.566563 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:45.566563 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:45.569735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.597858 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2593/5166] 10.222.0.59 () {58 vars in 1365 bytes} [Sun Aug 28 01:33:45 2022] GET /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles => generated 410 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:45.600265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.619378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd34b9-aa05-4119-bcc1-e502536b21dd tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.624513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.625260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.625620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.626012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.628337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3969f428f4ff420899c7964d36e0d138, group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.629445 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:45.629445 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:45.629445 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:45.632444 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:45.632675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.640230 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2574/5167] 10.222.0.59 () {58 vars in 1465 bytes} [Sun Aug 28 01:33:45 2022] HEAD /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:45.644074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.655740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7badb83-9ca8-4248-b6fc-c7960d89c02e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.660949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.661686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.662071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.662430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.666050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3969f428f4ff420899c7964d36e0d138, group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.667435 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:45.667435 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:45.667435 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:45.669536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.677773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role c0d5ce4ef0dc47cba97b4709d73e5cd5 was removed from group 6c9728b22825442891afd93252e9ad47 on domain 3969f428f4ff420899c7964d36e0d138. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:45.678250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.680274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:45.696800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.703263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:45.743569 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:45.779409 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2594/5168] 10.222.0.59 () {58 vars in 1467 bytes} [Sun Aug 28 01:33:45 2022] DELETE /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:45.784725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:45.786835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:45.798259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce35a48-3334-4889-ab2a-bce9dd4690b4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.871506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.871506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.871506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.871506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] PATH_INFO: `/v3/projects/8fa7a9085f114d6c8b1473fd22cb32b4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.871974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168a09-2d1f-4794-8b5b-b67d6b451bfb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:45.874042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa7a9085f114d6c8b1473fd22cb32b4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.876312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.878697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:45.879474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:45.879905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:45.880417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:45.883904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:45.887116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:45.981604 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2595/5169] 10.222.0.59 () {60 vars in 1486 bytes} [Sun Aug 28 01:33:45 2022] PUT /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:45.985995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.000671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa7a9085f114d6c8b1473fd22cb32b4', 'request_id': 'req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.008310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa7a9085f114d6c8b1473fd22cb32b4', 'request_id': 'req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.061837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1e56-34f0-44b0-bd2d-d60e612961f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.096508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa7a9085f114d6c8b1473fd22cb32b4', 'request_id': 'req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.109942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] The token cache is being invalidate because project 8fa7a9085f114d6c8b1473fd22cb32b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:46.110351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.111541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f15e0bba-1ce4-4482-b89e-e1261ac1b6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.113886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2575/5170] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:45 2022] DELETE /identity/v3/projects/8fa7a9085f114d6c8b1473fd22cb32b4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:46.119074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f6f47-b79d-40c2-9e28-b651cb427bb7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.119355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f6f47-b79d-40c2-9e28-b651cb427bb7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.119890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f6f47-b79d-40c2-9e28-b651cb427bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.129951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.130189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.130468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.130739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.132626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d59ffeb8e46945e78f55fbebb4ac7788, group_id=6c9728b22825442891afd93252e9ad47)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.136140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.140891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ef5f6f47-b79d-40c2-9e28-b651cb427bb7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:46.141681 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:46.142145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ef5f6f47-b79d-40c2-9e28-b651cb427bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:46.154567 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2596/5171] 10.222.0.59 () {58 vars in 1368 bytes} [Sun Aug 28 01:33:45 2022] GET /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:46.159144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.161466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:46.182804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e98c8c-0a3e-48d8-afaf-37c4e530b0d5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.194391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f88d8-72d7-4b1b-986f-48ca6ad8313e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.195703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f88d8-72d7-4b1b-986f-48ca6ad8313e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.196798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f88d8-72d7-4b1b-986f-48ca6ad8313e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.197230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f88d8-72d7-4b1b-986f-48ca6ad8313e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/groups/6c9728b22825442891afd93252e9ad47/users/c3bedb7bbdd0469486e064ad14c54adc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.199436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f88d8-72d7-4b1b-986f-48ca6ad8313e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6c9728b22825442891afd93252e9ad47, user_id=c3bedb7bbdd0469486e064ad14c54adc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.201992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f88d8-72d7-4b1b-986f-48ca6ad8313e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.248411 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2576/5172] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:46.260417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959433b-f6e2-4bfd-b3a8-4349f9f28178 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.260621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959433b-f6e2-4bfd-b3a8-4349f9f28178 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.260991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959433b-f6e2-4bfd-b3a8-4349f9f28178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.278253 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:46.284739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2959433b-f6e2-4bfd-b3a8-4349f9f28178 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:46.285955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2959433b-f6e2-4bfd-b3a8-4349f9f28178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:46.296498 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2577/5173] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:46.302283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959433b-f6e2-4bfd-b3a8-4349f9f28178 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.317204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959433b-f6e2-4bfd-b3a8-4349f9f28178 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.323031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.323797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.324115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.324358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.325020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:46.325327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.329397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.348887 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2597/5174] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:33:46 2022] PUT /identity/v3/groups/6c9728b22825442891afd93252e9ad47/users/c3bedb7bbdd0469486e064ad14c54adc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:46.355125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623a3c-80d8-408b-95a7-d83cfda8ca83 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.355125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623a3c-80d8-408b-95a7-d83cfda8ca83 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.355125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623a3c-80d8-408b-95a7-d83cfda8ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.386648 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2578/5175] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:46.386648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.431657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9d623a3c-80d8-408b-95a7-d83cfda8ca83 None None] MFA Rules not processed for user `c3bedb7bbdd0469486e064ad14c54adc`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:46.433438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9d623a3c-80d8-408b-95a7-d83cfda8ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:46.436420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb0d1-fc85-4627-aecf-3c5c8e33a0ca admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.526019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.526684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.526966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.527248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.527901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.530078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.549229 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2598/5176] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:46 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:46.556990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d623a3c-80d8-408b-95a7-d83cfda8ca83 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.614160 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:46.617883 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2579/5177] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:46 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:46.622200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.628398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d623a3c-80d8-408b-95a7-d83cfda8ca83 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.688653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb1a22-955c-4bb1-8dc7-9ab930b68306 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.690594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.691276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.691600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.691875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.695637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.695866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.696512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.696687 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:46.696687 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:46.696687 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:46.696955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.697044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.697701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.699089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.699646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.705397 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2599/5178] 10.222.0.59 () {58 vars in 1468 bytes} [Sun Aug 28 01:33:46 2022] HEAD /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:46.709482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.724374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bc6c4-f8be-4aee-836f-d6cb7d374bdc tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.724374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.725072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.725339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.726280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.728410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.731168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.736325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role c0d5ce4ef0dc47cba97b4709d73e5cd5 was removed from group 6c9728b22825442891afd93252e9ad47 on project d59ffeb8e46945e78f55fbebb4ac7788. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:46.736619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.737322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.811740 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2600/5179] 10.222.0.59 () {58 vars in 1470 bytes} [Sun Aug 28 01:33:46 2022] DELETE /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:46.815246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2580/5180] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:46 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:46.817000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.817169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.818453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:46.818856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:46.834728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a1471-6731-4f99-b9ab-0d0e97176c9f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.890314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa680147-accf-43fe-b81c-0c1a10afca58 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.896012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.896472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.896743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.897026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.897276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.897461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/groups/6c9728b22825442891afd93252e9ad47/users/c3bedb7bbdd0469486e064ad14c54adc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.897584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.897924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.898584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.899460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6c9728b22825442891afd93252e9ad47, user_id=c3bedb7bbdd0469486e064ad14c54adc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.900161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.900658 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:46.900658 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:46.900658 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:46.902445 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:46.902903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.912406 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2581/5181] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:46 2022] GET /identity/v3/roles => generated 2323 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:46.916838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.926894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fd6c3-4ef8-4a6b-bb29-dd578c60fb7e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.931589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.932169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.932449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.932722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.933346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.934957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:46.947711 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2582/5182] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:46 2022] GET /identity/v3/roles => generated 2323 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:46.951767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:46.961837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f915-0557-47d6-9e19-0762587bdb8f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:46.966399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e53f96-e608-42ba-aadc-46b2aad8389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:46.967015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53f96-e608-42ba-aadc-46b2aad8389e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:46.967297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53f96-e608-42ba-aadc-46b2aad8389e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:46.967572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53f96-e608-42ba-aadc-46b2aad8389e admin admin] PATH_INFO: `/v3/projects/402c6aec53a4462ea5f5d4bd71d09b2c/users/aba752cdc71a4e9bbc90496c3f99164e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:46.973714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c3bedb7bbdd0469486e064ad14c54adc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:46.981857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e53f96-e608-42ba-aadc-46b2aad8389e admin admin] RBAC: Authorizing `identity:create_grant(project_id=402c6aec53a4462ea5f5d4bd71d09b2c, user_id=aba752cdc71a4e9bbc90496c3f99164e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:46.984545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e53f96-e608-42ba-aadc-46b2aad8389e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.055303 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2601/5183] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:33:46 2022] DELETE /identity/v3/groups/6c9728b22825442891afd93252e9ad47/users/c3bedb7bbdd0469486e064ad14c54adc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:47.060553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.068189 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2583/5184] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:46 2022] PUT /identity/v3/projects/402c6aec53a4462ea5f5d4bd71d09b2c/users/aba752cdc71a4e9bbc90496c3f99164e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:47.079062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.079354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.079631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.108279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] MFA Rules not processed for user `aba752cdc71a4e9bbc90496c3f99164e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:47.109639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:47.123829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9d4fe-f74c-459b-a244-3937969c0b70 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.132376 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:47.176540 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2584/5185] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:47.185277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.186011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.186321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.186722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.188731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.190144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:47.195838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.199024 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:47.199024 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:47.199024 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:47.199476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.252497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf4903-c49a-4574-9034-2469477129d3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.256188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.257442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.257724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.258020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.267345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.268077 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2602/5186] 10.222.0.59 () {60 vars in 1381 bytes} [Sun Aug 28 01:33:47 2022] PUT /identity/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:47.270994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.271962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.283384 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2585/5187] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:33:47.284735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021153c0-8425-4819-8d82-690a47871778 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.291281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.291281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.291281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.291759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.292316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=6c9728b22825442891afd93252e9ad47)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.293519 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:47.293519 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:47.293519 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:47.294434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.317850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2603/5188] 10.222.0.59 () {58 vars in 1263 bytes} [Sun Aug 28 01:33:47 2022] GET /identity/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles => generated 376 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:47.320904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.322470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.333292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5b52d-3edf-4c45-be04-6f83c628d03a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.342324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.343360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.343360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.343606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.348283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.348283 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:47.348283 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:47.348283 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:47.348283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.356390 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2604/5189] 10.222.0.59 () {58 vars in 1363 bytes} [Sun Aug 28 01:33:47 2022] HEAD /identity/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:47.360504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.371603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0211d8e-7cd1-4555-9024-2cd07d332caa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.376356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.382709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.382709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.382709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.382709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=6c9728b22825442891afd93252e9ad47, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.383165 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:47.383165 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:47.383165 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:47.383165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.401433 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:47.408169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a58e9-62d3-4db0-a9d5-514bd98566bb service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.413705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.414581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.415026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.415311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] PATH_INFO: `/v3/users/aba752cdc71a4e9bbc90496c3f99164e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.416538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba752cdc71a4e9bbc90496c3f99164e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.418491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.465916 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2605/5190] 10.222.0.59 () {58 vars in 1365 bytes} [Sun Aug 28 01:33:47 2022] DELETE /identity/v3/system/groups/6c9728b22825442891afd93252e9ad47/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:47.471026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.481721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90bb7-1190-48f2-a10e-f9f6a7166da6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.486934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.487875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.488082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.488372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.490770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3969f428f4ff420899c7964d36e0d138, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.494656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.588458 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2606/5191] 10.222.0.59 () {60 vars in 1480 bytes} [Sun Aug 28 01:33:47 2022] PUT /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:47.592224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.620572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba752cdc71a4e9bbc90496c3f99164e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:47.633823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba752cdc71a4e9bbc90496c3f99164e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:47.640795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba752cdc71a4e9bbc90496c3f99164e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:47.641538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba752cdc71a4e9bbc90496c3f99164e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:47.659964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e74b9-1d33-4382-b553-d97f53030e53 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.665535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.672097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.672097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.672097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.672097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3969f428f4ff420899c7964d36e0d138, user_id=c3bedb7bbdd0469486e064ad14c54adc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.672511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.684920 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2607/5192] 10.222.0.59 () {58 vars in 1362 bytes} [Sun Aug 28 01:33:47 2022] GET /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles => generated 409 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:47.689217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.695503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:47.708824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236a26a-d05b-4f8a-99aa-96641d96753b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.713801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-589bb4a5-bd4f-42c2-8f79-1f543c16611c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba752cdc71a4e9bbc90496c3f99164e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:47.714690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.715608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.716019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.716499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.719394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3969f428f4ff420899c7964d36e0d138, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.722104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.722614 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2586/5193] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:47 2022] DELETE /identity/v3/users/aba752cdc71a4e9bbc90496c3f99164e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:47.727280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3131-07ee-470f-8aac-226babacea60 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.727564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3131-07ee-470f-8aac-226babacea60 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.727840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db3131-07ee-470f-8aac-226babacea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.729336 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2608/5194] 10.222.0.59 () {58 vars in 1462 bytes} [Sun Aug 28 01:33:47 2022] HEAD /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:47.733195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.745396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99fecd-06f2-4f54-a967-1824916a369f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.752232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-97db3131-07ee-470f-8aac-226babacea60 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:47.753719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-97db3131-07ee-470f-8aac-226babacea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:47.801803 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:47.816802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.817470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.821058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.821058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.821271 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2587/5195] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:47.821384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3969f428f4ff420899c7964d36e0d138, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:47.823676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:47.829663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role c0d5ce4ef0dc47cba97b4709d73e5cd5 was removed from user c3bedb7bbdd0469486e064ad14c54adc on domain 3969f428f4ff420899c7964d36e0d138. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:47.829989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:47.830693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db3131-07ee-470f-8aac-226babacea60 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.830797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:47.832389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-97db3131-07ee-470f-8aac-226babacea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:47.892884 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2609/5196] 10.222.0.59 () {58 vars in 1464 bytes} [Sun Aug 28 01:33:47 2022] DELETE /identity/v3/domains/3969f428f4ff420899c7964d36e0d138/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:47.898378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:47.899787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:47.910701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db3131-07ee-470f-8aac-226babacea60 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:47.949842 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:47.990728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:47.991682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:47.992212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:47.992656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:47.995914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:48.003081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3eb5b-0fc5-4975-bc49-5def939f0d9c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.008764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.009498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.010099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.010751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.013166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.018268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.075663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.077095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.087072 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2588/5197] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:48.108067 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2610/5198] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:47 2022] PUT /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:48.112247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.123048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2d2d-25f3-43cc-bd18-0d9b1f603466 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.189569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.190291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.190577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.190852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.192938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.195301 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:48.195301 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:48.195301 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:48.197095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.209258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2589/5199] 10.222.0.59 () {58 vars in 1365 bytes} [Sun Aug 28 01:33:48 2022] GET /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles => generated 410 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:48.214108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.224636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70036bad-6153-4d42-a445-f3e66e88d19c tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.229249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.230028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.230321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.230602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.232780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.235562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.241912 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2611/5200] 10.222.0.59 () {58 vars in 1465 bytes} [Sun Aug 28 01:33:48 2022] HEAD /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:48.246096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.256020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675373c-6b06-444b-9dd9-954a30fc4829 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.261959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.262870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.263155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.263433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.265665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d59ffeb8e46945e78f55fbebb4ac7788, user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.268305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.274413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role c0d5ce4ef0dc47cba97b4709d73e5cd5 was removed from user c3bedb7bbdd0469486e064ad14c54adc on project d59ffeb8e46945e78f55fbebb4ac7788. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:48.274708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:48.275397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:48.383258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2590/5201] 10.222.0.59 () {58 vars in 1467 bytes} [Sun Aug 28 01:33:48 2022] DELETE /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:48.388375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.390860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:48.412584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef894a-9df1-4263-bf81-3a4d29d162e5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.484515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.485096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.485385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.485665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.487459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.488488 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:48.488488 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:48.488488 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:48.489485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.576726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.578476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:48.590935 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2612/5202] 10.222.0.59 () {60 vars in 1378 bytes} [Sun Aug 28 01:33:48 2022] PUT /identity/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:48.603868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.625419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31895d-8af8-4695-a284-583109072e73 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.637522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.638189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.638474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.638748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.641213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=c3bedb7bbdd0469486e064ad14c54adc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.642247 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:48.642247 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:48.642247 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:48.643124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.661120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2613/5203] 10.222.0.59 () {58 vars in 1260 bytes} [Sun Aug 28 01:33:48 2022] GET /identity/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles => generated 375 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:48.666258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.676017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c625-24d4-417f-b8f0-97f47110b1b3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.682028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.682684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.682970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.683249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.685074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.686148 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:48.686148 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:48.686148 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:48.687167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.690105 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:48.696128 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2614/5204] 10.222.0.59 () {58 vars in 1360 bytes} [Sun Aug 28 01:33:48 2022] HEAD /identity/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:48.697186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf9135-401f-4085-b6c9-e418f12dd8e3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.697469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.702475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.703483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.703952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.704194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] PATH_INFO: `/v3/projects/402c6aec53a4462ea5f5d4bd71d09b2c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.706308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] RBAC: Authorizing `identity:delete_project(project_id=402c6aec53a4462ea5f5d4bd71d09b2c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.708588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.709503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d891d-625e-46b9-8393-6bebe9e29990 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.715593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.716568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.717042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.717322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.720022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=c3bedb7bbdd0469486e064ad14c54adc, role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.721476 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:48.721476 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:48.721476 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:48.722421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.788873 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2615/5205] 10.222.0.59 () {58 vars in 1362 bytes} [Sun Aug 28 01:33:48 2022] DELETE /identity/v3/system/users/c3bedb7bbdd0469486e064ad14c54adc/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:48.793927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.811246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d962-dded-4716-aeb3-95956d48cb37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.816419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:48.817110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:48.817468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:48.817838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:48.818797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:48.821844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:48.836285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402c6aec53a4462ea5f5d4bd71d09b2c', 'request_id': 'req-bb2060ec-9ddf-416e-84ec-c2612e77589d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:48.841769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402c6aec53a4462ea5f5d4bd71d09b2c', 'request_id': 'req-bb2060ec-9ddf-416e-84ec-c2612e77589d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:48.915146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2616/5206] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:48 2022] POST /identity/v3/roles => generated 269 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:48.919073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:48.930834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dbf64-1b75-4d49-8fd1-7c41feb5ff1b tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:48.941921 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:48.979579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402c6aec53a4462ea5f5d4bd71d09b2c', 'request_id': 'req-bb2060ec-9ddf-416e-84ec-c2612e77589d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:48.999422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.000154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.000352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.000628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.001302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.002844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] The token cache is being invalidate because project 402c6aec53a4462ea5f5d4bd71d09b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:49.002978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.003316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:49.004109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bb2060ec-9ddf-416e-84ec-c2612e77589d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:49.006147 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2591/5207] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:48 2022] DELETE /identity/v3/projects/402c6aec53a4462ea5f5d4bd71d09b2c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:49.016755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb2cd-5966-46c1-9efa-6b885deda3d8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.017199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb2cd-5966-46c1-9efa-6b885deda3d8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.017619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb2cd-5966-46c1-9efa-6b885deda3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.047161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-addbb2cd-5966-46c1-9efa-6b885deda3d8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:49.048357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-addbb2cd-5966-46c1-9efa-6b885deda3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:49.115415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2592/5208] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:49.124632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b26b8-0af9-4747-9b7f-3c971f2b1d91 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.133026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b26b8-0af9-4747-9b7f-3c971f2b1d91 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.133026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b26b8-0af9-4747-9b7f-3c971f2b1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.133432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2617/5209] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:48 2022] POST /identity/v3/roles => generated 270 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:49.135732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.139036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:49.146925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-de2b26b8-0af9-4747-9b7f-3c971f2b1d91 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:49.148882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de2b26b8-0af9-4747-9b7f-3c971f2b1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:49.153588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb3a7-730b-4a1e-8ad3-afe60d67780f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.157355 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2593/5210] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:49.158782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.159528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.159814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.160095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c8c7a35b5ded4887925150a82eeb8583` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.162127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7827a9ab969c48daa45b07c4ca746aff, implied_role_id=c8c7a35b5ded4887925150a82eeb8583)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.163896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b26b8-0af9-4747-9b7f-3c971f2b1d91 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.164046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.173415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b26b8-0af9-4747-9b7f-3c971f2b1d91 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.178589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.179497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.179782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.180056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.180799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:33:49.181108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.182730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.195092 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2594/5211] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:49.211909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.221779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffae9c-af03-4fa8-9bbf-c4bf2fdf3b4e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.227233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.227922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.228096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.228373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.229013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.230964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.257441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2618/5212] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:49 2022] PUT /identity/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c8c7a35b5ded4887925150a82eeb8583 => generated 530 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:49.261380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.325780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbade2-feb7-4225-a85f-bd32090f5992 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.330886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.331162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.331451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.334663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.334804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.337328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.366860 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2595/5213] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:33:49 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:49.371618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.424671 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:49.443404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe743f-b8a7-49c0-9430-e2374916334c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.448427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.449385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.449535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.449803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.449929 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2619/5214] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:33:49 2022] POST /identity/v3/domains => generated 277 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:49.451023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.451144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.453090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.522012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e9cf-e3dc-4774-bc8c-6999f6f48872 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.527693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.528323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.528644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.528985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.529666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.531355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.557173 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2596/5215] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:33:49 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:49.558540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.570104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418574f-fa3e-4d47-b39d-b2fb2c9aa746 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.610106 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2620/5216] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:49 2022] POST /identity/v3/roles => generated 270 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:49.611239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.624105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772e32d-1db5-4e65-9c76-b8699c0474a6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.629111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.629758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.630080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.630359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/182b8a1bb8f446198fdf7d16142a6303` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.630467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.631114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.631331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.631595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.632893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7827a9ab969c48daa45b07c4ca746aff, implied_role_id=182b8a1bb8f446198fdf7d16142a6303)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.633156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.634684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.635723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.637844 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:49.650745 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2597/5217] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:49 2022] GET /identity/v3/roles => generated 2323 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:49.651930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.662761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c2be-5a43-4ecf-a408-b1e580543b87 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.668016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.668625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.668911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.669186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.669953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.671540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.685225 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2598/5218] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:49 2022] GET /identity/v3/roles => generated 2323 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:33:49.689266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.699593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc70dc1-624a-42b6-9390-b70d7452e759 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.704320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43ca9c-d59a-473a-9133-73999d290f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.704951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43ca9c-d59a-473a-9133-73999d290f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.705235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43ca9c-d59a-473a-9133-73999d290f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.705513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43ca9c-d59a-473a-9133-73999d290f26 admin admin] PATH_INFO: `/v3/projects/3cde0af5172a4af896ea882d1c0f3159/users/4cfb68ce969d46b68e0706ff8fd35704/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.720313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43ca9c-d59a-473a-9133-73999d290f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cde0af5172a4af896ea882d1c0f3159, user_id=4cfb68ce969d46b68e0706ff8fd35704, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.723029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43ca9c-d59a-473a-9133-73999d290f26 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.741720 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2621/5219] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:49 2022] PUT /identity/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/182b8a1bb8f446198fdf7d16142a6303 => generated 530 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:49.745582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.782775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2599/5220] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:33:49 2022] PUT /identity/v3/projects/3cde0af5172a4af896ea882d1c0f3159/users/4cfb68ce969d46b68e0706ff8fd35704/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:49.793071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.793417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.793763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.816784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aa1a4-9512-4dd5-85f5-c89804422e28 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:49.835419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] MFA Rules not processed for user `4cfb68ce969d46b68e0706ff8fd35704`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:49.837376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:49.885919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:49.886684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:49.887153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:49.887539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:49.889544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7827a9ab969c48daa45b07c4ca746aff, implied_role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:49.891430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:49.933923 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2600/5221] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:49.946739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:49.949124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:49.983923 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:50.005966 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2622/5222] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:49 2022] PUT /identity/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 525 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:50.006600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:50.032358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e133-77d3-454e-9da7-8a485afa3c0a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:50.097942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:50.098567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:50.098878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:50.099149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:50.125717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac0ab3-9c55-4c58-9e49-b2ab0f7bb0c5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:50.133200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:50.135671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:50.135671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:50.135671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5/implies/7827a9ab969c48daa45b07c4ca746aff` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:50.137009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5, implied_role_id=7827a9ab969c48daa45b07c4ca746aff)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:50.139114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:50.156770 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:50.167530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:50.169014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:50.178942 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2601/5223] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] 7827a9ab969c48daa45b07c4ca746aff cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 7827a9ab969c48daa45b07c4ca746aff cannot be an implied roles. Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 28 01:33:50.191941 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 28 01:33:50.193088 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:50.193088 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:50.193088 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 28 01:33:50.193088 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 28 01:33:50.193088 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 7827a9ab969c48daa45b07c4ca746aff cannot be an implied roles. Aug 28 01:33:50.193088 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:33:50.195645 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2623/5224] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:50 2022] PUT /identity/v3/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5/implies/7827a9ab969c48daa45b07c4ca746aff => generated 116 bytes in 190 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:50.199738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:50.214849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf042d5-aecf-43cf-be58-bd1106e03ef4 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:50.219801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:50.220694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:50.221050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:50.221400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:50.223519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7827a9ab969c48daa45b07c4ca746aff, implied_role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:50.224609 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:50.224609 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:50.224609 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:50.226191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:50.280036 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2602/5225] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:50 2022] DELETE /identity/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:50.284289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:50.295405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f1e1d-d8e4-44b1-bf33-83fdf4c80bb3 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:50.392309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:50.393014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:50.393972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:50.394444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/182b8a1bb8f446198fdf7d16142a6303` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:50.396856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7827a9ab969c48daa45b07c4ca746aff, implied_role_id=182b8a1bb8f446198fdf7d16142a6303)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:50.400349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:50.513128 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2624/5226] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:50 2022] DELETE /identity/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/182b8a1bb8f446198fdf7d16142a6303 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:50.517482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:50.528842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a185f6-2ac2-4ab6-99a0-0b7bb269bd07 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:50.648372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:50.650316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:50.763750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6e5de-e960-4413-a5c9-8a591ac1b432 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:50.771610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:50.772514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:50.772953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:50.773385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:50.777133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:50.796472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:50.800144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:50.816063 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2625/5227] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:33:50.843658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:50.844351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:50.844646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:50.844957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/182b8a1bb8f446198fdf7d16142a6303` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:50.846146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=182b8a1bb8f446198fdf7d16142a6303)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:50.858976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:50.887311 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:50.975573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 182b8a1bb8f446198fdf7d16142a6303 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:50.975573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:50.978333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:50.984564 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2603/5228] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:50 2022] DELETE /identity/v3/roles/182b8a1bb8f446198fdf7d16142a6303 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:50.985458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:51.002983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab539a5-ccb5-49a6-84e8-900914bc33d4 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:51.102457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:51.103508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:51.103792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:51.104217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/35c1135c8eab4896818320efd497da84` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:51.117549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=35c1135c8eab4896818320efd497da84)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:51.119514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:51.130627 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:51.153089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '35c1135c8eab4896818320efd497da84'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.153089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '35c1135c8eab4896818320efd497da84'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.290966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '35c1135c8eab4896818320efd497da84'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.291595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '35c1135c8eab4896818320efd497da84'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.294304 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2626/5229] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:33:50 2022] PATCH /identity/v3/domains/35c1135c8eab4896818320efd497da84 => generated 278 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:51.298166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:51.299575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:51.313298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a820-b2f0-4d1a-87b8-4b8dbc5bf3da tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:51.386161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:51.387193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:51.387690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:51.388289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/35c1135c8eab4896818320efd497da84` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:51.404122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=35c1135c8eab4896818320efd497da84)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:51.405829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:51.466569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '35c1135c8eab4896818320efd497da84'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.471288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '35c1135c8eab4896818320efd497da84'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.604772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c1135c8eab4896818320efd497da84', 'request_id': 'req-8875feb3-15bc-4c20-abbf-0d72302ee57a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.614528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c1135c8eab4896818320efd497da84', 'request_id': 'req-8875feb3-15bc-4c20-abbf-0d72302ee57a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.707527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c1135c8eab4896818320efd497da84', 'request_id': 'req-8875feb3-15bc-4c20-abbf-0d72302ee57a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.726912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] The token cache is being invalidate because project 35c1135c8eab4896818320efd497da84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:51.727371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.728232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.740341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '35c1135c8eab4896818320efd497da84', 'request_id': 'req-8875feb3-15bc-4c20-abbf-0d72302ee57a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.741595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '35c1135c8eab4896818320efd497da84', 'request_id': 'req-8875feb3-15bc-4c20-abbf-0d72302ee57a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.742594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '35c1135c8eab4896818320efd497da84', 'request_id': 'req-8875feb3-15bc-4c20-abbf-0d72302ee57a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:51.753985 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2604/5230] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:51 2022] DELETE /identity/v3/domains/35c1135c8eab4896818320efd497da84 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:51.757691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:51.759291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:51.777186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d080b-d6cf-48b5-9952-b139d652fb68 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:51.858527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:51.859346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:51.859728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:51.860909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c8c7a35b5ded4887925150a82eeb8583` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:51.862845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7827a9ab969c48daa45b07c4ca746aff, implied_role_id=c8c7a35b5ded4887925150a82eeb8583)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:51.864909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:51.940167 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2627/5231] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:51 2022] DELETE /identity/v3/roles/7827a9ab969c48daa45b07c4ca746aff/implies/c8c7a35b5ded4887925150a82eeb8583 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:51.942004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:51.946233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:51.978242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875feb3-15bc-4c20-abbf-0d72302ee57a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:52.027636 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:52.120928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:52.122627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:52.123129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:52.123610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/c8c7a35b5ded4887925150a82eeb8583` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:52.125069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c8c7a35b5ded4887925150a82eeb8583)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:52.128098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:52.256139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role c8c7a35b5ded4887925150a82eeb8583 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:52.256581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:52.258875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:52.262390 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2605/5232] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:51 2022] DELETE /identity/v3/roles/c8c7a35b5ded4887925150a82eeb8583 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:52.269257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:52.275432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:52.309220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5a80-0d91-4a33-bd29-86d9c2cb09fb tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:52.429660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:52.430245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:52.430533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:52.430814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/7827a9ab969c48daa45b07c4ca746aff` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:52.433082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7827a9ab969c48daa45b07c4ca746aff)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:52.434153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:52.565304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 7827a9ab969c48daa45b07c4ca746aff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:52.565704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:52.566509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:52.569873 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2628/5233] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:52 2022] DELETE /identity/v3/roles/7827a9ab969c48daa45b07c4ca746aff => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:52.583748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:52.597861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d364c-312c-4560-a1f9-332b2a7ea594 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:52.696565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:52.697689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:52.698009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:52.698290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:52.700764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:52.702019 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:52.702019 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:52.702019 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:52.702903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:52.807357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2606/5234] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:52 2022] PUT /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 520 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:52.811323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:52.812946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:52.832846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301817-ae23-4967-8df0-2a1f02a97279 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:52.871165 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:52.906725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:52.908081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:52.908752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:52.909345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:52.911467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:52.914545 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:52.914545 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:52.914545 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:52.914545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:52.916486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:52.917576 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:52.917576 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:52.917576 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:52.918669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:52.924999 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2629/5235] 10.222.0.59 () {58 vars in 1345 bytes} [Sun Aug 28 01:33:52 2022] HEAD /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:52.929645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:52.942054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553b6b3-4f53-42d7-b5e7-2970ad2a6e7d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:52.947833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:52.948494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:52.956420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:52.956420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:52.956420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:52.956420 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:52.956420 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:52.956420 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:52.957007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:52.959461 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2607/5236] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:33:52 2022] GET /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 520 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:52.964763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:52.981024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228a41b-18a5-4b68-8350-b017a92ccb69 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:52.997959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20aa8b-b95a-4a6a-b24d-3574c45cb5f7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:52.998717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20aa8b-b95a-4a6a-b24d-3574c45cb5f7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:52.999011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20aa8b-b95a-4a6a-b24d-3574c45cb5f7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:52.999295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20aa8b-b95a-4a6a-b24d-3574c45cb5f7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.002002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20aa8b-b95a-4a6a-b24d-3574c45cb5f7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:53.006020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20aa8b-b95a-4a6a-b24d-3574c45cb5f7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:53.108008 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2630/5237] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:52 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:53.108109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:53.120025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef191621-fdda-4824-b876-66f7db33560d tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:53.226903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d24ce-7f54-4126-b97c-b0e2fea84387 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:53.227619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d24ce-7f54-4126-b97c-b0e2fea84387 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:53.228124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d24ce-7f54-4126-b97c-b0e2fea84387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.245617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:53.246312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:53.246596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:53.250945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.252863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:53.254694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:53.265169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c00d24ce-7f54-4126-b97c-b0e2fea84387 None None] MFA Rules not processed for user `4cfb68ce969d46b68e0706ff8fd35704`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2.: keystone.exception.ImpliedRoleNotFound: 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2. Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = query.one() Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:53.266563 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 01:33:53.267749 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 01:33:53.269010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 01:33:53.269010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2. Aug 28 01:33:53.269010 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:53.269415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c00d24ce-7f54-4126-b97c-b0e2fea84387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:53.271024 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2608/5238] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:33:53 2022] GET /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 137 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:53.276251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:53.287327 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:53.297085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9841d1-b903-437d-a35d-197711aa2631 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:53.302929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:53.304390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:53.304824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:53.305245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.307384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:53.309205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2.: keystone.exception.ImpliedRoleNotFound: 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2. Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = query.one() Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:53.321290 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 01:33:53.326595 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 01:33:53.327538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 01:33:53.327538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 01:33:53.327538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 01:33:53.327538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 31a662b412ec4b6085391140baa97696 does not imply 2c2734dae75e41c7a7e1a29cc543efd2. Aug 28 01:33:53.327538 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:53.329080 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2609/5239] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:53 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 137 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:53.330099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:53.348290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968ad6b-40a5-48bf-8e6d-aefcfdf8cc37 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:53.367423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2ea96-a32b-4169-ad91-518e617ca144 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:53.368210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ea96-a32b-4169-ad91-518e617ca144 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:53.368591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ea96-a32b-4169-ad91-518e617ca144 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:53.368943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2ea96-a32b-4169-ad91-518e617ca144 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.372328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2ea96-a32b-4169-ad91-518e617ca144 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:53.374036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2ea96-a32b-4169-ad91-518e617ca144 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:53.396912 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2631/5240] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:53.515548 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2610/5241] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:53 2022] PUT /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 520 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:53.520072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d24ce-7f54-4126-b97c-b0e2fea84387 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:53.550961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d24ce-7f54-4126-b97c-b0e2fea84387 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:53.579887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373b90-50bf-4457-aeeb-e4515bb27af3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:53.580231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373b90-50bf-4457-aeeb-e4515bb27af3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:53.580514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373b90-50bf-4457-aeeb-e4515bb27af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.637840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:53.638722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:53.639081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:53.639428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.641184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=8497f11cb2d54868ad5be5b5d60318b8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:53.642948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:53.657664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4a373b90-50bf-4457-aeeb-e4515bb27af3 None None] MFA Rules not processed for user `a239a0dd4451431aa7e3beea2d4b37aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:53.661316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a373b90-50bf-4457-aeeb-e4515bb27af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:53.736526 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2632/5242] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:53 2022] PUT /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8 => generated 521 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:53.740769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:53.769951 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2611/5243] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:53.815410 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:53.836981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62533d2-552d-47f4-8289-14b81d1f502f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:53.842915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:53.843710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:53.843996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:53.844273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:53.846173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8497f11cb2d54868ad5be5b5d60318b8, implied_role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:53.875623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:53.974969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2633/5244] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:53 2022] PUT /identity/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 521 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:53.980109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a373b90-50bf-4457-aeeb-e4515bb27af3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:54.003871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a373b90-50bf-4457-aeeb-e4515bb27af3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:54.078006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:54.079017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:54.079017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:54.079238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:54.079796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:54.080971 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:54.080971 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:54.080971 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:54.082935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:54.106016 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2612/5245] 10.222.0.59 () {58 vars in 1152 bytes} [Sun Aug 28 01:33:53 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:54.107855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:54.120956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a40d4a-5741-450d-a322-8ffc89069082 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:54.128721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:54.129387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:54.129681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:54.129993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:54.131870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8497f11cb2d54868ad5be5b5d60318b8, implied_role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:54.134536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:54.217712 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2634/5246] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:54 2022] DELETE /identity/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:54.222511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:54.234224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11f326-5737-4de1-8cf3-fd343c94771f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:54.307816 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:54.348245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:54.349114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:54.349519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:54.349802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:54.355521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=8497f11cb2d54868ad5be5b5d60318b8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:54.357308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:54.472691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2613/5247] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:54 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:54.473966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:54.498666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63844d7-ec7f-483c-b0f7-a9c714d2727f tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:54.578589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:54.579233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:54.579825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:54.580121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:54.582110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:54.583853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:54.681062 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2635/5248] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:54 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:54.691221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:54.698295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00dda3-d261-4a90-82ca-73fe3c653bde tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:54.790881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:54.790881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:54.790881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:54.791141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:54.791141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:54.793014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:54.808160 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2614/5249] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:54 2022] GET /identity/v3/roles => generated 2323 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:54.813599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:54.831570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21f6d-e83c-40dc-a119-9ec6672aab48 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:54.836240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:54.836792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:54.837203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:54.837584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:54.838307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:54.841885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:54.917908 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2636/5250] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:33:54 2022] POST /identity/v3/roles => generated 232 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:54.919388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:54.930207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17308f8-9e55-4409-89fd-3c85aea75e15 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:54.935612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:54.936397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:54.936719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:54.937139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/2047ba06765747f3a38d0f5e614f54cc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:54.938861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:update_role(role_id=2047ba06765747f3a38d0f5e614f54cc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:54.940109 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:54.940109 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:54.940109 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:54.941164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:55.134695 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2615/5251] 10.222.0.59 () {60 vars in 1243 bytes} [Sun Aug 28 01:33:54 2022] PATCH /identity/v3/roles/2047ba06765747f3a38d0f5e614f54cc => generated 238 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:55.136758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:55.161514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a8ec-3f8c-40d1-a938-64ee6285daee tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:55.172895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:55.173554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:55.173870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:55.174151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/2047ba06765747f3a38d0f5e614f54cc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:55.184904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:get_role(role_id=2047ba06765747f3a38d0f5e614f54cc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:55.186239 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:55.186239 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:55.186239 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:55.187533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:55.189523 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2637/5252] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:33:55 2022] GET /identity/v3/roles/2047ba06765747f3a38d0f5e614f54cc => generated 238 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:55.193116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:55.206358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ab77-28ac-405a-8c0b-8f06dbe1c3e2 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:55.220003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:55.220642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:55.220923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:55.221200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:55.222781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:55.225092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:55.242796 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2616/5253] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:33:55 2022] GET /identity/v3/roles => generated 2552 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:33:55.244205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:55.254652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6726f7e-2961-4b37-a84a-b8a9af036050 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:55.260759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:55.261505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:55.261879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:55.262167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/2047ba06765747f3a38d0f5e614f54cc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:55.263562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2047ba06765747f3a38d0f5e614f54cc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:55.264738 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:55.264738 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:55.264738 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:55.265617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:55.450359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 2047ba06765747f3a38d0f5e614f54cc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:55.450955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:55.453142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:55.456203 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2638/5254] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:55 2022] DELETE /identity/v3/roles/2047ba06765747f3a38d0f5e614f54cc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:55.462438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:55.465460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:55.480212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aac5f4-6267-4524-a92c-9f7bbc49d20e tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:55.576356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:55.580360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:55.580360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:55.580360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:55.581538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:55.583484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:55.718036 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2617/5255] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:55 2022] PUT /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 520 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:33:55.719258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:55.731038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0ef2-6caa-42c4-b4e3-d905fd1ed4c6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:55.794133 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:55.817975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:55.820231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:55.820644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:55.821062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:55.823513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=8497f11cb2d54868ad5be5b5d60318b8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:55.825697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:55.998349 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2639/5256] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:55 2022] PUT /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8 => generated 521 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:56.000494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:56.012222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804056ec-ad19-4fa8-9d0d-1eb29d98c5d4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:56.042793 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:56.072298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:56.073241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:56.073594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:56.074031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:56.075935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8497f11cb2d54868ad5be5b5d60318b8, implied_role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:56.077669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:56.181805 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2618/5257] 10.222.0.59 () {60 vars in 1363 bytes} [Sun Aug 28 01:33:55 2022] PUT /identity/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 521 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:33:56.185562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:56.199402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8f873-4428-4976-b576-f0bba9029922 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:56.292303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:56.293318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:56.298063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:56.298063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:56.298063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8497f11cb2d54868ad5be5b5d60318b8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:56.298677 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:56.298677 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:33:56.298677 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:33:56.300534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:56.309590 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2640/5258] 10.222.0.59 () {58 vars in 1245 bytes} [Sun Aug 28 01:33:56 2022] GET /identity/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies => generated 490 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:56.313214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:56.328422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd9f84-2642-47eb-a20e-a03fcbc78eb5 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:56.334229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:56.336008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:56.336540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:56.336900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:56.338110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=31a662b412ec4b6085391140baa97696)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:56.339719 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:56.339719 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:56.339719 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:56.341284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:56.351535 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2619/5259] 10.222.0.59 () {58 vars in 1245 bytes} [Sun Aug 28 01:33:56 2022] GET /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies => generated 660 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:33:56.355659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:56.368294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044915-be3d-4f91-97d8-d4a20a3130f1 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:56.374718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:56.375181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:56.378062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:56.378375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:56.380820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8497f11cb2d54868ad5be5b5d60318b8, implied_role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:56.383177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:56.479823 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2641/5260] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:56 2022] DELETE /identity/v3/roles/8497f11cb2d54868ad5be5b5d60318b8/implies/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:56.484155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:56.496390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c51a8-19d9-47f8-8964-1f339a19c9d7 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:56.622358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:56.623024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:56.623371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:56.623653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:56.629018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=8497f11cb2d54868ad5be5b5d60318b8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:56.632489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:56.742801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2620/5261] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:56 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/8497f11cb2d54868ad5be5b5d60318b8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:56.747210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:56.759397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6aa4a-5a27-427e-aa87-ebc55e3d9861 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:56.822076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dcc32-8bdb-45b7-a182-910b72a35c23 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:56.823899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dcc32-8bdb-45b7-a182-910b72a35c23 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:56.828485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dcc32-8bdb-45b7-a182-910b72a35c23 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:56.828485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dcc32-8bdb-45b7-a182-910b72a35c23 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:56.830084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467dcc32-8bdb-45b7-a182-910b72a35c23 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=31a662b412ec4b6085391140baa97696, implied_role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:56.831540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467dcc32-8bdb-45b7-a182-910b72a35c23 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:56.900790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2642/5262] 10.222.0.59 () {58 vars in 1347 bytes} [Sun Aug 28 01:33:56 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696/implies/2c2734dae75e41c7a7e1a29cc543efd2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:56.910445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:56.922976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6b38-32b9-4a7d-90c5-1acc0481710a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:56.923360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6b38-32b9-4a7d-90c5-1acc0481710a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:56.923712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc6b38-32b9-4a7d-90c5-1acc0481710a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:56.925753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f88f3-6790-49a5-a40c-7b96f374ffaa tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:56.945866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-43dc6b38-32b9-4a7d-90c5-1acc0481710a None None] MFA Rules not processed for user `5cc06c467eb8468dba45af3d1dcf808d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:56.947089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-43dc6b38-32b9-4a7d-90c5-1acc0481710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:57.062423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:57.063426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:57.063915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:57.064345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/35c1135c8eab4896818320efd497da84` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:57.074248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Could not find domain: 35c1135c8eab4896818320efd497da84.: keystone.exception.DomainNotFound: Could not find domain: 35c1135c8eab4896818320efd497da84. Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 35c1135c8eab4896818320efd497da84. Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:33:57.079791 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:33:57.080967 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 35c1135c8eab4896818320efd497da84. Aug 28 01:33:57.082087 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:33:57.087694 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2621/5263] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:33:56 2022] PATCH /identity/v3/domains/35c1135c8eab4896818320efd497da84 => generated 112 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:33:57.089437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:57.091287 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:57.102090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60e05-753e-4d6b-a3e5-73a27ed4a6f4 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:57.107211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:57.108465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:57.109842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:57.110224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/users/c3bedb7bbdd0469486e064ad14c54adc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:57.111516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c3bedb7bbdd0469486e064ad14c54adc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:57.113857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:57.123534 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2643/5264] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:33:57.232090 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:57.244240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bedb7bbdd0469486e064ad14c54adc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:57.270699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bedb7bbdd0469486e064ad14c54adc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:57.280907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bedb7bbdd0469486e064ad14c54adc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:57.282360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bedb7bbdd0469486e064ad14c54adc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:57.374281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bedb7bbdd0469486e064ad14c54adc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:57.386433 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2622/5265] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:57 2022] DELETE /identity/v3/users/c3bedb7bbdd0469486e064ad14c54adc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:57.390721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6b38-32b9-4a7d-90c5-1acc0481710a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:57.405061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc6b38-32b9-4a7d-90c5-1acc0481710a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:57.482623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:57.483686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:57.484287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:57.484787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:57.486452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c0d5ce4ef0dc47cba97b4709d73e5cd5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:57.489530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:57.638846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role c0d5ce4ef0dc47cba97b4709d73e5cd5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:57.639822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:57.641657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:57.651018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:57.657020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:57.657234 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2644/5266] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:57 2022] DELETE /identity/v3/roles/c0d5ce4ef0dc47cba97b4709d73e5cd5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:57.670061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603a59-0258-4fbb-bb63-5273a0d3a993 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:57.798544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:57.799334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:57.800870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:57.801659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/groups/6c9728b22825442891afd93252e9ad47` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:57.803535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6c9728b22825442891afd93252e9ad47)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:57.807154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:57.955617 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2623/5267] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:33:57 2022] DELETE /identity/v3/groups/6c9728b22825442891afd93252e9ad47 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:33:57.956824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:57.958513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:57.974017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a8ab3-e59b-45e6-bda1-6cc0de113ace tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:58.135393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:58.136068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:58.137140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:58.137430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:58.139285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d59ffeb8e46945e78f55fbebb4ac7788)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:58.141423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:58.301565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59ffeb8e46945e78f55fbebb4ac7788', 'request_id': 'req-479708c4-c07c-4731-aeaf-fc46f0925489'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.304522 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:58.309975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59ffeb8e46945e78f55fbebb4ac7788', 'request_id': 'req-479708c4-c07c-4731-aeaf-fc46f0925489'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.412116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59ffeb8e46945e78f55fbebb4ac7788', 'request_id': 'req-479708c4-c07c-4731-aeaf-fc46f0925489'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.446952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] The token cache is being invalidate because project d59ffeb8e46945e78f55fbebb4ac7788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:58.447250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.450314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.453792 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2645/5268] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:33:57 2022] DELETE /identity/v3/projects/d59ffeb8e46945e78f55fbebb4ac7788 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:58.457996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:58.460454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:58.476187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43909-29b9-462a-bd96-e2053c02cc6a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:58.545022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:58.545671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:58.546011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:58.546293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:58.547549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3969f428f4ff420899c7964d36e0d138)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:58.549143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:58.567773 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:58.578770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3969f428f4ff420899c7964d36e0d138'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.579560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3969f428f4ff420899c7964d36e0d138'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.660752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3969f428f4ff420899c7964d36e0d138'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.661387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3969f428f4ff420899c7964d36e0d138'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.663972 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2624/5269] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:33:58 2022] PATCH /identity/v3/domains/3969f428f4ff420899c7964d36e0d138 => generated 276 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:33:58.668328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:58.679902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479708c4-c07c-4731-aeaf-fc46f0925489 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:58.740942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:58.742477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:58.742477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:58.742477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/domains/3969f428f4ff420899c7964d36e0d138` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:58.754237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3969f428f4ff420899c7964d36e0d138)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:58.755852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:58.808640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3969f428f4ff420899c7964d36e0d138'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.812417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3969f428f4ff420899c7964d36e0d138'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.948840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3969f428f4ff420899c7964d36e0d138', 'request_id': 'req-8eb7a8bf-228a-4b3c-9c11-87081cd49344'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:58.962058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3969f428f4ff420899c7964d36e0d138', 'request_id': 'req-8eb7a8bf-228a-4b3c-9c11-87081cd49344'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.078615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3969f428f4ff420899c7964d36e0d138', 'request_id': 'req-8eb7a8bf-228a-4b3c-9c11-87081cd49344'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.096038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] The token cache is being invalidate because project 3969f428f4ff420899c7964d36e0d138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:59.096604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.097365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.106802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3969f428f4ff420899c7964d36e0d138', 'request_id': 'req-8eb7a8bf-228a-4b3c-9c11-87081cd49344'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.107621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3969f428f4ff420899c7964d36e0d138', 'request_id': 'req-8eb7a8bf-228a-4b3c-9c11-87081cd49344'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.110166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3969f428f4ff420899c7964d36e0d138', 'request_id': 'req-8eb7a8bf-228a-4b3c-9c11-87081cd49344'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.121307 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2646/5270] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:33:58 2022] DELETE /identity/v3/domains/3969f428f4ff420899c7964d36e0d138 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:59.123262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:59.124402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:59.139998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60afa0-73db-4447-9b4d-e8e0a5545e7a tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:59.230862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:59.231553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:59.231965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:59.232246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/8497f11cb2d54868ad5be5b5d60318b8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:59.233744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8497f11cb2d54868ad5be5b5d60318b8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:59.234859 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:33:59.234859 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:33:59.234859 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:33:59.235917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:59.392658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 8497f11cb2d54868ad5be5b5d60318b8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:59.392962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.393729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.397799 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2625/5271] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:59 2022] DELETE /identity/v3/roles/8497f11cb2d54868ad5be5b5d60318b8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:59.402839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:59.405799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:59.426612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7a8bf-228a-4b3c-9c11-87081cd49344 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:59.447827 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:59.502398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:59.503162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:59.503525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:59.503879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/2c2734dae75e41c7a7e1a29cc543efd2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:59.506540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2c2734dae75e41c7a7e1a29cc543efd2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:59.508478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:59.627741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 2c2734dae75e41c7a7e1a29cc543efd2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:59.628041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.628981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.636051 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2647/5272] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:59 2022] DELETE /identity/v3/roles/2c2734dae75e41c7a7e1a29cc543efd2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:59.640228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:59.643031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:59.659259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1b788-d27d-4ba9-9cb5-e6e0ccca1147 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:59.739869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500b15b0627e4cfdb22be593ac90c646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d2e666760f42c6b2872dafe6f0591d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:59.740506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:59.740789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:59.741672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] PATH_INFO: `/v3/roles/31a662b412ec4b6085391140baa97696` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:59.743162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorizing `identity:delete_role(role_id=31a662b412ec4b6085391140baa97696)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:59.744818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:59.889040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invalidating the token cache because role 31a662b412ec4b6085391140baa97696 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:33:59.889354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.890563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e6ba12fe-d738-4557-b839-47ec3a9eeca6 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:33:59.892541 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2626/5273] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:59 2022] DELETE /identity/v3/roles/31a662b412ec4b6085391140baa97696 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:33:59.896456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:59.899359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:00.021412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616fa63-1741-47e7-a797-2a8a89b30814 tempest-RolesV3TestJSON-1185718526 tempest-RolesV3TestJSON-1185718526-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:00.120786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:00.121772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:00.122353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:00.122831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] PATH_INFO: `/v3/users/03f3076433054dc6b0bc6e558694964d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:00.124590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f3076433054dc6b0bc6e558694964d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:00.136359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:00.400200 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:00.450131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f3076433054dc6b0bc6e558694964d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:00.451693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f3076433054dc6b0bc6e558694964d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:00.540822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f3076433054dc6b0bc6e558694964d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:00.550504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f3076433054dc6b0bc6e558694964d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:00.551683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f3076433054dc6b0bc6e558694964d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:00.595331 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2648/5274] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:33:59 2022] DELETE /identity/v3/users/03f3076433054dc6b0bc6e558694964d => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:00.597076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:00.597608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:00.598028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:00.629184 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:00.637048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:00.638861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:00.735565 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2627/5275] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:00.758355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:00.760972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:00.887910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b524c8-009d-4b57-a5ea-41d263f2195f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:00.894539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:00.895176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:00.895464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:00.895745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:00.921085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:00.921085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:00.932267 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2649/5276] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:02.388343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:02.389851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:02.411282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ff338-298b-422c-83ab-5ce96cf70e89 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:02.430769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:02.431570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:02.431852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:02.432131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] PATH_INFO: `/v3/projects/9f0297eaa02c477a9c4e93a95a6d14aa` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:02.433526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0297eaa02c477a9c4e93a95a6d14aa)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:02.439415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:02.592484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0297eaa02c477a9c4e93a95a6d14aa', 'request_id': 'req-c469a5d9-6029-4951-ba8d-857be1b53e1b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:02.599295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0297eaa02c477a9c4e93a95a6d14aa', 'request_id': 'req-c469a5d9-6029-4951-ba8d-857be1b53e1b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:02.705625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0297eaa02c477a9c4e93a95a6d14aa', 'request_id': 'req-c469a5d9-6029-4951-ba8d-857be1b53e1b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:02.720825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] The token cache is being invalidate because project 9f0297eaa02c477a9c4e93a95a6d14aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:02.722274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:02.723126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:02.726835 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2628/5277] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:02 2022] DELETE /identity/v3/projects/9f0297eaa02c477a9c4e93a95a6d14aa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:02.730817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:02.749838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d54725-b27a-4c26-b6e3-521c20b9e69c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:02.871445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:02.872093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:02.872378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:02.872654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] PATH_INFO: `/v3/users/500b15b0627e4cfdb22be593ac90c646` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:02.873792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500b15b0627e4cfdb22be593ac90c646)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:02.875977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:03.117801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500b15b0627e4cfdb22be593ac90c646'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:03.118809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500b15b0627e4cfdb22be593ac90c646'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:03.223198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500b15b0627e4cfdb22be593ac90c646'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:03.225183 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:03.236370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500b15b0627e4cfdb22be593ac90c646'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:03.237428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-00fa7ac4-d5da-44f5-a5d1-ba1da9640bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500b15b0627e4cfdb22be593ac90c646'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:03.263783 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2650/5278] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:02 2022] DELETE /identity/v3/users/500b15b0627e4cfdb22be593ac90c646 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:04.126651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:04.130872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:04.161935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a5d9-6029-4951-ba8d-857be1b53e1b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:04.239350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:04.239997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:04.240428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:04.240701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] PATH_INFO: `/v3/projects/60d2e666760f42c6b2872dafe6f0591d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:04.242523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d2e666760f42c6b2872dafe6f0591d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:04.244469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:04.359654 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:04.373988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d2e666760f42c6b2872dafe6f0591d', 'request_id': 'req-3363b80f-8002-471e-adf2-0ee3dbef56d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:04.381173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d2e666760f42c6b2872dafe6f0591d', 'request_id': 'req-3363b80f-8002-471e-adf2-0ee3dbef56d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:04.445393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d2e666760f42c6b2872dafe6f0591d', 'request_id': 'req-3363b80f-8002-471e-adf2-0ee3dbef56d6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:04.457642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] The token cache is being invalidate because project 60d2e666760f42c6b2872dafe6f0591d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:04.458114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:04.458962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3363b80f-8002-471e-adf2-0ee3dbef56d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:04.461354 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2629/5279] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:04 2022] DELETE /identity/v3/projects/60d2e666760f42c6b2872dafe6f0591d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:04.468183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5ea9e-1ca2-441e-b831-73d3ea0f7738 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:04.469171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5ea9e-1ca2-441e-b831-73d3ea0f7738 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:04.469662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5ea9e-1ca2-441e-b831-73d3ea0f7738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:04.496514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-83d5ea9e-1ca2-441e-b831-73d3ea0f7738 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:04.497944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83d5ea9e-1ca2-441e-b831-73d3ea0f7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:04.579909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2651/5280] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:04.581601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3a38-8f44-4042-ac7b-3c49f16a50f3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:04.581925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3a38-8f44-4042-ac7b-3c49f16a50f3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:04.582206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3a38-8f44-4042-ac7b-3c49f16a50f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:04.611477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-14df3a38-8f44-4042-ac7b-3c49f16a50f3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:04.615620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-14df3a38-8f44-4042-ac7b-3c49f16a50f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:04.626061 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2630/5281] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:04.630270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5ea9e-1ca2-441e-b831-73d3ea0f7738 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:04.644023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5ea9e-1ca2-441e-b831-73d3ea0f7738 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:04.652070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:04.652989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:04.653655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:04.654146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:04.655007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:34:04.655633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:04.658379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:04.677599 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2652/5282] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:34:04.682525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df3a38-8f44-4042-ac7b-3c49f16a50f3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:04.697202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df3a38-8f44-4042-ac7b-3c49f16a50f3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:04.713116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:04.713985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:04.714159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:04.714709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:04.715436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:04.729957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:04.841360 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2631/5283] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:04 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:04.845065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:04.860015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c0093-34fa-4b0e-8292-acc23d54ce9c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:04.929849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:04.932063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:04.952687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:04.953607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:04.954077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:04.954631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:04.955436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:04.958299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:05.011833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbc60-a30c-423d-a9c8-98d41a400954 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:05.019856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:05.020391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.020932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.021226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] PATH_INFO: `/v3/users/6a04391740ee4398bcced22404a02eed` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.023506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a04391740ee4398bcced22404a02eed)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:05.026772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:05.264859 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2653/5284] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:04 2022] POST /identity/v3/users => generated 288 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:05.271279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:05.282469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3838-b2bc-40f8-abdb-636ea336ddff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:05.290676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:05.290676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.290676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.290676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.291128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:05.291491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:05.304513 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2654/5285] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:05.308627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:05.341346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010673ad-33a5-488b-9b24-3caf2b29053b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:05.348112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12686276-4118-459e-96d5-667f62df405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:05.348887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12686276-4118-459e-96d5-667f62df405e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.349169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12686276-4118-459e-96d5-667f62df405e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.349551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12686276-4118-459e-96d5-667f62df405e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.358195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12686276-4118-459e-96d5-667f62df405e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:05.365517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12686276-4118-459e-96d5-667f62df405e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:05.394643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a04391740ee4398bcced22404a02eed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:05.407290 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2655/5286] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:34:05.409340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12686276-4118-459e-96d5-667f62df405e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:05.415584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a04391740ee4398bcced22404a02eed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:05.423258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12686276-4118-459e-96d5-667f62df405e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:05.425640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a04391740ee4398bcced22404a02eed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:05.429472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a04391740ee4398bcced22404a02eed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:05.430084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deef9c0-e1e3-4513-8eef-67ebe6ee50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:05.430755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deef9c0-e1e3-4513-8eef-67ebe6ee50c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.431023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deef9c0-e1e3-4513-8eef-67ebe6ee50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.431545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deef9c0-e1e3-4513-8eef-67ebe6ee50c1 admin admin] PATH_INFO: `/v3/projects/20f6700dc5104d87a52d1caec4ccdfc4/users/cc4b8e376d514d8cb96ccde128286bdb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.447385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deef9c0-e1e3-4513-8eef-67ebe6ee50c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f6700dc5104d87a52d1caec4ccdfc4, user_id=cc4b8e376d514d8cb96ccde128286bdb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:05.451299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deef9c0-e1e3-4513-8eef-67ebe6ee50c1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:05.500201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75ce2e42-f5e3-4a1e-b32e-209abcf9b596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a04391740ee4398bcced22404a02eed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:05.511433 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2632/5287] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:04 2022] DELETE /identity/v3/users/6a04391740ee4398bcced22404a02eed => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:05.516562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.517142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.517670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.539102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:05.540399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:05.548993 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2656/5288] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:05 2022] PUT /identity/v3/projects/20f6700dc5104d87a52d1caec4ccdfc4/users/cc4b8e376d514d8cb96ccde128286bdb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:05.557329 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:05.560402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cddec-c799-4b88-881d-0ab780654618 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.560976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cddec-c799-4b88-881d-0ab780654618 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.561321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cddec-c799-4b88-881d-0ab780654618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.574128 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:05.615011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-530cddec-c799-4b88-881d-0ab780654618 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:05.616383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-530cddec-c799-4b88-881d-0ab780654618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:05.634233 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2633/5289] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:05.645292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:05.647059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:05.730348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7117-a727-4172-ae7b-9156906dca3a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:05.736241 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2657/5290] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:05.738068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:05.739376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.739717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.740214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.741403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cddec-c799-4b88-881d-0ab780654618 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:05.750810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cddec-c799-4b88-881d-0ab780654618 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:05.751006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:05.752336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:05.755871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e02de6-4857-4323-8331-f0134ee0541b tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:05.757322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02de6-4857-4323-8331-f0134ee0541b tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:05.757529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02de6-4857-4323-8331-f0134ee0541b tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:05.757851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02de6-4857-4323-8331-f0134ee0541b tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:05.765459 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2634/5291] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:34:05.913953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-12e02de6-4857-4323-8331-f0134ee0541b tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:05.983025 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2658/5292] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:05 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:06.284205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:06.287356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:06.304633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3585-6acf-45e2-98c8-b7f0c0d250e3 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:06.333742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:06.333742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:06.333742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:06.333742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] PATH_INFO: `/v3/projects/f35c89df33cb486b80245d5a39e65f90` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:06.334147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35c89df33cb486b80245d5a39e65f90)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:06.334147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:06.489265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35c89df33cb486b80245d5a39e65f90', 'request_id': 'req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:06.497083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35c89df33cb486b80245d5a39e65f90', 'request_id': 'req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:06.570867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35c89df33cb486b80245d5a39e65f90', 'request_id': 'req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:06.586071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] The token cache is being invalidate because project f35c89df33cb486b80245d5a39e65f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:06.586727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:06.587570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3073ef64-e1bd-4c0d-93f4-5ddc1460bfce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:06.589519 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2635/5293] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:06 2022] DELETE /identity/v3/projects/f35c89df33cb486b80245d5a39e65f90 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:06.597199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdcbb1-1b7b-4faf-8545-3dd6d3f57c70 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:06.602499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdcbb1-1b7b-4faf-8545-3dd6d3f57c70 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:06.602499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdcbb1-1b7b-4faf-8545-3dd6d3f57c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:06.620714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-86bdcbb1-1b7b-4faf-8545-3dd6d3f57c70 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:06.621977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-86bdcbb1-1b7b-4faf-8545-3dd6d3f57c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:06.691020 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2659/5294] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:06.699755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d842d8-6a8b-47e0-9f40-af2f0dd02783 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:06.700092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d842d8-6a8b-47e0-9f40-af2f0dd02783 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:06.700395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d842d8-6a8b-47e0-9f40-af2f0dd02783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:06.721988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-22d842d8-6a8b-47e0-9f40-af2f0dd02783 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:06.723237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-22d842d8-6a8b-47e0-9f40-af2f0dd02783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:06.732430 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2636/5295] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:06.737130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdcbb1-1b7b-4faf-8545-3dd6d3f57c70 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:06.748135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdcbb1-1b7b-4faf-8545-3dd6d3f57c70 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:06.752946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:06.753594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:06.753909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:06.754193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:06.754851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:34:06.755155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:06.756833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:06.770136 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2660/5296] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:34:06.775150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d842d8-6a8b-47e0-9f40-af2f0dd02783 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:06.784620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d842d8-6a8b-47e0-9f40-af2f0dd02783 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:06.790408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a07cc-5c74-49a2-b6e0-3da671fa8625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:06.791005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a07cc-5c74-49a2-b6e0-3da671fa8625 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:06.791282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a07cc-5c74-49a2-b6e0-3da671fa8625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:06.791557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a07cc-5c74-49a2-b6e0-3da671fa8625 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:06.792206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a07cc-5c74-49a2-b6e0-3da671fa8625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:06.794158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a07cc-5c74-49a2-b6e0-3da671fa8625 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:06.882699 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2637/5297] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:06 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:34:06.885607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:06.895754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006f164-b624-4abf-81ca-755d9727d613 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:06.944770 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:06.957420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:06.962930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:06.962930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:06.962930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:06.962930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:06.962930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:06.989459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dafbc9-2a17-4e0c-86a9-8ba0072dc522 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:06.989751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dafbc9-2a17-4e0c-86a9-8ba0072dc522 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:06.990175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dafbc9-2a17-4e0c-86a9-8ba0072dc522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.009041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-35dafbc9-2a17-4e0c-86a9-8ba0072dc522 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:07.010276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-35dafbc9-2a17-4e0c-86a9-8ba0072dc522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:07.014808 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2638/5298] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:06 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 01:34:07.019502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9b18-21ec-41d9-ab4a-4a1cd92b32ce None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.019502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9b18-21ec-41d9-ab4a-4a1cd92b32ce None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.019502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9b18-21ec-41d9-ab4a-4a1cd92b32ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.028006 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:07.041041 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2661/5299] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:06 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:07.045164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:07.048611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-650f9b18-21ec-41d9-ab4a-4a1cd92b32ce None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:07.049945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-650f9b18-21ec-41d9-ab4a-4a1cd92b32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:07.056282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de2d55-de2f-469d-b3c3-4ab25b147574 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:07.061213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:07.061849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.062129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.062410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.063240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:07.065286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:07.078900 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2662/5300] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:34:07.082896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:07.100834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9dc30-f08a-4376-b3dc-6e2b62767ced admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:07.107567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:07.109076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.112351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.112351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.112351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:07.114435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:07.139013 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2663/5301] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:07.139013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:07.139309 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2639/5302] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:07.143815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9b18-21ec-41d9-ab4a-4a1cd92b32ce None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:07.149127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abdc2c-c70f-4cac-8b51-87ad34be2a29 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:07.154750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9b18-21ec-41d9-ab4a-4a1cd92b32ce None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:07.154913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b97cd-60c0-4506-8f50-452ca5aad90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:07.157140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b97cd-60c0-4506-8f50-452ca5aad90d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.157545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b97cd-60c0-4506-8f50-452ca5aad90d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.157925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b97cd-60c0-4506-8f50-452ca5aad90d admin admin] PATH_INFO: `/v3/projects/f63605b9d41f4a0c8b416d0155201c03/users/6f1befb6a1cc4bbcab7afe9d69483891/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.159495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861ae83-1757-433d-83b1-dbfb3f77e674 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:07.160414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861ae83-1757-433d-83b1-dbfb3f77e674 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.161502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861ae83-1757-433d-83b1-dbfb3f77e674 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.161502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861ae83-1757-433d-83b1-dbfb3f77e674 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.178532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b97cd-60c0-4506-8f50-452ca5aad90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63605b9d41f4a0c8b416d0155201c03, user_id=6f1befb6a1cc4bbcab7afe9d69483891, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:07.183878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b97cd-60c0-4506-8f50-452ca5aad90d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2861ae83-1757-433d-83b1-dbfb3f77e674 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:34:07.216890 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 01:34:07.219468 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:34:07.227091 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2640/5303] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:07 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 188 bytes in 81 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:34:07.227447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861ae83-1757-433d-83b1-dbfb3f77e674 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:07.243229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861ae83-1757-433d-83b1-dbfb3f77e674 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:07.248031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84979a-448f-4b91-bef2-5563f328d39d tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:07.248687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84979a-448f-4b91-bef2-5563f328d39d tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.248974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84979a-448f-4b91-bef2-5563f328d39d tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.249252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84979a-448f-4b91-bef2-5563f328d39d tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.275499 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2664/5304] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:07 2022] PUT /identity/v3/projects/f63605b9d41f4a0c8b416d0155201c03/users/6f1befb6a1cc4bbcab7afe9d69483891/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:07.278550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.278550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.278855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.300255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:07.301785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-2d84979a-448f-4b91-bef2-5563f328d39d tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:34:07.311739 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 01:34:07.312758 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:34:07.313757 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2641/5305] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:07 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 188 bytes in 86 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 01:34:07.316880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84979a-448f-4b91-bef2-5563f328d39d tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:07.326220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84979a-448f-4b91-bef2-5563f328d39d tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:07.371276 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2665/5306] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:07.381702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:07.383432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:07.385160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f24c30-49dd-4cf3-a77c-89b22278ae56 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:07.385752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f24c30-49dd-4cf3-a77c-89b22278ae56 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.386046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f24c30-49dd-4cf3-a77c-89b22278ae56 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.389949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f24c30-49dd-4cf3-a77c-89b22278ae56 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.458450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace57ea-8ce7-498c-917f-3ffabceac5a8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:07.463489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8bced-e099-44ed-aa84-985982bdc1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:07.464151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8bced-e099-44ed-aa84-985982bdc1ea service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:07.464435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8bced-e099-44ed-aa84-985982bdc1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:07.464709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8bced-e099-44ed-aa84-985982bdc1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:07.474204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8bced-e099-44ed-aa84-985982bdc1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:07.476474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8bced-e099-44ed-aa84-985982bdc1ea service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:07.486454 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2666/5307] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:07.498697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c8f24c30-49dd-4cf3-a77c-89b22278ae56 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:07.576591 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2642/5308] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:07 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:08.583436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687fc86-2456-4652-ad22-74b3c8b03dd2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:08.584050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687fc86-2456-4652-ad22-74b3c8b03dd2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:08.584271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687fc86-2456-4652-ad22-74b3c8b03dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:08.610324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a687fc86-2456-4652-ad22-74b3c8b03dd2 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:08.610324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a687fc86-2456-4652-ad22-74b3c8b03dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:08.613958 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2667/5309] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:08 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:08.615643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd419-976e-4800-84f8-46bf6b91d68a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:08.616681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd419-976e-4800-84f8-46bf6b91d68a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:08.616798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd419-976e-4800-84f8-46bf6b91d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:08.637860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4d8bd419-976e-4800-84f8-46bf6b91d68a None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:08.639069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d8bd419-976e-4800-84f8-46bf6b91d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:08.646525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2643/5310] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:08.650995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687fc86-2456-4652-ad22-74b3c8b03dd2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:08.665003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687fc86-2456-4652-ad22-74b3c8b03dd2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:08.670493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d1011-42af-4541-ba0d-ae5617da36ab tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:08.671370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1011-42af-4541-ba0d-ae5617da36ab tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:08.671855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1011-42af-4541-ba0d-ae5617da36ab tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:08.672290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1011-42af-4541-ba0d-ae5617da36ab tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:08.775561 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:08.781438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1f8d1011-42af-4541-ba0d-ae5617da36ab tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:08.863121 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2668/5311] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:08 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:09.868943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c848-c28e-473e-a845-f8a51536fe84 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:09.869517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c848-c28e-473e-a845-f8a51536fe84 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:09.869517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c848-c28e-473e-a845-f8a51536fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:09.906814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1594c848-c28e-473e-a845-f8a51536fe84 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:09.912141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1594c848-c28e-473e-a845-f8a51536fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:09.916506 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2644/5312] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:09 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:09.919456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d98a3-e3cb-446c-a9be-2aa60cbfc158 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:09.919933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d98a3-e3cb-446c-a9be-2aa60cbfc158 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:09.920042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d98a3-e3cb-446c-a9be-2aa60cbfc158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:09.955303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-805d98a3-e3cb-446c-a9be-2aa60cbfc158 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:09.956515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-805d98a3-e3cb-446c-a9be-2aa60cbfc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:09.978642 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2669/5313] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:09.982971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c848-c28e-473e-a845-f8a51536fe84 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:10.000914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c848-c28e-473e-a845-f8a51536fe84 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:10.011793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc72d56-7a50-47c3-bf84-4f9a490d0e24 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:10.012546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc72d56-7a50-47c3-bf84-4f9a490d0e24 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:10.012835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc72d56-7a50-47c3-bf84-4f9a490d0e24 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:10.013104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc72d56-7a50-47c3-bf84-4f9a490d0e24 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:10.217973 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:10.221887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7fc72d56-7a50-47c3-bf84-4f9a490d0e24 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:10.341171 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2645/5314] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:09 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:11.346680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c181-dffd-4284-8cd5-c6f756edf86f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:11.347548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c181-dffd-4284-8cd5-c6f756edf86f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:11.347993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c181-dffd-4284-8cd5-c6f756edf86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:11.386333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6bb3c181-dffd-4284-8cd5-c6f756edf86f None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:11.387824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6bb3c181-dffd-4284-8cd5-c6f756edf86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:11.396895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2670/5315] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:11 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:11.410214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60907-6664-4ea3-959b-bed61bb853df None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:11.410214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60907-6664-4ea3-959b-bed61bb853df None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:11.410214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b60907-6664-4ea3-959b-bed61bb853df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:11.442266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e6b60907-6664-4ea3-959b-bed61bb853df None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:11.446387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6b60907-6664-4ea3-959b-bed61bb853df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:11.471450 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2646/5316] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:11.475607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c181-dffd-4284-8cd5-c6f756edf86f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:11.494493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c181-dffd-4284-8cd5-c6f756edf86f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:11.499066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90d89-d9a6-4fba-b009-c445d5831cc6 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:11.502602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90d89-d9a6-4fba-b009-c445d5831cc6 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:11.502602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90d89-d9a6-4fba-b009-c445d5831cc6 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:11.502602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90d89-d9a6-4fba-b009-c445d5831cc6 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:11.735980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2ed90d89-d9a6-4fba-b009-c445d5831cc6 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:11.932402 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2671/5317] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:11 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:12.943904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32476bd-81f7-4f9f-8817-18111aeb9d75 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:12.944623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32476bd-81f7-4f9f-8817-18111aeb9d75 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:12.944623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32476bd-81f7-4f9f-8817-18111aeb9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:12.965012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a32476bd-81f7-4f9f-8817-18111aeb9d75 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:12.966732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a32476bd-81f7-4f9f-8817-18111aeb9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:12.971256 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2647/5318] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:12 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:13.977584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffc3a-d9ee-4781-a195-cc3482b685df None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:13.979739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffc3a-d9ee-4781-a195-cc3482b685df None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:13.979739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffc3a-d9ee-4781-a195-cc3482b685df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:14.019682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-611ffc3a-d9ee-4781-a195-cc3482b685df None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:14.024590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-611ffc3a-d9ee-4781-a195-cc3482b685df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:14.042160 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2672/5319] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:14.050741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abf184-897c-430f-a2e0-4d3d916dad82 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:14.050741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abf184-897c-430f-a2e0-4d3d916dad82 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:14.050741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abf184-897c-430f-a2e0-4d3d916dad82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:14.072037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-60abf184-897c-430f-a2e0-4d3d916dad82 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:14.073550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-60abf184-897c-430f-a2e0-4d3d916dad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:14.078738 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2648/5320] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:14 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:14.087563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f865-0413-4edf-af2f-84146c878ca1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:14.089112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f865-0413-4edf-af2f-84146c878ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:14.089932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f865-0413-4edf-af2f-84146c878ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:14.263352 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.server.flask.application [None req-2414f865-0413-4edf-af2f-84146c878ca1 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.59: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 01:34:14.265419 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2673/5321] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 179 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 01:34:14.269395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ed33-d538-47c2-bc01-a459df2030c9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:14.269671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ed33-d538-47c2-bc01-a459df2030c9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:14.270038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57ed33-d538-47c2-bc01-a459df2030c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:14.424540 n-d-master-1 devstack@keystone.service[82006]: WARNING keystone.server.flask.application [None req-7b57ed33-d538-47c2-bc01-a459df2030c9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.59: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 01:34:14.432381 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2649/5322] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 164 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 01:34:14.439850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841cef9-4511-4ebf-af45-3ed0611f9ca8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:14.440584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841cef9-4511-4ebf-af45-3ed0611f9ca8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:14.441242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841cef9-4511-4ebf-af45-3ed0611f9ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:14.492019 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.server.flask.application [None req-f841cef9-4511-4ebf-af45-3ed0611f9ca8 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.59: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 01:34:14.498251 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2674/5323] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 60 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 01:34:14.998096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b590-b7b6-469a-b7ea-5c0662852e17 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:14.998096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b590-b7b6-469a-b7ea-5c0662852e17 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:14.998096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b590-b7b6-469a-b7ea-5c0662852e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:15.046566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-70d5b590-b7b6-469a-b7ea-5c0662852e17 None None] MFA Rules not processed for user `6f1befb6a1cc4bbcab7afe9d69483891`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:15.047695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-70d5b590-b7b6-469a-b7ea-5c0662852e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:15.177096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2650/5324] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:15.186730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841cef9-4511-4ebf-af45-3ed0611f9ca8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:15.206449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841cef9-4511-4ebf-af45-3ed0611f9ca8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:15.218732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:15.220701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:15.221190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:15.221638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:15.222326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:15.225258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:15.360769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2675/5325] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:15 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:15.364055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5b590-b7b6-469a-b7ea-5c0662852e17 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:15.376063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5b590-b7b6-469a-b7ea-5c0662852e17 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:15.440956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:15.441488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:15.441767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:15.442141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:15.442789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:15.444756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:15.585630 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2651/5326] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:15 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:34:15.586925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:15.598820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3803ca-727e-4079-aa31-144f8a627183 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:15.604857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:15.605634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:15.606052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:15.606520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:15.607332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:15.609140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:15.621895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2676/5327] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:15.632481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:15.638664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7e0c-7268-4f8d-a2b8-91daa79d578f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:15.648820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:15.649838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:15.651415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:15.651706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] PATH_INFO: `/v3/projects/d157e736cd92438badcb63a18bab291c/users/5dbbc757b66c42ee84761cbc610e8f49/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:15.683245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d157e736cd92438badcb63a18bab291c, user_id=5dbbc757b66c42ee84761cbc610e8f49, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:15.686047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:15.844687 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2652/5328] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:15 2022] PUT /identity/v3/projects/d157e736cd92438badcb63a18bab291c/users/5dbbc757b66c42ee84761cbc610e8f49/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:15.846260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:15.861152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d9ee4-9472-4b36-b9fd-53cac7cd5b3d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:15.945009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d090-de45-4319-864d-49cc5e943ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:15.945988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d090-de45-4319-864d-49cc5e943ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:15.946285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d090-de45-4319-864d-49cc5e943ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:15.946565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d090-de45-4319-864d-49cc5e943ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:15.947215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d090-de45-4319-864d-49cc5e943ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:15.948826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d090-de45-4319-864d-49cc5e943ff6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:15.959457 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2677/5329] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:15.964447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:15.975851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177a53-cdb0-4b74-b6f8-03c8eca3e272 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:15.981644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82754fbf-6424-4bdc-9576-09968f5cb9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:15.982590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82754fbf-6424-4bdc-9576-09968f5cb9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:15.982957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82754fbf-6424-4bdc-9576-09968f5cb9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:15.983142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82754fbf-6424-4bdc-9576-09968f5cb9c4 admin admin] PATH_INFO: `/v3/projects/d157e736cd92438badcb63a18bab291c/users/5dbbc757b66c42ee84761cbc610e8f49/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:15.985259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82754fbf-6424-4bdc-9576-09968f5cb9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d157e736cd92438badcb63a18bab291c, user_id=5dbbc757b66c42ee84761cbc610e8f49, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:15.988194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82754fbf-6424-4bdc-9576-09968f5cb9c4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:15.993004 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:16.006368 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2653/5330] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:15 2022] PUT /identity/v3/projects/d157e736cd92438badcb63a18bab291c/users/5dbbc757b66c42ee84761cbc610e8f49/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:17.747291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:17.748202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:17.748481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:17.771109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] MFA Rules not processed for user `a239a0dd4451431aa7e3beea2d4b37aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:17.773632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:17.804817 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=3,keystone:UPDATE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:17.842399 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2678/5331] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:23.679954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:23.680840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:23.681208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:23.718652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:23.719896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:23.902578 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2654/5332] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:23.937697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:23.940611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:24.144303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87083f0c-6330-4050-a307-af2cff0d022b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:24.177631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7858e73-2db4-4c6a-8d89-8e6585ef781e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:24.179121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7858e73-2db4-4c6a-8d89-8e6585ef781e service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:24.179996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7858e73-2db4-4c6a-8d89-8e6585ef781e service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:24.180488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7858e73-2db4-4c6a-8d89-8e6585ef781e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:24.193748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7858e73-2db4-4c6a-8d89-8e6585ef781e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:24.200227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7858e73-2db4-4c6a-8d89-8e6585ef781e service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:24.209089 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2679/5333] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:34:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:34:24.896752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:24.898973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:25.075686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d6a8d-bb22-4c44-930a-ddf4df90be2d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:25.089310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:25.089991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:25.090267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:25.090724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:25.096309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:25.249720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:25.251574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:25.277209 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2655/5334] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:25.517096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774d7f-6cf8-4a0b-9295-bf6b3fb6beb8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:25.517096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774d7f-6cf8-4a0b-9295-bf6b3fb6beb8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:25.518085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774d7f-6cf8-4a0b-9295-bf6b3fb6beb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:25.704292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-29774d7f-6cf8-4a0b-9295-bf6b3fb6beb8 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:25.705416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-29774d7f-6cf8-4a0b-9295-bf6b3fb6beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:25.714380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2680/5335] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:25 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:25.721485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:25.935924 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:26.001712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8b92-cbe7-4054-9a57-a4e2045798fe service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:26.009503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:26.010525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:26.011039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:26.011518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:26.039930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52faa24-98c9-4a9d-b4d2-5573e926c508 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:26.040368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52faa24-98c9-4a9d-b4d2-5573e926c508 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:26.040750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52faa24-98c9-4a9d-b4d2-5573e926c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:26.099217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f52faa24-98c9-4a9d-b4d2-5573e926c508 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:26.110174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f52faa24-98c9-4a9d-b4d2-5573e926c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:26.138819 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2681/5336] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:26.157213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52faa24-98c9-4a9d-b4d2-5573e926c508 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:26.178990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52faa24-98c9-4a9d-b4d2-5573e926c508 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:26.186248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7279e-2507-4a8d-b710-2d1b79244ceb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:26.187277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7279e-2507-4a8d-b710-2d1b79244ceb service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:26.187730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7279e-2507-4a8d-b710-2d1b79244ceb service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:26.188578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7279e-2507-4a8d-b710-2d1b79244ceb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:26.199554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7279e-2507-4a8d-b710-2d1b79244ceb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:26.201701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7279e-2507-4a8d-b710-2d1b79244ceb service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:26.221327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:26.256170 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2682/5337] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:34:26.336007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fddb0-e959-4da6-ad40-71e380790e32 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:26.337586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fddb0-e959-4da6-ad40-71e380790e32 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:26.338969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fddb0-e959-4da6-ad40-71e380790e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:26.339173 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2656/5338] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:25 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:26.398919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9a1fddb0-e959-4da6-ad40-71e380790e32 None None] MFA Rules not processed for user `5dbbc757b66c42ee84761cbc610e8f49`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:26.402991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9a1fddb0-e959-4da6-ad40-71e380790e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:26.514863 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2683/5339] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:26.529164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:26.531467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:26.656091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b0df9-b34c-4757-bb5d-712b9cc9ab7c tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:26.660322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b698116-ca70-449d-bc3b-7976714da34e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:26.661207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698116-ca70-449d-bc3b-7976714da34e service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:26.661675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698116-ca70-449d-bc3b-7976714da34e service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:26.662220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698116-ca70-449d-bc3b-7976714da34e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:26.782099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b698116-ca70-449d-bc3b-7976714da34e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:26.784222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b698116-ca70-449d-bc3b-7976714da34e service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:26.797841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2657/5340] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:27.334728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33055-5777-4e5a-9071-0508a9e600b6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:27.335517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33055-5777-4e5a-9071-0508a9e600b6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:27.335517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33055-5777-4e5a-9071-0508a9e600b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:27.344735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2f8eb-c7a4-4375-84d9-54d618c2b90a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:27.345248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2f8eb-c7a4-4375-84d9-54d618c2b90a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:27.345933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2f8eb-c7a4-4375-84d9-54d618c2b90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:27.380497 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:27.384606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-91e2f8eb-c7a4-4375-84d9-54d618c2b90a None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:27.388073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-91e2f8eb-c7a4-4375-84d9-54d618c2b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:27.391757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e5b33055-5777-4e5a-9071-0508a9e600b6 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:27.393437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e5b33055-5777-4e5a-9071-0508a9e600b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:27.393712 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2658/5341] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:27 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:27.395400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f909a7-a5a4-4474-9b63-62c2b7a80d06 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:27.395695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f909a7-a5a4-4474-9b63-62c2b7a80d06 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:27.395969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f909a7-a5a4-4474-9b63-62c2b7a80d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:27.403666 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2684/5342] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:27.416652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33055-5777-4e5a-9071-0508a9e600b6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-69f909a7-a5a4-4474-9b63-62c2b7a80d06 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 28 01:34:27.451262 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:34:27.452822 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 01:34:27.454203 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:34:27.456715 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2659/5343] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:27 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 01:34:27.462751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29645-d9f2-4ae9-ad63-6fbad06ecf11 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:27.463255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29645-d9f2-4ae9-ad63-6fbad06ecf11 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:27.463896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29645-d9f2-4ae9-ad63-6fbad06ecf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:27.474693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33055-5777-4e5a-9071-0508a9e600b6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:27.488627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf65ae-4e41-435f-aa7f-4df7e6feda2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:27.491021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf65ae-4e41-435f-aa7f-4df7e6feda2f service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:27.491226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf65ae-4e41-435f-aa7f-4df7e6feda2f service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:27.491501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf65ae-4e41-435f-aa7f-4df7e6feda2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:27.514563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf65ae-4e41-435f-aa7f-4df7e6feda2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:27.516249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf65ae-4e41-435f-aa7f-4df7e6feda2f service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:27.526914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2685/5344] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:34:27.686264 n-d-master-1 devstack@keystone.service[82006]: WARNING keystone.server.flask.application [None req-80c29645-d9f2-4ae9-ad63-6fbad06ecf11 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.59: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 01:34:27.686264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2660/5345] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:27 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 224 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 28 01:34:27.687341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487adbe5-ea75-4c17-a37c-a7410ac4a38b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:27.687633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487adbe5-ea75-4c17-a37c-a7410ac4a38b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:27.687907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487adbe5-ea75-4c17-a37c-a7410ac4a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:27.854968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-487adbe5-ea75-4c17-a37c-a7410ac4a38b None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:27.859841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-487adbe5-ea75-4c17-a37c-a7410ac4a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:27.877994 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2686/5346] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:27.879719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c29645-d9f2-4ae9-ad63-6fbad06ecf11 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:27.903385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c29645-d9f2-4ae9-ad63-6fbad06ecf11 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:27.908415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f4c18-45ae-4fdd-b532-e4a6bc3f2705 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:27.909433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f4c18-45ae-4fdd-b532-e4a6bc3f2705 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:27.910148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f4c18-45ae-4fdd-b532-e4a6bc3f2705 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:27.910667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f4c18-45ae-4fdd-b532-e4a6bc3f2705 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:28.082707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b45f4c18-45ae-4fdd-b532-e4a6bc3f2705 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:28.180087 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2661/5347] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:27 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:28.518047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e03e6-54a8-40ec-996d-d6be4091bb8c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:28.518520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e03e6-54a8-40ec-996d-d6be4091bb8c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:28.518601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e03e6-54a8-40ec-996d-d6be4091bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:28.555411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cc1e03e6-54a8-40ec-996d-d6be4091bb8c None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:28.557276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cc1e03e6-54a8-40ec-996d-d6be4091bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:28.568478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2687/5348] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:28.584200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f4c18-45ae-4fdd-b532-e4a6bc3f2705 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:28.603913 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:28.609095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f4c18-45ae-4fdd-b532-e4a6bc3f2705 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:28.646332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fe086-ba8a-4fd0-88e9-a57ac7c5f9a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:28.648864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fe086-ba8a-4fd0-88e9-a57ac7c5f9a2 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:28.649151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fe086-ba8a-4fd0-88e9-a57ac7c5f9a2 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:28.649608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fe086-ba8a-4fd0-88e9-a57ac7c5f9a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:28.672289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fe086-ba8a-4fd0-88e9-a57ac7c5f9a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:28.674353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fe086-ba8a-4fd0-88e9-a57ac7c5f9a2 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:28.714174 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2662/5349] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:34:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:34:29.184327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f8903-da37-4b57-acc5-5c3e596a7a25 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:29.184617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f8903-da37-4b57-acc5-5c3e596a7a25 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:29.194926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f8903-da37-4b57-acc5-5c3e596a7a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:29.238733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8c0f8903-da37-4b57-acc5-5c3e596a7a25 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:29.244874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8c0f8903-da37-4b57-acc5-5c3e596a7a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:29.259124 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2688/5350] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:29 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:29.264381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08670c2-c258-4b5f-ac49-b0353264f27b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:29.265390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08670c2-c258-4b5f-ac49-b0353264f27b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:29.265942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08670c2-c258-4b5f-ac49-b0353264f27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:29.308736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d08670c2-c258-4b5f-ac49-b0353264f27b None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:29.310538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d08670c2-c258-4b5f-ac49-b0353264f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:29.332924 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2663/5351] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:29.348860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f8903-da37-4b57-acc5-5c3e596a7a25 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:29.372139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f8903-da37-4b57-acc5-5c3e596a7a25 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:29.386446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ba623-1f3d-4854-b6bc-56ee52c763e9 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:29.387487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ba623-1f3d-4854-b6bc-56ee52c763e9 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:29.388373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ba623-1f3d-4854-b6bc-56ee52c763e9 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:29.389565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ba623-1f3d-4854-b6bc-56ee52c763e9 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:29.628033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c20ba623-1f3d-4854-b6bc-56ee52c763e9 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:29.863292 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2689/5352] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:29 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:30.870240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da500a4-32bc-4876-88ba-db5ef1c1e24d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:30.871294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da500a4-32bc-4876-88ba-db5ef1c1e24d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:30.871876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da500a4-32bc-4876-88ba-db5ef1c1e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:30.906486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9da500a4-32bc-4876-88ba-db5ef1c1e24d None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:30.908293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9da500a4-32bc-4876-88ba-db5ef1c1e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:30.918401 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2664/5353] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:30 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:30.920015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:30.920503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:30.920719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:30.945598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:30.947208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:30.955013 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2690/5354] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:30.959948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da500a4-32bc-4876-88ba-db5ef1c1e24d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:30.978639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da500a4-32bc-4876-88ba-db5ef1c1e24d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:30.992360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc4b8e376d514d8cb96ccde128286bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20f6700dc5104d87a52d1caec4ccdfc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:30.993318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:30.993800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:30.994315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:31.061915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:31.063381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:31.184604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:31.239108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558f6dd-f82d-4c72-a7ca-ddca4dfbf359 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:31.250020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:31.251124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:31.251598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:31.252314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] PATH_INFO: `/v3/users/5cc06c467eb8468dba45af3d1dcf808d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:31.254323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc06c467eb8468dba45af3d1dcf808d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:31.262064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:31.294743 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2665/5355] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:34:30 2022] POST /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb/password => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:31.582284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc06c467eb8468dba45af3d1dcf808d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:31.583154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc06c467eb8468dba45af3d1dcf808d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:31.659910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc06c467eb8468dba45af3d1dcf808d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:31.672868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc06c467eb8468dba45af3d1dcf808d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:31.674684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-60f7e821-75ba-4769-8444-656fe22851ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc06c467eb8468dba45af3d1dcf808d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:31.708222 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:31.742307 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2691/5356] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:31 2022] DELETE /identity/v3/users/5cc06c467eb8468dba45af3d1dcf808d => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:32.265906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:32.267729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:32.298461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471411-8f54-46ff-ba7b-07693e818a4a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:32.298985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471411-8f54-46ff-ba7b-07693e818a4a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:32.299091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d471411-8f54-46ff-ba7b-07693e818a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:32.323791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518550d5-a058-4ac7-821a-da512aa42508 tempest-IdentityV3UsersTest-1468856251 tempest-IdentityV3UsersTest-1468856251-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:32.352411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8d471411-8f54-46ff-ba7b-07693e818a4a None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:32.354922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d471411-8f54-46ff-ba7b-07693e818a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:32.360087 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2692/5357] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:34:32.537748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:32.540347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:32.540347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:32.540347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] PATH_INFO: `/v3/projects/171a5316d3264797a95a2ba66da1b4c9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:32.543256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171a5316d3264797a95a2ba66da1b4c9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:32.548068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:32.755664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171a5316d3264797a95a2ba66da1b4c9', 'request_id': 'req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:32.773074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171a5316d3264797a95a2ba66da1b4c9', 'request_id': 'req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:32.924683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171a5316d3264797a95a2ba66da1b4c9', 'request_id': 'req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:32.943355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] The token cache is being invalidate because project 171a5316d3264797a95a2ba66da1b4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:32.944602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:32.946076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ceb09a6-ca09-4fd3-b0ec-b44637b0c2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:32.950264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2666/5358] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:32 2022] DELETE /identity/v3/projects/171a5316d3264797a95a2ba66da1b4c9 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:32.954233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b1b43-7a1f-4d95-a032-5a36b70c2cbd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:32.954528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b1b43-7a1f-4d95-a032-5a36b70c2cbd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:32.954797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b1b43-7a1f-4d95-a032-5a36b70c2cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:32.975464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e62b1b43-7a1f-4d95-a032-5a36b70c2cbd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:32.977301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e62b1b43-7a1f-4d95-a032-5a36b70c2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:33.049324 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2693/5359] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:33.058364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b432-b832-4182-b28f-4f60223a6170 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.058857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b432-b832-4182-b28f-4f60223a6170 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.059136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b432-b832-4182-b28f-4f60223a6170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.083251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4101b432-b832-4182-b28f-4f60223a6170 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:33.084516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4101b432-b832-4182-b28f-4f60223a6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:33.095314 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2667/5360] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:33.099629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b1b43-7a1f-4d95-a032-5a36b70c2cbd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.116158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b1b43-7a1f-4d95-a032-5a36b70c2cbd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:33.121406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:33.122133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.122444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.122726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.126405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:34:33.126810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:33.130715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:33.145134 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2694/5361] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:34:33.149543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101b432-b832-4182-b28f-4f60223a6170 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.159517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101b432-b832-4182-b28f-4f60223a6170 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:33.165187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942a9ee-5fe6-4e91-9951-412681c93dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:33.166498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a9ee-5fe6-4e91-9951-412681c93dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.166788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a9ee-5fe6-4e91-9951-412681c93dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.167068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a9ee-5fe6-4e91-9951-412681c93dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.167923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942a9ee-5fe6-4e91-9951-412681c93dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:33.169929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942a9ee-5fe6-4e91-9951-412681c93dc3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:33.293217 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2668/5362] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:33 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:33.297840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.311852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d205da-34c5-485f-a68c-10d87998888c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:33.373148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.373763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.374238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.384516 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:33.390693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:33.391749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.392197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.392488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.393137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:33.395927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:33.405771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] MFA Rules not processed for user `cc4b8e376d514d8cb96ccde128286bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:33.408518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:33.482826 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2669/5363] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:33.485520 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2695/5364] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:33 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:33.489060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.493118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.500424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:33.507255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86d5c-5522-4d0f-995e-89678fda2128 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:33.516096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121230-fd31-40c9-8b5c-76352a719db9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:33.517291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:33.517947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.518366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.518695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.519299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:33.521091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:33.521211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:33.521826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.522188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.522973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] PATH_INFO: `/v3/users/cc4b8e376d514d8cb96ccde128286bdb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.524121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4b8e376d514d8cb96ccde128286bdb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:33.526241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:33.535318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2696/5365] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:34:33.540035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.552353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbda7-3cb7-44ad-bf50-ceae96082be9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:33.560518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:33.561233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.561587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.561972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.562688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:33.564617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:33.577110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2697/5366] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:33.586176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.598705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acb495-6e81-4693-a569-48f2b1c0db29 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:33.607463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12baa31-6086-48e6-9756-8451e4d38b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:33.608137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12baa31-6086-48e6-9756-8451e4d38b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.617592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12baa31-6086-48e6-9756-8451e4d38b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.617592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12baa31-6086-48e6-9756-8451e4d38b72 admin admin] PATH_INFO: `/v3/projects/534faa0072ff45dbbd81c6f642045378/users/23e8d987796845018f6070fdd89c421b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.626658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12baa31-6086-48e6-9756-8451e4d38b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534faa0072ff45dbbd81c6f642045378, user_id=23e8d987796845018f6070fdd89c421b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:33.629385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12baa31-6086-48e6-9756-8451e4d38b72 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:33.772644 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2698/5367] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:33 2022] PUT /identity/v3/projects/534faa0072ff45dbbd81c6f642045378/users/23e8d987796845018f6070fdd89c421b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:33.775075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:33.776070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:33.777093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:33.820985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:33.822244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:33.831259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:33.841889 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:33.869251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:33.895861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:33.896673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:33.937857 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2699/5368] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:33.951787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:33.957000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:33.987227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a4dfa79-0cd4-4efb-99d9-156fd9abe392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4b8e376d514d8cb96ccde128286bdb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:33.995759 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2670/5369] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:33 2022] DELETE /identity/v3/users/cc4b8e376d514d8cb96ccde128286bdb => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:34.000326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:34.000474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:34.000745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:34.035576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:34.036886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:34.055755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c12ade-dfd9-4195-bb2d-e9e10184f628 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:34.123634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:34.124626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:34.125350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:34.125699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:34.133869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2671/5370] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:34.143673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:34.143673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:34.144371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:34.146440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:34.153394 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2700/5371] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:34.183290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ada9-51af-45fb-a5d9-d49059524711 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:34.188414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:34.189043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:34.189357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:34.189631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:34.200234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:34.201718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:34.212774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2672/5372] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:34:34.752579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:34.754243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:34.791245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b18837-4ef0-4e05-9bac-bfff8e2a6caa service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:34.800291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:34.800850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:34.801417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:34.801803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] PATH_INFO: `/v3/projects/20f6700dc5104d87a52d1caec4ccdfc4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:34.808308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f6700dc5104d87a52d1caec4ccdfc4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:34.808308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:34.952651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f6700dc5104d87a52d1caec4ccdfc4', 'request_id': 'req-7769b56c-a8de-4268-a276-5a02bf2a5287'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:34.952651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f6700dc5104d87a52d1caec4ccdfc4', 'request_id': 'req-7769b56c-a8de-4268-a276-5a02bf2a5287'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:34.980248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:34.981780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:35.009720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f6700dc5104d87a52d1caec4ccdfc4', 'request_id': 'req-7769b56c-a8de-4268-a276-5a02bf2a5287'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.043823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] The token cache is being invalidate because project 20f6700dc5104d87a52d1caec4ccdfc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:35.044137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.046171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce266b86-a1b7-4b24-98e6-81de01af9e63 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:35.047915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7769b56c-a8de-4268-a276-5a02bf2a5287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.055436 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2701/5373] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:34 2022] DELETE /identity/v3/projects/20f6700dc5104d87a52d1caec4ccdfc4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:35.056187 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:35.057942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2516f0e-b6be-402d-98ea-b6aacc1b1aff None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.058235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2516f0e-b6be-402d-98ea-b6aacc1b1aff None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.061054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2516f0e-b6be-402d-98ea-b6aacc1b1aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.071562 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:35.098011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c2516f0e-b6be-402d-98ea-b6aacc1b1aff None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:35.100417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2516f0e-b6be-402d-98ea-b6aacc1b1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:35.191078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:35.191827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.192163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.192737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] PATH_INFO: `/v3/users/4cfb68ce969d46b68e0706ff8fd35704` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.194563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cfb68ce969d46b68e0706ff8fd35704)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:35.198025 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2702/5374] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:35.198213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:35.199528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c410-be01-4bd3-aa2a-61fc408dc8e2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.199824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c410-be01-4bd3-aa2a-61fc408dc8e2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.200111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c410-be01-4bd3-aa2a-61fc408dc8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.222267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4492c410-be01-4bd3-aa2a-61fc408dc8e2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:35.224279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4492c410-be01-4bd3-aa2a-61fc408dc8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:35.246768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2703/5375] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:35.254039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c410-be01-4bd3-aa2a-61fc408dc8e2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:35.265916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c410-be01-4bd3-aa2a-61fc408dc8e2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:35.273344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:35.274087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.274371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.274646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.275322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:34:35.275628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:35.277728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:35.297940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2704/5376] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:34:35.304340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:35.323105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3e0b1-0a32-41da-bd7a-217752f287b2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:35.345544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:35.346682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.346975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.347250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.348088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:35.350205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:35.456178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cfb68ce969d46b68e0706ff8fd35704'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.471470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cfb68ce969d46b68e0706ff8fd35704'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.479121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cfb68ce969d46b68e0706ff8fd35704'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.479981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cfb68ce969d46b68e0706ff8fd35704'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.504773 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2705/5377] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:35 2022] POST /identity/v3/projects => generated 399 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:35.509105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:35.511106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:35.610139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc14358-9e68-4b27-872b-f7954699f60b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:35.617674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:35.618437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.618722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.619092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.619724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:35.621846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:35.627608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2f07f511-0378-4d91-8c4d-5740d5a4b518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cfb68ce969d46b68e0706ff8fd35704'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:35.638414 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2673/5378] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:34 2022] DELETE /identity/v3/users/4cfb68ce969d46b68e0706ff8fd35704 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:35.640783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.641077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.641363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.684352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:35.684352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:35.740250 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2706/5379] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:35 2022] POST /identity/v3/users => generated 306 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:35.746330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:35.760284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1e459-5512-464c-a474-f404d4e4ab54 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:35.766849 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2674/5380] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:35.770610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:35.771340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.771633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.772567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.773518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:35.775306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:35.780885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:35.782386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:35.819772 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2707/5381] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:34:35.830658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:35.861080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217c2ad-7480-4007-bf03-d447d530ac96 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:35.876256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:35.876256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.876256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.876256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] PATH_INFO: `/v3/projects/22f21e8992b4426893fd857acf664f1b/users/d1bb6ece76f74b6db7e3b12863084529/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.918005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f21e8992b4426893fd857acf664f1b, user_id=d1bb6ece76f74b6db7e3b12863084529, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:35.925944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:35.942097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ac60f-62b1-49d6-9b77-c6ffe70e1184 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:35.948015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:35.948653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:35.949088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:35.949195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:35.964105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:35.966250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:35.990252 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2675/5382] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:34:36.188984 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2708/5383] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:35 2022] PUT /identity/v3/projects/22f21e8992b4426893fd857acf664f1b/users/d1bb6ece76f74b6db7e3b12863084529/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:36.191722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:36.205115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c8747-ebf2-4773-87bd-b68c1f11abc8 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:36.279829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc271d6-ec42-44c8-94b0-05567c2a40a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:36.280661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc271d6-ec42-44c8-94b0-05567c2a40a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.281196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc271d6-ec42-44c8-94b0-05567c2a40a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.281571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc271d6-ec42-44c8-94b0-05567c2a40a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.282562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc271d6-ec42-44c8-94b0-05567c2a40a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:36.284938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc271d6-ec42-44c8-94b0-05567c2a40a1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:36.298242 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2676/5384] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:36.302699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:36.314141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75008277-70d8-44a0-add2-a9b65d6498e9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:36.320513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:36.321213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.321568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.321946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] PATH_INFO: `/v3/projects/22f21e8992b4426893fd857acf664f1b/users/d1bb6ece76f74b6db7e3b12863084529/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.324042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f21e8992b4426893fd857acf664f1b, user_id=d1bb6ece76f74b6db7e3b12863084529, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:36.327364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:36.369034 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2709/5385] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:36 2022] PUT /identity/v3/projects/22f21e8992b4426893fd857acf664f1b/users/d1bb6ece76f74b6db7e3b12863084529/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:36.371045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4c290-41a6-462e-bc47-b81f8f8b50c1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.371442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4c290-41a6-462e-bc47-b81f8f8b50c1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.371818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4c290-41a6-462e-bc47-b81f8f8b50c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.411518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bde4c290-41a6-462e-bc47-b81f8f8b50c1 None None] MFA Rules not processed for user `d1bb6ece76f74b6db7e3b12863084529`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:36.412854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bde4c290-41a6-462e-bc47-b81f8f8b50c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:36.452504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:36.454345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:36.505537 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2677/5386] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:36.510255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4c290-41a6-462e-bc47-b81f8f8b50c1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:36.539935 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:36.595633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1761cab-b1ee-4dee-8d26-9c7623f8edff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:36.601993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:36.605234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.605234 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:36.605234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.605234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] PATH_INFO: `/v3/projects/3cde0af5172a4af896ea882d1c0f3159` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.607141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cde0af5172a4af896ea882d1c0f3159)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:36.609171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:36.612035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4c290-41a6-462e-bc47-b81f8f8b50c1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:36.619158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:36.619803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.620083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.620831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.622695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:36.625073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:36.774290 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2678/5387] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:36 2022] POST /identity/v3/projects => generated 397 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:34:36.777875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:36.790900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cde0af5172a4af896ea882d1c0f3159', 'request_id': 'req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:36.797574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cde0af5172a4af896ea882d1c0f3159', 'request_id': 'req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:36.862300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cde0af5172a4af896ea882d1c0f3159', 'request_id': 'req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:36.877736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] The token cache is being invalidate because project 3cde0af5172a4af896ea882d1c0f3159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:36.878169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:36.879936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5dfb9ebd-b2b1-4b58-9184-3dd128b844e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:36.882209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2710/5388] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:36 2022] DELETE /identity/v3/projects/3cde0af5172a4af896ea882d1c0f3159 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:36.884830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f221c8-3cc0-4c9b-989f-089fc016cf1c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:36.889188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723a87-2b75-4b7b-8a39-e88e81725919 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.889531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723a87-2b75-4b7b-8a39-e88e81725919 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.890193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723a87-2b75-4b7b-8a39-e88e81725919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.892375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:36.893069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.893354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.893727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.894523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:36.896787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:36.919891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ab723a87-2b75-4b7b-8a39-e88e81725919 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:36.921281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab723a87-2b75-4b7b-8a39-e88e81725919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:36.930467 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2711/5389] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:36.938320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5399e20-4197-4d18-8fb1-7d2d5f91ebc0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:36.939009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5399e20-4197-4d18-8fb1-7d2d5f91ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:36.939788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5399e20-4197-4d18-8fb1-7d2d5f91ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:36.961496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f5399e20-4197-4d18-8fb1-7d2d5f91ebc0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:36.962843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5399e20-4197-4d18-8fb1-7d2d5f91ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:36.975603 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2712/5390] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:36.976519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5399e20-4197-4d18-8fb1-7d2d5f91ebc0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:36.993081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5399e20-4197-4d18-8fb1-7d2d5f91ebc0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.004599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.005059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.005891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.005891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.007398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:34:37.007398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.009301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.034491 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2679/5391] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:36 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:37.039686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.044206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:37.073686 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2713/5392] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:34:37.077934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.093976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3504-0d12-436f-a317-683ff3ad4e7d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.104989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.106000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.106326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.106606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.106830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b95ef1-518e-4bff-97b9-e2f9ab179d52 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.107240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.109227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.120446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.121953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.122540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.130678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.130678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.134700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.182581 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2680/5393] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:37.192730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.223746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04300-0f15-4f1e-829a-b1a014693c9f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.233212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.245401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.245854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.246144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.247745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.249671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.277332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2681/5394] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:37.281123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.301424 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2714/5395] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:37 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:34:37.305522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.329090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40bbc0-4033-4310-9ad7-9d5b23dd5bfb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.482599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760734d2-2c1a-4ff7-b282-bcc99a609581 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.488056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274017-41f3-4b5c-9a87-5671b70a9b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.489145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274017-41f3-4b5c-9a87-5671b70a9b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.489762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274017-41f3-4b5c-9a87-5671b70a9b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.495676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274017-41f3-4b5c-9a87-5671b70a9b8d admin admin] PATH_INFO: `/v3/projects/b507dcf0c6614d0199ced9703bb2a624/users/99d897baf8d1408fbfae52bc559e27f4/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.495817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.495817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.495817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.495817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.496399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.499431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.526145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef274017-41f3-4b5c-9a87-5671b70a9b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b507dcf0c6614d0199ced9703bb2a624, user_id=99d897baf8d1408fbfae52bc559e27f4, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.530457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef274017-41f3-4b5c-9a87-5671b70a9b8d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.663717 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2715/5396] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:37 2022] POST /identity/v3/users => generated 287 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:37.667762 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2682/5397] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:37 2022] PUT /identity/v3/projects/b507dcf0c6614d0199ced9703bb2a624/users/99d897baf8d1408fbfae52bc559e27f4/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:37.668368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.679021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.681648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.681648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.684224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042cae-f2b8-4405-9c62-175f4d749e81 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.736882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] MFA Rules not processed for user `99d897baf8d1408fbfae52bc559e27f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:37.738256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:37.815311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.816360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.816785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.817105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.817747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.825662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.844590 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2716/5398] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:37.849048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.849431 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2683/5399] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:37.864949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.864949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:37.867120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed72272-a655-4dab-9a09-7e1fc0ff73d4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.872318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.872959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.873247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.873524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.875352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:37.877148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:37.913718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2717/5400] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:37.921708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:37.947571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f6ac-b5ef-4587-bf9f-fc5ccd795baf None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.949844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5025d-3e60-4abf-8cbd-ee577a7ea58d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:37.953205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4374ee9-0e12-4c14-aa13-6689090533c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.953878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4374ee9-0e12-4c14-aa13-6689090533c5 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.957736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4374ee9-0e12-4c14-aa13-6689090533c5 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.957736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4374ee9-0e12-4c14-aa13-6689090533c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:37.957736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f4374ee9-0e12-4c14-aa13-6689090533c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:37.958167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:37.958167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:37.958355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:37.958597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] PATH_INFO: `/v3/projects/b16eebe3879f4d9795819125e4a88f7b/users/bdd1cb1110744fb486ce5703ec8e60c1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:38.003036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16eebe3879f4d9795819125e4a88f7b, user_id=bdd1cb1110744fb486ce5703ec8e60c1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:38.009074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:38.056757 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:38.072742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4374ee9-0e12-4c14-aa13-6689090533c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:38.076588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4374ee9-0e12-4c14-aa13-6689090533c5 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:38.088725 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2684/5401] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:34:38.114929 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2718/5402] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:37 2022] PUT /identity/v3/projects/b16eebe3879f4d9795819125e4a88f7b/users/bdd1cb1110744fb486ce5703ec8e60c1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:38.119914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577c97-1217-4be4-8db5-a67210b88db3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:38.120271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577c97-1217-4be4-8db5-a67210b88db3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:38.120625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577c97-1217-4be4-8db5-a67210b88db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:38.148496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-84577c97-1217-4be4-8db5-a67210b88db3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:38.150575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84577c97-1217-4be4-8db5-a67210b88db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:38.268035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2685/5403] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:38.288923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:38.291506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:38.422442 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:38.452334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137eaaa-1096-476f-9707-2fc5149e4953 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:38.456808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c801c8b-aa74-4ce5-9a9e-e1af2f346352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:38.457718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c801c8b-aa74-4ce5-9a9e-e1af2f346352 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:38.458245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c801c8b-aa74-4ce5-9a9e-e1af2f346352 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:38.458677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c801c8b-aa74-4ce5-9a9e-e1af2f346352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:38.470729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c801c8b-aa74-4ce5-9a9e-e1af2f346352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:38.472481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c801c8b-aa74-4ce5-9a9e-e1af2f346352 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:38.486014 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2719/5404] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:34:38.976900 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:39.653537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577c97-1217-4be4-8db5-a67210b88db3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:39.671596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577c97-1217-4be4-8db5-a67210b88db3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:39.678742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:39.680051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:39.680675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:39.681314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] PATH_INFO: `/v3/users/d1bb6ece76f74b6db7e3b12863084529` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:39.684000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bb6ece76f74b6db7e3b12863084529)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:39.688284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:39.964592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bb6ece76f74b6db7e3b12863084529'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:39.993929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bb6ece76f74b6db7e3b12863084529'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:40.008015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bb6ece76f74b6db7e3b12863084529'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:40.009181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bb6ece76f74b6db7e3b12863084529'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:40.116126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bb6ece76f74b6db7e3b12863084529'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:40.139329 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2686/5405] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:39 2022] DELETE /identity/v3/users/d1bb6ece76f74b6db7e3b12863084529 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:40.144316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:40.152376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:40.152376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:40.167621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:40.169566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:40.220083 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:40.274201 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2720/5406] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:40.283040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:40.284993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:40.348696 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:40.404750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e433a24-73cf-491a-a5e9-40e83ebcd44d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:40.414621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:40.417800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:40.417800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:40.417800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:40.446414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:40.447982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:40.464080 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2687/5407] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:41.530585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:41.532183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:41.555077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c18ebe-43da-4d16-a846-4d43054be5b1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:41.565265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:41.566969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:41.568489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:41.570939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] PATH_INFO: `/v3/projects/22f21e8992b4426893fd857acf664f1b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:41.578770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f21e8992b4426893fd857acf664f1b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:41.601086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:41.835303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f21e8992b4426893fd857acf664f1b', 'request_id': 'req-045e26e1-0311-4deb-b884-8fe3a214027e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:41.856112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f21e8992b4426893fd857acf664f1b', 'request_id': 'req-045e26e1-0311-4deb-b884-8fe3a214027e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:41.970454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f21e8992b4426893fd857acf664f1b', 'request_id': 'req-045e26e1-0311-4deb-b884-8fe3a214027e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.006547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] The token cache is being invalidate because project 22f21e8992b4426893fd857acf664f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:42.007078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.011157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-045e26e1-0311-4deb-b884-8fe3a214027e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.015449 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2721/5408] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:41 2022] DELETE /identity/v3/projects/22f21e8992b4426893fd857acf664f1b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:42.019698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:42.035570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7fef-ed0e-4f2a-b0c7-8f9b454dfb1e service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:42.196924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:42.200794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:42.203605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:42.205523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] PATH_INFO: `/v3/users/99d897baf8d1408fbfae52bc559e27f4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:42.208781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d897baf8d1408fbfae52bc559e27f4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:42.215810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:42.276661 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:42.597961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d897baf8d1408fbfae52bc559e27f4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.635315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d897baf8d1408fbfae52bc559e27f4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.666697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d897baf8d1408fbfae52bc559e27f4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.676616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d897baf8d1408fbfae52bc559e27f4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.783934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d897baf8d1408fbfae52bc559e27f4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:42.799629 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2688/5409] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:42 2022] DELETE /identity/v3/users/99d897baf8d1408fbfae52bc559e27f4 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:42.868409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff12418-4417-4f14-b03e-67c1a026c9c2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:42.868943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff12418-4417-4f14-b03e-67c1a026c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:42.869052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff12418-4417-4f14-b03e-67c1a026c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:42.927086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5ff12418-4417-4f14-b03e-67c1a026c9c2 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:42.934029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5ff12418-4417-4f14-b03e-67c1a026c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:43.018832 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2722/5410] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:43.032237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:43.037230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:43.178313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb6de6-b70e-4d86-b04b-95de803c02b4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:43.187409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6d078-42f8-4a3d-b82f-168951055766 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:43.191696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d078-42f8-4a3d-b82f-168951055766 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:43.192869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d078-42f8-4a3d-b82f-168951055766 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:43.196225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6d078-42f8-4a3d-b82f-168951055766 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:43.208809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6d078-42f8-4a3d-b82f-168951055766 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:43.218948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6d078-42f8-4a3d-b82f-168951055766 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:43.255196 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2689/5411] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:34:44.176398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:44.176962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:44.176962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:44.262048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] MFA Rules not processed for user `23e8d987796845018f6070fdd89c421b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:44.264637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:44.567318 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:44.601344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2723/5412] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:44.611097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:44.617098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:44.617098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:44.653071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] MFA Rules not processed for user `23e8d987796845018f6070fdd89c421b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:44.659785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:44.687801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2690/5413] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:44.709027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:44.714834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:44.931776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:44.933201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:45.249738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122577a-a399-4411-b219-0b51beee5c3c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:45.308039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4228c-363e-484c-ba49-2f42748e3400 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:45.314213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b04e72-aa4c-46c4-bc12-d63f03eb350a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:45.314893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04e72-aa4c-46c4-bc12-d63f03eb350a service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:45.326169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:45.327467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:45.327754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:45.332707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] PATH_INFO: `/v3/projects/b507dcf0c6614d0199ced9703bb2a624` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:45.344144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04e72-aa4c-46c4-bc12-d63f03eb350a service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:45.344822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b507dcf0c6614d0199ced9703bb2a624)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:45.346570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04e72-aa4c-46c4-bc12-d63f03eb350a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:45.346820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:45.433767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b04e72-aa4c-46c4-bc12-d63f03eb350a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:45.448024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b04e72-aa4c-46c4-bc12-d63f03eb350a service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:45.487546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2724/5414] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:45.572650 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:45.626282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b507dcf0c6614d0199ced9703bb2a624', 'request_id': 'req-0c03849d-91a4-4352-beba-c8f62f75c7c0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:45.668177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b507dcf0c6614d0199ced9703bb2a624', 'request_id': 'req-0c03849d-91a4-4352-beba-c8f62f75c7c0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:45.822311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b507dcf0c6614d0199ced9703bb2a624', 'request_id': 'req-0c03849d-91a4-4352-beba-c8f62f75c7c0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:45.851975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] The token cache is being invalidate because project b507dcf0c6614d0199ced9703bb2a624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:34:45.852328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:45.858689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c03849d-91a4-4352-beba-c8f62f75c7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:45.875131 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2691/5415] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:44 2022] DELETE /identity/v3/projects/b507dcf0c6614d0199ced9703bb2a624 => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:45.877139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23290-4356-4c04-8d9d-26b695d7eab5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:45.877434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23290-4356-4c04-8d9d-26b695d7eab5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:45.877715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23290-4356-4c04-8d9d-26b695d7eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:45.957451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dbf23290-4356-4c04-8d9d-26b695d7eab5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:45.958734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dbf23290-4356-4c04-8d9d-26b695d7eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:46.259874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2725/5416] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:46.265276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809693-1c8a-4243-8097-19dceb1d6ae5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:46.265925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809693-1c8a-4243-8097-19dceb1d6ae5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:46.266305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809693-1c8a-4243-8097-19dceb1d6ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:46.348028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-96809693-1c8a-4243-8097-19dceb1d6ae5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:46.348028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-96809693-1c8a-4243-8097-19dceb1d6ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:46.387141 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2692/5417] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:46.413854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23290-4356-4c04-8d9d-26b695d7eab5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:46.441649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23290-4356-4c04-8d9d-26b695d7eab5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:46.454945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:46.455967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:46.456461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:46.457193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:46.458142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:34:46.458699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:46.461686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:46.503408 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2726/5418] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:34:46.507976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96809693-1c8a-4243-8097-19dceb1d6ae5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:46.534797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96809693-1c8a-4243-8097-19dceb1d6ae5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:46.553683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:46.556365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:46.569984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:46.578151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:46.580079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:46.583046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:47.645614 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2693/5419] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:46 2022] POST /identity/v3/projects => generated 385 bytes in 1138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:47.649956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:47.663580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e2199-932f-4966-914d-fedd51d8f405 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:47.838127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:47.838975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:47.839501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:47.839962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:47.840763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:47.846542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:48.031561 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:48.039914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2727/5420] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:47 2022] POST /identity/v3/users => generated 299 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:48.044364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:48.119055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1178e4e-f296-4dee-bf1d-51be60eb88c8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:48.170768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:48.172181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:48.173244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:48.174495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:48.177792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:48.190310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:48.251279 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2694/5421] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:48.252453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:48.270680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8de5b6-a959-4401-9012-b3df311985ba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:48.302685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:48.303993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:48.304466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:48.304909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] PATH_INFO: `/v3/projects/81d30a0d4317413b9b0bfac622cd8530/users/cb8726cf8aea466298c826115aa6b1be/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:48.374834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d30a0d4317413b9b0bfac622cd8530, user_id=cb8726cf8aea466298c826115aa6b1be, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:48.382325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:48.584271 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2728/5422] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:48 2022] PUT /identity/v3/projects/81d30a0d4317413b9b0bfac622cd8530/users/cb8726cf8aea466298c826115aa6b1be/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:48.592998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:48.607338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa81d5d-1003-45a6-ab5b-e22973b4ed32 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:48.783143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e64dfc-71cd-483b-9afd-66423d17055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:48.784427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e64dfc-71cd-483b-9afd-66423d17055f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:48.784944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e64dfc-71cd-483b-9afd-66423d17055f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:48.785387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e64dfc-71cd-483b-9afd-66423d17055f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:48.786257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e64dfc-71cd-483b-9afd-66423d17055f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:48.797039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e64dfc-71cd-483b-9afd-66423d17055f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:48.824158 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2695/5423] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:34:48.828075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:48.841598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57543d2b-e9d2-4251-b7ad-09a7eae1d41b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:48.860565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:48.861475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:48.861944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:48.862388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] PATH_INFO: `/v3/projects/81d30a0d4317413b9b0bfac622cd8530/users/cb8726cf8aea466298c826115aa6b1be/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:48.873367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d30a0d4317413b9b0bfac622cd8530, user_id=cb8726cf8aea466298c826115aa6b1be, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:48.880580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:48.917143 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2729/5424] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:48 2022] PUT /identity/v3/projects/81d30a0d4317413b9b0bfac622cd8530/users/cb8726cf8aea466298c826115aa6b1be/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:48.927404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caead12-5b64-469d-a74b-68c6a1307eee None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:48.928461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caead12-5b64-469d-a74b-68c6a1307eee None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:48.928903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caead12-5b64-469d-a74b-68c6a1307eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:48.997087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9caead12-5b64-469d-a74b-68c6a1307eee None None] MFA Rules not processed for user `cb8726cf8aea466298c826115aa6b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:48.998897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9caead12-5b64-469d-a74b-68c6a1307eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:49.105623 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:49.136590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2696/5425] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:49.141419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:49.304915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56096c3-50c3-47c9-af1f-17c053b8e16b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:49.336441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:49.337478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:49.338008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:49.338460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:49.339284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:49.342094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:49.460388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2730/5426] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:49 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:49.464210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caead12-5b64-469d-a74b-68c6a1307eee None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:49.481003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caead12-5b64-469d-a74b-68c6a1307eee None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:49.672626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:49.674063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:49.677382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:49.677886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:49.679343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:49.681692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:49.823322 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2697/5427] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:49 2022] POST /identity/v3/users => generated 293 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:49.829376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:49.849102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60f07-5c8f-4846-8de2-af1493f54b6e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:49.858450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:49.859409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:49.860711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:49.861394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:49.862793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:49.864716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:49.881113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2731/5428] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:49.885345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:49.932174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b44613-b2dd-452e-9eb4-975ce5f1c90c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:49.955632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7374-5c58-4124-b905-68d93e675764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:49.960378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7374-5c58-4124-b905-68d93e675764 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:49.963276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7374-5c58-4124-b905-68d93e675764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:49.964558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7374-5c58-4124-b905-68d93e675764 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:49.966222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7374-5c58-4124-b905-68d93e675764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:49.991558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7374-5c58-4124-b905-68d93e675764 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:50.059856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2698/5429] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:50.063930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:50.087139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e8a36-e5f3-4ae9-be52-d336cde70eca admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:50.105315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:50.111814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:50.112420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:50.113882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] PATH_INFO: `/v3/projects/aff543bfd57c4a0c968905f711226101/users/cfc0370988834369890b47c936c5cc7f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:50.182980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff543bfd57c4a0c968905f711226101, user_id=cfc0370988834369890b47c936c5cc7f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:50.196987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:50.309984 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2732/5430] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:50 2022] PUT /identity/v3/projects/aff543bfd57c4a0c968905f711226101/users/cfc0370988834369890b47c936c5cc7f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:50.323035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648be8-04b8-4125-87c2-e3dcf7a13dd3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:50.323417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648be8-04b8-4125-87c2-e3dcf7a13dd3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:50.323577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648be8-04b8-4125-87c2-e3dcf7a13dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:50.421348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3b648be8-04b8-4125-87c2-e3dcf7a13dd3 None None] MFA Rules not processed for user `cfc0370988834369890b47c936c5cc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:50.422633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b648be8-04b8-4125-87c2-e3dcf7a13dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:50.655214 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2699/5431] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:51.811200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:51.813164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:51.826661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:51.827160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:51.830821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:51.902755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] MFA Rules not processed for user `bdd1cb1110744fb486ce5703ec8e60c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:51.904941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:52.083401 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:52.088130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff08f-57ae-46a0-a998-cf3731826fb9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:52.105160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:52.106088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:52.106522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:52.107168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:52.116608 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2700/5432] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:52.120093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:52.124524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:52.170598 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:52.272932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:52.274869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:52.307182 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2733/5433] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:52.311744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d091c-80f4-4594-8fb8-1e76f5495643 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:52.321623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:52.322435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:52.322719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:52.322990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:52.323698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:52.325672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:52.564021 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2701/5434] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:34:52 2022] POST /identity/v3/projects => generated 375 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:52.565793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:52.587762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae627e10-91d0-46f0-9097-2946d2c0d2d6 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:52.696032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:52.698065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:52.705571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:52.705571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:52.705571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:52.705571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:52.817596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2734/5435] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:34:52 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:34:52.822010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:52.835175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451935e6-86bc-4707-a7d5-df2d163eda6e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:52.873495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:52.874187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:52.879442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:52.879442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:52.879442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:52.879442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:52.940231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2702/5436] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:52.941297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:52.960057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ccd31-cf51-417c-a2bc-1e8e5940cd7f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:52.968673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:52.972495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:52.973064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:52.973704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] PATH_INFO: `/v3/projects/6031be79f0ad481a9044530ccae99206/users/3549c664d5a64543b65d312b62df6b0e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:53.043067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6031be79f0ad481a9044530ccae99206, user_id=3549c664d5a64543b65d312b62df6b0e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:53.052513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:53.179092 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2735/5437] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:52 2022] PUT /identity/v3/projects/6031be79f0ad481a9044530ccae99206/users/3549c664d5a64543b65d312b62df6b0e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:34:53.181972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:53.203328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a78f9c-eadf-4e5a-976f-4ea600dc83e8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:53.382525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:53.383350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:53.383716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:53.384095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:53.385498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:53.389579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:53.422964 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2703/5438] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:34:53.427188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:53.450406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb088320-b5ee-4f7d-9e0c-195328880a7f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:53.469292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a86e6-9df9-4513-bcdd-374a6c9c1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:53.470311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a86e6-9df9-4513-bcdd-374a6c9c1b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:53.470748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a86e6-9df9-4513-bcdd-374a6c9c1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:53.471455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a86e6-9df9-4513-bcdd-374a6c9c1b4a admin admin] PATH_INFO: `/v3/projects/6031be79f0ad481a9044530ccae99206/users/3549c664d5a64543b65d312b62df6b0e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:53.480422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a86e6-9df9-4513-bcdd-374a6c9c1b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6031be79f0ad481a9044530ccae99206, user_id=3549c664d5a64543b65d312b62df6b0e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:53.491083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a86e6-9df9-4513-bcdd-374a6c9c1b4a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:53.514732 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2736/5439] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:34:53 2022] PUT /identity/v3/projects/6031be79f0ad481a9044530ccae99206/users/3549c664d5a64543b65d312b62df6b0e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:55.150382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:55.169744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9eb28-df2a-47b1-9ef8-79f62c33a8bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:55.335595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:55.337068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:55.337363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:55.337642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] PATH_INFO: `/v3/users/cb8726cf8aea466298c826115aa6b1be` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:55.340364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8726cf8aea466298c826115aa6b1be)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:55.346886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:55.355955 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:55.614689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8726cf8aea466298c826115aa6b1be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:55.647859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8726cf8aea466298c826115aa6b1be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:55.661244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8726cf8aea466298c826115aa6b1be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:55.662063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8726cf8aea466298c826115aa6b1be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:55.736401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8726cf8aea466298c826115aa6b1be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:34:55.744700 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2704/5440] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:34:55 2022] DELETE /identity/v3/users/cb8726cf8aea466298c826115aa6b1be => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:34:55.749207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:55.750773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:55.751256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:55.794649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:55.795882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:56.006589 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2737/5441] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:34:56.017904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:56.019546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:56.291765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cb688-a290-413a-89db-48eda93f6b61 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:56.305985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:56.311394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:56.312011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:56.312590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:56.355039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:56.357272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:56.394222 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2705/5442] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:59.951277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:59.953755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:59.990904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa4a0-3b6b-411b-84a2-a15110456999 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:00.017682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:00.022898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:00.033144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:00.033786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] PATH_INFO: `/v3/projects/81d30a0d4317413b9b0bfac622cd8530` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:00.040005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d30a0d4317413b9b0bfac622cd8530)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:00.060120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:00.096789 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:00.267816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d30a0d4317413b9b0bfac622cd8530', 'request_id': 'req-8682a512-e023-4b80-a2d9-a8bae8257081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:00.276407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d30a0d4317413b9b0bfac622cd8530', 'request_id': 'req-8682a512-e023-4b80-a2d9-a8bae8257081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:00.375809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d30a0d4317413b9b0bfac622cd8530', 'request_id': 'req-8682a512-e023-4b80-a2d9-a8bae8257081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:00.443381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] The token cache is being invalidate because project 81d30a0d4317413b9b0bfac622cd8530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:35:00.444222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:00.456257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:00.464499 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2738/5443] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:34:59 2022] DELETE /identity/v3/projects/81d30a0d4317413b9b0bfac622cd8530 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:00.468570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:00.483609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff8eb-65b4-4cad-8932-210afb3a7d54 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:00.649955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:00.654237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:00.654783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:00.658141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] PATH_INFO: `/v3/users/cfc0370988834369890b47c936c5cc7f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:00.659653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc0370988834369890b47c936c5cc7f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:00.661688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:00.840864 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:00.994266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc0370988834369890b47c936c5cc7f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.026648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc0370988834369890b47c936c5cc7f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.038899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc0370988834369890b47c936c5cc7f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.039951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc0370988834369890b47c936c5cc7f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.136095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-943846ff-832e-4a9e-b397-a98378ff0fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc0370988834369890b47c936c5cc7f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.143965 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2706/5444] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:35:00 2022] DELETE /identity/v3/users/cfc0370988834369890b47c936c5cc7f => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:02.085741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:02.088922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:02.106886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682a512-e023-4b80-a2d9-a8bae8257081 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:02.291897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:02.292629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.292998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.293232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] PATH_INFO: `/v3/projects/aff543bfd57c4a0c968905f711226101` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.295720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff543bfd57c4a0c968905f711226101)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:02.297738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:02.493628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff543bfd57c4a0c968905f711226101', 'request_id': 'req-0045d6b9-f324-4854-9612-07dffcfed54a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.502701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff543bfd57c4a0c968905f711226101', 'request_id': 'req-0045d6b9-f324-4854-9612-07dffcfed54a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.560718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff543bfd57c4a0c968905f711226101', 'request_id': 'req-0045d6b9-f324-4854-9612-07dffcfed54a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.584326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] The token cache is being invalidate because project aff543bfd57c4a0c968905f711226101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:35:02.592392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.596887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0045d6b9-f324-4854-9612-07dffcfed54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.608430 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2739/5445] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:35:02 2022] DELETE /identity/v3/projects/aff543bfd57c4a0c968905f711226101 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:02.613566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c3e43-9fe7-4cef-b6c8-2f75fc3a7633 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.615193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c3e43-9fe7-4cef-b6c8-2f75fc3a7633 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.615701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c3e43-9fe7-4cef-b6c8-2f75fc3a7633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.673930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8f0c3e43-9fe7-4cef-b6c8-2f75fc3a7633 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:02.673930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8f0c3e43-9fe7-4cef-b6c8-2f75fc3a7633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:02.860328 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2707/5446] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:02.869646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b12b-a17e-457f-b081-459dd5f1ceb4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.869986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b12b-a17e-457f-b081-459dd5f1ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.870273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b12b-a17e-457f-b081-459dd5f1ceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.949264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c484b12b-a17e-457f-b081-459dd5f1ceb4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:02.954367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c484b12b-a17e-457f-b081-459dd5f1ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:02.983123 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2740/5447] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:02.987627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c3e43-9fe7-4cef-b6c8-2f75fc3a7633 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.003501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c3e43-9fe7-4cef-b6c8-2f75fc3a7633 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.037972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.039688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.040288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.052647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.052647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:35:03.052647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.054951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.098011 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2708/5448] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:35:03.103136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484b12b-a17e-457f-b081-459dd5f1ceb4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.123791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484b12b-a17e-457f-b081-459dd5f1ceb4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.138452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.140750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.141063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.141335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.142396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.155117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.294247 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:03.304878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2741/5449] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:35:03.309363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.327951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ff254-7a75-428f-b1b9-fd032de31f42 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.460970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.461551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.462146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.462146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.462740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.464734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.619369 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2709/5450] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:35:03.623223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.638999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c5a2-147b-4e48-a36e-8acb439de5c3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.650501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.653430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.653970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.654404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.660665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.666469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.731227 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2742/5451] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:35:03.733641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.748395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e4005-d875-4156-946e-96c13e81d862 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.763596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40950274-0970-4395-8d52-3c838fc517d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.764261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40950274-0970-4395-8d52-3c838fc517d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.764660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40950274-0970-4395-8d52-3c838fc517d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.764987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40950274-0970-4395-8d52-3c838fc517d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.765698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40950274-0970-4395-8d52-3c838fc517d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.767534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40950274-0970-4395-8d52-3c838fc517d3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.800245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2710/5452] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:35:03.801732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.856063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c318eb0-bd68-4503-a0d0-b36bc4fa65e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.878713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.879641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.880122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.880565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] PATH_INFO: `/v3/projects/daa8127959ef4a5790a073d2567d827c/users/b1f56e655ef94e41b86df2eeb69fbd9d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.918923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa8127959ef4a5790a073d2567d827c, user_id=b1f56e655ef94e41b86df2eeb69fbd9d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.921621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:04.366882 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2743/5453] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:35:03 2022] PUT /identity/v3/projects/daa8127959ef4a5790a073d2567d827c/users/b1f56e655ef94e41b86df2eeb69fbd9d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:04.377562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97130f-172d-4d60-a8c8-e6b96de1c501 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:04.377855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97130f-172d-4d60-a8c8-e6b96de1c501 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:04.378143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97130f-172d-4d60-a8c8-e6b96de1c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:04.405966 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:04.415995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7e97130f-172d-4d60-a8c8-e6b96de1c501 None None] MFA Rules not processed for user `b1f56e655ef94e41b86df2eeb69fbd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:04.417419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7e97130f-172d-4d60-a8c8-e6b96de1c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:04.513976 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2711/5454] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:04.526696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:04.528459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:04.628353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ba98a-bd52-49d8-91ce-8ca0cfdc6ad3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:04.633647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:04.634477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:04.634952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:04.635336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:04.667623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:04.671298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:04.709795 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2744/5455] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:14.689283 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:15.227574 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=27 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:17.080657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1545fc-b734-41e2-ae00-98f3ea8bd7cd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:17.081874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1545fc-b734-41e2-ae00-98f3ea8bd7cd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:17.083304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1545fc-b734-41e2-ae00-98f3ea8bd7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:17.163513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6b1545fc-b734-41e2-ae00-98f3ea8bd7cd None None] MFA Rules not processed for user `3549c664d5a64543b65d312b62df6b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:17.168000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6b1545fc-b734-41e2-ae00-98f3ea8bd7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:17.380770 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2712/5456] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:17.388016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:17.390723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:17.533980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add5e9f-b024-4979-983f-4e721b051eb6 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:17.544496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:17.545489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:17.546157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:17.546650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:17.562151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:17.564254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:17.579035 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2745/5457] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:17.666555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:17.667303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:17.668032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:17.738257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] MFA Rules not processed for user `bdd1cb1110744fb486ce5703ec8e60c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:17.745939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:18.025098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2713/5458] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:25.913938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:25.922058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:26.095130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09988-d4b2-430b-8b58-c47e8824ee25 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:26.100863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:26.101621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:26.102035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:26.102598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:26.105175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:26.231536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:26.233844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:26.245259 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2746/5459] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:35:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:35:28.000059 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=59 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:36.164003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:36.173230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:36.240720 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:36.335563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebd345-87ec-435e-9e94-f944a942b622 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:36.355937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:36.360761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:36.360761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:36.360761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] PATH_INFO: `/v3/users/23e8d987796845018f6070fdd89c421b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:36.360761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e8d987796845018f6070fdd89c421b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:36.361155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:36.621457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e8d987796845018f6070fdd89c421b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:36.681553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e8d987796845018f6070fdd89c421b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:36.708488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e8d987796845018f6070fdd89c421b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:36.713802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e8d987796845018f6070fdd89c421b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:36.799298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c1e435cd-36ac-4f81-b80d-2896fef8b5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e8d987796845018f6070fdd89c421b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:36.827119 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2714/5460] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:35:36 2022] DELETE /identity/v3/users/23e8d987796845018f6070fdd89c421b => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:37.734393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:37.753164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f293894-e785-4d7b-864d-429009a847b9 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:37.926955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:37.928363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:37.928850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:37.929317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] PATH_INFO: `/v3/projects/534faa0072ff45dbbd81c6f642045378` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:37.930846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=534faa0072ff45dbbd81c6f642045378)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:37.932967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:38.140774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534faa0072ff45dbbd81c6f642045378', 'request_id': 'req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:38.170086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534faa0072ff45dbbd81c6f642045378', 'request_id': 'req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:38.330109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534faa0072ff45dbbd81c6f642045378', 'request_id': 'req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:38.358353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] The token cache is being invalidate because project 534faa0072ff45dbbd81c6f642045378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:35:38.358353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:38.359192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f4f85e22-f94b-4fa0-bebe-47e8613ad51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:38.363418 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2747/5461] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:35:37 2022] DELETE /identity/v3/projects/534faa0072ff45dbbd81c6f642045378 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:38.367435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43400429-85c3-4d9b-98fb-af51b598b07e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:38.367950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43400429-85c3-4d9b-98fb-af51b598b07e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:38.368070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43400429-85c3-4d9b-98fb-af51b598b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:38.416746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-43400429-85c3-4d9b-98fb-af51b598b07e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:38.420238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-43400429-85c3-4d9b-98fb-af51b598b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:38.606972 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2715/5462] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:38.607899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a436-ac76-4914-b5d1-acae92490d06 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:38.608433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a436-ac76-4914-b5d1-acae92490d06 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:38.608937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a436-ac76-4914-b5d1-acae92490d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:38.659479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-25f4a436-ac76-4914-b5d1-acae92490d06 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:38.660737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25f4a436-ac76-4914-b5d1-acae92490d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:38.695609 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2748/5463] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:38.702774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43400429-85c3-4d9b-98fb-af51b598b07e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:38.713407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43400429-85c3-4d9b-98fb-af51b598b07e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:38.729942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:38.734976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:38.734976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:38.734976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:38.734976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:35:38.734976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:38.734976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:38.766915 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2716/5464] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:35:38.767062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a436-ac76-4914-b5d1-acae92490d06 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:38.784983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a436-ac76-4914-b5d1-acae92490d06 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:38.798830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:38.799665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:38.800096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:38.800517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:38.801580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:38.804106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:38.946394 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2749/5465] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:35:38 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:35:38.959260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:38.975599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb362f9c-9bbd-4d81-a5c0-b669e3176fbb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:38.982305 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:39.109395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:39.110142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:39.110421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:39.110689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:39.111340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:39.113260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:39.225206 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2717/5466] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:35:38 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:35:39.226608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:39.246121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d3e4-a71c-4335-983d-4f9250838749 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:39.253210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:39.254819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:39.255545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:39.257071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:39.258024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:39.260729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:39.280623 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2750/5467] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:35:39.284397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:39.298097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c636659-2d42-40cd-937c-3d7a9005a555 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:39.313385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56032351-9bee-4ba0-9355-6dd5254f14eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:39.314843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56032351-9bee-4ba0-9355-6dd5254f14eb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:39.315308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56032351-9bee-4ba0-9355-6dd5254f14eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:39.315761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56032351-9bee-4ba0-9355-6dd5254f14eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:39.317853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56032351-9bee-4ba0-9355-6dd5254f14eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:39.321939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56032351-9bee-4ba0-9355-6dd5254f14eb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:39.349840 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2718/5468] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:35:39.354415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:39.371590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59abbf-51f3-41e5-ab1e-34e63685e2f8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:39.433280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:39.434000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:39.434291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:39.434574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] PATH_INFO: `/v3/projects/b8ec907722f944929ff367d619ea4a28/users/eaf9d78c85244936b0a97356afb50071/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:39.474948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ec907722f944929ff367d619ea4a28, user_id=eaf9d78c85244936b0a97356afb50071, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:39.478056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:39.591675 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2751/5469] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:35:39 2022] PUT /identity/v3/projects/b8ec907722f944929ff367d619ea4a28/users/eaf9d78c85244936b0a97356afb50071/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:39.597065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da840-d90d-4700-853e-add526d589be None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:39.597560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da840-d90d-4700-853e-add526d589be None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:39.597859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da840-d90d-4700-853e-add526d589be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:39.663198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-286da840-d90d-4700-853e-add526d589be None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:39.666360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-286da840-d90d-4700-853e-add526d589be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:39.824939 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2719/5470] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:39.846975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:39.848821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:39.909114 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:39.949605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eef599-74c9-48b2-8cb8-50849fd627de admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:39.957380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6cd3c-4dae-44c7-8f5d-5c60fdd964f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:39.958326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6cd3c-4dae-44c7-8f5d-5c60fdd964f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:39.959164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6cd3c-4dae-44c7-8f5d-5c60fdd964f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:39.959450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6cd3c-4dae-44c7-8f5d-5c60fdd964f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:39.970690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6cd3c-4dae-44c7-8f5d-5c60fdd964f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:39.972578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6cd3c-4dae-44c7-8f5d-5c60fdd964f6 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:39.991627 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2752/5471] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:42.313572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab02b8-e4e7-48d9-9667-682d15ad7ba7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:42.313572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab02b8-e4e7-48d9-9667-682d15ad7ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:42.313572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab02b8-e4e7-48d9-9667-682d15ad7ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:42.362772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e2ab02b8-e4e7-48d9-9667-682d15ad7ba7 None None] MFA Rules not processed for user `bdd1cb1110744fb486ce5703ec8e60c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:42.367943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e2ab02b8-e4e7-48d9-9667-682d15ad7ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:42.545617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63167299-70cf-4cc3-b32d-1158d997085a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:42.546165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63167299-70cf-4cc3-b32d-1158d997085a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:42.546275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63167299-70cf-4cc3-b32d-1158d997085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:42.583212 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2720/5472] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:42.633281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-63167299-70cf-4cc3-b32d-1158d997085a None None] MFA Rules not processed for user `eaf9d78c85244936b0a97356afb50071`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:42.636940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-63167299-70cf-4cc3-b32d-1158d997085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:42.809548 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2753/5473] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:35:42.811229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96ef9c-4a7d-4363-80d8-771e64bc3f7f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:42.811577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96ef9c-4a7d-4363-80d8-771e64bc3f7f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:42.811863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96ef9c-4a7d-4363-80d8-771e64bc3f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:42.850895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dc96ef9c-4a7d-4363-80d8-771e64bc3f7f None None] MFA Rules not processed for user `eaf9d78c85244936b0a97356afb50071`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:42.852172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dc96ef9c-4a7d-4363-80d8-771e64bc3f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:42.871184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2721/5474] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:42.881991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:42.882285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:42.882564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:42.921645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] MFA Rules not processed for user `eaf9d78c85244936b0a97356afb50071`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:42.923690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:42.943383 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2754/5475] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:43.690956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96ef9c-4a7d-4363-80d8-771e64bc3f7f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:43.716612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96ef9c-4a7d-4363-80d8-771e64bc3f7f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:43.727685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218a4b-5ebd-42ba-b315-3235d60f196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:43.728568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218a4b-5ebd-42ba-b315-3235d60f196e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:43.729050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218a4b-5ebd-42ba-b315-3235d60f196e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:43.729513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218a4b-5ebd-42ba-b315-3235d60f196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:43.732855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d4218a4b-5ebd-42ba-b315-3235d60f196e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:43.763451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218a4b-5ebd-42ba-b315-3235d60f196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:43.767974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218a4b-5ebd-42ba-b315-3235d60f196e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:43.787636 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2722/5476] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:44.054910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:44.057606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:44.326079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e7b5-e614-436a-a479-3213265c48e6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:44.355898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334706e6-9eb0-4f53-a86b-b4e7ecf84d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:44.356537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334706e6-9eb0-4f53-a86b-b4e7ecf84d60 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:44.356821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334706e6-9eb0-4f53-a86b-b4e7ecf84d60 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:44.359160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334706e6-9eb0-4f53-a86b-b4e7ecf84d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:44.378033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334706e6-9eb0-4f53-a86b-b4e7ecf84d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:44.379551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334706e6-9eb0-4f53-a86b-b4e7ecf84d60 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:44.418268 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2755/5477] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:46.667531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81869b-4e8e-44bd-9dce-7b2a17afde26 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:46.668019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81869b-4e8e-44bd-9dce-7b2a17afde26 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:46.668340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81869b-4e8e-44bd-9dce-7b2a17afde26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:46.750348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3d81869b-4e8e-44bd-9dce-7b2a17afde26 None None] MFA Rules not processed for user `eaf9d78c85244936b0a97356afb50071`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:46.764825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d81869b-4e8e-44bd-9dce-7b2a17afde26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:46.818910 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2723/5478] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:48.378041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412570-3ccb-4289-8f15-8c945d1610aa None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:48.378527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412570-3ccb-4289-8f15-8c945d1610aa None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:48.379981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412570-3ccb-4289-8f15-8c945d1610aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:48.441897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2f412570-3ccb-4289-8f15-8c945d1610aa None None] MFA Rules not processed for user `eaf9d78c85244936b0a97356afb50071`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:48.444133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f412570-3ccb-4289-8f15-8c945d1610aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:48.451561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81869b-4e8e-44bd-9dce-7b2a17afde26 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:48.458327 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:48.467126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81869b-4e8e-44bd-9dce-7b2a17afde26 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:48.472953 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2756/5479] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:35:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:48.483614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:48.484778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:48.485967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:48.500623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:48.503822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:48.542759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:48.544360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:48.569751 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2724/5480] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:35:56.523107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:56.524302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:56.524801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:56.548073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:56.554504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:56.615534 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:56.691044 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2757/5481] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:57.023160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:57.026360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:57.249506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5cf65-76a6-409d-b744-fa55beb7ec08 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:57.254839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:57.255542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:57.255829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:57.256107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:57.266521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:57.268147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:57.284017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2725/5482] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:35:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:36:00.758515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:00.760468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:00.808326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065c6c2-a714-4094-a4b2-87192a91f98f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:00.816644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:00.817308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:00.817901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:00.818198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] PATH_INFO: `/v3/users/74e3121ebe26417585da5cf7f484f096` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:00.819920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e3121ebe26417585da5cf7f484f096)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:00.821893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:00.979558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:00.981600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:01.142316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e3121ebe26417585da5cf7f484f096'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:01.144463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e3121ebe26417585da5cf7f484f096'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:01.173542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906539d7-edab-4241-ac3c-1275aaa74572 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:01.212740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:01.212740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:01.212740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:01.212740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:01.221535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:01.244084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:01.248379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:01.273547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e3121ebe26417585da5cf7f484f096'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:01.294763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2726/5483] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:36:01.294763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:01.314028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:01.320492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e3121ebe26417585da5cf7f484f096'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:01.335285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e3121ebe26417585da5cf7f484f096'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:01.340793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77874de7-77c2-47bc-b430-117bf95406d6 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:01.351531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:01.352221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:01.353169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:01.353450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:01.356084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:01.375857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:01.377698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:01.398024 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2758/5484] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:36:00 2022] DELETE /identity/v3/users/74e3121ebe26417585da5cf7f484f096 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:01.411934 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2727/5485] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:01.905047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:01.907847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:01.957270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:01.959050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:01.997295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e57ac-5c9c-403f-bf8d-439be5d5c624 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:02.113590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f854f-ffa1-484b-8f1e-41261c2d8f9a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:02.131809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa7aa8-db44-441e-994b-051a527ac246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:02.133261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa7aa8-db44-441e-994b-051a527ac246 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:02.133562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa7aa8-db44-441e-994b-051a527ac246 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:02.133871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa7aa8-db44-441e-994b-051a527ac246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:02.138918 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:02.141273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6aaa7aa8-db44-441e-994b-051a527ac246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:02.155785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:02.156716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:02.157179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:02.157598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] PATH_INFO: `/v3/projects/d059b9687ce34cc4b79d88fac1863e83` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:02.160046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d059b9687ce34cc4b79d88fac1863e83)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:02.162626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:02.176238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa7aa8-db44-441e-994b-051a527ac246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:02.182436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa7aa8-db44-441e-994b-051a527ac246 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:02.227218 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2759/5486] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:02.355672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd059b9687ce34cc4b79d88fac1863e83', 'request_id': 'req-37c9fe10-806e-4875-9035-2224d1710bee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:02.382603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd059b9687ce34cc4b79d88fac1863e83', 'request_id': 'req-37c9fe10-806e-4875-9035-2224d1710bee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:02.506405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd059b9687ce34cc4b79d88fac1863e83', 'request_id': 'req-37c9fe10-806e-4875-9035-2224d1710bee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:02.524377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] The token cache is being invalidate because project d059b9687ce34cc4b79d88fac1863e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:36:02.524675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:02.526196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-37c9fe10-806e-4875-9035-2224d1710bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:02.530944 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2728/5487] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:36:01 2022] DELETE /identity/v3/projects/d059b9687ce34cc4b79d88fac1863e83 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:36:02.537201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565daa60-bf47-4c57-8daa-6e0335e1ee4f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:02.537742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565daa60-bf47-4c57-8daa-6e0335e1ee4f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:02.538216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565daa60-bf47-4c57-8daa-6e0335e1ee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:02.599457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-565daa60-bf47-4c57-8daa-6e0335e1ee4f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:02.601671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-565daa60-bf47-4c57-8daa-6e0335e1ee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:02.691698 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:02.762604 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2760/5488] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:02.779453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8710-d4c1-405b-85f1-5d17aa1f5e3b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:02.783837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8710-d4c1-405b-85f1-5d17aa1f5e3b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:02.784428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c8710-d4c1-405b-85f1-5d17aa1f5e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:02.878627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-432c8710-d4c1-405b-85f1-5d17aa1f5e3b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:02.879886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-432c8710-d4c1-405b-85f1-5d17aa1f5e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:02.905325 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2729/5489] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:02.910471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565daa60-bf47-4c57-8daa-6e0335e1ee4f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:02.942432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565daa60-bf47-4c57-8daa-6e0335e1ee4f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:02.963656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:02.964304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:02.964594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:02.964874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:02.969888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:36:02.970259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:02.974702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:03.027403 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2761/5490] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:36:03.031758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c8710-d4c1-405b-85f1-5d17aa1f5e3b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:03.043864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c8710-d4c1-405b-85f1-5d17aa1f5e3b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:03.049454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:03.050396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:03.051165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:03.051699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:03.052793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:03.055004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:03.210949 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2730/5491] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:36:03 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:36:03.214411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:03.230766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34141208-da84-4657-b4a9-83ce0c71f546 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:03.412008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:03.412943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:03.413231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:03.413561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:03.414250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:03.416711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:03.562899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2762/5492] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:36:03 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:36:03.566974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:03.583878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c527a-6865-45e8-9147-4acfca31e24f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:03.591960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:03.592988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:03.596006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:03.596006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:03.596006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:03.596629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:03.611964 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2731/5493] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:36:03.616830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:03.633372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944226e8-0028-4e03-8747-2da4d1713035 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:03.646343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d032ab0-021f-407c-ac37-348226912c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:03.647358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032ab0-021f-407c-ac37-348226912c7c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:03.647857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032ab0-021f-407c-ac37-348226912c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:03.648316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032ab0-021f-407c-ac37-348226912c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:03.651066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d032ab0-021f-407c-ac37-348226912c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:03.656288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d032ab0-021f-407c-ac37-348226912c7c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:03.669936 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2763/5494] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:36:03.673760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:03.686309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c08afa-01b5-4ab9-a309-73ece907fe1c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:03.693729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:03.698702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:03.699972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:03.700433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] PATH_INFO: `/v3/projects/0295485d1ef54b5ca6a03a298b9dedd4/users/13d47aaea13a458299f133080c5e3004/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:03.743562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0295485d1ef54b5ca6a03a298b9dedd4, user_id=13d47aaea13a458299f133080c5e3004, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:03.746791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:03.888475 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2732/5495] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:36:03 2022] PUT /identity/v3/projects/0295485d1ef54b5ca6a03a298b9dedd4/users/13d47aaea13a458299f133080c5e3004/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:36:03.893749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52448d62-ed0f-496e-b538-5c8191afd17b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:03.894418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52448d62-ed0f-496e-b538-5c8191afd17b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:03.894855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52448d62-ed0f-496e-b538-5c8191afd17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:04.100850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-52448d62-ed0f-496e-b538-5c8191afd17b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:04.102147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-52448d62-ed0f-496e-b538-5c8191afd17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:04.235412 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2764/5496] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:04.265674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:04.267589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:04.373821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328449-563e-4b6d-aa43-0b66459b5391 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:04.399207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:04.400476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:04.400947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:04.401829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:04.430830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:04.433307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:04.447402 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2733/5497] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:36:14.220150 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:14.440793 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:20.011449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:20.011997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:20.012227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:20.096946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] MFA Rules not processed for user `13d47aaea13a458299f133080c5e3004`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:20.104669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:20.303709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2765/5498] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:20.319872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:20.321305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:20.569027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47139-338c-466b-ae1a-acc71e315428 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:20.591435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38082-bbc2-44cd-9034-7d932c41c9b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:20.591435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38082-bbc2-44cd-9034-7d932c41c9b2 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:20.591435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38082-bbc2-44cd-9034-7d932c41c9b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:20.591435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38082-bbc2-44cd-9034-7d932c41c9b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:20.645103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e38082-bbc2-44cd-9034-7d932c41c9b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:20.645103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e38082-bbc2-44cd-9034-7d932c41c9b2 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:20.680194 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2734/5499] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:25.866295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:25.867793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:26.060705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d927c-5f14-4ddb-a1d2-48744849c317 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:26.066569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:26.068921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:26.069319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:26.069693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:26.071695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:26.089271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:26.091219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:26.107015 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2766/5500] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:26.362343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfda81-eef3-4e7a-afe3-0de2848b1fd4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:26.362859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfda81-eef3-4e7a-afe3-0de2848b1fd4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:26.363096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfda81-eef3-4e7a-afe3-0de2848b1fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:26.420205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b8dfda81-eef3-4e7a-afe3-0de2848b1fd4 None None] MFA Rules not processed for user `13d47aaea13a458299f133080c5e3004`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:26.430226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b8dfda81-eef3-4e7a-afe3-0de2848b1fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:26.451529 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2735/5501] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:36.089185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:36.091181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:36.116184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0511b-0945-4458-bb5c-a8b6b159cc96 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:36.125121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:36.126106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:36.126562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:36.127276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:36.129391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:36.149174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:36.151670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:36.181143 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2767/5502] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:36.395090 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=37 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:39.322670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfda81-eef3-4e7a-afe3-0de2848b1fd4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:39.349050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfda81-eef3-4e7a-afe3-0de2848b1fd4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:39.354050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:39.355043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:39.355512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:39.355999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:39.359954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:39.387490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:39.391007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:39.415118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2736/5503] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:42.297444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:42.298951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:42.329510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878f81-f200-4682-84d0-8ee208541f2f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:42.335697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:42.336723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:42.336723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:42.337319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:42.338728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:42.371165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:42.371165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:42.381752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2768/5504] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:48.826291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:48.827781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:48.855339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1757f-80a5-4b9a-a9a8-2486919a7851 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:48.882223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:48.882223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:48.882223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:48.882223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] PATH_INFO: `/v3/users/a239a0dd4451431aa7e3beea2d4b37aa` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:48.883703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a239a0dd4451431aa7e3beea2d4b37aa)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:48.901883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:49.272461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a239a0dd4451431aa7e3beea2d4b37aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:49.323135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a239a0dd4451431aa7e3beea2d4b37aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:49.382986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a239a0dd4451431aa7e3beea2d4b37aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:49.388570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a239a0dd4451431aa7e3beea2d4b37aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:49.513776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7da3cc10-8561-4661-8d13-e9a01777c271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a239a0dd4451431aa7e3beea2d4b37aa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:49.560117 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2737/5505] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:36:48 2022] DELETE /identity/v3/users/a239a0dd4451431aa7e3beea2d4b37aa => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:50.873196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:50.881885 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=77 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:50.896739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d580f-6616-4f8f-9e3d-9874de956a2b service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:51.066343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:51.068401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:51.068710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:51.069177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] PATH_INFO: `/v3/projects/c17c99eff277405da26bea01f0edfd17` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:51.094368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17c99eff277405da26bea01f0edfd17)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:51.100757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:51.378011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17c99eff277405da26bea01f0edfd17', 'request_id': 'req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:51.412876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17c99eff277405da26bea01f0edfd17', 'request_id': 'req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:51.652450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17c99eff277405da26bea01f0edfd17', 'request_id': 'req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:51.673318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] The token cache is being invalidate because project c17c99eff277405da26bea01f0edfd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:36:51.682641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:51.685354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-29f06fff-ec80-4b50-b11a-fdc2fb8c1a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:51.687626 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2769/5506] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:36:50 2022] DELETE /identity/v3/projects/c17c99eff277405da26bea01f0edfd17 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:51.692658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510fbe-670b-475d-80df-7f73b6d128e8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:51.693783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510fbe-670b-475d-80df-7f73b6d128e8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:51.694450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510fbe-670b-475d-80df-7f73b6d128e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:51.750569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fc510fbe-670b-475d-80df-7f73b6d128e8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:51.752141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fc510fbe-670b-475d-80df-7f73b6d128e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:51.915001 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2738/5507] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:51.916005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc3754-037e-43db-b26f-5c59a7f70f4c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:51.916491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc3754-037e-43db-b26f-5c59a7f70f4c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:51.916662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc3754-037e-43db-b26f-5c59a7f70f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:51.957120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b6cc3754-037e-43db-b26f-5c59a7f70f4c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:51.961257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6cc3754-037e-43db-b26f-5c59a7f70f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:51.986146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2770/5508] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:51.991151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc510fbe-670b-475d-80df-7f73b6d128e8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:52.006267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc510fbe-670b-475d-80df-7f73b6d128e8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:52.014766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:52.015876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:52.016412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:52.016992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:52.018720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:36:52.019287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:52.023911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:52.050962 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2739/5509] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:36:52.058247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc3754-037e-43db-b26f-5c59a7f70f4c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:52.075695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc3754-037e-43db-b26f-5c59a7f70f4c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:52.099487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:52.101047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:52.101505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:52.101984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:52.112757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:52.112757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:52.287319 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2771/5510] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:36:52 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:36:52.292279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:52.316051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c588d-b14b-4a16-8d23-5d597305c24b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:52.444966 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:52.481589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:52.482401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:52.483464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:52.484049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:52.484763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:52.486985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:52.635216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:52.638038 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2740/5511] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:36:52 2022] POST /identity/v3/users => generated 291 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:36:52.657115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b6c1-7ff8-45a2-8207-f55826b9c189 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:52.671350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:52.672083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:52.672488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:52.672874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:52.673627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:52.679069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:52.695876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2772/5512] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:36:52.717686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:52.732648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461fa4c-1585-410a-aa19-77416df3fdc8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:52.750078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ba51f-d30f-41eb-a7d0-4de9acb7ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:52.751371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ba51f-d30f-41eb-a7d0-4de9acb7ebf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:52.751892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ba51f-d30f-41eb-a7d0-4de9acb7ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:52.752418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ba51f-d30f-41eb-a7d0-4de9acb7ebf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:52.753447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ba51f-d30f-41eb-a7d0-4de9acb7ebf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:52.756109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ba51f-d30f-41eb-a7d0-4de9acb7ebf9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:52.795114 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2741/5513] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:36:52.806369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:52.819085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d6088-7021-4e2d-83b7-43ec7f232466 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:52.833346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:52.837314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:52.837929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:52.838712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] PATH_INFO: `/v3/projects/4a408cb14fce45368519810a3782889e/users/03e6cc8d3bcd49989e73622c99549cec/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:52.878511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a408cb14fce45368519810a3782889e, user_id=03e6cc8d3bcd49989e73622c99549cec, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:52.887770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:52.974651 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2773/5514] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:36:52 2022] PUT /identity/v3/projects/4a408cb14fce45368519810a3782889e/users/03e6cc8d3bcd49989e73622c99549cec/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:52.980058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:52.980452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:52.980877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:53.021236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:53.027023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:53.198910 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2742/5515] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:36:53.238954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:53.239855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:53.315278 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:53.372702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135991e8-5281-4f06-9ef6-f034f3fff518 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:53.393220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:53.396182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:53.396182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:53.396182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:53.421557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:53.441074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:53.450905 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2774/5516] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:54.631399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:54.633440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:54.653419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8775bed-ec96-4e44-8ab2-de4c006b3c64 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:54.667333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:54.672002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:54.672002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:54.672002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] PATH_INFO: `/v3/users/bdd1cb1110744fb486ce5703ec8e60c1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:54.672002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd1cb1110744fb486ce5703ec8e60c1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:54.678884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:55.042893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd1cb1110744fb486ce5703ec8e60c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:55.066297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd1cb1110744fb486ce5703ec8e60c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:55.080199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd1cb1110744fb486ce5703ec8e60c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:55.081957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd1cb1110744fb486ce5703ec8e60c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:55.190898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd1cb1110744fb486ce5703ec8e60c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:55.209083 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2743/5517] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:36:54 2022] DELETE /identity/v3/users/bdd1cb1110744fb486ce5703ec8e60c1 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:55.742297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:55.762764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c90d-eeb0-4299-b35e-d2d1befe58b9 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:55.917790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:55.918736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:55.919183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:55.921356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] PATH_INFO: `/v3/projects/b16eebe3879f4d9795819125e4a88f7b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:55.922913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16eebe3879f4d9795819125e4a88f7b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:55.925029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:56.140508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16eebe3879f4d9795819125e4a88f7b', 'request_id': 'req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:56.156334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16eebe3879f4d9795819125e4a88f7b', 'request_id': 'req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:56.265614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16eebe3879f4d9795819125e4a88f7b', 'request_id': 'req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:56.295250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] The token cache is being invalidate because project b16eebe3879f4d9795819125e4a88f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:36:56.295553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:56.302291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:56.312860 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2775/5518] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:36:55 2022] DELETE /identity/v3/projects/b16eebe3879f4d9795819125e4a88f7b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:56.314070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:56.315538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:56.343372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3ff06-acc0-47d2-a332-3da62ac6f9a5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:56.513376 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:56.700833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:56.700833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:56.700833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:56.700833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] PATH_INFO: `/v3/users/3549c664d5a64543b65d312b62df6b0e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:56.713550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3549c664d5a64543b65d312b62df6b0e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:56.716833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:57.022558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3549c664d5a64543b65d312b62df6b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:57.048933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3549c664d5a64543b65d312b62df6b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:57.067661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3549c664d5a64543b65d312b62df6b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:57.072139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3549c664d5a64543b65d312b62df6b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:57.156112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b3c0e9f1-523d-413f-a3bb-5cfaf73e61b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3549c664d5a64543b65d312b62df6b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:57.163793 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2744/5519] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:36:56 2022] DELETE /identity/v3/users/3549c664d5a64543b65d312b62df6b0e => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:58.048233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:58.051422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:58.076588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a90d1-f9f0-4108-bc8f-e3dab6722a43 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:58.215227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:58.216327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:58.216786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:58.217354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] PATH_INFO: `/v3/projects/6031be79f0ad481a9044530ccae99206` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:58.219295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6031be79f0ad481a9044530ccae99206)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:58.222351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:58.227007 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:58.359812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6031be79f0ad481a9044530ccae99206', 'request_id': 'req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:58.375121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6031be79f0ad481a9044530ccae99206', 'request_id': 'req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:58.465770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6031be79f0ad481a9044530ccae99206', 'request_id': 'req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:58.486300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] The token cache is being invalidate because project 6031be79f0ad481a9044530ccae99206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:36:58.486544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:58.487313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fd7d19fd-ab6a-48c1-8c5d-157b779c020d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:36:58.491929 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2776/5520] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:36:58 2022] DELETE /identity/v3/projects/6031be79f0ad481a9044530ccae99206 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:36:58.497131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f707-64bc-4099-ae45-38019b6724dd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:58.497607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f707-64bc-4099-ae45-38019b6724dd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:58.497691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f707-64bc-4099-ae45-38019b6724dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:58.538723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4422f707-64bc-4099-ae45-38019b6724dd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:58.540731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4422f707-64bc-4099-ae45-38019b6724dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:58.780593 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2745/5521] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:58.782770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede697-cc2e-4688-b23d-9cc12aebd2e6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:58.783072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede697-cc2e-4688-b23d-9cc12aebd2e6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:58.783338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede697-cc2e-4688-b23d-9cc12aebd2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:58.825926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-45ede697-cc2e-4688-b23d-9cc12aebd2e6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:58.827346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-45ede697-cc2e-4688-b23d-9cc12aebd2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:58.868386 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2777/5522] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:58.870141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422f707-64bc-4099-ae45-38019b6724dd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:58.885492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422f707-64bc-4099-ae45-38019b6724dd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:58.899735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:58.900455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:58.900738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:58.901012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:58.901724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:36:58.902388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:58.907644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:58.941401 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2746/5523] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:36:58.946250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede697-cc2e-4688-b23d-9cc12aebd2e6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:58.957922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede697-cc2e-4688-b23d-9cc12aebd2e6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:58.987793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:58.989557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:58.990157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:58.991444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:58.992169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:59.000159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:59.197029 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2778/5524] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:36:58 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:36:59.205511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:59.224939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c631-6a24-45f3-bc6d-badffdf1dd7a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:59.378682 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:59.412655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:59.413322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:59.413692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:59.413848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:59.414479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:59.416448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:59.549671 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2747/5525] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:36:59 2022] POST /identity/v3/users => generated 290 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:36:59.554818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:59.574125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27755d-80a2-45ab-9554-fa25d8784da0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:59.581918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:59.582576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:59.582856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:59.583133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:59.583789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:59.590957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:59.610033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2779/5526] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:36:59.613177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:59.636062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c295-f279-476e-b761-7b5e3f5756e5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:59.662976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e6667-26c6-4581-a364-b40e1da82458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:59.664021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6667-26c6-4581-a364-b40e1da82458 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:59.664476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6667-26c6-4581-a364-b40e1da82458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:59.664933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e6667-26c6-4581-a364-b40e1da82458 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:59.665920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e6667-26c6-4581-a364-b40e1da82458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:59.667786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e6667-26c6-4581-a364-b40e1da82458 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:59.688516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2748/5527] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:36:59.693236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:59.711115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4e61-203a-4d26-a794-354a408e2d43 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:59.716868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:59.717559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:59.717874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:59.718162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] PATH_INFO: `/v3/projects/44551141b439487386b79d9daa5b1ace/users/2680256107a841b6bba7b959a0952c02/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:59.737321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44551141b439487386b79d9daa5b1ace, user_id=2680256107a841b6bba7b959a0952c02, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:59.740720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:59.810834 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2780/5528] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:36:59 2022] PUT /identity/v3/projects/44551141b439487386b79d9daa5b1ace/users/2680256107a841b6bba7b959a0952c02/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:36:59.815800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:59.816416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:59.819698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:59.868330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:59.871118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:00.022686 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2749/5529] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:00.060923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:00.063410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:00.344242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c98d5-4515-4b2d-bde8-51e201ae3142 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:00.350261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:00.350876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:00.351156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:00.351430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:00.372759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:00.387711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:00.413368 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2781/5530] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:02.066096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:02.068775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:02.110889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823139c0-38d2-451a-9c5b-ac9eb2b8437a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:02.141781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e9be2-e84d-45bb-8483-ff854169aa39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:02.142457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e9be2-e84d-45bb-8483-ff854169aa39 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:02.148541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e9be2-e84d-45bb-8483-ff854169aa39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:02.148541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e9be2-e84d-45bb-8483-ff854169aa39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:02.161418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-616e9be2-e84d-45bb-8483-ff854169aa39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:02.275301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e9be2-e84d-45bb-8483-ff854169aa39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:02.278348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e9be2-e84d-45bb-8483-ff854169aa39 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:02.358493 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2750/5531] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:08.933110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:08.935168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:08.953559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559528-f433-41c2-9826-fbd65640483e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:08.960124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:08.961038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:08.961482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:08.961955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] PATH_INFO: `/v3/users/c10295ee56f14f8b9eb6bea840a6610c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:08.991434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10295ee56f14f8b9eb6bea840a6610c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:09.006070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:09.052489 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:09.331348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10295ee56f14f8b9eb6bea840a6610c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:09.333760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10295ee56f14f8b9eb6bea840a6610c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:09.443155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10295ee56f14f8b9eb6bea840a6610c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:09.458338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10295ee56f14f8b9eb6bea840a6610c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:09.460339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba69aca5-1f4e-4f02-b6d0-f3b3bd44436b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10295ee56f14f8b9eb6bea840a6610c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:09.499946 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2782/5532] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:08 2022] DELETE /identity/v3/users/c10295ee56f14f8b9eb6bea840a6610c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:10.352767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:10.353381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:10.353534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:10.408999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] MFA Rules not processed for user `03e6cc8d3bcd49989e73622c99549cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:10.411290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:10.560930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2751/5533] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:10.565291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:10.565860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:10.566097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:10.589124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] MFA Rules not processed for user `03e6cc8d3bcd49989e73622c99549cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:10.590793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:10.605030 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2783/5534] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:10.613063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:10.615426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:10.700053 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:10.765309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135121e0-299f-4b52-97a6-fd1e9a9bce6c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:10.789648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:10.790393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:10.790683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:10.790963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:10.837853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:10.839491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:10.871871 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2752/5535] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:11.561881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:11.569152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:11.692430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558100ec-7f75-4891-98f7-96bf6f996781 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:11.702000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:11.702000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:11.702000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:11.702000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] PATH_INFO: `/v3/projects/bdadda46353c4f438375aca89dbdb64e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:11.718259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdadda46353c4f438375aca89dbdb64e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:11.723844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:11.938746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdadda46353c4f438375aca89dbdb64e', 'request_id': 'req-8fc848c7-91e3-4943-8afc-5714e5828e4d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:11.964936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdadda46353c4f438375aca89dbdb64e', 'request_id': 'req-8fc848c7-91e3-4943-8afc-5714e5828e4d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.063747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdadda46353c4f438375aca89dbdb64e', 'request_id': 'req-8fc848c7-91e3-4943-8afc-5714e5828e4d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.079219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] The token cache is being invalidate because project bdadda46353c4f438375aca89dbdb64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:12.079860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.080694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.085767 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2784/5536] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:11 2022] DELETE /identity/v3/projects/bdadda46353c4f438375aca89dbdb64e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:12.086863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:12.100499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d4b76-25bd-474e-a846-99ed7241235f service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:12.173836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:12.174618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:12.174901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:12.175501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] PATH_INFO: `/v3/users/58913dfcbc49476283a7624dbc8e73cd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:12.191377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=58913dfcbc49476283a7624dbc8e73cd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:12.193888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:12.459822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58913dfcbc49476283a7624dbc8e73cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.487786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58913dfcbc49476283a7624dbc8e73cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.504590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58913dfcbc49476283a7624dbc8e73cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.506332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58913dfcbc49476283a7624dbc8e73cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.629099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-209bc178-27db-47db-aa00-f1c6095404bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58913dfcbc49476283a7624dbc8e73cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:12.641012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2753/5537] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:12 2022] DELETE /identity/v3/users/58913dfcbc49476283a7624dbc8e73cd => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:37:13.264749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:13.266765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:13.308600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc848c7-91e3-4943-8afc-5714e5828e4d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:13.329762 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:13.478569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:13.480067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:13.480772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:13.481577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] PATH_INFO: `/v3/projects/92222cad729c4a77a6fd9a98bbe0eb1e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:13.509613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92222cad729c4a77a6fd9a98bbe0eb1e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:13.512042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:13.703827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92222cad729c4a77a6fd9a98bbe0eb1e', 'request_id': 'req-66857930-3548-42a8-b109-ef8891800b15'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:13.731908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92222cad729c4a77a6fd9a98bbe0eb1e', 'request_id': 'req-66857930-3548-42a8-b109-ef8891800b15'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:13.801910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92222cad729c4a77a6fd9a98bbe0eb1e', 'request_id': 'req-66857930-3548-42a8-b109-ef8891800b15'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:13.852966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] The token cache is being invalidate because project 92222cad729c4a77a6fd9a98bbe0eb1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:13.852966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:13.856921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66857930-3548-42a8-b109-ef8891800b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:13.859534 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2785/5538] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:13 2022] DELETE /identity/v3/projects/92222cad729c4a77a6fd9a98bbe0eb1e => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:13.865789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c44c-ff7e-4775-b068-584102b58ac0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:13.867056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c44c-ff7e-4775-b068-584102b58ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:13.867580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c44c-ff7e-4775-b068-584102b58ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:13.954930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e6f1c44c-ff7e-4775-b068-584102b58ac0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:13.960718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6f1c44c-ff7e-4775-b068-584102b58ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:14.068949 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:14.131087 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2754/5539] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:14.132097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2561-a7b0-45ba-83f2-5fb10b042f82 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:14.132404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2561-a7b0-45ba-83f2-5fb10b042f82 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:14.132682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b2561-a7b0-45ba-83f2-5fb10b042f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:14.198405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-924b2561-a7b0-45ba-83f2-5fb10b042f82 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:14.211195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-924b2561-a7b0-45ba-83f2-5fb10b042f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:14.229265 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2786/5540] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:37:14.235348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c44c-ff7e-4775-b068-584102b58ac0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:14.253211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c44c-ff7e-4775-b068-584102b58ac0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:14.266126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:14.270398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:14.270398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:14.272350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:14.273601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:37:14.274826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:14.279949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:14.319830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b2561-a7b0-45ba-83f2-5fb10b042f82 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:14.335337 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2755/5541] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:37:14.336055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b2561-a7b0-45ba-83f2-5fb10b042f82 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:14.351952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:14.352944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:14.353458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:14.354017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:14.359390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:14.362483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:14.522435 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2787/5542] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:14 2022] POST /identity/v3/projects => generated 399 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:14.526499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:14.540300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ca3c-51fd-497d-82bf-dc3ad7ef4d05 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:14.652090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:14.652785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:14.653393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:14.653729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:14.669529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:14.671578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:14.823694 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2756/5543] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:14 2022] POST /identity/v3/users => generated 300 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:37:14.830880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:14.847440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9eaa8-4621-48a6-ba32-d780fb36dd5d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:14.861276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:14.870593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:14.871095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:14.871474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:14.872717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:14.878139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:14.917232 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2788/5544] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:14.921124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:14.935695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa340a7-d2dc-42dc-8c8a-d202f5e30ad1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:14.943248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d87b8-28fd-4193-99d5-1a15fffbb5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:14.944241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d87b8-28fd-4193-99d5-1a15fffbb5ef admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:14.945200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d87b8-28fd-4193-99d5-1a15fffbb5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:14.945638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d87b8-28fd-4193-99d5-1a15fffbb5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:14.946511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d87b8-28fd-4193-99d5-1a15fffbb5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:14.948962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d87b8-28fd-4193-99d5-1a15fffbb5ef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:15.033277 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2757/5545] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:15.038412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:15.056371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10abed1-b739-45b8-9fd0-c4e8421501a5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:15.075452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:15.076381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:15.076845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:15.077287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] PATH_INFO: `/v3/projects/6fca0156d15a4f7d94649ac102e81cb2/users/6dcec69c35ba44168d493b5de8c8b0d7/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:15.164371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fca0156d15a4f7d94649ac102e81cb2, user_id=6dcec69c35ba44168d493b5de8c8b0d7, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:15.177298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:15.381038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2789/5546] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:15 2022] PUT /identity/v3/projects/6fca0156d15a4f7d94649ac102e81cb2/users/6dcec69c35ba44168d493b5de8c8b0d7/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:15.386271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f6f0-4f00-4e06-b37a-2c39d39d9ee7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:15.386893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f6f0-4f00-4e06-b37a-2c39d39d9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:15.387375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f6f0-4f00-4e06-b37a-2c39d39d9ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:15.451806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7ae0f6f0-4f00-4e06-b37a-2c39d39d9ee7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:15.463266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7ae0f6f0-4f00-4e06-b37a-2c39d39d9ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:15.729372 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2758/5547] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:15.759393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:15.770739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:15.843013 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:15.908641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43ef56-14fb-4d0e-92f8-a67e7d8a33c5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:15.915113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:15.916598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:15.917178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:15.920417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:15.984956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:15.987082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:16.018796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2790/5548] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:20.343785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970a405-565f-4497-a4f2-183c0ce3ebbf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:20.344413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970a405-565f-4497-a4f2-183c0ce3ebbf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:20.344586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970a405-565f-4497-a4f2-183c0ce3ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:20.402580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5970a405-565f-4497-a4f2-183c0ce3ebbf None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:20.407667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5970a405-565f-4497-a4f2-183c0ce3ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:20.471190 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:20.541648 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2759/5549] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:20.546773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:20.549009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:20.575177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79809297-a0ea-4506-84e1-9ed48b122073 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:20.591591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:20.592425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:20.592955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:20.593400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:20.594252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:20.596633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:20.743018 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2791/5550] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:20 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:20.746472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970a405-565f-4497-a4f2-183c0ce3ebbf None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:20.771919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970a405-565f-4497-a4f2-183c0ce3ebbf None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:20.909504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:20.911045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:20.912453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:20.912949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:20.914368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:20.919967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:21.041140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:21.051135 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2760/5551] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:20 2022] POST /identity/v3/users => generated 296 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:21.066850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b8132-501f-4212-80a6-7907204a6ba2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:21.083125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:21.083769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:21.087759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:21.088270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:21.089135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:21.093302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:21.119502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:21.127408 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2792/5552] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:21.136198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3c21f-ffad-467f-9e2d-09b3ab5614e8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:21.148286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:21.150310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:21.151498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:21.154644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] PATH_INFO: `/v3/projects/88579203ca1b4d8fa92bac6eea795745/users/037c1a7dab6247f2b33162ca5b296747/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:21.191162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=88579203ca1b4d8fa92bac6eea795745, user_id=037c1a7dab6247f2b33162ca5b296747, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:21.212435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:21.369634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:21.370026 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2761/5553] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:21 2022] PUT /identity/v3/projects/88579203ca1b4d8fa92bac6eea795745/users/037c1a7dab6247f2b33162ca5b296747/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:21.405945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafb19-8c88-464c-a0e6-5cec9515c6c9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:21.566164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:21.567875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:21.568171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:21.568494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:21.569160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:21.573208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:21.611247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:21.619156 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2793/5554] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:37:21.636406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17113f3-43b3-4b38-aeb8-840e663c0ecc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:21.657839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:21.663238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:21.666090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:21.676486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:21.676774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:21.677056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] PATH_INFO: `/v3/projects/88579203ca1b4d8fa92bac6eea795745/users/037c1a7dab6247f2b33162ca5b296747/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:21.682001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88579203ca1b4d8fa92bac6eea795745, user_id=037c1a7dab6247f2b33162ca5b296747, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:21.684676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:21.694666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af16fa-df34-48d6-a137-00ca9ffc8b2a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:21.708296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:21.709206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:21.709695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:21.710271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] PATH_INFO: `/v3/users/eaf9d78c85244936b0a97356afb50071` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:21.712956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf9d78c85244936b0a97356afb50071)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:21.718805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:21.736695 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2762/5555] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:21 2022] PUT /identity/v3/projects/88579203ca1b4d8fa92bac6eea795745/users/037c1a7dab6247f2b33162ca5b296747/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:22.028434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf9d78c85244936b0a97356afb50071'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:22.031016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf9d78c85244936b0a97356afb50071'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:22.112600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf9d78c85244936b0a97356afb50071'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:22.124417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf9d78c85244936b0a97356afb50071'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:22.125713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-07736308-0465-4ef9-bed4-0471cc171e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf9d78c85244936b0a97356afb50071'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:22.182538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2794/5556] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:21 2022] DELETE /identity/v3/users/eaf9d78c85244936b0a97356afb50071 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:23.848634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:23.852934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:24.025315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca666-a843-47bb-a281-cdad6ff553e9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:24.096439 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:24.163734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:24.164413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:24.164701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:24.164983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] PATH_INFO: `/v3/projects/b8ec907722f944929ff367d619ea4a28` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:24.166570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ec907722f944929ff367d619ea4a28)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:24.168867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:24.385222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ec907722f944929ff367d619ea4a28', 'request_id': 'req-d8a5d338-8802-4684-80d0-cb02f0bdc403'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:24.392829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ec907722f944929ff367d619ea4a28', 'request_id': 'req-d8a5d338-8802-4684-80d0-cb02f0bdc403'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:24.476699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ec907722f944929ff367d619ea4a28', 'request_id': 'req-d8a5d338-8802-4684-80d0-cb02f0bdc403'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:24.499192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] The token cache is being invalidate because project b8ec907722f944929ff367d619ea4a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:24.499501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:24.500187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d8a5d338-8802-4684-80d0-cb02f0bdc403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:24.501754 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2763/5557] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:23 2022] DELETE /identity/v3/projects/b8ec907722f944929ff367d619ea4a28 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:24.507852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c28b51-94a2-494f-832b-f5a6cebf686a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:24.508851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c28b51-94a2-494f-832b-f5a6cebf686a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:24.509360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c28b51-94a2-494f-832b-f5a6cebf686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:24.522912 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:24.555824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c2c28b51-94a2-494f-832b-f5a6cebf686a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:24.557080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2c28b51-94a2-494f-832b-f5a6cebf686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:24.710099 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2795/5558] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:24.712251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73dd5-c49e-429c-9b47-b30b4da7731c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:24.712535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73dd5-c49e-429c-9b47-b30b4da7731c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:24.712807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73dd5-c49e-429c-9b47-b30b4da7731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:24.752025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a3d73dd5-c49e-429c-9b47-b30b4da7731c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:24.753326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a3d73dd5-c49e-429c-9b47-b30b4da7731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:24.781258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2764/5559] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:24.783705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c28b51-94a2-494f-832b-f5a6cebf686a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:24.802936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c28b51-94a2-494f-832b-f5a6cebf686a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:24.812311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:24.814225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:24.814225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:24.814225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:24.814225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:37:24.814585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:24.816042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:24.858044 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2796/5560] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:37:24.859658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73dd5-c49e-429c-9b47-b30b4da7731c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:24.875255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73dd5-c49e-429c-9b47-b30b4da7731c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:24.889691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:24.890419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:24.890684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:24.890961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:24.891610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:24.893543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:24.995585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2765/5561] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:24 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:25.000218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:25.017433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a342b4-55db-4762-810d-ecfe7ac01a01 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:25.157269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:25.157985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:25.158265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:25.158542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:25.159870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:25.164328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:25.269662 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2797/5562] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:24 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:25.274917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:25.292624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c94444-ca1b-4005-a387-304239859688 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:25.326441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:25.330450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:25.330738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:25.331009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:25.331709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:25.333829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:25.390290 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2766/5563] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:25.398032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:25.412677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7d6c-7305-40b6-b89f-981956ecf755 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:25.427921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419f261-7d89-40ef-aa26-25cd2f3bd40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:25.428552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f261-7d89-40ef-aa26-25cd2f3bd40e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:25.428884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f261-7d89-40ef-aa26-25cd2f3bd40e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:25.429164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f261-7d89-40ef-aa26-25cd2f3bd40e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:25.430240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419f261-7d89-40ef-aa26-25cd2f3bd40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:25.431929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419f261-7d89-40ef-aa26-25cd2f3bd40e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:25.466505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2798/5564] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:25.470791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:25.491212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055f0f8-50a3-4b70-aaf8-2c4428414111 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:25.497093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f769fb9-9feb-463d-8892-1362df160871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:25.498012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f769fb9-9feb-463d-8892-1362df160871 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:25.498299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f769fb9-9feb-463d-8892-1362df160871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:25.498578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f769fb9-9feb-463d-8892-1362df160871 admin admin] PATH_INFO: `/v3/projects/e06ea9e5a62046328c89ec72043a88a8/users/925d1460c9c04b14afe68794811e6f69/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:25.540508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f769fb9-9feb-463d-8892-1362df160871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06ea9e5a62046328c89ec72043a88a8, user_id=925d1460c9c04b14afe68794811e6f69, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:25.562214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f769fb9-9feb-463d-8892-1362df160871 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:25.643408 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2767/5565] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:25 2022] PUT /identity/v3/projects/e06ea9e5a62046328c89ec72043a88a8/users/925d1460c9c04b14afe68794811e6f69/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:25.658067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:25.659135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:25.659619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:25.752861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] MFA Rules not processed for user `925d1460c9c04b14afe68794811e6f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:25.754245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:25.930382 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2799/5566] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:25.940787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:25.941939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:25.942120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:25.978918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] MFA Rules not processed for user `925d1460c9c04b14afe68794811e6f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:25.985702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:26.007014 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2768/5567] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:26.034899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:26.036811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:26.115574 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:26.231513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5ca1-ddc1-4160-bb87-b1c742fe54b9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:26.246682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e95aa-8c5e-4835-acec-51b4a63f54b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:26.247335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e95aa-8c5e-4835-acec-51b4a63f54b5 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:26.247622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e95aa-8c5e-4835-acec-51b4a63f54b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:26.247896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e95aa-8c5e-4835-acec-51b4a63f54b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:26.262828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e95aa-8c5e-4835-acec-51b4a63f54b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:26.264464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e95aa-8c5e-4835-acec-51b4a63f54b5 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:26.276687 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2800/5568] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:29.739637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:29.741086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:29.854995 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:29.883054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7005bf-cbc5-4077-b7ce-f081fbd12c90 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:29.888595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:29.889520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:29.890253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:29.890707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] PATH_INFO: `/v3/users/25c450da892f47a6a31149f0796fb363` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:29.911963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c450da892f47a6a31149f0796fb363)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:29.916267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:30.183004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c450da892f47a6a31149f0796fb363'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:30.227319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c450da892f47a6a31149f0796fb363'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:30.245525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c450da892f47a6a31149f0796fb363'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:30.247274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c450da892f47a6a31149f0796fb363'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:30.373962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-388e4a89-46ae-4350-a717-380e8b90b1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c450da892f47a6a31149f0796fb363'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:30.383283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2769/5569] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:29 2022] DELETE /identity/v3/users/25c450da892f47a6a31149f0796fb363 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:37:31.027149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:31.027644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:31.027733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:31.077728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] MFA Rules not processed for user `6dcec69c35ba44168d493b5de8c8b0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:31.079446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:31.211020 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2801/5570] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:31.221141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:31.221998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:31.231167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:31.266981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] MFA Rules not processed for user `6dcec69c35ba44168d493b5de8c8b0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:31.270622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:31.307441 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2770/5571] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:31.317039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:31.318207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:31.578904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85124b-cbc5-49f9-bb25-70192d66d47b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:31.596196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:31.596955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:31.597121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:31.598264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:31.634137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:31.640044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:31.656474 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:31.680162 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2802/5572] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:31.748552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:31.752814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:32.033676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383841e6-ba2b-4f8e-be00-75b09f201b3c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:32.047035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:32.047830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:32.048207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:32.048729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] PATH_INFO: `/v3/projects/9d460c0d46f84be186271ba796fd7b05` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:32.080654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d460c0d46f84be186271ba796fd7b05)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:32.082729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:32.279824 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:32.289140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d460c0d46f84be186271ba796fd7b05', 'request_id': 'req-5d97bbea-2e84-4e13-a552-7be81737fa34'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.302176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d460c0d46f84be186271ba796fd7b05', 'request_id': 'req-5d97bbea-2e84-4e13-a552-7be81737fa34'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.362656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d460c0d46f84be186271ba796fd7b05', 'request_id': 'req-5d97bbea-2e84-4e13-a552-7be81737fa34'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.398880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] The token cache is being invalidate because project 9d460c0d46f84be186271ba796fd7b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:32.399554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.400483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.409453 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2771/5573] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:31 2022] DELETE /identity/v3/projects/9d460c0d46f84be186271ba796fd7b05 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:32.413641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:32.444454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8850ee-4e76-4c27-9ff4-f149a67ba185 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:32.537367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:32.538722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:32.539273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:32.539888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] PATH_INFO: `/v3/users/17eadd6b4bd649119d76573f2279eae0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:32.541624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17eadd6b4bd649119d76573f2279eae0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:32.543976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:32.820728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17eadd6b4bd649119d76573f2279eae0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.823495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17eadd6b4bd649119d76573f2279eae0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.939194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17eadd6b4bd649119d76573f2279eae0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.951086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17eadd6b4bd649119d76573f2279eae0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.953351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17eadd6b4bd649119d76573f2279eae0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:32.997913 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2803/5574] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:32 2022] DELETE /identity/v3/users/17eadd6b4bd649119d76573f2279eae0 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:33.724726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:33.726981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:33.746973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:33.748571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:33.763492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97bbea-2e84-4e13-a552-7be81737fa34 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:33.963516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:33.963516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:33.963516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:33.964007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] PATH_INFO: `/v3/users/b1f56e655ef94e41b86df2eeb69fbd9d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:33.965465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f56e655ef94e41b86df2eeb69fbd9d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:33.967434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359181e-cd98-434e-a22c-46a900fc35c0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:33.967864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:33.980116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:33.981100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:33.981357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:33.981633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] PATH_INFO: `/v3/projects/5f1339cd1c4649c2840ab9a2f565beb6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:34.009671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1339cd1c4649c2840ab9a2f565beb6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:34.011814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:34.052129 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:34.263923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1339cd1c4649c2840ab9a2f565beb6', 'request_id': 'req-51bf2af9-413b-47ce-b62b-169f38b02710'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.272783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f56e655ef94e41b86df2eeb69fbd9d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.297432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1339cd1c4649c2840ab9a2f565beb6', 'request_id': 'req-51bf2af9-413b-47ce-b62b-169f38b02710'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.321799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f56e655ef94e41b86df2eeb69fbd9d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.347865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f56e655ef94e41b86df2eeb69fbd9d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.349457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f56e655ef94e41b86df2eeb69fbd9d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.425793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1339cd1c4649c2840ab9a2f565beb6', 'request_id': 'req-51bf2af9-413b-47ce-b62b-169f38b02710'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.446879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] The token cache is being invalidate because project 5f1339cd1c4649c2840ab9a2f565beb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:34.447557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.450684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-51bf2af9-413b-47ce-b62b-169f38b02710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.456096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2804/5575] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:33 2022] DELETE /identity/v3/projects/5f1339cd1c4649c2840ab9a2f565beb6 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:37:34.461708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e904c8-bcbb-4754-9074-6b45ea7968db None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:34.462809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e904c8-bcbb-4754-9074-6b45ea7968db None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:34.463453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e904c8-bcbb-4754-9074-6b45ea7968db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:34.505501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8686ba69-1da6-4d65-8476-ebf870b0308c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f56e655ef94e41b86df2eeb69fbd9d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:34.512822 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2772/5576] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:33 2022] DELETE /identity/v3/users/b1f56e655ef94e41b86df2eeb69fbd9d => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:34.516944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b337b-8408-4b75-9d62-2f112d7d6b0d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:34.517334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b337b-8408-4b75-9d62-2f112d7d6b0d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:34.517623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b337b-8408-4b75-9d62-2f112d7d6b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:34.532375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b6e904c8-bcbb-4754-9074-6b45ea7968db None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:34.538678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6e904c8-bcbb-4754-9074-6b45ea7968db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:34.593735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-832b337b-8408-4b75-9d62-2f112d7d6b0d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:34.609885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-832b337b-8408-4b75-9d62-2f112d7d6b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:34.753109 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2805/5577] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:34.763664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d46b8-a672-4aca-b65b-c557ac42dbad None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:34.763960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d46b8-a672-4aca-b65b-c557ac42dbad None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:34.764242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d46b8-a672-4aca-b65b-c557ac42dbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:34.794612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0d5d46b8-a672-4aca-b65b-c557ac42dbad None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:34.795951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0d5d46b8-a672-4aca-b65b-c557ac42dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:34.811888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2806/5578] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:37:34.819117 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:34.821563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d46b8-a672-4aca-b65b-c557ac42dbad None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:34.843137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d46b8-a672-4aca-b65b-c557ac42dbad None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:34.853321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:34.853955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:34.854437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:34.854722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:34.855568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:37:34.856092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:34.858553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:34.881995 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2773/5579] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:34.891274 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2807/5580] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:37:34.895282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b337b-8408-4b75-9d62-2f112d7d6b0d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:34.896540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:34.900668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:34.922516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b337b-8408-4b75-9d62-2f112d7d6b0d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:34.938762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:34.939799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:34.940302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:34.940969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:34.941955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:34.944459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:35.037095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6447b8-997d-48f6-9e72-c17a17c6d4c6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:35.047384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:35.049272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:35.049568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:35.052955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:35.130896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:35.134738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:35.137478 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2774/5581] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:34 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:35.139606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:35.175337 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2808/5582] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:35.444720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cbb01-bfbb-4f78-88d2-ebf914a46092 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:35.458238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:35.458985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:35.463190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:35.463489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:35.464181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:35.466214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:35.600659 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2775/5583] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:35 2022] POST /identity/v3/users => generated 294 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:35.601873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:35.616940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160a1d-8c64-454d-8d85-2443861c1539 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:35.655219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:35.655870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:35.656148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:35.664551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:35.664551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:35.666065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:35.699876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2809/5584] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:35.703928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:35.731602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737b252-a184-4beb-914b-ee266983b64a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:35.759315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:35.761220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:35.763421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:35.765360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:35.766365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:35.777063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:35.814693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:35.829601 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2776/5585] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:35.857331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1c9b9-1786-4d3f-9d8f-d5ecb9c319f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:35.864754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:35.867084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:35.873282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:35.875583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:35.875876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:35.879082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] PATH_INFO: `/v3/projects/bcc77666821f402ea0b07397a5771ffb/users/619ae5b10f9146fc910aa7bd9765c9e2/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:35.911103 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:35.931674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc77666821f402ea0b07397a5771ffb, user_id=619ae5b10f9146fc910aa7bd9765c9e2, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:35.949686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:36.000239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea458d-bc4f-4b4a-95f2-bdaeefb8eaaa admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:36.008928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650bf12-323d-4f46-bf06-46b704f94a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:36.010035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650bf12-323d-4f46-bf06-46b704f94a82 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:36.010515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650bf12-323d-4f46-bf06-46b704f94a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:36.010956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650bf12-323d-4f46-bf06-46b704f94a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:36.020025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b650bf12-323d-4f46-bf06-46b704f94a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:36.099520 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2810/5586] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:35 2022] PUT /identity/v3/projects/bcc77666821f402ea0b07397a5771ffb/users/619ae5b10f9146fc910aa7bd9765c9e2/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:37:36.103187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:36.105804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:36.155706 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:36.194991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650bf12-323d-4f46-bf06-46b704f94a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:36.195488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650bf12-323d-4f46-bf06-46b704f94a82 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:36.224093 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2777/5587] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:36.229536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9564-4e87-4b83-a392-8a8eac1db140 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:36.230670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9564-4e87-4b83-a392-8a8eac1db140 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:36.230670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d9564-4e87-4b83-a392-8a8eac1db140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:36.282079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-674d9564-4e87-4b83-a392-8a8eac1db140 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:36.285672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-674d9564-4e87-4b83-a392-8a8eac1db140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:36.368165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff39b-12f1-412e-b6dc-c6288587ebd0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:36.383573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:36.384502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:36.385636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:36.386109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] PATH_INFO: `/v3/projects/daa8127959ef4a5790a073d2567d827c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:36.390175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa8127959ef4a5790a073d2567d827c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:36.393056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:36.617622 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2778/5588] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:36.629224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d9564-4e87-4b83-a392-8a8eac1db140 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:36.631374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa8127959ef4a5790a073d2567d827c', 'request_id': 'req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:36.639047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa8127959ef4a5790a073d2567d827c', 'request_id': 'req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:36.710219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d9564-4e87-4b83-a392-8a8eac1db140 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:36.749207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa8127959ef4a5790a073d2567d827c', 'request_id': 'req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:36.801235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] The token cache is being invalidate because project daa8127959ef4a5790a073d2567d827c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:36.801462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:36.816102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c2c319b-f9ab-4ee3-9c3e-e299cc464ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:36.818872 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2811/5589] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:36 2022] DELETE /identity/v3/projects/daa8127959ef4a5790a073d2567d827c => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:36.836745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b05099-6790-4024-8613-271c0ada5ffc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:36.837426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b05099-6790-4024-8613-271c0ada5ffc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:36.837948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b05099-6790-4024-8613-271c0ada5ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:36.844124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:36.846401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:36.846801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:36.846994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:36.853368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:36.868044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-28b05099-6790-4024-8613-271c0ada5ffc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:36.869481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-28b05099-6790-4024-8613-271c0ada5ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:36.992962 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:36.996161 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2812/5590] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:36.997404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:36.999166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:37.002120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5bda1-12ba-4130-a23c-846b8db49f8e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:37.002662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5bda1-12ba-4130-a23c-846b8db49f8e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:37.003147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5bda1-12ba-4130-a23c-846b8db49f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:37.045152 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2779/5591] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:37.049408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-55c5bda1-12ba-4130-a23c-846b8db49f8e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:37.051144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-55c5bda1-12ba-4130-a23c-846b8db49f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:37.073060 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2813/5592] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:37.077620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:37.097002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae558986-8d1c-4a48-83c5-c639ca475c45 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:37.119153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:37.122266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:37.122679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:37.123376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:37.125077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:37:37.126841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:37.132477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:37.164298 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2780/5593] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:37:37.165670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5bda1-12ba-4130-a23c-846b8db49f8e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:37.179587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5bda1-12ba-4130-a23c-846b8db49f8e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:37.207384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:37.208026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:37.211937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:37.212262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:37.217340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:37.220231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:37.246233 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:37.350348 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2814/5594] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:37 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:37.354303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:37.389269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452095e1-87e0-4131-94a9-43d29551ae24 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:37.533671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:37.534362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:37.534696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:37.538433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:37.538433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:37.538433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:37.688986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2781/5595] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:37 2022] POST /identity/v3/users => generated 295 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:37.692942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:37.732571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad08a4-6434-4692-aacb-8df25a703acc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:37.752666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:37.754244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:37.754853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:37.755407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:37.756112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:37.761368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:37.791743 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2815/5596] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:37.799712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:37.810765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7edcbf-bf84-427f-9ee2-282e55019320 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:37.822477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f3c81-6138-4ee8-9de9-60fb71f4813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:37.823132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3c81-6138-4ee8-9de9-60fb71f4813a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:37.823418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3c81-6138-4ee8-9de9-60fb71f4813a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:37.824191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3c81-6138-4ee8-9de9-60fb71f4813a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:37.824864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f3c81-6138-4ee8-9de9-60fb71f4813a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:37.826844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f3c81-6138-4ee8-9de9-60fb71f4813a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:37.846105 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2782/5597] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:37.850952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:37.863913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20041010-951e-45a5-b462-c393236ef811 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:37.883881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:37.884931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:37.885424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:37.885952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] PATH_INFO: `/v3/projects/89bbfa6491f343ea9f7fd035973495d7/users/0a6cd442aacc4d6c949b9714afd9aac8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:37.938537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bbfa6491f343ea9f7fd035973495d7, user_id=0a6cd442aacc4d6c949b9714afd9aac8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:37.942475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:38.065098 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2816/5598] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:37 2022] PUT /identity/v3/projects/89bbfa6491f343ea9f7fd035973495d7/users/0a6cd442aacc4d6c949b9714afd9aac8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:37:38.076959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5963a78-e247-4777-9166-d454651d3f81 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:38.077269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5963a78-e247-4777-9166-d454651d3f81 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:38.077547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5963a78-e247-4777-9166-d454651d3f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:38.136924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a5963a78-e247-4777-9166-d454651d3f81 None None] MFA Rules not processed for user `0a6cd442aacc4d6c949b9714afd9aac8`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:38.138957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a5963a78-e247-4777-9166-d454651d3f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:38.396389 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2783/5599] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:38.473659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:38.476436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:38.537408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705502b8-d809-489d-864f-c43e35ea1c7e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:38.537719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705502b8-d809-489d-864f-c43e35ea1c7e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:38.538138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705502b8-d809-489d-864f-c43e35ea1c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:38.639413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b12c4-b905-462a-91e5-b16aa1680100 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:38.643714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-705502b8-d809-489d-864f-c43e35ea1c7e None None] MFA Rules not processed for user `037c1a7dab6247f2b33162ca5b296747`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:38.646539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-705502b8-d809-489d-864f-c43e35ea1c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:38.649916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:38.653031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:38.654825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:38.655304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:38.678702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:38.682605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:38.709715 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2817/5600] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:38.828581 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:38.951405 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2784/5601] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:37:38.967890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:38.970380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:39.149066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2709ee-7101-434c-89ba-586495a7188b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:39.160801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:39.162911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:39.163302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:39.163643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:39.197007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:39.203571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:39.248000 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2818/5602] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:39.692652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705502b8-d809-489d-864f-c43e35ea1c7e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:39.715559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705502b8-d809-489d-864f-c43e35ea1c7e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:39.728250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:39.729086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:39.729368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:39.729640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:39.734695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:39.866751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:39.868530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:39.882896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2785/5603] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:41.006797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:41.038222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2ea85-5b57-4670-a670-73396ecaf79d service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:41.056833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e28f1-bdc0-4822-83f9-6ec18c7c224e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:41.057640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e28f1-bdc0-4822-83f9-6ec18c7c224e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:41.058048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e28f1-bdc0-4822-83f9-6ec18c7c224e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:41.058418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e28f1-bdc0-4822-83f9-6ec18c7c224e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:41.066900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1f2e28f1-bdc0-4822-83f9-6ec18c7c224e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:41.195908 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:41.241702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e28f1-bdc0-4822-83f9-6ec18c7c224e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:41.243333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e28f1-bdc0-4822-83f9-6ec18c7c224e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:41.277327 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2819/5604] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:41.715736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:41.723371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:41.914755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902e5e3-3479-4e73-96e7-94436e3f23f0 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:41.931624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:41.932443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:41.932835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:41.933219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] PATH_INFO: `/v3/users/925d1460c9c04b14afe68794811e6f69` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:41.934613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=925d1460c9c04b14afe68794811e6f69)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:41.936656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:42.210953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925d1460c9c04b14afe68794811e6f69'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:42.238159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925d1460c9c04b14afe68794811e6f69'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:42.259364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925d1460c9c04b14afe68794811e6f69'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:42.260622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925d1460c9c04b14afe68794811e6f69'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:42.269788 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:42.362506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925d1460c9c04b14afe68794811e6f69'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:42.374546 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2786/5605] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:41 2022] DELETE /identity/v3/users/925d1460c9c04b14afe68794811e6f69 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:42.376138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ad7fe-6800-424b-bbb4-c5c46df5c4c4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:42.376614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ad7fe-6800-424b-bbb4-c5c46df5c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:42.376859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ad7fe-6800-424b-bbb4-c5c46df5c4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:42.421421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c02ad7fe-6800-424b-bbb4-c5c46df5c4c4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:42.427070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c02ad7fe-6800-424b-bbb4-c5c46df5c4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:42.599780 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2820/5606] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:42.672424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:42.674112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:42.847702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417db23-6abe-4254-8677-d032f7d4ba9f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:42.859134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:42.864314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:42.864314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:42.874244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:42.903982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:42.907286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:42.931803 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2787/5607] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:44.991754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb849be-7867-460b-8efb-b89b99ba5ffe None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:44.992402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb849be-7867-460b-8efb-b89b99ba5ffe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:44.992402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb849be-7867-460b-8efb-b89b99ba5ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:45.051541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2fb849be-7867-460b-8efb-b89b99ba5ffe None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:45.052937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2fb849be-7867-460b-8efb-b89b99ba5ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:45.163507 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2821/5608] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:46.589620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:46.591971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:46.624950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c415859-ce03-43d2-8a3d-8009d1e3e0f6 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:46.643105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:46.644944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:46.645393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:46.645852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] PATH_INFO: `/v3/projects/e06ea9e5a62046328c89ec72043a88a8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:46.652958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06ea9e5a62046328c89ec72043a88a8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:46.655301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:46.884718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06ea9e5a62046328c89ec72043a88a8', 'request_id': 'req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:46.898432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06ea9e5a62046328c89ec72043a88a8', 'request_id': 'req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:47.037473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06ea9e5a62046328c89ec72043a88a8', 'request_id': 'req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:47.078160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] The token cache is being invalidate because project e06ea9e5a62046328c89ec72043a88a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:47.078454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:47.083789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6fd30a5c-2ee4-4b66-8287-8eb2cc5ba973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:47.088723 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2788/5609] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:46 2022] DELETE /identity/v3/projects/e06ea9e5a62046328c89ec72043a88a8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:47.093772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e826f-ea35-4b9a-9284-ac1880614e05 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:47.094305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e826f-ea35-4b9a-9284-ac1880614e05 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:47.094501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e826f-ea35-4b9a-9284-ac1880614e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:47.138440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-496e826f-ea35-4b9a-9284-ac1880614e05 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:47.140082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-496e826f-ea35-4b9a-9284-ac1880614e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:47.391697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa12df3-1114-49ba-9871-cd9913adcad7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:47.392240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2822/5610] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:47.392638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa12df3-1114-49ba-9871-cd9913adcad7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:47.393148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa12df3-1114-49ba-9871-cd9913adcad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:47.484895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2fa12df3-1114-49ba-9871-cd9913adcad7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:47.486173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2fa12df3-1114-49ba-9871-cd9913adcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:47.526873 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2789/5611] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:37:47.528479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e826f-ea35-4b9a-9284-ac1880614e05 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:47.544434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e826f-ea35-4b9a-9284-ac1880614e05 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:47.575486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:47.581779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:47.582478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:47.582963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:47.596273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:37:47.600646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:47.602762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:47.656123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa12df3-1114-49ba-9871-cd9913adcad7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:47.656707 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2823/5612] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:37:47.671999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa12df3-1114-49ba-9871-cd9913adcad7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:47.698390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:47.700311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:47.700883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:47.701394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:47.702297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:47.704461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:47.857708 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2790/5613] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:47 2022] POST /identity/v3/projects => generated 403 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:37:47.868112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:47.885181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f85e-0d73-429a-89fe-1960aa7faca2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:47.938939 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:48.155495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:48.156188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:48.156400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:48.156675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:48.157319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:48.159299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:48.317899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2824/5614] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:47 2022] POST /identity/v3/users => generated 302 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:48.319790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:48.344144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078b51-0a6a-4523-992a-813c41c77058 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:48.373517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:48.375601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:48.377065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:48.377504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:48.378453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:48.380598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:48.407186 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2791/5615] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:48.407954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:48.431429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930943b3-24e5-40bb-b19d-6100d82acd8c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:48.445351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:48.446284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:48.446844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:48.447287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:48.448119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:48.458030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:48.481532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:48.483341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:48.484735 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2825/5616] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:48.492858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:48.508447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746764-804e-4064-88ae-d7f9390fc494 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:48.521280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3366d8-73ff-4fe5-867b-f93c38f5618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:48.522172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3366d8-73ff-4fe5-867b-f93c38f5618d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:48.522458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3366d8-73ff-4fe5-867b-f93c38f5618d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:48.523346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3366d8-73ff-4fe5-867b-f93c38f5618d admin admin] PATH_INFO: `/v3/projects/206ea2d869194c1888f633e3afbc289e/users/a25fe045e6624b6fb01deb43fcc311d5/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:48.562377 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:48.564503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3366d8-73ff-4fe5-867b-f93c38f5618d admin admin] RBAC: Authorizing `identity:create_grant(project_id=206ea2d869194c1888f633e3afbc289e, user_id=a25fe045e6624b6fb01deb43fcc311d5, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:48.568281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3366d8-73ff-4fe5-867b-f93c38f5618d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:48.586120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3af624-5849-48f9-a607-5af146c782b2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:48.592043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:48.600705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:48.601928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:48.602556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:48.605675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:48.644640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:48.646805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:48.650147 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2826/5617] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:48 2022] PUT /identity/v3/projects/206ea2d869194c1888f633e3afbc289e/users/a25fe045e6624b6fb01deb43fcc311d5/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:37:48.664384 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2792/5618] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:48.664882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b794-6e07-4166-92d4-6be73e4e0818 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:48.665119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b794-6e07-4166-92d4-6be73e4e0818 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:48.665228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b794-6e07-4166-92d4-6be73e4e0818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:48.740263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bf82b794-6e07-4166-92d4-6be73e4e0818 None None] MFA Rules not processed for user `a25fe045e6624b6fb01deb43fcc311d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:48.741513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bf82b794-6e07-4166-92d4-6be73e4e0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:48.925716 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2827/5619] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:37:48.937642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:48.962122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac40c0-9be6-4388-8ede-090d0f696194 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:49.111356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:49.111930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:49.112439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:49.112563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] PATH_INFO: `/v3/users/a25fe045e6624b6fb01deb43fcc311d5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:49.113938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25fe045e6624b6fb01deb43fcc311d5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:49.122119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:49.139528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702cff-1dd5-446e-9ff9-8701ae7f33e2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:49.139808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702cff-1dd5-446e-9ff9-8701ae7f33e2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:49.140081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68702cff-1dd5-446e-9ff9-8701ae7f33e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:49.246675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-68702cff-1dd5-446e-9ff9-8701ae7f33e2 None None] MFA Rules not processed for user `619ae5b10f9146fc910aa7bd9765c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:49.248450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-68702cff-1dd5-446e-9ff9-8701ae7f33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:49.332946 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:49.357851 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2828/5620] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:49.365749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:49.366695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:49.367867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:49.412592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25fe045e6624b6fb01deb43fcc311d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:49.438117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] MFA Rules not processed for user `619ae5b10f9146fc910aa7bd9765c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:49.440295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:49.448313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25fe045e6624b6fb01deb43fcc311d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:49.454120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2829/5621] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:49.466367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:49.468861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:49.475888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25fe045e6624b6fb01deb43fcc311d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:49.476244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25fe045e6624b6fb01deb43fcc311d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:49.579330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ace861f-4a2d-4d38-9628-99c9f757fbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25fe045e6624b6fb01deb43fcc311d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:49.593551 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2793/5622] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:48 2022] DELETE /identity/v3/users/a25fe045e6624b6fb01deb43fcc311d5 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:49.596436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:49.596936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:49.598043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:49.634318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:49.639180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:49.658566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee3f58-2563-4c61-9f23-327a17621640 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:49.793647 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2794/5623] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:37:49.807577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:49.807577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:49.814711 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:49.832410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:49.833310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:49.833603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:49.833907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:49.838975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:49.948654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e917f1-14f1-4b39-bae4-1273c53365a1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:49.953107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:49.953716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:49.954825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:49.955105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:49.968544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:49.971661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:49.984911 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2795/5624] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:37:50.087634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:50.205593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:50.370163 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2830/5625] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 904 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:37:51.367885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:51.369317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:51.463665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:51.465127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:51.494839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a520074-1713-4089-994a-ec8ef5c21e68 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:51.505087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:51.505712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:51.506013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:51.506289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:51.516633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:51.555548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:51.557016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:51.607144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf8f9-a4dc-48c1-8f47-981ae70cb96b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:51.615765 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2831/5626] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:51.619128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290cc85-84a8-4bca-b464-60d4eb5a2411 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:51.619774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cc85-84a8-4bca-b464-60d4eb5a2411 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:51.620062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cc85-84a8-4bca-b464-60d4eb5a2411 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:51.620343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290cc85-84a8-4bca-b464-60d4eb5a2411 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:51.622849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2290cc85-84a8-4bca-b464-60d4eb5a2411 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:51.643312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290cc85-84a8-4bca-b464-60d4eb5a2411 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:51.643928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290cc85-84a8-4bca-b464-60d4eb5a2411 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:51.674242 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2796/5627] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:52.823389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:52.826917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:52.850158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d50e9a-59fd-4516-8bae-cd4b2ad59102 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:52.868043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:52.873980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:52.873980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:52.873980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] PATH_INFO: `/v3/projects/206ea2d869194c1888f633e3afbc289e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:52.873980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=206ea2d869194c1888f633e3afbc289e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:52.875950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:52.877959 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:53.076319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206ea2d869194c1888f633e3afbc289e', 'request_id': 'req-5a5e6264-a306-4e48-a0e0-4926afb6c9db'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:53.086763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206ea2d869194c1888f633e3afbc289e', 'request_id': 'req-5a5e6264-a306-4e48-a0e0-4926afb6c9db'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:53.239981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206ea2d869194c1888f633e3afbc289e', 'request_id': 'req-5a5e6264-a306-4e48-a0e0-4926afb6c9db'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:53.258679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] The token cache is being invalidate because project 206ea2d869194c1888f633e3afbc289e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:53.259391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:53.260897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5a5e6264-a306-4e48-a0e0-4926afb6c9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:53.264827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2832/5628] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:52 2022] DELETE /identity/v3/projects/206ea2d869194c1888f633e3afbc289e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:53.269692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e7ec-e5a9-49ea-a762-969e1e690356 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:53.270229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e7ec-e5a9-49ea-a762-969e1e690356 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:53.270337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e7ec-e5a9-49ea-a762-969e1e690356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:53.312188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c377e7ec-e5a9-49ea-a762-969e1e690356 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:53.318731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c377e7ec-e5a9-49ea-a762-969e1e690356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:53.515946 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2797/5629] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:53.527866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e395a3-b5bf-4cfd-b416-8666086a3bfc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:53.528378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e395a3-b5bf-4cfd-b416-8666086a3bfc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:53.528831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e395a3-b5bf-4cfd-b416-8666086a3bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:53.581340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f9e395a3-b5bf-4cfd-b416-8666086a3bfc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:53.581340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f9e395a3-b5bf-4cfd-b416-8666086a3bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:53.599783 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2833/5630] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:53.602989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e7ec-e5a9-49ea-a762-969e1e690356 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:53.615360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e7ec-e5a9-49ea-a762-969e1e690356 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:53.638708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:53.639432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:53.639633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:53.640018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:53.640545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:37:53.640928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:53.642605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:53.665003 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2798/5631] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:37:53.666269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e395a3-b5bf-4cfd-b416-8666086a3bfc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:53.684419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e395a3-b5bf-4cfd-b416-8666086a3bfc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:53.694675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:53.695912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:53.696527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:53.696975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:53.697832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:53.702320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:53.945031 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2834/5632] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:53 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:53.950807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:53.986405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941ac11-6baa-417e-8613-2a5b424558fe admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:54.010926 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:54.145692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:54.146554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:54.147145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:54.147511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:54.151495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:54.153608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:54.281443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2799/5633] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:53 2022] POST /identity/v3/users => generated 287 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:54.282993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:54.304579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d855484-5fda-44d7-96ce-58d59a2caede admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:54.316262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:54.318470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:54.318953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:54.319530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:54.320371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:54.327012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:54.352321 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2835/5634] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:54.357062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:54.372041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42a7e-f6f9-4aea-a845-451d3132aa82 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:54.384442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9325-66bb-4680-965e-52304c593d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:54.384442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9325-66bb-4680-965e-52304c593d59 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:54.384442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9325-66bb-4680-965e-52304c593d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:54.384442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9325-66bb-4680-965e-52304c593d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:54.384859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9325-66bb-4680-965e-52304c593d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:54.404703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9325-66bb-4680-965e-52304c593d59 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:54.490975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:54.492011 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2800/5635] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:54.508003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaafc9b-ca35-49f0-8f27-ca0bcb04ba52 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:54.515760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:54.516687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:54.517295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:54.517754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] PATH_INFO: `/v3/projects/e5edae27be944ca6bb1bb8cfd0e1ad09/users/eca17b42b3b44349b6ec0f1280c07164/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:54.558442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5edae27be944ca6bb1bb8cfd0e1ad09, user_id=eca17b42b3b44349b6ec0f1280c07164, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:54.565521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:54.711820 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2836/5636] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:54 2022] PUT /identity/v3/projects/e5edae27be944ca6bb1bb8cfd0e1ad09/users/eca17b42b3b44349b6ec0f1280c07164/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:37:54.728629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548d88-e14d-4f02-a95c-5dffa7cd823f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:54.728629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548d88-e14d-4f02-a95c-5dffa7cd823f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:54.728629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a548d88-e14d-4f02-a95c-5dffa7cd823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:54.786780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9a548d88-e14d-4f02-a95c-5dffa7cd823f None None] MFA Rules not processed for user `eca17b42b3b44349b6ec0f1280c07164`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:54.788292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a548d88-e14d-4f02-a95c-5dffa7cd823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:55.010148 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2801/5637] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:55.010945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:55.013582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:55.236628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f71a-4755-4b6a-bc4f-a500f3d89fa6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:55.256541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b565ed7-d93b-419f-b695-684f8c09d771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:55.257465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565ed7-d93b-419f-b695-684f8c09d771 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:55.257750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565ed7-d93b-419f-b695-684f8c09d771 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:55.258095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b565ed7-d93b-419f-b695-684f8c09d771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:55.274250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b565ed7-d93b-419f-b695-684f8c09d771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:55.277880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b565ed7-d93b-419f-b695-684f8c09d771 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:55.297531 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2837/5638] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:37:55.806150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548d88-e14d-4f02-a95c-5dffa7cd823f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:55.994910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a548d88-e14d-4f02-a95c-5dffa7cd823f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:56.004250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:56.004250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:56.004250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:56.004250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] PATH_INFO: `/v3/users/eca17b42b3b44349b6ec0f1280c07164` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:56.004700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca17b42b3b44349b6ec0f1280c07164)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:56.007022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:56.246366 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:56.274167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca17b42b3b44349b6ec0f1280c07164'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:56.322507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca17b42b3b44349b6ec0f1280c07164'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:56.332877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca17b42b3b44349b6ec0f1280c07164'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:56.343304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca17b42b3b44349b6ec0f1280c07164'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:56.440529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca17b42b3b44349b6ec0f1280c07164'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:56.453411 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2802/5639] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:37:55 2022] DELETE /identity/v3/users/eca17b42b3b44349b6ec0f1280c07164 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:56.460749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042f43-a52c-46df-b057-ebf88293382b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:56.463021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042f43-a52c-46df-b057-ebf88293382b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:56.463021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042f43-a52c-46df-b057-ebf88293382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:56.517419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-57042f43-a52c-46df-b057-ebf88293382b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:56.519423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-57042f43-a52c-46df-b057-ebf88293382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:56.539484 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:56.661698 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2838/5640] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:56.672589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:56.675174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:56.827164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92611e43-ff64-4941-b07f-0790d8ea9ed0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:56.835793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2deb-2ffe-41c1-a88d-764d9d8a798b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:56.835793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2deb-2ffe-41c1-a88d-764d9d8a798b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:56.835793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2deb-2ffe-41c1-a88d-764d9d8a798b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:56.836406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2deb-2ffe-41c1-a88d-764d9d8a798b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:56.847093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2deb-2ffe-41c1-a88d-764d9d8a798b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:56.849442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2deb-2ffe-41c1-a88d-764d9d8a798b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:56.871093 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2803/5641] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:57.897843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57042f43-a52c-46df-b057-ebf88293382b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:57.899842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-57042f43-a52c-46df-b057-ebf88293382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:57.917728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57042f43-a52c-46df-b057-ebf88293382b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:57.935765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:57.936610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:57.936995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:57.937661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] PATH_INFO: `/v3/projects/e5edae27be944ca6bb1bb8cfd0e1ad09` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:57.939191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5edae27be944ca6bb1bb8cfd0e1ad09)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:57.944511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:58.209065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5edae27be944ca6bb1bb8cfd0e1ad09', 'request_id': 'req-3cb359df-5afc-458b-92b4-37816462c2ba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:58.220480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5edae27be944ca6bb1bb8cfd0e1ad09', 'request_id': 'req-3cb359df-5afc-458b-92b4-37816462c2ba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:58.391699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5edae27be944ca6bb1bb8cfd0e1ad09', 'request_id': 'req-3cb359df-5afc-458b-92b4-37816462c2ba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:58.431522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] The token cache is being invalidate because project e5edae27be944ca6bb1bb8cfd0e1ad09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:37:58.431962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:58.433183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3cb359df-5afc-458b-92b4-37816462c2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:37:58.435196 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2839/5642] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:37:57 2022] DELETE /identity/v3/projects/e5edae27be944ca6bb1bb8cfd0e1ad09 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:58.440397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f4dc-b306-4db4-b8e6-806c70701d09 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:58.441264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f4dc-b306-4db4-b8e6-806c70701d09 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:58.441744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f4dc-b306-4db4-b8e6-806c70701d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:58.501339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c143f4dc-b306-4db4-b8e6-806c70701d09 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:58.504424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c143f4dc-b306-4db4-b8e6-806c70701d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:58.592217 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2804/5643] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:58.603726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05583b15-a115-45d5-86f2-6a70efe7a98a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:58.605105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05583b15-a115-45d5-86f2-6a70efe7a98a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:58.605663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05583b15-a115-45d5-86f2-6a70efe7a98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:58.650058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-05583b15-a115-45d5-86f2-6a70efe7a98a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:37:58.651554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-05583b15-a115-45d5-86f2-6a70efe7a98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:58.674306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2840/5644] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:37:58.680041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f4dc-b306-4db4-b8e6-806c70701d09 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:58.713435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f4dc-b306-4db4-b8e6-806c70701d09 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:58.736753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:58.743307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:58.744278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:58.744957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:58.747589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:37:58.750678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:58.758793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:58.792232 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2805/5645] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:37:58.796593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05583b15-a115-45d5-86f2-6a70efe7a98a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:58.811154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05583b15-a115-45d5-86f2-6a70efe7a98a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:58.824792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:58.825438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:58.827994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:58.828280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:58.832873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:58.835257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:59.035127 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2841/5646] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:37:58 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:59.039674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:59.068097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850453d7-0bce-4075-a716-1b067883b404 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:59.165477 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:59.195898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:59.196714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:59.197000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:59.197596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:59.198348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:59.201622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:59.464416 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2806/5647] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:37:59 2022] POST /identity/v3/users => generated 288 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:37:59.469051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:59.494423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094854d-6688-4eac-bd89-37c1f32e56a9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:59.526116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:59.528041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:59.528503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:59.540295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:59.543680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:59.548046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:59.595779 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2842/5648] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:59.603358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:59.655394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2474dfe-f63d-4382-a409-9c331de0964b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:59.682956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6abd6-158b-43ee-80ed-6922128d132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:59.687390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6abd6-158b-43ee-80ed-6922128d132f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:59.689075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6abd6-158b-43ee-80ed-6922128d132f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:59.689597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6abd6-158b-43ee-80ed-6922128d132f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:59.691160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6abd6-158b-43ee-80ed-6922128d132f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:59.694504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6abd6-158b-43ee-80ed-6922128d132f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:59.734048 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2807/5649] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:37:59.739018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:59.751594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8589b-bc70-441f-bb8c-8bbd64a111c5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:59.777387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:59.778091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:59.778369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:59.782154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] PATH_INFO: `/v3/projects/9ab809754f204297b409115b662d4b58/users/02a268bd2a45421d8afbd013611bbc57/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:59.828823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab809754f204297b409115b662d4b58, user_id=02a268bd2a45421d8afbd013611bbc57, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:59.838591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:59.949706 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2843/5650] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:37:59 2022] PUT /identity/v3/projects/9ab809754f204297b409115b662d4b58/users/02a268bd2a45421d8afbd013611bbc57/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:37:59.950904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4a9f0-997c-4250-b6a7-208b8ea5b49e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:59.951382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4a9f0-997c-4250-b6a7-208b8ea5b49e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:59.951671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4a9f0-997c-4250-b6a7-208b8ea5b49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:00.051269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0ac4a9f0-997c-4250-b6a7-208b8ea5b49e None None] MFA Rules not processed for user `02a268bd2a45421d8afbd013611bbc57`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:00.056892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0ac4a9f0-997c-4250-b6a7-208b8ea5b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:00.267354 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2808/5651] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:00.272579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:00.391307 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:00.476840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea555e9-8d62-4ff9-bd74-3215aa2c0119 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:00.499378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:00.500011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:00.500292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:00.502701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:00.505571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:00.511671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:00.735127 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2844/5652] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:00 2022] POST /identity/v3/projects => generated 373 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:00.739227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4a9f0-997c-4250-b6a7-208b8ea5b49e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:00.767854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4a9f0-997c-4250-b6a7-208b8ea5b49e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:00.944137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:00.945121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:00.945577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:00.946300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:00.948415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:00.957069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:01.058578 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2809/5653] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:00 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:01.063795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:01.080354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32545f-ec40-4f79-9eca-4fcb372e88d7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:01.092341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:01.092978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:01.093355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:01.093642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:01.094178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:01.095788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:01.133125 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2845/5654] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:01.135404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:01.168244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ee163-3995-4718-b573-ad3a5f54c130 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:01.198058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:01.198769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:01.199055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:01.204326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] PATH_INFO: `/v3/projects/8823e5fb3c2341c9a672382af30213a1/users/54326ddc1bfa4b3e88e5f03bf343b9a0/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:01.245039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8823e5fb3c2341c9a672382af30213a1, user_id=54326ddc1bfa4b3e88e5f03bf343b9a0, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:01.248348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:01.370447 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2810/5655] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:01 2022] PUT /identity/v3/projects/8823e5fb3c2341c9a672382af30213a1/users/54326ddc1bfa4b3e88e5f03bf343b9a0/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:01.372044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:01.391502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c236d-6a4d-476b-8bf2-128390dabcdd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:01.614964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:01.615599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:01.615875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:01.616144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:01.616790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:01.618655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:01.641237 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2846/5656] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:01.643209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:01.671679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7157-211f-483e-b9f6-67b5f945277d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:01.721115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db790e-0255-4fed-b52c-569c1a80f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:01.726717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db790e-0255-4fed-b52c-569c1a80f6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:01.746326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db790e-0255-4fed-b52c-569c1a80f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:01.746326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db790e-0255-4fed-b52c-569c1a80f6eb admin admin] PATH_INFO: `/v3/projects/8823e5fb3c2341c9a672382af30213a1/users/54326ddc1bfa4b3e88e5f03bf343b9a0/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:01.746326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db790e-0255-4fed-b52c-569c1a80f6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8823e5fb3c2341c9a672382af30213a1, user_id=54326ddc1bfa4b3e88e5f03bf343b9a0, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:01.749412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:01.750833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db790e-0255-4fed-b52c-569c1a80f6eb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:01.751560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:01.775841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f20262-873a-49d8-8979-5af69d301ecb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:01.781751 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:01.808760 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2811/5657] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:01 2022] PUT /identity/v3/projects/8823e5fb3c2341c9a672382af30213a1/users/54326ddc1bfa4b3e88e5f03bf343b9a0/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:01.813023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73849e-5548-442c-98df-ee154749ed81 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:01.814058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73849e-5548-442c-98df-ee154749ed81 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:01.814506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73849e-5548-442c-98df-ee154749ed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:01.873901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:01.875268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:01.875957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:01.876467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] PATH_INFO: `/v3/users/03e6cc8d3bcd49989e73622c99549cec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:01.879143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e6cc8d3bcd49989e73622c99549cec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:01.881750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:01.924449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6a73849e-5548-442c-98df-ee154749ed81 None None] MFA Rules not processed for user `54326ddc1bfa4b3e88e5f03bf343b9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:01.928269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6a73849e-5548-442c-98df-ee154749ed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:02.120922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2812/5658] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:02.126887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73849e-5548-442c-98df-ee154749ed81 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:02.148812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73849e-5548-442c-98df-ee154749ed81 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:02.161993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:02.163883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:02.164256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:02.164631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:02.165559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:02.168358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:02.238227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e6cc8d3bcd49989e73622c99549cec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:02.238955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e6cc8d3bcd49989e73622c99549cec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:02.293374 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2813/5659] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:02 2022] POST /identity/v3/projects => generated 350 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:02.295957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:02.382215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e6cc8d3bcd49989e73622c99549cec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:02.392538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e6cc8d3bcd49989e73622c99549cec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:02.393556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e6cc8d3bcd49989e73622c99549cec'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:02.462545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62524265-084e-48d0-9997-ce41c24cfa86 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:02.466984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:02.467647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:02.467950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:02.468280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:02.469150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:02.473794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:02.474291 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2847/5660] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:01 2022] DELETE /identity/v3/users/03e6cc8d3bcd49989e73622c99549cec => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:02.609491 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2814/5661] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:02 2022] POST /identity/v3/projects => generated 351 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:02.611720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:02.613958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:02.677159 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:02.759269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0397aee-b78a-4dd9-85aa-517a3fd3cef3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:02.863272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:02.864218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:02.864678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:02.865141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/users/02a268bd2a45421d8afbd013611bbc57` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:02.867190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:get_user(user_id=02a268bd2a45421d8afbd013611bbc57)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:02.869976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:02.872986 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2848/5662] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:38:02 2022] GET /identity/v3/users/02a268bd2a45421d8afbd013611bbc57 => generated 288 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:02.877086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:02.890489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641e9a3-f0b5-44d3-baae-79454c0bd921 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:02.897199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:02.897574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:02.898036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:02.898436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:02.899560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:02.902001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:02.985992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:02.994922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2815/5663] 10.222.0.59 () {60 vars in 1162 bytes} [Sun Aug 28 01:38:02 2022] POST /identity/v3/credentials => generated 429 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:02.997706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14cf22-db1c-442b-8497-5a14fde3dbe8 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:03.008528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:03.009289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:03.009677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:03.010126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials/f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:03.012935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.014428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.018011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.021696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.136307 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2849/5664] 10.222.0.59 () {60 vars in 1358 bytes} [Sun Aug 28 01:38:02 2022] PATCH /identity/v3/credentials/f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df => generated 436 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:03.157180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:03.178934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703613d-327c-4f5a-802a-4f5ef1375d7b tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:03.186885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:03.192312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:03.192312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:03.192312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials/f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:03.194118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.198037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.206487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:03.206887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2816/5665] 10.222.0.59 () {58 vars in 1335 bytes} [Sun Aug 28 01:38:03 2022] GET /identity/v3/credentials/f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df => generated 436 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:03.222691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61b205-57ca-430d-91a2-fd72cfa9fe5e tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:03.234282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:03.234949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:03.235697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:03.235697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials/f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:03.238167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.239829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.427071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2850/5666] 10.222.0.59 () {58 vars in 1338 bytes} [Sun Aug 28 01:38:03 2022] DELETE /identity/v3/credentials/f11ccf8c491f22f6449c1e8412101c6cc455b179e52de8e9dcf56156e34034df => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:03.434079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:03.511743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664349d-60a5-4230-a743-da6ed5549257 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:03.529102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:03.533057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:03.533542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:03.534560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:03.536444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.545652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.651081 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2817/5667] 10.222.0.59 () {60 vars in 1162 bytes} [Sun Aug 28 01:38:03 2022] POST /identity/v3/credentials => generated 430 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:03.652483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:03.677602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af3c23-97ec-401b-bcbf-bf6d4fc357db tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:03.683790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:03.684694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:03.685149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:03.685637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:03.687550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.690012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.824545 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2851/5668] 10.222.0.59 () {60 vars in 1162 bytes} [Sun Aug 28 01:38:03 2022] POST /identity/v3/credentials => generated 431 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:03.829777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:03.844471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabef97-ab8a-470a-91ac-682db34a2dcb tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:03.872009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:03.873337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:03.873795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:03.879007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:03.879007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.879007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.895516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.922491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.927757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.932070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:03.945869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:03.957478 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2818/5669] 10.222.0.59 () {58 vars in 1140 bytes} [Sun Aug 28 01:38:03 2022] GET /identity/v3/credentials => generated 946 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:03.962932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:03.966913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a032-681a-46f1-b40e-16ee8b1441d6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:03.970009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:03.981933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:03.983208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:03.983766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:03.984524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials/3d446e6ca83f6bb80f7896c6736104ef9bdcfdda609c527c5a970e02b65b5259` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:03.989011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=3d446e6ca83f6bb80f7896c6736104ef9bdcfdda609c527c5a970e02b65b5259)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:03.992170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:04.009617 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:04.149850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2852/5670] 10.222.0.59 () {58 vars in 1338 bytes} [Sun Aug 28 01:38:03 2022] DELETE /identity/v3/credentials/3d446e6ca83f6bb80f7896c6736104ef9bdcfdda609c527c5a970e02b65b5259 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:04.159702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:04.171265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebbc93-57bd-4562-a3c4-d47cab9cd839 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:04.186668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:04.187635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:04.188104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:04.189147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] PATH_INFO: `/v3/projects/4a408cb14fce45368519810a3782889e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:04.193335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a408cb14fce45368519810a3782889e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:04.207023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:04.224330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b04a-7b80-456d-9dfa-e9e8aa2a4cf6 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:04.248054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:04.249307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:04.249686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:04.250144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/credentials/9ada09c18207e058bbfa0ca5b0f2c5f5b78322bb3954976fa1d5cb195bb112d8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:04.254531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=9ada09c18207e058bbfa0ca5b0f2c5f5b78322bb3954976fa1d5cb195bb112d8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:04.282396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:04.451841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a408cb14fce45368519810a3782889e', 'request_id': 'req-fcba0ec7-c691-4b25-9e5f-332be1799c4c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:04.456003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2853/5671] 10.222.0.59 () {58 vars in 1338 bytes} [Sun Aug 28 01:38:04 2022] DELETE /identity/v3/credentials/9ada09c18207e058bbfa0ca5b0f2c5f5b78322bb3954976fa1d5cb195bb112d8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:04.459551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:04.466464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:04.475658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a408cb14fce45368519810a3782889e', 'request_id': 'req-fcba0ec7-c691-4b25-9e5f-332be1799c4c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:04.584440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a408cb14fce45368519810a3782889e', 'request_id': 'req-fcba0ec7-c691-4b25-9e5f-332be1799c4c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:04.614709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] The token cache is being invalidate because project 4a408cb14fce45368519810a3782889e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:04.615326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:04.618251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:04.622164 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2819/5672] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:03 2022] DELETE /identity/v3/projects/4a408cb14fce45368519810a3782889e => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:04.628150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:04.633097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:04.714790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f58f7e-d471-4de0-b8d4-c0c08db8c056 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:04.863430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0ec7-c691-4b25-9e5f-332be1799c4c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:04.871194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:04.872485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:04.873064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:04.873609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/projects/06d824ad8f2f496a8b51dc32e3386202` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:04.875617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06d824ad8f2f496a8b51dc32e3386202)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:04.879953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:04.903015 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:04.911418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00152552-1e7f-4a6b-b96f-f9d44ef3d240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:04.912501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00152552-1e7f-4a6b-b96f-f9d44ef3d240 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:04.912970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00152552-1e7f-4a6b-b96f-f9d44ef3d240 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:04.914157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00152552-1e7f-4a6b-b96f-f9d44ef3d240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:04.916813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-00152552-1e7f-4a6b-b96f-f9d44ef3d240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:04.934231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00152552-1e7f-4a6b-b96f-f9d44ef3d240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:04.936839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00152552-1e7f-4a6b-b96f-f9d44ef3d240 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:04.956172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2854/5673] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:04.958387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b1cf-e144-4ff1-afdf-e528ff36f29c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:04.959102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b1cf-e144-4ff1-afdf-e528ff36f29c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:04.959574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b1cf-e144-4ff1-afdf-e528ff36f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:04.992778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7d70b1cf-e144-4ff1-afdf-e528ff36f29c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:04.995748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7d70b1cf-e144-4ff1-afdf-e528ff36f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:05.042650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d824ad8f2f496a8b51dc32e3386202', 'request_id': 'req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.075912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d824ad8f2f496a8b51dc32e3386202', 'request_id': 'req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.113180 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2855/5674] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:05.125560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59321b85-6074-4e00-ba7f-6a5adbfc83b2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:05.125560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59321b85-6074-4e00-ba7f-6a5adbfc83b2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:05.125560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59321b85-6074-4e00-ba7f-6a5adbfc83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:05.174055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d824ad8f2f496a8b51dc32e3386202', 'request_id': 'req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.196203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] The token cache is being invalidate because project 06d824ad8f2f496a8b51dc32e3386202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:05.197988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.200833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.208391 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2820/5675] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:04 2022] DELETE /identity/v3/projects/06d824ad8f2f496a8b51dc32e3386202 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:05.209504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:05.213308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:05.227718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-59321b85-6074-4e00-ba7f-6a5adbfc83b2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:05.232163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-59321b85-6074-4e00-ba7f-6a5adbfc83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:05.257221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2856/5676] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:05.261036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59321b85-6074-4e00-ba7f-6a5adbfc83b2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:05.281907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59321b85-6074-4e00-ba7f-6a5adbfc83b2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:05.295594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:05.297475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:05.300561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:05.301046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:05.302009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:05.302457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:05.306106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:05.361647 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2857/5677] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:05.363094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:05.377625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c8c37-5f6e-4683-8b11-874ed5cf2d2a tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:05.388455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303eef8-e5e8-4412-aff8-92b7f85dc9dd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:05.399804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54326ddc1bfa4b3e88e5f03bf343b9a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8823e5fb3c2341c9a672382af30213a1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:05.400954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:05.401252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:05.402276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] PATH_INFO: `/v3/projects/a9dc95fa35e6480eab1f732462544c07` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:05.408811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9dc95fa35e6480eab1f732462544c07)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:05.413218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:05.429297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:05.431575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:05.431928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:05.432214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:05.438078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:05.438078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:05.500114 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:05.567779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9dc95fa35e6480eab1f732462544c07', 'request_id': 'req-12e1007f-c656-4f71-8912-b9d2a6d08bc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.574260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9dc95fa35e6480eab1f732462544c07', 'request_id': 'req-12e1007f-c656-4f71-8912-b9d2a6d08bc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.578170 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2858/5678] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:05 2022] POST /identity/v3/projects => generated 393 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:05.579335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:05.666319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9dc95fa35e6480eab1f732462544c07', 'request_id': 'req-12e1007f-c656-4f71-8912-b9d2a6d08bc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.691299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] The token cache is being invalidate because project a9dc95fa35e6480eab1f732462544c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:05.693033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.695634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:05.700444 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2821/5679] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:05 2022] DELETE /identity/v3/projects/a9dc95fa35e6480eab1f732462544c07 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:05.703686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:05.708856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:05.742971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96347-c5b0-41a3-a6c8-778cc46089df admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:05.760604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:05.761538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:05.763325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:05.764382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:05.766325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:05.771292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:05.896723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1007f-c656-4f71-8912-b9d2a6d08bc3 tempest-CredentialsTestJSON-476721341 tempest-CredentialsTestJSON-476721341-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:05.913516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:05.914994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:05.915451 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2859/5680] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:05 2022] POST /identity/v3/users => generated 297 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:05.915843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:05.916416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] PATH_INFO: `/v3/users/02a268bd2a45421d8afbd013611bbc57` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:05.916893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:05.918014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a268bd2a45421d8afbd013611bbc57)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:05.920723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:05.921107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:05.952444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab626f-5ada-443f-823d-7e0dbc426a2d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:05.964250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:05.965427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:05.966409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:05.966726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:05.967484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:05.970729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:06.001249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2860/5681] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:06.002369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:06.050440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170a9a6-225b-42c2-8aa1-ac0d28f7d06f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:06.057386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:06.058162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:06.058622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:06.058910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:06.059985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:06.061439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:06.085620 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2861/5682] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:06.089984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:06.107085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792068-2af2-4f8f-8f39-52d1f4e89255 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:06.114459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550508c-7a30-4ffd-80c9-f25704ee96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:06.115265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550508c-7a30-4ffd-80c9-f25704ee96c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:06.116170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550508c-7a30-4ffd-80c9-f25704ee96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:06.116869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550508c-7a30-4ffd-80c9-f25704ee96c2 admin admin] PATH_INFO: `/v3/projects/2c0a3bc3d53b4ab886103d1868ce89b0/users/88c64df8e3034b71b25b6139a454bdf1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:06.152432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550508c-7a30-4ffd-80c9-f25704ee96c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0a3bc3d53b4ab886103d1868ce89b0, user_id=88c64df8e3034b71b25b6139a454bdf1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:06.156484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550508c-7a30-4ffd-80c9-f25704ee96c2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:06.278326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2862/5683] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:06 2022] PUT /identity/v3/projects/2c0a3bc3d53b4ab886103d1868ce89b0/users/88c64df8e3034b71b25b6139a454bdf1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:06.283761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:06.284054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:06.285199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:06.292749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a268bd2a45421d8afbd013611bbc57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:06.318069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:06.319788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:06.327018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a268bd2a45421d8afbd013611bbc57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:06.346641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a268bd2a45421d8afbd013611bbc57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:06.348075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a268bd2a45421d8afbd013611bbc57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:06.402317 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2863/5684] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:06.459350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4c3473a-189e-4e94-8c84-d085a46a9f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a268bd2a45421d8afbd013611bbc57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:06.475582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:06.479261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:06.485221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2822/5685] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:05 2022] DELETE /identity/v3/users/02a268bd2a45421d8afbd013611bbc57 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:06.493066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:06.494838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:06.497626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:06.562067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:06.566478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:06.643740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcee1ff-aa07-411d-9e25-c2c50c27c219 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:06.739589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2823/5686] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:06.743042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af5248-ec6f-4ff3-bd5d-e84db0c50dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:06.743696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af5248-ec6f-4ff3-bd5d-e84db0c50dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:06.743986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af5248-ec6f-4ff3-bd5d-e84db0c50dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:06.744626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af5248-ec6f-4ff3-bd5d-e84db0c50dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:06.754706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af5248-ec6f-4ff3-bd5d-e84db0c50dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:06.756447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af5248-ec6f-4ff3-bd5d-e84db0c50dc1 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:06.770938 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2864/5687] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:06.782370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:06.783757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:06.806399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9803e-7e9b-4333-ae76-9d0847c776a1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:06.813479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:06.814490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:06.814876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:06.815451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:06.837233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:06.840474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:06.855465 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2824/5688] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:07.719877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c5819-82ab-4f81-8944-e8e0f37c37e7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:07.721080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c5819-82ab-4f81-8944-e8e0f37c37e7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:07.722431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c5819-82ab-4f81-8944-e8e0f37c37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:07.754757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e08c5819-82ab-4f81-8944-e8e0f37c37e7 None None] MFA Rules not processed for user `13d47aaea13a458299f133080c5e3004`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:07.756114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e08c5819-82ab-4f81-8944-e8e0f37c37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:07.880800 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2865/5689] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:08.681759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:08.683975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:08.726255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c964c-187a-48ee-b0be-a2f2db71e92d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:08.740001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:08.741903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:08.743970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:08.744722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] PATH_INFO: `/v3/projects/9ab809754f204297b409115b662d4b58` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:08.746327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab809754f204297b409115b662d4b58)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:08.748559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:08.979062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab809754f204297b409115b662d4b58', 'request_id': 'req-075e1c0a-a7df-40ce-842a-db288f4ae542'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.017339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab809754f204297b409115b662d4b58', 'request_id': 'req-075e1c0a-a7df-40ce-842a-db288f4ae542'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.313734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab809754f204297b409115b662d4b58', 'request_id': 'req-075e1c0a-a7df-40ce-842a-db288f4ae542'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.335410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] The token cache is being invalidate because project 9ab809754f204297b409115b662d4b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:09.335705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.336384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.338147 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2825/5690] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:08 2022] DELETE /identity/v3/projects/9ab809754f204297b409115b662d4b58 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:09.341956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c5819-82ab-4f81-8944-e8e0f37c37e7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:09.353157 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:09.361784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c5819-82ab-4f81-8944-e8e0f37c37e7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:09.462090 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:09.525903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:09.528777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:09.528777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:09.528777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] PATH_INFO: `/v3/users/54326ddc1bfa4b3e88e5f03bf343b9a0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:09.530880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54326ddc1bfa4b3e88e5f03bf343b9a0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:09.533133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:09.762689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54326ddc1bfa4b3e88e5f03bf343b9a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.770041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54326ddc1bfa4b3e88e5f03bf343b9a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.921330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54326ddc1bfa4b3e88e5f03bf343b9a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.932031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54326ddc1bfa4b3e88e5f03bf343b9a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.932819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0bc13dab-eb9d-4ab6-93d1-3a8600337f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54326ddc1bfa4b3e88e5f03bf343b9a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:09.987268 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2866/5691] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:09 2022] DELETE /identity/v3/users/54326ddc1bfa4b3e88e5f03bf343b9a0 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:10.602296 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:11.852209 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:12.083229 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:12.234085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:12.235565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:12.261098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e1c0a-a7df-40ce-842a-db288f4ae542 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:12.368402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:12.369239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:12.369685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:12.370171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] PATH_INFO: `/v3/projects/8823e5fb3c2341c9a672382af30213a1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:12.371510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8823e5fb3c2341c9a672382af30213a1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:12.374257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:12.538729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8823e5fb3c2341c9a672382af30213a1', 'request_id': 'req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:12.546747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8823e5fb3c2341c9a672382af30213a1', 'request_id': 'req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:12.635627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8823e5fb3c2341c9a672382af30213a1', 'request_id': 'req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:12.655203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] The token cache is being invalidate because project 8823e5fb3c2341c9a672382af30213a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:12.655602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:12.656342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-03c3b9d6-c27a-4d59-a92a-fb4f237000ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:12.663853 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2826/5692] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:12 2022] DELETE /identity/v3/projects/8823e5fb3c2341c9a672382af30213a1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:12.665399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970038c-cbb5-4a30-9e34-678922cccd8d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:12.665771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970038c-cbb5-4a30-9e34-678922cccd8d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:12.666130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970038c-cbb5-4a30-9e34-678922cccd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:12.714275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3970038c-cbb5-4a30-9e34-678922cccd8d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:12.715707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3970038c-cbb5-4a30-9e34-678922cccd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:12.796494 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2867/5693] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:12.805845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11f00-cbfc-4ce8-8e59-cd19ddd86c00 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:12.806160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11f00-cbfc-4ce8-8e59-cd19ddd86c00 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:12.806479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae11f00-cbfc-4ce8-8e59-cd19ddd86c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:12.828007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4ae11f00-cbfc-4ce8-8e59-cd19ddd86c00 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:12.829285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4ae11f00-cbfc-4ce8-8e59-cd19ddd86c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:12.844160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970038c-cbb5-4a30-9e34-678922cccd8d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:12.851221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2827/5694] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:12.855593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970038c-cbb5-4a30-9e34-678922cccd8d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:12.880262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:12.881110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:12.884272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:12.889622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:12.889622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:12.889622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:12.889622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:12.921855 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2868/5695] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:12.927017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae11f00-cbfc-4ce8-8e59-cd19ddd86c00 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:12.936342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae11f00-cbfc-4ce8-8e59-cd19ddd86c00 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:12.941442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:12.942095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:12.942378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:12.954152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:12.960604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:12.962599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:13.060998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2828/5696] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:12 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:13.062561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:13.079200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a862e9-0fa5-46f1-9363-4be5b48eccc9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:13.244309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:13.246121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:13.246600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:13.248129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:13.250135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:13.257150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:13.440984 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2869/5697] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:13 2022] POST /identity/v3/users => generated 288 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:13.442748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:13.465989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:13.468291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:13.474279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77c4b-ba33-42d0-943b-57010dba22f1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:13.493400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:13.494313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:13.494987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:13.495426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:13.496282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:13.507541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:13.559357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2829/5698] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:13.566138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:13.594302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12acfdb-1cb7-420d-b249-2bbf71d8acd5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:13.614919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:13.615921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:13.616378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:13.616842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:13.619287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:13.624347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:13.644661 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2830/5699] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:13.648534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:13.650393 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:13.667793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760aad-cbb5-436c-92f1-a0871cc28473 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:13.672157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1a7c5-7719-4750-a4d8-51e7f4613d82 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:13.677027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b000f-5ca5-469d-88d7-72c081a7b3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:13.677941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b000f-5ca5-469d-88d7-72c081a7b3ca service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:13.678394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b000f-5ca5-469d-88d7-72c081a7b3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:13.678862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b000f-5ca5-469d-88d7-72c081a7b3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:13.679017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:13.679903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:13.680437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:13.681043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] PATH_INFO: `/v3/projects/823aff97741d4a428f8fa306eae26c46/users/abca24b96fdb451cba59fbc83aada10f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:13.683089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-164b000f-5ca5-469d-88d7-72c081a7b3ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:13.712859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] RBAC: Authorizing `identity:create_grant(project_id=823aff97741d4a428f8fa306eae26c46, user_id=abca24b96fdb451cba59fbc83aada10f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:13.717218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:13.745111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b000f-5ca5-469d-88d7-72c081a7b3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:13.755142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b000f-5ca5-469d-88d7-72c081a7b3ca service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:13.790228 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2870/5700] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:38:13.793660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2831/5701] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:13 2022] PUT /identity/v3/projects/823aff97741d4a428f8fa306eae26c46/users/abca24b96fdb451cba59fbc83aada10f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:13.804694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96ba4-edf2-4141-94e8-09d105ca3f8a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:13.804936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96ba4-edf2-4141-94e8-09d105ca3f8a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:13.805167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a96ba4-edf2-4141-94e8-09d105ca3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:13.881532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-93a96ba4-edf2-4141-94e8-09d105ca3f8a None None] MFA Rules not processed for user `abca24b96fdb451cba59fbc83aada10f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:13.889319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-93a96ba4-edf2-4141-94e8-09d105ca3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:14.026906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:14.029565 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2871/5702] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:38:14.062411 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:14.190754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e902-512f-4108-a8c6-916bfa21868b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:14.198376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:14.199387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:14.199976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:14.200516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:14.201406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:14.203698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:14.376819 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2832/5703] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:14 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:14.376950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96ba4-edf2-4141-94e8-09d105ca3f8a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:14.376950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a96ba4-edf2-4141-94e8-09d105ca3f8a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:14.451667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:14.451667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:14.451667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:14.452110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:14.457215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:14.457215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:14.579530 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2872/5704] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:14 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:14.583739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:14.595221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c675-35fb-4772-aa01-748e094410d7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:14.610613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:14.611259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:14.611550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:14.611836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:14.613076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:14.614744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:14.646127 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2833/5705] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:14.647339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:14.667291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7850017-1f0b-4f79-92c9-f9a3fa97beab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:14.696758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:14.697458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:14.697747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:14.698057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] PATH_INFO: `/v3/projects/e3a376538c7842ef9777ded25cdb74c3/users/ae5cca84903040dda88c4c8e7d000e3f/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:14.728463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a376538c7842ef9777ded25cdb74c3, user_id=ae5cca84903040dda88c4c8e7d000e3f, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:14.732795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:14.848867 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2873/5706] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:14 2022] PUT /identity/v3/projects/e3a376538c7842ef9777ded25cdb74c3/users/ae5cca84903040dda88c4c8e7d000e3f/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:14.851041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:14.873994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec04d9-8a6b-4842-816e-9f51d007c8f6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:15.035743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a440b49-3fe3-4ca4-a5aa-20d3cab37a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:15.036987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440b49-3fe3-4ca4-a5aa-20d3cab37a6f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:15.038811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440b49-3fe3-4ca4-a5aa-20d3cab37a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:15.039166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a440b49-3fe3-4ca4-a5aa-20d3cab37a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:15.039972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a440b49-3fe3-4ca4-a5aa-20d3cab37a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:15.042811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a440b49-3fe3-4ca4-a5aa-20d3cab37a6f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:15.079583 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2834/5707] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:15.080534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:15.095598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711deb88-5659-4d43-9d38-46e41321cca3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:15.122943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:15.123519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:15.123807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:15.124091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] PATH_INFO: `/v3/projects/e3a376538c7842ef9777ded25cdb74c3/users/ae5cca84903040dda88c4c8e7d000e3f/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:15.132008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a376538c7842ef9777ded25cdb74c3, user_id=ae5cca84903040dda88c4c8e7d000e3f, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:15.134131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:15.163002 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2874/5708] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:15 2022] PUT /identity/v3/projects/e3a376538c7842ef9777ded25cdb74c3/users/ae5cca84903040dda88c4c8e7d000e3f/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:15.177990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d696ef-2639-4b90-a8ec-28d8023c8738 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:15.177990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d696ef-2639-4b90-a8ec-28d8023c8738 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:15.177990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d696ef-2639-4b90-a8ec-28d8023c8738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:15.241398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e7d696ef-2639-4b90-a8ec-28d8023c8738 None None] MFA Rules not processed for user `ae5cca84903040dda88c4c8e7d000e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:15.247285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e7d696ef-2639-4b90-a8ec-28d8023c8738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:15.458902 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2835/5709] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:15.459224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:15.481665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44f23-6b12-4277-b313-442391744c7c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:15.501600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:15.509132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:15.510106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:15.511329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:15.512922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:15.515290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:15.609191 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:15.622497 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2875/5710] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:38:15 2022] POST /identity/v3/domains => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:15.625890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d696ef-2639-4b90-a8ec-28d8023c8738 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:15.644336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d696ef-2639-4b90-a8ec-28d8023c8738 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:15.826520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:15.826955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:15.827270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:15.827550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:15.828205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:15.830473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:15.989057 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2836/5711] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:15 2022] POST /identity/v3/projects => generated 409 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:15.989372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:16.006929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23702e-2e76-48c0-9c1a-8733e1e628c3 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:16.082682 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:16.155151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:16.158741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:16.160135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:16.160706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:16.161779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:16.165221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:16.376291 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2876/5712] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:15 2022] POST /identity/v3/users => generated 348 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:16.376513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:16.399030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da37ae-89b5-4529-8e16-4abdcbe8dea9 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:16.417119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ec55-abf5-46dc-b231-d6493d6cc324 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:16.419775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ec55-abf5-46dc-b231-d6493d6cc324 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:16.420147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ec55-abf5-46dc-b231-d6493d6cc324 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:16.420520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ec55-abf5-46dc-b231-d6493d6cc324 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:16.421896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ec55-abf5-46dc-b231-d6493d6cc324 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:16.426981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ec55-abf5-46dc-b231-d6493d6cc324 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:16.458165 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2837/5713] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:16.458922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:16.479349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcfe53-73f6-4f13-b35b-0a5ba1b63400 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:16.495629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb6d2f-426a-4627-a676-b8ca76e439ec tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:16.496341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6d2f-426a-4627-a676-b8ca76e439ec tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:16.496619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6d2f-426a-4627-a676-b8ca76e439ec tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:16.496945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6d2f-426a-4627-a676-b8ca76e439ec tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/projects/832107b83cb34c4f896b942a617c0a1e/users/79da83330e44444c95cf3b09396e2952/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:16.530800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb6d2f-426a-4627-a676-b8ca76e439ec tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:create_grant(project_id=832107b83cb34c4f896b942a617c0a1e, user_id=79da83330e44444c95cf3b09396e2952, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:16.533555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb6d2f-426a-4627-a676-b8ca76e439ec tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:16.709013 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2877/5714] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:16 2022] PUT /identity/v3/projects/832107b83cb34c4f896b942a617c0a1e/users/79da83330e44444c95cf3b09396e2952/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:16.715578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f7ca-aa87-4b4e-90fc-b03d1cdffd4f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:16.716017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f7ca-aa87-4b4e-90fc-b03d1cdffd4f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:16.716985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f7ca-aa87-4b4e-90fc-b03d1cdffd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:16.899464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8869f7ca-aa87-4b4e-90fc-b03d1cdffd4f None None] MFA Rules not processed for user `79da83330e44444c95cf3b09396e2952`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:16.904566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8869f7ca-aa87-4b4e-90fc-b03d1cdffd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:16.944261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee367-84d0-4205-8001-e45d5fd5b212 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:16.944476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee367-84d0-4205-8001-e45d5fd5b212 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:16.944728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ee367-84d0-4205-8001-e45d5fd5b212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:16.954099 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2838/5715] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:16.968337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7d3ee367-84d0-4205-8001-e45d5fd5b212 None None] MFA Rules not processed for user `79da83330e44444c95cf3b09396e2952`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:16.970157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7d3ee367-84d0-4205-8001-e45d5fd5b212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:16.983957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869f7ca-aa87-4b4e-90fc-b03d1cdffd4f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:16.991099 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2878/5716] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:16.996860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869f7ca-aa87-4b4e-90fc-b03d1cdffd4f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:17.002258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79da83330e44444c95cf3b09396e2952', 'user_domain_id': '455d050b8e624a95b448936b76c2e623', 'system_scope': None, 'project_id': '832107b83cb34c4f896b942a617c0a1e', 'project_domain_id': '455d050b8e624a95b448936b76c2e623', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:17.005656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:17.006472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:17.007105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:17.019728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:17.021896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:17.040294 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2839/5717] 10.222.0.59 () {56 vars in 1284 bytes} [Sun Aug 28 01:38:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:17.041134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ee367-84d0-4205-8001-e45d5fd5b212 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:17.136715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ee367-84d0-4205-8001-e45d5fd5b212 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:17.144459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:17.145256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:17.145784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:17.146197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/users/79da83330e44444c95cf3b09396e2952` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:17.148601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:delete_user(user_id=79da83330e44444c95cf3b09396e2952)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:17.150716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:17.521946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79da83330e44444c95cf3b09396e2952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:17.525169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79da83330e44444c95cf3b09396e2952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:17.641845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79da83330e44444c95cf3b09396e2952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:17.650704 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:17.661631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79da83330e44444c95cf3b09396e2952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:17.669492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79da83330e44444c95cf3b09396e2952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:17.713379 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2879/5718] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:17 2022] DELETE /identity/v3/users/79da83330e44444c95cf3b09396e2952 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:17.718782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:17.738606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92fb6b-b70b-4188-875f-1709b14b93b1 tempest-test_project-137468369 tempest-user-1845609499] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:17.814388 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:17.868805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:17.870397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:17.871576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:17.872355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/projects/832107b83cb34c4f896b942a617c0a1e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:17.875318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:delete_project(project_id=832107b83cb34c4f896b942a617c0a1e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:17.880313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:18.095854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832107b83cb34c4f896b942a617c0a1e', 'request_id': 'req-98095ca7-1e13-4ed6-8091-9ba844ee6467'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.109571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832107b83cb34c4f896b942a617c0a1e', 'request_id': 'req-98095ca7-1e13-4ed6-8091-9ba844ee6467'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.208666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832107b83cb34c4f896b942a617c0a1e', 'request_id': 'req-98095ca7-1e13-4ed6-8091-9ba844ee6467'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.234623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] The token cache is being invalidate because project 832107b83cb34c4f896b942a617c0a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:18.239552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.239552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.241474 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2840/5719] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:17 2022] DELETE /identity/v3/projects/832107b83cb34c4f896b942a617c0a1e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:18.248769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:18.258554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:18.293208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add803f1-6a40-4b77-874f-01120ca2d5da tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:18.374240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:18.375339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:18.375818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:18.376415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/domains/455d050b8e624a95b448936b76c2e623` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:18.379574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=455d050b8e624a95b448936b76c2e623)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:18.381531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:18.470402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '455d050b8e624a95b448936b76c2e623'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.470402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '455d050b8e624a95b448936b76c2e623'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.614461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '455d050b8e624a95b448936b76c2e623'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.616048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '455d050b8e624a95b448936b76c2e623'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:18.618996 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2880/5720] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:38:18 2022] PATCH /identity/v3/domains/455d050b8e624a95b448936b76c2e623 => generated 247 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:18.623200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:18.625362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:18.666678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095ca7-1e13-4ed6-8091-9ba844ee6467 tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:18.906341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5cca84903040dda88c4c8e7d000e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a376538c7842ef9777ded25cdb74c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:18.908082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:18.908674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:18.910303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] PATH_INFO: `/v3/domains/455d050b8e624a95b448936b76c2e623` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:18.940133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=455d050b8e624a95b448936b76c2e623)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:18.942349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:19.050319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '455d050b8e624a95b448936b76c2e623'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.062802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '455d050b8e624a95b448936b76c2e623'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.116381 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:19.232606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455d050b8e624a95b448936b76c2e623', 'request_id': 'req-7257f758-4e77-4d7c-bd71-a4779e50bfac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.254454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455d050b8e624a95b448936b76c2e623', 'request_id': 'req-7257f758-4e77-4d7c-bd71-a4779e50bfac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.385124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455d050b8e624a95b448936b76c2e623', 'request_id': 'req-7257f758-4e77-4d7c-bd71-a4779e50bfac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.442707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] The token cache is being invalidate because project 455d050b8e624a95b448936b76c2e623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:19.442707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.442707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.492458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '455d050b8e624a95b448936b76c2e623', 'request_id': 'req-7257f758-4e77-4d7c-bd71-a4779e50bfac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.495417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '455d050b8e624a95b448936b76c2e623', 'request_id': 'req-7257f758-4e77-4d7c-bd71-a4779e50bfac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.498028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '455d050b8e624a95b448936b76c2e623', 'request_id': 'req-7257f758-4e77-4d7c-bd71-a4779e50bfac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:19.580740 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2841/5721] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:38:18 2022] DELETE /identity/v3/domains/455d050b8e624a95b448936b76c2e623 => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:19.582873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:19.584924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:19.712771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf0567-296b-4803-b1f2-69f60c43700b tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:19.765295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:19.767084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:19.855447 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:19.888699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:19.889625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:19.890140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:19.891816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] PATH_INFO: `/v3/users/abca24b96fdb451cba59fbc83aada10f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:19.896489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=abca24b96fdb451cba59fbc83aada10f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:19.902886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:19.976868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f758-4e77-4d7c-bd71-a4779e50bfac tempest-TestDefaultProjectId-1959024603 tempest-TestDefaultProjectId-1959024603-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:19.991707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:19.992628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:19.992925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:19.993208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] PATH_INFO: `/v3/users/6dcec69c35ba44168d493b5de8c8b0d7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:19.995043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcec69c35ba44168d493b5de8c8b0d7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:19.998360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:20.231138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abca24b96fdb451cba59fbc83aada10f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.232166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abca24b96fdb451cba59fbc83aada10f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.285226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcec69c35ba44168d493b5de8c8b0d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.324521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcec69c35ba44168d493b5de8c8b0d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.334097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abca24b96fdb451cba59fbc83aada10f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.347088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abca24b96fdb451cba59fbc83aada10f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.348205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a266457c-d7d8-4a4f-b51c-b55561018afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abca24b96fdb451cba59fbc83aada10f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.353044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcec69c35ba44168d493b5de8c8b0d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.354931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcec69c35ba44168d493b5de8c8b0d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.406225 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2881/5722] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:19 2022] DELETE /identity/v3/users/abca24b96fdb451cba59fbc83aada10f => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:20.411987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:20.411987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:20.412285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:20.434914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:20.436162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:20.499684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2882/5723] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:20.504470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcec69c35ba44168d493b5de8c8b0d7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:20.511491 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2842/5724] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:19 2022] DELETE /identity/v3/users/6dcec69c35ba44168d493b5de8c8b0d7 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:20.525646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:20.528718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:20.716260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a0edf-7c07-46ce-aa43-d09b4d686c40 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:20.808508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:20.809137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:20.809418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:20.809694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:20.928078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:20.929901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:20.958098 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2883/5725] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:21.780318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:21.782537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:21.807167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f40e3-6142-4d55-80ee-f5a83a604937 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:21.825311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:21.826517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:21.827016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:21.827585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] PATH_INFO: `/v3/projects/6fca0156d15a4f7d94649ac102e81cb2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:21.829493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fca0156d15a4f7d94649ac102e81cb2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:21.832917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:21.840913 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=21,keystone:SELECT=77,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:22.078207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fca0156d15a4f7d94649ac102e81cb2', 'request_id': 'req-703691c3-a9bf-49fc-b646-7d10945e5a12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.082429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:22.084010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:22.089169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fca0156d15a4f7d94649ac102e81cb2', 'request_id': 'req-703691c3-a9bf-49fc-b646-7d10945e5a12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.134599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e916dd-073e-4fc5-b3cf-21282ded1e68 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:22.192653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fca0156d15a4f7d94649ac102e81cb2', 'request_id': 'req-703691c3-a9bf-49fc-b646-7d10945e5a12'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.228025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] The token cache is being invalidate because project 6fca0156d15a4f7d94649ac102e81cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:22.231914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.231914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.238158 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2843/5726] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:21 2022] DELETE /identity/v3/projects/6fca0156d15a4f7d94649ac102e81cb2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:22.239495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:22.246258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:22.262960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:22.264150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:22.264792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:22.265385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] PATH_INFO: `/v3/projects/823aff97741d4a428f8fa306eae26c46` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:22.283526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823aff97741d4a428f8fa306eae26c46)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:22.287878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:22.384353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703691c3-a9bf-49fc-b646-7d10945e5a12 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:22.411364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:22.412997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:22.413277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:22.413554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] PATH_INFO: `/v3/users/0a6cd442aacc4d6c949b9714afd9aac8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:22.416699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6cd442aacc4d6c949b9714afd9aac8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:22.418709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:22.462755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823aff97741d4a428f8fa306eae26c46', 'request_id': 'req-eb2f1bce-f756-4eb5-9abf-fab7313da850'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.476134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823aff97741d4a428f8fa306eae26c46', 'request_id': 'req-eb2f1bce-f756-4eb5-9abf-fab7313da850'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.565326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823aff97741d4a428f8fa306eae26c46', 'request_id': 'req-eb2f1bce-f756-4eb5-9abf-fab7313da850'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.592042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] The token cache is being invalidate because project 823aff97741d4a428f8fa306eae26c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:22.592351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.593131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb2f1bce-f756-4eb5-9abf-fab7313da850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.594977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2884/5727] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:22 2022] DELETE /identity/v3/projects/823aff97741d4a428f8fa306eae26c46 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:22.596191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:22.597020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:22.597320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:22.626575 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:22.628049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:22.629470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:22.697064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6cd442aacc4d6c949b9714afd9aac8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.724570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6cd442aacc4d6c949b9714afd9aac8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.737869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6cd442aacc4d6c949b9714afd9aac8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.738644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6cd442aacc4d6c949b9714afd9aac8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.820492 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2885/5728] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:22.822016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:22.824222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:22.843582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49c31d-d915-4bb6-9a1c-f5bf7a9867af None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:22.854575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:22.855557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:22.856024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:22.856483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] PATH_INFO: `/v3/users/ae5cca84903040dda88c4c8e7d000e3f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:22.857893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5cca84903040dda88c4c8e7d000e3f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:22.859739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bf90799-b11f-445d-8f5d-0eebf65638cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6cd442aacc4d6c949b9714afd9aac8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:22.861657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:22.870755 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2844/5729] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:22 2022] DELETE /identity/v3/users/0a6cd442aacc4d6c949b9714afd9aac8 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:22.872156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48729bed-7d6d-4bf5-9666-f49ba4ffc8b1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:22.872688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48729bed-7d6d-4bf5-9666-f49ba4ffc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:22.879844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48729bed-7d6d-4bf5-9666-f49ba4ffc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:22.914102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-48729bed-7d6d-4bf5-9666-f49ba4ffc8b1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:22.919457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-48729bed-7d6d-4bf5-9666-f49ba4ffc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:23.008665 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2845/5730] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:23.010888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305a7d-a3a7-4452-b04a-2cee81bc900c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.011271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305a7d-a3a7-4452-b04a-2cee81bc900c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.012013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f305a7d-a3a7-4452-b04a-2cee81bc900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.050986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9f305a7d-a3a7-4452-b04a-2cee81bc900c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:23.052558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f305a7d-a3a7-4452-b04a-2cee81bc900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:23.077716 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2846/5731] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:23.078633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305a7d-a3a7-4452-b04a-2cee81bc900c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:23.103388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f305a7d-a3a7-4452-b04a-2cee81bc900c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:23.106528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5cca84903040dda88c4c8e7d000e3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:23.109505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5cca84903040dda88c4c8e7d000e3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:23.124756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:23.129377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.129377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.129377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.129377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:23.129377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:23.130555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:23.149321 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2847/5732] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:23.150281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:23.164157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980964-5f92-4308-ad63-69663b016e66 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:23.170361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:23.171242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.171868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.172989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.173774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:23.177019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:23.202023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5cca84903040dda88c4c8e7d000e3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:23.216126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5cca84903040dda88c4c8e7d000e3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:23.223409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5cca84903040dda88c4c8e7d000e3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:23.262935 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2886/5733] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:22 2022] DELETE /identity/v3/users/ae5cca84903040dda88c4c8e7d000e3f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:23.263861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:23.267619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:23.301604 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2848/5734] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:23 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:23.306347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:23.308801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:23.385413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8137-6ffd-4a58-870a-8b99b1a0c67a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:23.487772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6a2f5-1909-47ad-8bfb-defc25b9b105 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:23.488976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:23.489676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.490618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.490899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.497881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:23.510833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:23.511590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.511936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.512284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.513003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:23.518922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:23.523990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:23.526494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:23.545020 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2887/5735] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:23.642953 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2849/5736] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:23 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:23.647004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:23.663383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97e5a7-918d-4f04-afd2-1de3c5615ac1 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:23.677853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:23.679373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.679901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.681276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.682633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:23.684605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:23.705441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2888/5737] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:23.714671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:23.736868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5550b6-6b20-4dc6-b935-e2ffc8868a47 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:23.751922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd34537-c7b0-41c8-b600-dbd800df8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:23.753103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34537-c7b0-41c8-b600-dbd800df8360 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.754568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34537-c7b0-41c8-b600-dbd800df8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.755443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd34537-c7b0-41c8-b600-dbd800df8360 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.757683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34537-c7b0-41c8-b600-dbd800df8360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:23.761631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd34537-c7b0-41c8-b600-dbd800df8360 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:23.791299 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2850/5738] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:23.795228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:23.812332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86827777-9d06-4499-b604-63bad52146c9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:23.825480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:23.826703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.828200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.828619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] PATH_INFO: `/v3/projects/6de5f879b878484e94af834c1df008e8/users/40464c801b5a4ea3a0d489afc9f46d92/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:23.874426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de5f879b878484e94af834c1df008e8, user_id=40464c801b5a4ea3a0d489afc9f46d92, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:23.878299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:23.975450 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2889/5739] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:23 2022] PUT /identity/v3/projects/6de5f879b878484e94af834c1df008e8/users/40464c801b5a4ea3a0d489afc9f46d92/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:23.980713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e6f9-c94a-4341-b779-5f1688f5660c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:23.981254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e6f9-c94a-4341-b779-5f1688f5660c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:23.981254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0e6f9-c94a-4341-b779-5f1688f5660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.001126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aca0e6f9-c94a-4341-b779-5f1688f5660c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:24.002860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aca0e6f9-c94a-4341-b779-5f1688f5660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:24.008055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:24.010193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:24.075754 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2851/5740] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:24.083805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0e6f9-c94a-4341-b779-5f1688f5660c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:24.122856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3f5ff-122a-4ec7-b94b-26e05de8d45b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:24.128064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:24.128800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.129083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.129355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] PATH_INFO: `/v3/projects/89bbfa6491f343ea9f7fd035973495d7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.131630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bbfa6491f343ea9f7fd035973495d7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:24.134477 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:24.134620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:24.211943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0e6f9-c94a-4341-b779-5f1688f5660c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:24.215918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb097487-4a6c-4d39-9e24-4c129f88f831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:24.216568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097487-4a6c-4d39-9e24-4c129f88f831 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.216846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097487-4a6c-4d39-9e24-4c129f88f831 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.217121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb097487-4a6c-4d39-9e24-4c129f88f831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.227448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb097487-4a6c-4d39-9e24-4c129f88f831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:24.229310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb097487-4a6c-4d39-9e24-4c129f88f831 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:24.252152 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2852/5741] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:38:24.329035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bbfa6491f343ea9f7fd035973495d7', 'request_id': 'req-827fc9cd-ac57-47b6-b839-98b072ddb12d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:24.344942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bbfa6491f343ea9f7fd035973495d7', 'request_id': 'req-827fc9cd-ac57-47b6-b839-98b072ddb12d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:24.436893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bbfa6491f343ea9f7fd035973495d7', 'request_id': 'req-827fc9cd-ac57-47b6-b839-98b072ddb12d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:24.460339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] The token cache is being invalidate because project 89bbfa6491f343ea9f7fd035973495d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:24.460636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:24.461337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-827fc9cd-ac57-47b6-b839-98b072ddb12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:24.463401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2890/5742] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:24 2022] DELETE /identity/v3/projects/89bbfa6491f343ea9f7fd035973495d7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:24.469130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112739d3-bcaa-4edc-ac6b-02a8292d623d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.469403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112739d3-bcaa-4edc-ac6b-02a8292d623d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.470777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112739d3-bcaa-4edc-ac6b-02a8292d623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.499416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-112739d3-bcaa-4edc-ac6b-02a8292d623d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:24.501217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-112739d3-bcaa-4edc-ac6b-02a8292d623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:24.623699 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:24.644338 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2853/5743] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:24.652859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8691e0-ef54-4d49-b663-80ca52d5d622 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.653328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8691e0-ef54-4d49-b663-80ca52d5d622 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.653615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8691e0-ef54-4d49-b663-80ca52d5d622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.678455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bb8691e0-ef54-4d49-b663-80ca52d5d622 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:24.679800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bb8691e0-ef54-4d49-b663-80ca52d5d622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:24.695769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112739d3-bcaa-4edc-ac6b-02a8292d623d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:24.702947 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2891/5744] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:24.719612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112739d3-bcaa-4edc-ac6b-02a8292d623d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:24.732001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:24.732640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.732945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.733212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.734153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:24.734469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:24.736636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:24.763560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8691e0-ef54-4d49-b663-80ca52d5d622 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:24.772421 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2854/5745] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:24.777081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8691e0-ef54-4d49-b663-80ca52d5d622 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:24.784477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695bcec-36d0-41d3-85b8-cd51f168161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:24.785497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695bcec-36d0-41d3-85b8-cd51f168161d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.786125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695bcec-36d0-41d3-85b8-cd51f168161d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.786640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695bcec-36d0-41d3-85b8-cd51f168161d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.787740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695bcec-36d0-41d3-85b8-cd51f168161d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:24.791884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695bcec-36d0-41d3-85b8-cd51f168161d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:24.847086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:24.849409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:24.872675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3cd82-b951-4027-9ad8-3aa323284280 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:24.883026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:24.885748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.890891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.891332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] PATH_INFO: `/v3/projects/e3a376538c7842ef9777ded25cdb74c3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:24.893576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a376538c7842ef9777ded25cdb74c3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:24.895865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:24.973935 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2892/5746] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:24 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:24.984208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c06be-c677-48b3-90f8-632ae151cc99 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:24.985842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c06be-c677-48b3-90f8-632ae151cc99 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:24.986893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c06be-c677-48b3-90f8-632ae151cc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.052432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c13c06be-c677-48b3-90f8-632ae151cc99 None None] MFA Rules not processed for user `88c64df8e3034b71b25b6139a454bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:25.054464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c13c06be-c677-48b3-90f8-632ae151cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:25.133044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a376538c7842ef9777ded25cdb74c3', 'request_id': 'req-78f7d7e2-dd61-4dea-853c-524e414033f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:25.140169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a376538c7842ef9777ded25cdb74c3', 'request_id': 'req-78f7d7e2-dd61-4dea-853c-524e414033f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:25.152239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2893/5747] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:25.153750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c06be-c677-48b3-90f8-632ae151cc99 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.218917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a376538c7842ef9777ded25cdb74c3', 'request_id': 'req-78f7d7e2-dd61-4dea-853c-524e414033f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:25.234544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c06be-c677-48b3-90f8-632ae151cc99 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:25.239466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] The token cache is being invalidate because project e3a376538c7842ef9777ded25cdb74c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:25.241866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:25.243691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78f7d7e2-dd61-4dea-853c-524e414033f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:25.253798 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2855/5748] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:24 2022] DELETE /identity/v3/projects/e3a376538c7842ef9777ded25cdb74c3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:25.262976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab9287-5ac9-415a-b6c8-c509cb5e1329 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.263704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab9287-5ac9-415a-b6c8-c509cb5e1329 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.264933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab9287-5ac9-415a-b6c8-c509cb5e1329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.290433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d9ab9287-5ac9-415a-b6c8-c509cb5e1329 None None] MFA Rules not processed for user `88c64df8e3034b71b25b6139a454bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:25.291673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d9ab9287-5ac9-415a-b6c8-c509cb5e1329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:25.320125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d36e9-4a79-48d3-8300-1080349a13e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:25.321091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d36e9-4a79-48d3-8300-1080349a13e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.321607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d36e9-4a79-48d3-8300-1080349a13e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.322113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d36e9-4a79-48d3-8300-1080349a13e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.323243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d36e9-4a79-48d3-8300-1080349a13e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:25.325459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d36e9-4a79-48d3-8300-1080349a13e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:25.383774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2856/5749] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:25.386464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.400484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.400879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.430772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:25.431965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:25.443159 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2857/5750] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:25.444122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.454445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:25.456902 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2894/5751] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:25 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:25.458527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.469973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.469973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.497319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:25.498605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:25.522048 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2895/5752] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:25.527431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.527600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:25.551587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e2d87-4373-447e-b7e9-0aa7a9938930 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:25.564888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:25.566183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.567322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.567627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.568298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:25.569985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:25.599026 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2896/5753] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:25.599990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.625354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b0d3-fdc2-440a-9141-b02b65b76395 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:25.635115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80053f03-e93d-46b1-bdd8-9978ec0d8244 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:25.647193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:25.650417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.650580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:25.651307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.651662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.652049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.652354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.652660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.653014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:25.653840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:25.657466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:25.658569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:25.691166 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2897/5754] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:25.691166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.699172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:25.708856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d73c8-9dab-436e-9291-b3bf058fe5e5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:25.723259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:25.730135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:25.731495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.731889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.732272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.733133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:25.737588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:25.763569 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2898/5755] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:25.764568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.766548 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2858/5756] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:25.769952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.780788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681eda4-95eb-4372-b88a-efce5a692553 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:25.786900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:25.787602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.787998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.788403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.789932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:25.791970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:25.811104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564477e-315a-4f51-a84a-a47a5b631a5d service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:25.823550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a05f9-2856-407e-b09f-8e049e59885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:25.824239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a05f9-2856-407e-b09f-8e049e59885d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.824521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a05f9-2856-407e-b09f-8e049e59885d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.824798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a05f9-2856-407e-b09f-8e049e59885d admin admin] PATH_INFO: `/v3/projects/0c9ad9c501ca49d0a0daa8bf128ed66f/users/c1d0a94b18ea46109f3e89de317161c1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:25.872042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a05f9-2856-407e-b09f-8e049e59885d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9ad9c501ca49d0a0daa8bf128ed66f, user_id=c1d0a94b18ea46109f3e89de317161c1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:25.875004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a05f9-2856-407e-b09f-8e049e59885d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:25.897328 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2899/5757] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:25 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:25.901616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:25.974903 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2859/5758] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:25 2022] PUT /identity/v3/projects/0c9ad9c501ca49d0a0daa8bf128ed66f/users/c1d0a94b18ea46109f3e89de317161c1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:25.985534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:25.989964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:25.989964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:26.042630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] MFA Rules not processed for user `c1d0a94b18ea46109f3e89de317161c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:26.044062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:26.057789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5142a-3bc9-4995-85e3-4acec29a6462 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:26.073779 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:26.172506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:26.177113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:26.177113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:26.177113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:26.177113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:26.178440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:26.178591 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2860/5759] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:26.241335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:26.243037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:26.264567 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2900/5760] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:25 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:26.271662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:26.293138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08020c02-e215-4d7e-ab37-19c0bbe1f4b1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:26.306164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:26.307123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:26.310416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:26.310416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:26.310416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:26.316326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:26.343306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2901/5761] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:38:26.347717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:26.370356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbdfb5-c3af-4251-a838-b8ab43fcedd9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:26.385141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:26.386256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:26.387108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:26.388355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:26.390522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:26.392619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076b09a-7bf6-4783-99a8-604f1267c27d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:26.395837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:26.411017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce046a2a-bea6-4587-95e8-dfd091310148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:26.411267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046a2a-bea6-4587-95e8-dfd091310148 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:26.411616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046a2a-bea6-4587-95e8-dfd091310148 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:26.411963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce046a2a-bea6-4587-95e8-dfd091310148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:26.434341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce046a2a-bea6-4587-95e8-dfd091310148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:26.434621 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2902/5762] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:26.435796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce046a2a-bea6-4587-95e8-dfd091310148 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:26.438214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:26.448244 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:26.454231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0709-8e2c-4f5c-8907-2ca343049be2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:26.460897 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2861/5763] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:26.464768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:26.465650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:26.468284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:26.468736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] PATH_INFO: `/v3/projects/b2b86bdade734dc595a034dedb0ac308/users/31cfdff695c44ce68ee434d1ed194bed/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:26.501187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b86bdade734dc595a034dedb0ac308, user_id=31cfdff695c44ce68ee434d1ed194bed, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:26.513713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:26.653431 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2903/5764] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:26 2022] PUT /identity/v3/projects/b2b86bdade734dc595a034dedb0ac308/users/31cfdff695c44ce68ee434d1ed194bed/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:26.665671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb01ed-3585-4f90-9c11-bcc1213082e4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:26.666805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb01ed-3585-4f90-9c11-bcc1213082e4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:26.667228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb01ed-3585-4f90-9c11-bcc1213082e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:26.748257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1afb01ed-3585-4f90-9c11-bcc1213082e4 None None] MFA Rules not processed for user `31cfdff695c44ce68ee434d1ed194bed`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:26.749489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1afb01ed-3585-4f90-9c11-bcc1213082e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:26.929780 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2862/5765] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:26.931308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:27.051813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb01ed-3585-4f90-9c11-bcc1213082e4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:27.105899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacdb08-4888-45b3-a282-b4be6a0c52e2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:27.117957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ffb10-02fd-4851-b858-0c473a711873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:27.120014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffb10-02fd-4851-b858-0c473a711873 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:27.121003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffb10-02fd-4851-b858-0c473a711873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:27.123909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffb10-02fd-4851-b858-0c473a711873 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:27.124800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ffb10-02fd-4851-b858-0c473a711873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:27.129025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ffb10-02fd-4851-b858-0c473a711873 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:27.219562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb01ed-3585-4f90-9c11-bcc1213082e4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:27.225887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:27.226647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:27.226836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:27.227117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] PATH_INFO: `/v3/users/c1d0a94b18ea46109f3e89de317161c1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:27.228772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d0a94b18ea46109f3e89de317161c1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:27.230959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:27.244803 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:27.340972 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2904/5766] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:26 2022] POST /identity/v3/projects => generated 371 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:27.343662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:27.344708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:27.345109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:27.428812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] MFA Rules not processed for user `88c64df8e3034b71b25b6139a454bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:27.430298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:27.521096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d0a94b18ea46109f3e89de317161c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:27.600691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d0a94b18ea46109f3e89de317161c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:27.622943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d0a94b18ea46109f3e89de317161c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:27.629302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d0a94b18ea46109f3e89de317161c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:27.691142 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2905/5767] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:27.696107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:27.700538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:27.730767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4532da5-e104-45ec-a2f7-25003c3e396f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d0a94b18ea46109f3e89de317161c1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:27.738527 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2863/5768] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:27 2022] DELETE /identity/v3/users/c1d0a94b18ea46109f3e89de317161c1 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:27.745670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:27.745983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:27.746441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:27.811091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:27.816780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:27.914043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe32f-376f-422c-a2df-06cf40fd6f41 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:27.976241 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2864/5769] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:27.999157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:28.000839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:28.036983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:28.038148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:28.038485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:28.038762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:28.040115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:28.042632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:28.155538 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:28.163688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ccb53-bf86-4e8d-84c8-e8b7ad8b3dc4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:28.186805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:28.186805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:28.186805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:28.186805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:28.227592 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2906/5770] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:27 2022] POST /identity/v3/users => generated 292 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:28.235680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:28.287124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:28.292069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:28.306194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7c48-4fde-463e-90dc-6a0977d82666 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:28.328547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:28.328931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:28.329225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:28.329510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:28.333935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:28.337390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:28.339730 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2865/5771] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:38:28.368890 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2907/5772] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:28.370157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:28.381689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de315d34-3f7f-450d-9fbe-0e53e455a14e service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:28.390846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:28.391989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:28.392341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:28.392697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] PATH_INFO: `/v3/projects/da5611bfde214b32990f75f1a18e2fe8/users/6d634ff0a8be45b8947f43f97b683b57/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:28.439950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5611bfde214b32990f75f1a18e2fe8, user_id=6d634ff0a8be45b8947f43f97b683b57, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:28.443455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:28.582897 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2866/5773] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:28 2022] PUT /identity/v3/projects/da5611bfde214b32990f75f1a18e2fe8/users/6d634ff0a8be45b8947f43f97b683b57/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:28.586755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:28.601144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0adc52-d94a-4e45-920c-5631540e4192 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:28.730405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186641e-8ed3-482f-99ef-a8ecee8583b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:28.731062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186641e-8ed3-482f-99ef-a8ecee8583b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:28.731731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186641e-8ed3-482f-99ef-a8ecee8583b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:28.732021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186641e-8ed3-482f-99ef-a8ecee8583b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:28.732685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186641e-8ed3-482f-99ef-a8ecee8583b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:28.736354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186641e-8ed3-482f-99ef-a8ecee8583b3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:28.761710 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2908/5774] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:28.765674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:28.785190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a16902-da84-4430-a987-25becd7bef81 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:28.797462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:28.798446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:28.798446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:28.798814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] PATH_INFO: `/v3/projects/da5611bfde214b32990f75f1a18e2fe8/users/6d634ff0a8be45b8947f43f97b683b57/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:28.803953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5611bfde214b32990f75f1a18e2fe8, user_id=6d634ff0a8be45b8947f43f97b683b57, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:28.809149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:28.842417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2867/5775] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:28 2022] PUT /identity/v3/projects/da5611bfde214b32990f75f1a18e2fe8/users/6d634ff0a8be45b8947f43f97b683b57/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:28.853933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67daa2-1964-4eb5-8781-0405a3de27d8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:28.853933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67daa2-1964-4eb5-8781-0405a3de27d8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:28.854261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67daa2-1964-4eb5-8781-0405a3de27d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:28.929037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1e67daa2-1964-4eb5-8781-0405a3de27d8 None None] MFA Rules not processed for user `6d634ff0a8be45b8947f43f97b683b57`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:28.933033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1e67daa2-1964-4eb5-8781-0405a3de27d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:28.982541 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:29.186101 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2909/5776] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:29.187823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:29.203172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749e51-befe-42ec-b7d5-7d40f6bea00c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:29.224467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:29.225109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:29.225398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:29.226260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:29.230410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:29.238299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:29.391091 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2868/5777] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:29 2022] POST /identity/v3/services => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:29.392264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67daa2-1964-4eb5-8781-0405a3de27d8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:29.412402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67daa2-1964-4eb5-8781-0405a3de27d8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:29.456807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:29.457508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:29.457803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:29.458116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:29.458817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:29.461069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:29.489380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:29.492602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:29.582146 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1158612822. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:38:29.582146 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:38:29.582146 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:29.713478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2910/5778] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:38:29 2022] POST /identity/v3/endpoints => generated 360 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:29.718257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:29.780258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463ad4-548b-4d8c-b03b-57a4af7677eb tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:29.792708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:29.793482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:29.794159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:29.794836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-1158612822` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:29.796534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1158612822)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:29.797950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:29.801680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3097e2-8c10-4a61-a896-4628eee7d992 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:29.804911 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2911/5779] 10.222.0.59 () {58 vars in 1206 bytes} [Sun Aug 28 01:38:29 2022] GET /identity/v3/regions/tempest-region-1158612822 => generated 180 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:29.808295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:29.832110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b043a0a-7b8b-4511-ba24-479fbc889945 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:29.841673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:29.845166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:29.845455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:29.847110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:29.847965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] PATH_INFO: `/v3/projects/0c9ad9c501ca49d0a0daa8bf128ed66f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:29.850380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:29.852974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:29.852974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:29.852974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:29.855530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9ad9c501ca49d0a0daa8bf128ed66f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:29.858690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:29.860198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:29.979114 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2912/5780] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:29 2022] POST /identity/v3/services => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:29.983784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:30.087264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8114c-8398-4630-bcd5-044039e7a5dc tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:30.093150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:30.094084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:30.094544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:30.095056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:30.095902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:30.097959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:30.229971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9ad9c501ca49d0a0daa8bf128ed66f', 'request_id': 'req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:30.256578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9ad9c501ca49d0a0daa8bf128ed66f', 'request_id': 'req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:30.263695 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-182701671. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:38:30.263695 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:38:30.263695 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:30.314604 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:30.427057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9ad9c501ca49d0a0daa8bf128ed66f', 'request_id': 'req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:30.429620 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2913/5781] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:38:29 2022] POST /identity/v3/endpoints => generated 360 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:30.444501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:30.448705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] The token cache is being invalidate because project 0c9ad9c501ca49d0a0daa8bf128ed66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:30.449796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:30.450625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e08e62cc-81ee-4aac-b3af-15fb1d4a093c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:30.452238 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2869/5782] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:29 2022] DELETE /identity/v3/projects/0c9ad9c501ca49d0a0daa8bf128ed66f => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:30.459023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea812df4-9915-4807-978c-58174ad9d609 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:30.459318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea812df4-9915-4807-978c-58174ad9d609 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:30.459602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea812df4-9915-4807-978c-58174ad9d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:30.515926 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:30.527260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ea812df4-9915-4807-978c-58174ad9d609 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:30.530725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea812df4-9915-4807-978c-58174ad9d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:30.558332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a3b3a-0171-4d4a-a3b9-2c53f9eaad07 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:30.703842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:30.705439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:30.707592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:30.708134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-182701671` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:30.710585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-182701671)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:30.712452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:30.715892 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2914/5783] 10.222.0.59 () {58 vars in 1203 bytes} [Sun Aug 28 01:38:30 2022] GET /identity/v3/regions/tempest-region-182701671 => generated 178 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:30.724041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:30.728976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:30.754224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58289735-63af-4d2b-92c2-d3a5a2bfd52e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:30.771582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:30.772034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:30.772322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:30.772603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:30.774463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:30.776526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:30.789679 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2870/5784] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:30 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:30.792834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad165-fe47-4bd8-8440-635a61b31bba None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:30.793244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad165-fe47-4bd8-8440-635a61b31bba None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:30.793399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad165-fe47-4bd8-8440-635a61b31bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:30.842585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1e9ad165-fe47-4bd8-8440-635a61b31bba None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:30.844112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1e9ad165-fe47-4bd8-8440-635a61b31bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:30.854948 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2871/5785] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:30 2022] POST /identity/v3/auth/tokens => generated 3868 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:30.859074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad165-fe47-4bd8-8440-635a61b31bba None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:30.872460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad165-fe47-4bd8-8440-635a61b31bba None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:30.878236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:30.878901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:30.879176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:30.879445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:30.880423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:30.880423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:30.882031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:30.896650 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1566542166. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:38:30.896650 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:38:30.896650 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:30.897436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2872/5786] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:30.901481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:30.913148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3198104-3a5d-4e4f-b8aa-5d77a790d481 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:30.932779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:30.933465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:30.934384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:30.934384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:30.934742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:30.937130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.012008 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2915/5787] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:38:30 2022] POST /identity/v3/endpoints => generated 361 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:31.016261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.070826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab2e6d-c76c-4d38-aa4d-fbaaa053a0a8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.077892 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2873/5788] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:30 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:31.079681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.085191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.086791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.087344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.087853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-1566542166` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.088662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1566542166)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.090016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.100728 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2916/5789] 10.222.0.59 () {58 vars in 1206 bytes} [Sun Aug 28 01:38:31 2022] GET /identity/v3/regions/tempest-region-1566542166 => generated 180 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:31.102052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.120174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23722560-5dca-432c-9349-8255df619829 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.253477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84230ac0-0a56-4918-9096-b7b300d4680c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.254783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.255537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.255910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.256392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.257097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.259985 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:31.259985 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:38:31.259985 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:31.261058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.292462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.293090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.293366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.293642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.294305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.296146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2917/5790] 10.222.0.59 () {58 vars in 1134 bytes} [Sun Aug 28 01:38:31 2022] GET /identity/v3/endpoints => generated 4395 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:31.300670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.300896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.324877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd74afb-cf13-420c-8581-00bbc5ed2ead tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.343427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.349560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.349560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.349560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints/288426a0b1b14d8bb538da52fb50e0d6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.396459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=288426a0b1b14d8bb538da52fb50e0d6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.397351 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:31.397351 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:38:31.397351 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:31.398638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.401785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2918/5791] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:31 2022] GET /identity/v3/endpoints/288426a0b1b14d8bb538da52fb50e0d6 => generated 361 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:31.413496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.441876 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2874/5792] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:31 2022] POST /identity/v3/users => generated 286 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:31.446393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.459381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13b17e-7d5f-4b08-95df-7238135eea32 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.465220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.466140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.466599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.467678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints/288426a0b1b14d8bb538da52fb50e0d6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.470142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=288426a0b1b14d8bb538da52fb50e0d6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.472168 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:31.472168 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:38:31.472168 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:31.474257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.477421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d1fe-b866-4745-9ea4-8210aa01e8d2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.507737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.508502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.508894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.509520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.510391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.516696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.553258 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2875/5793] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:31.554550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '288426a0b1b14d8bb538da52fb50e0d6', 'request_id': 'req-aaaf51a8-66b6-424f-9378-d7df74958100'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:31.556763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.573789 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2919/5794] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:38:31 2022] DELETE /identity/v3/endpoints/288426a0b1b14d8bb538da52fb50e0d6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:31.576889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8b633-48eb-425d-b64e-10cabc420cca admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.577885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.626349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.627078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.628072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.629939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.637317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.639829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.656475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf51a8-66b6-424f-9378-d7df74958100 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.663929 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2876/5795] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:38:31.668528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.671545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.672182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.672468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.672745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.676049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.677691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.705647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1e3a1-ac4b-4944-9e7d-95a25b4e8231 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.707969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2920/5796] 10.222.0.59 () {58 vars in 1134 bytes} [Sun Aug 28 01:38:31 2022] GET /identity/v3/endpoints => generated 4047 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:31.709123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.714323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b60e8-9b1f-45f3-9d29-322ed775e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.715231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b60e8-9b1f-45f3-9d29-322ed775e78a admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.715755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b60e8-9b1f-45f3-9d29-322ed775e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.722672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b60e8-9b1f-45f3-9d29-322ed775e78a admin admin] PATH_INFO: `/v3/projects/b72d461772bc4a55b182df526d82208c/users/d5ab22d31f864923bbf6d005d2f77504/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.729384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a14f4-8863-45af-9f97-2045f9cb8ac8 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.750139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b60e8-9b1f-45f3-9d29-322ed775e78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72d461772bc4a55b182df526d82208c, user_id=d5ab22d31f864923bbf6d005d2f77504, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:31.754497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b60e8-9b1f-45f3-9d29-322ed775e78a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:31.754696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:31.756870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.757006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.757449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints/288426a0b1b14d8bb538da52fb50e0d6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.783528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Could not find endpoint: 288426a0b1b14d8bb538da52fb50e0d6.: keystone.exception.EndpointNotFound: Could not find endpoint: 288426a0b1b14d8bb538da52fb50e0d6. Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:38:31.833459 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 288426a0b1b14d8bb538da52fb50e0d6. Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:38:31.834974 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:38:31.836399 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 288426a0b1b14d8bb538da52fb50e0d6. Aug 28 01:38:31.838649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:38:31.855233 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2921/5797] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:38:31 2022] DELETE /identity/v3/endpoints/288426a0b1b14d8bb538da52fb50e0d6 => generated 114 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:38:31.856579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2877/5798] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:31 2022] PUT /identity/v3/projects/b72d461772bc4a55b182df526d82208c/users/d5ab22d31f864923bbf6d005d2f77504/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:31.874809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:31.876264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320148e6-8782-43b9-ab90-71864628c241 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:31.876752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320148e6-8782-43b9-ab90-71864628c241 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:31.877209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320148e6-8782-43b9-ab90-71864628c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:31.893057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed74fd1-5b03-4c32-b0bb-4ee6cd8f9568 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:31.974415 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:31.998861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-320148e6-8782-43b9-ab90-71864628c241 None None] MFA Rules not processed for user `d5ab22d31f864923bbf6d005d2f77504`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:32.003742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-320148e6-8782-43b9-ab90-71864628c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:32.005076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.007003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.007584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.008509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-1566542166` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.009303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1566542166)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.015055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.123891 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2878/5799] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:31 2022] POST /identity/v3/auth/tokens => generated 3877 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:32.132620 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2922/5800] 10.222.0.59 () {58 vars in 1209 bytes} [Sun Aug 28 01:38:31 2022] DELETE /identity/v3/regions/tempest-region-1566542166 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:32.134443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320148e6-8782-43b9-ab90-71864628c241 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.138451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.140522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-320148e6-8782-43b9-ab90-71864628c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:32.195157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f9e0-fc3f-4853-9c6c-c1d21bc4f5aa tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.208598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.209513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.209851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.210209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.210967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.213429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.241694 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:32.250177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2923/5801] 10.222.0.59 () {58 vars in 1134 bytes} [Sun Aug 28 01:38:32 2022] GET /identity/v3/endpoints => generated 4047 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:32.253231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.270956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b8ed1-7a48-4ab7-bc3b-ae2a01461d17 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.297152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.298137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.300791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.301085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.301774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Adding query filter params (service_id=b3b066a7b0534ad2a56999fbe14d02e1) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:32.302245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.307920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.328306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2924/5802] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:38:32 2022] GET /identity/v3/endpoints?service_id=b3b066a7b0534ad2a56999fbe14d02e1 => generated 502 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:32.336440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.337487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320148e6-8782-43b9-ab90-71864628c241 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.355285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73b42-5c19-4b43-8483-2dfee265d5a9 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.368907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.369542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.369840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.370129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.370595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.370799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Adding query filter params (service_id=8ee804648754474281e63b734272eefc) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:32.371107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.371501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.371851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.372233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.372706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.384189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.385798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.389249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2925/5803] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:38:32 2022] GET /identity/v3/endpoints?service_id=8ee804648754474281e63b734272eefc => generated 502 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:32.395863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.440589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89a5e-6b47-490c-b610-917f6c169804 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.452351 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2879/5804] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:32 2022] GET /identity/v3/auth/tokens => generated 3877 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:32.475222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.476407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.476892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.477348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.479130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:32.480295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.482158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.523642 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2926/5805] 10.222.0.59 () {58 vars in 1167 bytes} [Sun Aug 28 01:38:32 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:32.527870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.552056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb26831-12c4-4d44-9137-0cb015bc18ac service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.576137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.580234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.580234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.580234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.580234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:32.580234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.580745 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:32.580745 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:38:32.580745 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:32.593470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.605057 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2880/5806] 10.222.0.59 () {58 vars in 1171 bytes} [Sun Aug 28 01:38:32 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:32.614887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.630492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217f5bf-2791-42e0-88d3-5435ca4806d7 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.649626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.650283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.650560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.651044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.651871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.653667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:32.802902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:32.809823 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2927/5807] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:32 2022] POST /identity/v3/services => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:32.819379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a4d21-fc5a-449e-b7b2-8f5f67bff8b4 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:32.867505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:32.868222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:32.868443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:32.868691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:32.869361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:32.871022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:33.013852 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-929140465. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:38:33.013852 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:38:33.013852 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:33.164261 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2881/5808] 10.222.0.59 () {60 vars in 1156 bytes} [Sun Aug 28 01:38:32 2022] POST /identity/v3/endpoints => generated 359 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:33.169303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:33.183829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a76a8-7ace-4af6-9835-53a80ca09620 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:33.220196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:33.220847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:33.221156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:33.221656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-929140465` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:33.222471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-929140465)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:33.223766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:33.227794 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2928/5809] 10.222.0.59 () {58 vars in 1203 bytes} [Sun Aug 28 01:38:33 2022] GET /identity/v3/regions/tempest-region-929140465 => generated 178 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:33.238329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:33.246477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fbe98-c405-49eb-9488-e4d9cc5a234c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:33.251976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:33.252861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:33.253547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:33.253747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints/256d223c9457401384db9df0852fa73b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:33.260316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=256d223c9457401384db9df0852fa73b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:33.262558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:33.364311 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-711451864. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:38:33.364311 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:38:33.364311 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:33.443498 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:33.484332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2882/5810] 10.222.0.59 () {60 vars in 1256 bytes} [Sun Aug 28 01:38:33 2022] PATCH /identity/v3/endpoints/256d223c9457401384db9df0852fa73b => generated 361 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:33.489022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:33.502215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721bf21-7b55-400b-93cc-6fd742222630 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:33.545508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:33.546855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:33.547249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:33.550263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-711451864` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:33.551048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-711451864)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:33.557719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:33.560944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2929/5811] 10.222.0.59 () {58 vars in 1203 bytes} [Sun Aug 28 01:38:33 2022] GET /identity/v3/regions/tempest-region-711451864 => generated 178 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:33.565658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:33.582235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c534115-e5a8-4aa7-a1a9-0710fe1a8c01 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:33.604162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:33.605101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:33.605580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:33.606069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints/256d223c9457401384db9df0852fa73b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:33.622536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=256d223c9457401384db9df0852fa73b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:33.622536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:33.698452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '256d223c9457401384db9df0852fa73b', 'request_id': 'req-89bfd615-f6af-4079-9561-6540f0363d36'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:33.712777 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2883/5812] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:38:33 2022] DELETE /identity/v3/endpoints/256d223c9457401384db9df0852fa73b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:33.718785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:33.738770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff169c-3f5c-4a3b-baa5-6a82d6670547 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:33.779357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:33.780525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:33.780888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:33.781231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-711451864` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:33.781926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-711451864)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:33.784415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:33.910245 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-711451864. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:38:33.910245 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:38:33.910245 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:33.927957 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2930/5813] 10.222.0.59 () {58 vars in 1206 bytes} [Sun Aug 28 01:38:33 2022] DELETE /identity/v3/regions/tempest-region-711451864 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:33.928324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:33.944192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfd615-f6af-4079-9561-6540f0363d36 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:33.965158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:33.966059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:33.966510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:33.976675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-929140465` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:33.977539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-929140465)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:33.990126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:34.123413 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2884/5814] 10.222.0.59 () {58 vars in 1206 bytes} [Sun Aug 28 01:38:33 2022] DELETE /identity/v3/regions/tempest-region-929140465 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:34.128187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:34.140711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eab0dd-e72e-4ba3-b163-2fe36bc17766 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:34.168764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:34.173985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:34.173985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:34.173985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/services/9bcf09c5664643029494843b075178a3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:34.173985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9bcf09c5664643029494843b075178a3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:34.173985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:34.321760 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2931/5815] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:34 2022] DELETE /identity/v3/services/9bcf09c5664643029494843b075178a3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:34.327183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:34.341196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaad318-c169-49b6-9cea-79a8bf633357 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:34.359090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:34.360219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:34.360735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:34.361176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints/5d4e1f662b8242d9a6237bb6b56624a1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:34.365881 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:34.372086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5d4e1f662b8242d9a6237bb6b56624a1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:34.374829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:34.479882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5d4e1f662b8242d9a6237bb6b56624a1', 'request_id': 'req-f4095275-004d-4783-8bd5-1d1fb443c81a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:34.494268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2885/5816] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:38:34 2022] DELETE /identity/v3/endpoints/5d4e1f662b8242d9a6237bb6b56624a1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:34.498559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:34.520343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da1ca-71bd-4b35-85a6-85e3dfd7e351 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:34.546886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:34.547529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:34.547813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:34.548464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-182701671` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:34.550023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-182701671)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:34.551955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:34.652359 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2932/5817] 10.222.0.59 () {58 vars in 1206 bytes} [Sun Aug 28 01:38:34 2022] DELETE /identity/v3/regions/tempest-region-182701671 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:34.656108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:34.671125 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:34.671593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4095275-004d-4783-8bd5-1d1fb443c81a tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:34.688705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:34.689727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:34.690327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:34.690676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/services/8ee804648754474281e63b734272eefc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:34.691478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8ee804648754474281e63b734272eefc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:34.693448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:34.796781 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2886/5818] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:34 2022] DELETE /identity/v3/services/8ee804648754474281e63b734272eefc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:34.802880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:34.819260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96e17c-ba23-4d7c-bff7-48a3cfbb2a19 tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:34.845203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:34.845976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:34.849784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:34.849784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/endpoints/ffd731a2ffc2451dbe5e53d4a4890180` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:34.862963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ffd731a2ffc2451dbe5e53d4a4890180)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:34.865465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:34.987695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ffd731a2ffc2451dbe5e53d4a4890180', 'request_id': 'req-167ca3fb-b33c-4d8a-a36e-126a6876891b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:35.025442 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2933/5819] 10.222.0.59 () {58 vars in 1236 bytes} [Sun Aug 28 01:38:34 2022] DELETE /identity/v3/endpoints/ffd731a2ffc2451dbe5e53d4a4890180 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:35.026106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:35.042275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce5cbb-7ebd-4267-8901-d56f33970d8c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:35.064754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:35.066261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:35.066890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:35.067348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/regions/tempest-region-1158612822` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:35.070551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1158612822)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:35.072566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:35.152983 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1158612822. To ensure interoperability, identifiers should be a valid uuid. Aug 28 01:38:35.152983 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 01:38:35.152983 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:35.163592 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2887/5820] 10.222.0.59 () {58 vars in 1209 bytes} [Sun Aug 28 01:38:35 2022] DELETE /identity/v3/regions/tempest-region-1158612822 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:35.167531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:35.184509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca3fb-b33c-4d8a-a36e-126a6876891b tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:35.223220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b6f8f-f146-40d0-bfcc-5780e648120c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d634ff0a8be45b8947f43f97b683b57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da5611bfde214b32990f75f1a18e2fe8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:35.224297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b6f8f-f146-40d0-bfcc-5780e648120c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:35.228542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b6f8f-f146-40d0-bfcc-5780e648120c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:35.228542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b6f8f-f146-40d0-bfcc-5780e648120c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] PATH_INFO: `/v3/services/b3b066a7b0534ad2a56999fbe14d02e1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:35.228542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b6f8f-f146-40d0-bfcc-5780e648120c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b3b066a7b0534ad2a56999fbe14d02e1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:35.229252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b6f8f-f146-40d0-bfcc-5780e648120c tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:35.335312 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2934/5821] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:35 2022] DELETE /identity/v3/services/b3b066a7b0534ad2a56999fbe14d02e1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:35.336882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:35.338949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:35.439877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7afda7-b9dc-4642-b82e-d8833988af6e tempest-EndPointsTestJSON-1145317293 tempest-EndPointsTestJSON-1145317293-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:35.457972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:35.459035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:35.459589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:35.460107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] PATH_INFO: `/v3/users/31cfdff695c44ce68ee434d1ed194bed` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:35.461524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cfdff695c44ce68ee434d1ed194bed)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:35.463985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:35.716724 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:35.747769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cfdff695c44ce68ee434d1ed194bed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:35.772180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cfdff695c44ce68ee434d1ed194bed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:35.782292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cfdff695c44ce68ee434d1ed194bed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:35.790312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cfdff695c44ce68ee434d1ed194bed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:35.853415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cfdff695c44ce68ee434d1ed194bed'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:35.875680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:35.876273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:35.876716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:35.880798 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2888/5822] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:35 2022] DELETE /identity/v3/users/31cfdff695c44ce68ee434d1ed194bed => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:35.904126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:35.904126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:35.991901 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2935/5823] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:36.013312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:36.015384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:36.098958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dd848-ea05-4a51-9917-81d4144b6d16 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:36.103021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:36.103761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:36.104143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:36.104489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:36.110172 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:36.119300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:36.123040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:36.141834 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2889/5824] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:36.687089 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:37.075747 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:37.076971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:37.081641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:37.098902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ec42f-c7f7-4022-b4fd-6c1016588388 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:37.129399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:37.130223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:37.130574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:37.130920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] PATH_INFO: `/v3/projects/b2b86bdade734dc595a034dedb0ac308` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:37.142696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b86bdade734dc595a034dedb0ac308)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:37.145263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:37.385790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b86bdade734dc595a034dedb0ac308', 'request_id': 'req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:37.399670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b86bdade734dc595a034dedb0ac308', 'request_id': 'req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:37.512776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b86bdade734dc595a034dedb0ac308', 'request_id': 'req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:37.542499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] The token cache is being invalidate because project b2b86bdade734dc595a034dedb0ac308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:37.542790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:37.543586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:37.552016 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2936/5825] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:37 2022] DELETE /identity/v3/projects/b2b86bdade734dc595a034dedb0ac308 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:37.553564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:37.564003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859086e-9be9-4fca-987a-036754ff2c5f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:37.654828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:37.655849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:37.656321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:37.657534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] PATH_INFO: `/v3/users/6d634ff0a8be45b8947f43f97b683b57` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:37.662542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d634ff0a8be45b8947f43f97b683b57)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:37.670083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:37.957441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d634ff0a8be45b8947f43f97b683b57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:37.993499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d634ff0a8be45b8947f43f97b683b57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:38.002028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d634ff0a8be45b8947f43f97b683b57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:38.003148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d634ff0a8be45b8947f43f97b683b57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:38.077509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11aeefb5-fa9c-47b9-88da-2114bcc8b143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d634ff0a8be45b8947f43f97b683b57'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:38.094893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2890/5826] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:37 2022] DELETE /identity/v3/users/6d634ff0a8be45b8947f43f97b683b57 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:38.790214 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:39.078466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:39.080246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c860-d701-4408-bbf8-90e2c2039d55 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:39.081251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:39.081760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c860-d701-4408-bbf8-90e2c2039d55 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:39.082274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c860-d701-4408-bbf8-90e2c2039d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:39.105066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a42e-6cc0-4a12-b291-2c584dae4d37 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:39.121828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a2f2c860-d701-4408-bbf8-90e2c2039d55 None None] MFA Rules not processed for user `6f1befb6a1cc4bbcab7afe9d69483891`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:39.124463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2f2c860-d701-4408-bbf8-90e2c2039d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:39.240784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:39.241443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:39.241729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:39.242027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] PATH_INFO: `/v3/projects/da5611bfde214b32990f75f1a18e2fe8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:39.251819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5611bfde214b32990f75f1a18e2fe8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:39.254184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:39.280458 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2891/5827] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:38:39.459903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5611bfde214b32990f75f1a18e2fe8', 'request_id': 'req-df28d2f8-260e-4489-afec-868dbde3dff6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:39.469966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5611bfde214b32990f75f1a18e2fe8', 'request_id': 'req-df28d2f8-260e-4489-afec-868dbde3dff6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:39.597377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5611bfde214b32990f75f1a18e2fe8', 'request_id': 'req-df28d2f8-260e-4489-afec-868dbde3dff6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:39.622318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] The token cache is being invalidate because project da5611bfde214b32990f75f1a18e2fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:39.622617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:39.634298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df28d2f8-260e-4489-afec-868dbde3dff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:39.636199 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2937/5828] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:39 2022] DELETE /identity/v3/projects/da5611bfde214b32990f75f1a18e2fe8 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:39.641114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630304c-004d-4c22-9e90-b34f6c4b3ec4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:39.641404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630304c-004d-4c22-9e90-b34f6c4b3ec4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:39.641734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630304c-004d-4c22-9e90-b34f6c4b3ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:39.673310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f630304c-004d-4c22-9e90-b34f6c4b3ec4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:39.677414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f630304c-004d-4c22-9e90-b34f6c4b3ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:39.700619 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:39.813596 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2892/5829] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:39.816188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f56d-c835-4f8c-99e3-bac1092e2ba2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:39.816723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f56d-c835-4f8c-99e3-bac1092e2ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:39.816723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934f56d-c835-4f8c-99e3-bac1092e2ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:39.885790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c934f56d-c835-4f8c-99e3-bac1092e2ba2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:39.893198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c934f56d-c835-4f8c-99e3-bac1092e2ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:39.920469 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2938/5830] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:39.925290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630304c-004d-4c22-9e90-b34f6c4b3ec4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:39.944967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630304c-004d-4c22-9e90-b34f6c4b3ec4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:39.958083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:39.958726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:39.959008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:39.959284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:39.960014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:39.960360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:39.962020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:39.987631 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2893/5831] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:39.990937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934f56d-c835-4f8c-99e3-bac1092e2ba2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:40.006485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934f56d-c835-4f8c-99e3-bac1092e2ba2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:40.016691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:40.017424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:40.018628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:40.018628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:40.019402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:40.025198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:40.187331 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2939/5832] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:39 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:40.192890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:40.208498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd5f99-4a77-4d77-8d43-a077a23e2dc0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:40.292192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:40.293158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:40.296700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:40.305532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:40.305532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:40.305532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:40.411726 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2894/5833] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:40 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:40.415593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:40.435681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6287b-ce9d-414c-a30f-d854baef464f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:40.442793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:40.444042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:40.444558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:40.445060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:40.446301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:40.449533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:40.454154 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:40.470446 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2940/5834] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:38:40.472691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:40.486559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2be41-c174-4ab3-96a4-cd512a75c612 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:40.493039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd45bb-acf4-43fa-b279-4af730a605f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:40.494040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd45bb-acf4-43fa-b279-4af730a605f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:40.494855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd45bb-acf4-43fa-b279-4af730a605f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:40.495368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd45bb-acf4-43fa-b279-4af730a605f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:40.496281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd45bb-acf4-43fa-b279-4af730a605f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:40.498430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd45bb-acf4-43fa-b279-4af730a605f1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:40.517895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2895/5835] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:40.521506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:40.534421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2ced2-7993-49f4-8dc4-dacda27d92bb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:40.543877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:40.544982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:40.545874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:40.546576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] PATH_INFO: `/v3/projects/7d1be35e5d9742978d258b5053aa5073/users/f2b854462c704010ae3a416d309713d9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:40.571172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1be35e5d9742978d258b5053aa5073, user_id=f2b854462c704010ae3a416d309713d9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:40.574631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:40.698428 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2941/5836] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:40 2022] PUT /identity/v3/projects/7d1be35e5d9742978d258b5053aa5073/users/f2b854462c704010ae3a416d309713d9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:40.709973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7004-a1a2-43ae-990e-98f9f78fcdfb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:40.710571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7004-a1a2-43ae-990e-98f9f78fcdfb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:40.711010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7004-a1a2-43ae-990e-98f9f78fcdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:40.765435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-86eb7004-a1a2-43ae-990e-98f9f78fcdfb None None] MFA Rules not processed for user `f2b854462c704010ae3a416d309713d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:40.768531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-86eb7004-a1a2-43ae-990e-98f9f78fcdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:40.868801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2896/5837] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:38:40.873451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:40.885184 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:40.950900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb353e-f4db-4701-ba8b-8e97886e4dcf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:40.957104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:40.958003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:40.958448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:40.958915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:40.959738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:40.962000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:41.120046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2942/5838] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:40 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:41.120885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb7004-a1a2-43ae-990e-98f9f78fcdfb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:41.155844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb7004-a1a2-43ae-990e-98f9f78fcdfb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:41.446331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:41.448151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:41.453398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:41.453398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:41.453398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:41.460526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:41.560388 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2897/5839] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:41 2022] POST /identity/v3/users => generated 290 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:41.564113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:41.590390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5fc6f-0602-4520-ac27-fbde92d96c81 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:41.598751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:41.599772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:41.600224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:41.600929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:41.601745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:41.603742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:41.654641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:41.659093 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2943/5840] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:41.670052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72dde9-3a0c-420a-b051-5568ccf25c7d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:41.676118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:41.678242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:41.684468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:41.684468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] PATH_INFO: `/v3/projects/4f631956ca604dddaa9373571da65971/users/0ec596b6e2fd401487843389611a74fd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:41.722491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f631956ca604dddaa9373571da65971, user_id=0ec596b6e2fd401487843389611a74fd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:41.729662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:41.834886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2898/5841] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:41 2022] PUT /identity/v3/projects/4f631956ca604dddaa9373571da65971/users/0ec596b6e2fd401487843389611a74fd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:41.836062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:41.850026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4acda-a34f-48fd-8321-d0c2a8425f0e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:41.944099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf342f-7734-4461-9e5d-bc88390c0924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:41.946031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf342f-7734-4461-9e5d-bc88390c0924 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:41.946560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf342f-7734-4461-9e5d-bc88390c0924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:41.947110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf342f-7734-4461-9e5d-bc88390c0924 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:41.948075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf342f-7734-4461-9e5d-bc88390c0924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:41.950102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf342f-7734-4461-9e5d-bc88390c0924 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:41.968499 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2944/5842] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:41.973271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:41.984447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe0401-a176-400c-afbc-aa216b365fdc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:41.990187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:41.991209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:41.991762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:41.992348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] PATH_INFO: `/v3/projects/4f631956ca604dddaa9373571da65971/users/0ec596b6e2fd401487843389611a74fd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:41.995480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f631956ca604dddaa9373571da65971, user_id=0ec596b6e2fd401487843389611a74fd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:41.998698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:42.012525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2899/5843] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:41 2022] PUT /identity/v3/projects/4f631956ca604dddaa9373571da65971/users/0ec596b6e2fd401487843389611a74fd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:42.023792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f121-6f2f-497f-8aaa-572e4702b7bf None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:42.024114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f121-6f2f-497f-8aaa-572e4702b7bf None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:42.024418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803f121-6f2f-497f-8aaa-572e4702b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:42.058499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e803f121-6f2f-497f-8aaa-572e4702b7bf None None] MFA Rules not processed for user `0ec596b6e2fd401487843389611a74fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:42.059858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e803f121-6f2f-497f-8aaa-572e4702b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:42.140858 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2945/5844] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:38:42.146532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:42.160929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aea4c-f979-4256-ae33-8154b6f21884 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:42.167269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:42.167977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:42.168389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:42.169265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:42.170376 n-d-master-1 devstack@keystone.service[82006]: WARNING oslo_log.versionutils [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 01:38:42.170937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:42.172225 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:42.172225 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:38:42.172225 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:42.173679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:42.313585 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2900/5845] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:38:42 2022] POST /identity/v3/policies => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:38:42.323911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f121-6f2f-497f-8aaa-572e4702b7bf None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:42.339218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803f121-6f2f-497f-8aaa-572e4702b7bf None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:42.346235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:42.347085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:42.347370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:42.347645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies/8123dd82ca8c496e83cecf930a7bca8f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:42.348999 n-d-master-1 devstack@keystone.service[82007]: WARNING oslo_log.versionutils [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 01:38:42.349503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=8123dd82ca8c496e83cecf930a7bca8f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:42.351107 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:42.351107 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:38:42.351107 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:42.352159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:42.447278 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2946/5846] 10.222.0.59 () {60 vars in 1252 bytes} [Sun Aug 28 01:38:42 2022] PATCH /identity/v3/policies/8123dd82ca8c496e83cecf930a7bca8f => generated 235 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:42.455788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:42.467175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df84697-9ccd-4c98-afd6-47dd1def3abf tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:42.477268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:42.479266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:42.479760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:42.480596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies/8123dd82ca8c496e83cecf930a7bca8f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:42.481775 n-d-master-1 devstack@keystone.service[82006]: WARNING oslo_log.versionutils [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 01:38:42.482617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=8123dd82ca8c496e83cecf930a7bca8f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:42.484115 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:42.484115 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:38:42.484115 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:42.485638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:42.511201 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2901/5847] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:38:42 2022] GET /identity/v3/policies/8123dd82ca8c496e83cecf930a7bca8f => generated 235 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:42.515456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:42.531284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef75c8-90d6-4e90-8ae0-698125d3546a tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:42.544313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:42.545221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:42.546571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:42.548671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies/8123dd82ca8c496e83cecf930a7bca8f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:42.552740 n-d-master-1 devstack@keystone.service[82007]: WARNING oslo_log.versionutils [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 01:38:42.555956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8123dd82ca8c496e83cecf930a7bca8f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:42.562374 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:42.562374 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:38:42.562374 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:42.566514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:42.678353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:42.678547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2947/5848] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:42 2022] DELETE /identity/v3/policies/8123dd82ca8c496e83cecf930a7bca8f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:42.707505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3b71d-0202-47cc-b184-f9f7c44d8d27 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:42.720210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:42.722451 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:42.726259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:42.742192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:42.742192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:42.742192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:42.742192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:42.876124 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2902/5849] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:38:42 2022] POST /identity/v3/policies => generated 228 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:42.880168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:42.891028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a45b6-0d10-44b1-aa12-ae9b1c3a5fbb tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:42.897125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:42.898151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:42.898708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:42.899219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:42.900402 n-d-master-1 devstack@keystone.service[82007]: WARNING oslo_log.versionutils [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 01:38:42.901141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:42.902696 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:42.902696 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:38:42.902696 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:42.903898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:43.034442 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2948/5850] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:38:42 2022] POST /identity/v3/policies => generated 228 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:43.038684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:43.055493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ace01-5884-474b-aad3-3f5f56fb5a0d tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:43.071639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:43.072952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:43.073634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:43.073634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:43.074725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:43.077869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:43.163774 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:43.181857 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2903/5851] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:38:43 2022] POST /identity/v3/policies => generated 230 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:43.186601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:43.209727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55371a-1128-43c8-9764-d863665019e3 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:43.217101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:43.218068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:43.218359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:43.219192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:43.220152 n-d-master-1 devstack@keystone.service[82007]: WARNING oslo_log.versionutils [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 01:38:43.221440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:43.224409 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:43.224409 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:38:43.224409 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:38:43.225699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:43.239209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2949/5852] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:38:43 2022] GET /identity/v3/policies => generated 762 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:43.243617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:43.258025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341dec9-5cfd-478a-8b0d-0ebc46ce89ad tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:43.264203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:43.264859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:43.265337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:43.265997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies/54841ec8cf6e46cf920e6969602f8281` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:43.266962 n-d-master-1 devstack@keystone.service[82006]: WARNING oslo_log.versionutils [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 01:38:43.267871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=54841ec8cf6e46cf920e6969602f8281)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:43.269865 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:43.269865 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:38:43.269865 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:43.271475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:43.374751 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2904/5853] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:43 2022] DELETE /identity/v3/policies/54841ec8cf6e46cf920e6969602f8281 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:43.379605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:43.400137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc929e4-ef76-4b47-aa16-e29e18a0f4a5 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:43.418351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:43.419554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:43.420000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:43.420515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies/e280602c0ede478590056aa2e9c9b644` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:43.421989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e280602c0ede478590056aa2e9c9b644)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:43.430974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:43.528120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2950/5854] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:43 2022] DELETE /identity/v3/policies/e280602c0ede478590056aa2e9c9b644 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:43.532237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:43.550288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fdd6f-605f-4c36-9d2c-11f23c525643 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:43.558062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6374f-a9f4-425d-bcb8-8077dd4bf3be tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ec596b6e2fd401487843389611a74fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f631956ca604dddaa9373571da65971', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:43.559868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6374f-a9f4-425d-bcb8-8077dd4bf3be tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:43.560303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6374f-a9f4-425d-bcb8-8077dd4bf3be tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:43.561258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6374f-a9f4-425d-bcb8-8077dd4bf3be tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] PATH_INFO: `/v3/policies/c4a66f9c92d74984b3d1789e553cb800` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:43.562739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6374f-a9f4-425d-bcb8-8077dd4bf3be tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c4a66f9c92d74984b3d1789e553cb800)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:43.566015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6374f-a9f4-425d-bcb8-8077dd4bf3be tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:43.671520 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2905/5855] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:43 2022] DELETE /identity/v3/policies/c4a66f9c92d74984b3d1789e553cb800 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:43.678552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:43.941141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449e82e-4601-4240-9ee6-e16de8ec3f11 tempest-PoliciesTestJSON-820544267 tempest-PoliciesTestJSON-820544267-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:43.956859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:43.958427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:43.958951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:43.959467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] PATH_INFO: `/v3/users/f2b854462c704010ae3a416d309713d9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:43.963121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b854462c704010ae3a416d309713d9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:43.965287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:44.243519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b854462c704010ae3a416d309713d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:44.243519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b854462c704010ae3a416d309713d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:44.350022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b854462c704010ae3a416d309713d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:44.361234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b854462c704010ae3a416d309713d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:44.361234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b854462c704010ae3a416d309713d9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:44.381615 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2951/5856] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:43 2022] DELETE /identity/v3/users/f2b854462c704010ae3a416d309713d9 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:44.386812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac2e7a-9143-48a6-94ef-2e72d31d9e47 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:44.387092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac2e7a-9143-48a6-94ef-2e72d31d9e47 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:44.387374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac2e7a-9143-48a6-94ef-2e72d31d9e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:44.429116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-06ac2e7a-9143-48a6-94ef-2e72d31d9e47 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:44.432280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-06ac2e7a-9143-48a6-94ef-2e72d31d9e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:44.519896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2906/5857] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:44.530094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:44.531858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:44.636953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ca536-2f9a-4052-8108-3bde5d4c01c7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:44.640679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691d61b-8c39-46d5-8560-099cfb6d7bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:44.642533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d61b-8c39-46d5-8560-099cfb6d7bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:44.643182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d61b-8c39-46d5-8560-099cfb6d7bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:44.643474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691d61b-8c39-46d5-8560-099cfb6d7bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:44.658291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691d61b-8c39-46d5-8560-099cfb6d7bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:44.661467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691d61b-8c39-46d5-8560-099cfb6d7bc3 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:44.675690 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2952/5858] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:44.681912 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:44.996940 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:45.970376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:45.970823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:45.971961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:46.082811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] MFA Rules not processed for user `40464c801b5a4ea3a0d489afc9f46d92`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:46.088567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:46.228503 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:46.308069 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2907/5859] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:46.309931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:46.310397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:46.310489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:46.342347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:46.344085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:46.372760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] MFA Rules not processed for user `40464c801b5a4ea3a0d489afc9f46d92`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:46.379908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:46.384744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248d0af-8e05-4791-b21f-00dc727ba771 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:46.430163 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2953/5860] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:46.431078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:46.431968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:46.432403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:46.432863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] PATH_INFO: `/v3/projects/7d1be35e5d9742978d258b5053aa5073` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:46.434734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1be35e5d9742978d258b5053aa5073)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:46.436973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:46.445631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:46.447163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:46.664069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1be35e5d9742978d258b5053aa5073', 'request_id': 'req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:46.683938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1be35e5d9742978d258b5053aa5073', 'request_id': 'req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:46.744145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b592da9-b6ca-4dfd-9f47-d69eb30aad05 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:46.791747 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:46.812615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1be35e5d9742978d258b5053aa5073', 'request_id': 'req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:46.858465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] The token cache is being invalidate because project 7d1be35e5d9742978d258b5053aa5073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:46.861318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:46.866219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:46.872072 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2908/5861] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:46 2022] DELETE /identity/v3/projects/7d1be35e5d9742978d258b5053aa5073 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:46.874372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:46.877302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:46.938345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:46.938982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:46.939268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:46.939747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:46.947769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:46.997462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dac1c-68b9-4c20-9ca8-efbaf7c382b3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:47.004649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:47.005700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:47.006397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:47.007380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:47.012431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:47.046396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:47.050740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:47.083727 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2909/5862] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:47.086207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:47.090095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:47.093747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:47.098717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:47.142529 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2954/5863] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:38:47.307030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f536cc-b61d-48d5-b797-2bf1a4c33737 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:47.319053 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:47.339909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:47.343949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:47.344266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:47.347962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] PATH_INFO: `/v3/users/0ec596b6e2fd401487843389611a74fd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:47.362642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec596b6e2fd401487843389611a74fd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:47.372657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:47.662692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec596b6e2fd401487843389611a74fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:47.715536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec596b6e2fd401487843389611a74fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:47.754084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec596b6e2fd401487843389611a74fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:47.754084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec596b6e2fd401487843389611a74fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:47.860457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a369c2c6-4dbb-4b1a-8de8-f654d13d779c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec596b6e2fd401487843389611a74fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:47.872049 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2910/5864] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:47 2022] DELETE /identity/v3/users/0ec596b6e2fd401487843389611a74fd => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:49.098388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:49.116020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573725d-a528-4e99-958b-66a6033d07e9 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:49.331298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:49.332169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.332642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.333437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] PATH_INFO: `/v3/projects/4f631956ca604dddaa9373571da65971` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.334949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f631956ca604dddaa9373571da65971)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:49.337587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:49.519387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f631956ca604dddaa9373571da65971', 'request_id': 'req-faef6626-119a-4776-b514-5e7a2d28ef67'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:49.530560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f631956ca604dddaa9373571da65971', 'request_id': 'req-faef6626-119a-4776-b514-5e7a2d28ef67'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:49.633148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f631956ca604dddaa9373571da65971', 'request_id': 'req-faef6626-119a-4776-b514-5e7a2d28ef67'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:49.635058 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:49.655227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] The token cache is being invalidate because project 4f631956ca604dddaa9373571da65971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:49.655540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:49.656352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-faef6626-119a-4776-b514-5e7a2d28ef67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:49.666042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5d58-ce8b-44ee-84e9-09d62f07c1d7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.666585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5d58-ce8b-44ee-84e9-09d62f07c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.666585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5d58-ce8b-44ee-84e9-09d62f07c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.670543 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2955/5865] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:49 2022] DELETE /identity/v3/projects/4f631956ca604dddaa9373571da65971 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:49.724046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a68c5d58-ce8b-44ee-84e9-09d62f07c1d7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:49.725311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a68c5d58-ce8b-44ee-84e9-09d62f07c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:49.898348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448655-31eb-41ea-899f-102fbc704375 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.898637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448655-31eb-41ea-899f-102fbc704375 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.898934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448655-31eb-41ea-899f-102fbc704375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.903751 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2911/5866] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:49.949017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-29448655-31eb-41ea-899f-102fbc704375 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:49.953390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-29448655-31eb-41ea-899f-102fbc704375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:49.993388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2956/5867] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:50.001547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5d58-ce8b-44ee-84e9-09d62f07c1d7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:50.027688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5d58-ce8b-44ee-84e9-09d62f07c1d7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:50.048777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:50.050127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:50.050652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:50.051132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:50.052035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:50.052822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:50.054560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:50.102651 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2912/5868] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:50.106489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448655-31eb-41ea-899f-102fbc704375 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:50.156778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448655-31eb-41ea-899f-102fbc704375 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:50.176269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:50.177481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:50.178017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:50.178486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:50.179303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:50.187223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:50.365337 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2957/5869] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:50 2022] POST /identity/v3/projects => generated 369 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:50.370285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:50.424030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecdd5f-fcbe-4348-ba3c-9c926780eae7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:50.638394 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:50.638394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:50.638394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:50.638394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:50.640976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:50.640976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:50.640976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:50.909395 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2913/5870] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:50 2022] POST /identity/v3/users => generated 285 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:50.917979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:50.934789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6027-09b3-4e18-a59d-415a1f211a5f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:50.943340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:50.945624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:50.945624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:50.945624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:50.947040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:50.951636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:50.995415 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2958/5871] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:50.999040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:51.018800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2796be-e415-45b4-8895-4ac4ef021d0e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:51.025369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ceb12-2c70-424b-a412-ff3b27829c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:51.028684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ceb12-2c70-424b-a412-ff3b27829c72 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:51.030158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ceb12-2c70-424b-a412-ff3b27829c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:51.030541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ceb12-2c70-424b-a412-ff3b27829c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:51.032443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ceb12-2c70-424b-a412-ff3b27829c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:51.040812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ceb12-2c70-424b-a412-ff3b27829c72 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:51.072037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2914/5872] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:38:51.076559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:51.091875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e87f-c20f-40d3-894e-8d6139344466 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:51.100560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:51.101537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:51.102103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:51.102495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] PATH_INFO: `/v3/projects/1026daada77d49f7ad16d1f0485e183f/users/8c242abedca64987a5c4e94db8587f7c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:51.134594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1026daada77d49f7ad16d1f0485e183f, user_id=8c242abedca64987a5c4e94db8587f7c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:51.137770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:51.222119 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2959/5873] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:51 2022] PUT /identity/v3/projects/1026daada77d49f7ad16d1f0485e183f/users/8c242abedca64987a5c4e94db8587f7c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:51.233314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713e85-e8f0-4ce6-8029-305e9977ef42 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:51.234262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713e85-e8f0-4ce6-8029-305e9977ef42 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:51.234813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713e85-e8f0-4ce6-8029-305e9977ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:51.297195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-16713e85-e8f0-4ce6-8029-305e9977ef42 None None] MFA Rules not processed for user `8c242abedca64987a5c4e94db8587f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:51.299065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-16713e85-e8f0-4ce6-8029-305e9977ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:51.419029 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2915/5874] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:51.423786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:51.524291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36f71-13dc-4592-97b6-4a881a430e89 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:51.531864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:51.534054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:51.534625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:51.535071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:51.536194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:51.539259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:51.727489 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2960/5875] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:51 2022] POST /identity/v3/projects => generated 367 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:51.731661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713e85-e8f0-4ce6-8029-305e9977ef42 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:51.771158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713e85-e8f0-4ce6-8029-305e9977ef42 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:52.069113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:52.073039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:52.073341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:52.073610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:52.077309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:52.083958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:52.242869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:52.257896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2916/5876] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:51 2022] POST /identity/v3/users => generated 290 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:52.258502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862045-feda-49d9-a3b3-92c6aa4d56ff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:52.266901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:52.267863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:52.268417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:52.268898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:52.269903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:52.272073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:52.311672 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2961/5877] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:38:52.317159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:52.357506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616692-295c-49cb-870b-05a1c2ca1d35 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:52.358622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:52.358959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:52.359334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:52.359906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] PATH_INFO: `/v3/projects/610ce57f2c56406bad7211fd03bf20c1/users/a05c69197d0a4017a46ec7478b4fa775/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:52.381766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=610ce57f2c56406bad7211fd03bf20c1, user_id=a05c69197d0a4017a46ec7478b4fa775, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:52.384544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:52.502956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:52.504184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2917/5878] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:52 2022] PUT /identity/v3/projects/610ce57f2c56406bad7211fd03bf20c1/users/a05c69197d0a4017a46ec7478b4fa775/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:52.523271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d92ca-2f4e-4612-a916-7fc6e070efb9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:52.784929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2522bdc-45f1-4432-8ab3-834fe703d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:52.784929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522bdc-45f1-4432-8ab3-834fe703d4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:52.784929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522bdc-45f1-4432-8ab3-834fe703d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:52.784929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522bdc-45f1-4432-8ab3-834fe703d4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:52.785757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2522bdc-45f1-4432-8ab3-834fe703d4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:52.785907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2522bdc-45f1-4432-8ab3-834fe703d4e1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:52.787629 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:52.813643 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2962/5879] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:38:52.816925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:52.844919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3822b-8124-41c1-937a-c2032ef74d71 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:52.853355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:52.854308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:52.854691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:52.855070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] PATH_INFO: `/v3/projects/610ce57f2c56406bad7211fd03bf20c1/users/a05c69197d0a4017a46ec7478b4fa775/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:52.858018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=610ce57f2c56406bad7211fd03bf20c1, user_id=a05c69197d0a4017a46ec7478b4fa775, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:52.861655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:52.877625 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2918/5880] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:38:52 2022] PUT /identity/v3/projects/610ce57f2c56406bad7211fd03bf20c1/users/a05c69197d0a4017a46ec7478b4fa775/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:52.887907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25f25-69a6-48c3-94dc-a844e75b5420 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:52.894232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25f25-69a6-48c3-94dc-a844e75b5420 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:52.894232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25f25-69a6-48c3-94dc-a844e75b5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:52.957674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a1c25f25-69a6-48c3-94dc-a844e75b5420 None None] MFA Rules not processed for user `a05c69197d0a4017a46ec7478b4fa775`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:52.959233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1c25f25-69a6-48c3-94dc-a844e75b5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:53.136822 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2963/5881] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:38:53.147686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:53.170388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28050a-b6b6-49c2-a4e5-7f23535dd760 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:53.192530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:53.193397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:53.193878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:53.194371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:53.195467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:53.197513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:53.395017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2919/5882] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:53 2022] POST /identity/v3/projects => generated 360 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:53.397084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c25f25-69a6-48c3-94dc-a844e75b5420 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:53.410268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c25f25-69a6-48c3-94dc-a844e75b5420 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:53.514549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:53.515218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:53.515664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:53.515963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:53.516596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:53.518509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:53.582504 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:53.628326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2964/5883] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:38:53 2022] POST /identity/v3/users => generated 413 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:53.628587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:53.666437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d3c69-8d02-4873-8998-385b52d0220a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:53.681749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:53.682960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:53.684570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:53.685456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/users/9133058c9a9640519af5a3b83bf61d39` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:53.715716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_user(user_id=9133058c9a9640519af5a3b83bf61d39)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:53.720152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:53.727244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:53.741296 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2920/5884] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:38:53 2022] GET /identity/v3/users/9133058c9a9640519af5a3b83bf61d39 => generated 413 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:53.748150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfffb7-986f-4c5d-a96e-8ebbfb7c2ded tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:53.774290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:53.774954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:53.779682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:53.780023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/users/9133058c9a9640519af5a3b83bf61d39` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:53.786357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9133058c9a9640519af5a3b83bf61d39)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:53.793549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:53.964850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9133058c9a9640519af5a3b83bf61d39'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:53.967214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9133058c9a9640519af5a3b83bf61d39'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.060512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9133058c9a9640519af5a3b83bf61d39'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.080854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9133058c9a9640519af5a3b83bf61d39'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.085349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9133058c9a9640519af5a3b83bf61d39'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.134428 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2965/5885] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:53 2022] DELETE /identity/v3/users/9133058c9a9640519af5a3b83bf61d39 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:54.138999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:54.141676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:54.191909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92718f65-6993-428d-97f5-744318fd5f06 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:54.403553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:54.404307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:54.404598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:54.404881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/60da393f7bbd43a7afda9f39a4b604f8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:54.406532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60da393f7bbd43a7afda9f39a4b604f8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:54.413835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:54.671275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60da393f7bbd43a7afda9f39a4b604f8', 'request_id': 'req-4240cb10-fda2-4ee4-875a-db83834f0cfb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.691916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60da393f7bbd43a7afda9f39a4b604f8', 'request_id': 'req-4240cb10-fda2-4ee4-875a-db83834f0cfb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.839856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60da393f7bbd43a7afda9f39a4b604f8', 'request_id': 'req-4240cb10-fda2-4ee4-875a-db83834f0cfb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.865877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 60da393f7bbd43a7afda9f39a4b604f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:54.866138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.879431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:54.888059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:54.888690 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2921/5886] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:54 2022] DELETE /identity/v3/projects/60da393f7bbd43a7afda9f39a4b604f8 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:54.924861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520f6f-9e9a-44a3-b5a6-5e41317aa1ea tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:55.136657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:55.136657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:55.136657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:55.137595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:55.137595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:55.137595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:55.278702 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2966/5887] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:54 2022] POST /identity/v3/projects => generated 347 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:55.282930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:55.284492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:55.338469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240cb10-fda2-4ee4-875a-db83834f0cfb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:55.418264 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:55.459917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:55.460572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:55.462445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:55.462445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:55.462445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:38:55.462884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:55.464695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:55.513337 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:55.527273 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2922/5888] 10.222.0.59 () {58 vars in 1160 bytes} [Sun Aug 28 01:38:55 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:38:55.531176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:55.548356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e8dc-b884-41d0-a69f-bb363e670b7a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:55.565923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:55.569736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:55.570073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:55.570357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:55.571073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:55.587457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:55.648095 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2967/5889] 10.222.0.59 () {58 vars in 1128 bytes} [Sun Aug 28 01:38:55 2022] GET /identity/v3/domains => generated 828 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:55.649295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:55.661929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65884a5c-3815-4054-a009-1edaf2877aad tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:55.680119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:55.681366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:55.681852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:55.682302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/e6e47fdf45da41cdad076bd00fe00082` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:55.684020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:update_project(project_id=e6e47fdf45da41cdad076bd00fe00082)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:55.685474 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:38:55.685474 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:38:55.685474 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:38:55.687921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:55.737541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:55.740122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.100206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.101795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.115022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:56.117002 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2923/5890] 10.222.0.59 () {60 vars in 1252 bytes} [Sun Aug 28 01:38:55 2022] PATCH /identity/v3/projects/e6e47fdf45da41cdad076bd00fe00082 => generated 361 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:38:56.119854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:56.152583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b36140-a616-494d-9ad5-9ec889ef02f2 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:56.313186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:56.314238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:56.314745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:56.315465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/e6e47fdf45da41cdad076bd00fe00082` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:56.354526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e6e47fdf45da41cdad076bd00fe00082)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:56.357830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:56.431855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.444645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.697089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082', 'request_id': 'req-fe096bfe-0620-4b10-b84c-148188e5524e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.720984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082', 'request_id': 'req-fe096bfe-0620-4b10-b84c-148188e5524e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.827362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082', 'request_id': 'req-fe096bfe-0620-4b10-b84c-148188e5524e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.854600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project e6e47fdf45da41cdad076bd00fe00082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:56.854993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.856372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.871754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082', 'request_id': 'req-fe096bfe-0620-4b10-b84c-148188e5524e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.877444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082', 'request_id': 'req-fe096bfe-0620-4b10-b84c-148188e5524e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.877444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e6e47fdf45da41cdad076bd00fe00082', 'request_id': 'req-fe096bfe-0620-4b10-b84c-148188e5524e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:56.897874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2968/5891] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:56 2022] DELETE /identity/v3/projects/e6e47fdf45da41cdad076bd00fe00082 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:56.902936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:56.903131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:56.905938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:56.941566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77de126-6981-4e0d-9efa-c1e58f56d6dd tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:57.125399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096bfe-0620-4b10-b84c-148188e5524e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:57.151758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:57.151758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:57.151758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:57.151758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:57.154603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:57.183306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:57.184953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:57.186780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:57.187210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:57.188400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:57.188558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:57.189215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:57.198256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:57.226060 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2969/5892] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:38:57.407736 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2924/5893] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:56 2022] POST /identity/v3/projects => generated 359 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:57.413608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:57.413608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:57.443703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10538e7-3e0f-402b-a339-e0fdb343bf5f service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:57.576578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:57.577675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:57.578149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:57.578813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/2318d47da8ae4398b55c5e021a5a9ef6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:57.581341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=2318d47da8ae4398b55c5e021a5a9ef6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:57.583670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:57.599790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2970/5894] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:38:57 2022] GET /identity/v3/projects/2318d47da8ae4398b55c5e021a5a9ef6 => generated 359 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:57.603966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:57.632499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6569-0757-4b3f-89a9-fb9de9b5957f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:57.665970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:57.665970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:57.665970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:57.666269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/2318d47da8ae4398b55c5e021a5a9ef6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:57.668585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2318d47da8ae4398b55c5e021a5a9ef6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:57.676919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:57.895007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2318d47da8ae4398b55c5e021a5a9ef6', 'request_id': 'req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:57.902546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2318d47da8ae4398b55c5e021a5a9ef6', 'request_id': 'req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:57.954695 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:57.994671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2318d47da8ae4398b55c5e021a5a9ef6', 'request_id': 'req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:58.032950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 2318d47da8ae4398b55c5e021a5a9ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:58.034758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:58.038317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:58.047935 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2925/5895] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:57 2022] DELETE /identity/v3/projects/2318d47da8ae4398b55c5e021a5a9ef6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:58.052916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:58.054760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:58.092892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b716-96e1-43ad-9cc1-e1b50a8ab258 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:58.197954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:58.198587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:58.198953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:58.199125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:58.199975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:58.202911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:58.395822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:58.396061 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2971/5896] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:38:58 2022] POST /identity/v3/projects => generated 360 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:58.438707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e118a-fa2f-4fe2-92b6-7fbcbe500e31 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:58.567133 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:58.636818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:58.638005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:58.638461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:58.643087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/0f38d893f6734a90acc6f5b4423e3190` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:58.652887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f38d893f6734a90acc6f5b4423e3190)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:58.652887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:58.652887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2926/5897] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:38:58 2022] GET /identity/v3/projects/0f38d893f6734a90acc6f5b4423e3190 => generated 360 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:58.654728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:58.694818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:58.697636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:58.705766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514462-5746-4c92-9c75-bcaf002a5896 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:58.722729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:58.723390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:58.723680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:58.723961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/0f38d893f6734a90acc6f5b4423e3190` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:58.726706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f38d893f6734a90acc6f5b4423e3190)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:58.730326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:58.830904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabb79d-1b17-4409-89b1-aa0eddfac0f1 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:58.838676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:58.839848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:58.840394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:58.841287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] PATH_INFO: `/v3/users/619ae5b10f9146fc910aa7bd9765c9e2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:58.844037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=619ae5b10f9146fc910aa7bd9765c9e2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:58.846905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:58.872020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f38d893f6734a90acc6f5b4423e3190', 'request_id': 'req-6292e717-9930-4a84-b1d8-21c6f38cb42b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:58.903615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f38d893f6734a90acc6f5b4423e3190', 'request_id': 'req-6292e717-9930-4a84-b1d8-21c6f38cb42b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.038914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f38d893f6734a90acc6f5b4423e3190', 'request_id': 'req-6292e717-9930-4a84-b1d8-21c6f38cb42b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.067118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 0f38d893f6734a90acc6f5b4423e3190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:38:59.067447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.070253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.075507 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2972/5898] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:58 2022] DELETE /identity/v3/projects/0f38d893f6734a90acc6f5b4423e3190 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:38:59.081194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:59.085848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:59.119983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619ae5b10f9146fc910aa7bd9765c9e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.159758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619ae5b10f9146fc910aa7bd9765c9e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.183389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619ae5b10f9146fc910aa7bd9765c9e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.184762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619ae5b10f9146fc910aa7bd9765c9e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.313434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619ae5b10f9146fc910aa7bd9765c9e2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:38:59.321476 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2927/5899] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:38:58 2022] DELETE /identity/v3/users/619ae5b10f9146fc910aa7bd9765c9e2 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:38:59.328251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292e717-9930-4a84-b1d8-21c6f38cb42b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:59.438011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:59.443301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:59.443301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:59.443301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:59.443301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:59.443301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:59.570771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:59.572262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:59.581963 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2973/5900] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:38:59 2022] POST /identity/v3/projects => generated 346 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:38:59.598020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff312ec-9f2b-48b8-b43f-095e446284fd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:59.755616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:59.755616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:59.755616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:59.755929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/96f4c69920c54289b429c7eff4019ced` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:59.760259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=96f4c69920c54289b429c7eff4019ced)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:59.770208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:59.774573 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2928/5901] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:38:59 2022] GET /identity/v3/projects/96f4c69920c54289b429c7eff4019ced => generated 346 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:38:59.780884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:59.837516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c88cc-e588-4165-9378-5606ccf1c8b7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:59.864182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:59.865628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:59.871133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:59.871634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/96f4c69920c54289b429c7eff4019ced` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:59.875839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96f4c69920c54289b429c7eff4019ced)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:59.879592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:00.087699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f4c69920c54289b429c7eff4019ced', 'request_id': 'req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:00.098333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f4c69920c54289b429c7eff4019ced', 'request_id': 'req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:00.252566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f4c69920c54289b429c7eff4019ced', 'request_id': 'req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:00.275637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 96f4c69920c54289b429c7eff4019ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:00.276176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:00.277188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:00.279401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2974/5902] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:38:59 2022] DELETE /identity/v3/projects/96f4c69920c54289b429c7eff4019ced => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:00.284774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:00.287558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:00.311154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c84d-5cbd-4eeb-830a-568483a56ac5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:00.410175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:00.411515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:00.412896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:00.424754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:00.424754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:00.424754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:00.514462 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2929/5903] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:39:00 2022] POST /identity/v3/domains => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:00.518699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:00.531537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7bcd9-d33a-478d-a7f2-ccf6aa59713e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:00.745750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:00.746785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:00.747195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:00.747551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:00.748329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:00.750570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:00.887568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:00.889501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:00.933528 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2975/5904] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:00 2022] POST /identity/v3/projects => generated 405 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:39:00.934822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:01.030218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c77b7-08d2-4926-982c-40b514e48d20 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:01.030553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138a235-fcb4-4dc1-be3a-6023c60e7619 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:01.038929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:01.039923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:01.041303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:01.041800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/588e86d76f0249cba16cae08a8c5e825` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:01.046425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=588e86d76f0249cba16cae08a8c5e825)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:01.053590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:01.058259 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2976/5905] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:39:00 2022] GET /identity/v3/projects/588e86d76f0249cba16cae08a8c5e825 => generated 405 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:01.063895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:01.087580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce52a2-5cbe-490b-b382-11ce84b7a7b5 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:01.098097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:01.099104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:01.099562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:01.101543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/588e86d76f0249cba16cae08a8c5e825` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:01.103657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=588e86d76f0249cba16cae08a8c5e825)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:01.106245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:01.131321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:01.132843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:01.132843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:01.134103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] PATH_INFO: `/v3/projects/bcc77666821f402ea0b07397a5771ffb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:01.136408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc77666821f402ea0b07397a5771ffb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:01.138981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:01.338358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588e86d76f0249cba16cae08a8c5e825', 'request_id': 'req-d26cc869-635c-4057-8bbe-563d40d19951'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.346124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588e86d76f0249cba16cae08a8c5e825', 'request_id': 'req-d26cc869-635c-4057-8bbe-563d40d19951'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.403876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc77666821f402ea0b07397a5771ffb', 'request_id': 'req-40988db2-44cd-4f91-949e-6b8ef5c8b08c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.404831 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:01.411092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc77666821f402ea0b07397a5771ffb', 'request_id': 'req-40988db2-44cd-4f91-949e-6b8ef5c8b08c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.478482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588e86d76f0249cba16cae08a8c5e825', 'request_id': 'req-d26cc869-635c-4057-8bbe-563d40d19951'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.492792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 588e86d76f0249cba16cae08a8c5e825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:01.493087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.494010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.495704 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2977/5906] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:01 2022] DELETE /identity/v3/projects/588e86d76f0249cba16cae08a8c5e825 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:39:01.499635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:01.501199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:01.599168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc77666821f402ea0b07397a5771ffb', 'request_id': 'req-40988db2-44cd-4f91-949e-6b8ef5c8b08c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.605391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cc869-635c-4057-8bbe-563d40d19951 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:01.616857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] The token cache is being invalidate because project bcc77666821f402ea0b07397a5771ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:01.617498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.618431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-40988db2-44cd-4f91-949e-6b8ef5c8b08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.624655 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2930/5907] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:00 2022] DELETE /identity/v3/projects/bcc77666821f402ea0b07397a5771ffb => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:39:01.627769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ada81-0c15-4cfe-b907-ce1edfc33136 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:01.628379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ada81-0c15-4cfe-b907-ce1edfc33136 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:01.628893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ada81-0c15-4cfe-b907-ce1edfc33136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:01.686887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ae0ada81-0c15-4cfe-b907-ce1edfc33136 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:01.689376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ae0ada81-0c15-4cfe-b907-ce1edfc33136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:01.746479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:01.750899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:01.750899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:01.750899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains/3752f1dac9b844399e4c1ce5264f79f1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:01.754418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3752f1dac9b844399e4c1ce5264f79f1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:01.759166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:01.832105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.833046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.857531 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2931/5908] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:01.866212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f490d-f22d-411e-941a-37705429ca0f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:01.867340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f490d-f22d-411e-941a-37705429ca0f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:01.867846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f490d-f22d-411e-941a-37705429ca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:01.897154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-025f490d-f22d-411e-941a-37705429ca0f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:01.898466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-025f490d-f22d-411e-941a-37705429ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:01.944035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.944809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:01.948852 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2978/5909] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:39:01 2022] PATCH /identity/v3/domains/3752f1dac9b844399e4c1ce5264f79f1 => generated 276 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:39:01.962896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:01.964321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:01.991395 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2932/5910] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:01.995723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f490d-f22d-411e-941a-37705429ca0f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.008038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f490d-f22d-411e-941a-37705429ca0f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.013218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.013945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.014191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.014457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.015126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:39:02.015437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.017093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.041638 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2933/5911] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:02.041638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.055059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed720112-974e-4338-91ed-6e02cd134da6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.062666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.062666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.062666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.062666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.066573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.066573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.086575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd44f8-1be7-4b23-9a67-bc8b0350ed8f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.096852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.097524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.098023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.098241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains/3752f1dac9b844399e4c1ce5264f79f1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.110716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3752f1dac9b844399e4c1ce5264f79f1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.112977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.144496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.149928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.180765 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2934/5912] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:02 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:02.182732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.260953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f0b7-092c-450e-8b80-a95030f2f642 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.265988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.266597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.266881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.267155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.268361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.270390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.402088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1', 'request_id': 'req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.409901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1', 'request_id': 'req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.418402 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2935/5913] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:39:02 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:02.423799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.434621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48576ca0-49d1-4a11-a110-ce0c8498700b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.497759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.498601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.499073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.499412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.500265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.501978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.506634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1', 'request_id': 'req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.509565 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:02.521487 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2936/5914] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:39:02.525010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.525512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 3752f1dac9b844399e4c1ce5264f79f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:02.525833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.526635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.537953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1', 'request_id': 'req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.538888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230bf39-3767-4a49-928c-98edf020b14f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.544199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1', 'request_id': 'req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.544199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3752f1dac9b844399e4c1ce5264f79f1', 'request_id': 'req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:02.544500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.545279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.545753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.546254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.547175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.549829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.554745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2979/5915] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:39:01 2022] DELETE /identity/v3/domains/3752f1dac9b844399e4c1ce5264f79f1 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:02.559378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.561395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:02.568775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2937/5916] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:39:02.576580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.579492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:02.598572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252f7ef-c2ba-4a5e-92ac-0c01410fd544 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.604013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7630e3-cd3f-45ea-9115-b026d55cd24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.605290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7630e3-cd3f-45ea-9115-b026d55cd24a admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.605870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7630e3-cd3f-45ea-9115-b026d55cd24a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.606861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7630e3-cd3f-45ea-9115-b026d55cd24a admin admin] PATH_INFO: `/v3/projects/9033d301c1af46b39eae0dd38905d9fb/users/0c626a937b8c4554867af55667f115d4/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.633281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7630e3-cd3f-45ea-9115-b026d55cd24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9033d301c1af46b39eae0dd38905d9fb, user_id=0c626a937b8c4554867af55667f115d4, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.636739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7630e3-cd3f-45ea-9115-b026d55cd24a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.654204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1bfa2-7500-4e13-a0f0-aef0fc294636 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.660248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.660975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.661525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.661804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.662707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:02.665161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:02.712631 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2938/5917] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:02 2022] PUT /identity/v3/projects/9033d301c1af46b39eae0dd38905d9fb/users/0c626a937b8c4554867af55667f115d4/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:02.714238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c4a67-d643-4742-af9e-b54f13f30501 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.714632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c4a67-d643-4742-af9e-b54f13f30501 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.714830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c4a67-d643-4742-af9e-b54f13f30501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.735409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-721c4a67-d643-4742-af9e-b54f13f30501 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:02.737383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-721c4a67-d643-4742-af9e-b54f13f30501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:02.809873 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2939/5918] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:02.818826 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2980/5919] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:39:02 2022] POST /identity/v3/domains => generated 276 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:02.822620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c4a67-d643-4742-af9e-b54f13f30501 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.826068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:02.828019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:02.930096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca2cf2-91a8-4531-b60c-1141f4f07579 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:02.934090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372f04f-6285-498d-a5c0-19bd1e6ff592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:02.934810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f04f-6285-498d-a5c0-19bd1e6ff592 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:02.935094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f04f-6285-498d-a5c0-19bd1e6ff592 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:02.936103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f04f-6285-498d-a5c0-19bd1e6ff592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:02.939434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c4a67-d643-4742-af9e-b54f13f30501 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:03.031517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372f04f-6285-498d-a5c0-19bd1e6ff592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:03.031785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:03.032375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:03.032740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:03.033868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:03.034375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372f04f-6285-498d-a5c0-19bd1e6ff592 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:03.035199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:03.037449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:03.048103 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2981/5920] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:39:03.050613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219c0f-afb9-42f1-9620-881a2f6bde53 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:03.051107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219c0f-afb9-42f1-9620-881a2f6bde53 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:03.051983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219c0f-afb9-42f1-9620-881a2f6bde53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:03.080833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d8219c0f-afb9-42f1-9620-881a2f6bde53 None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:03.082413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d8219c0f-afb9-42f1-9620-881a2f6bde53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:03.167245 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2982/5921] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:03.197044 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2940/5922] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:02 2022] POST /identity/v3/projects => generated 410 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:03.201374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8219c0f-afb9-42f1-9620-881a2f6bde53 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:03.225133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8219c0f-afb9-42f1-9620-881a2f6bde53 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:03.309689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:03.310665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:03.311378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:03.311808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:03.312563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:03.315548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:03.431734 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2983/5923] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:03 2022] POST /identity/v3/projects => generated 404 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:03.437955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:03.450445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628a4f1-52c0-486f-8ecc-b27246a66a33 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:03.535638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:03.536497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:03.536791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:03.537075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/5c5082b34edc4381b6b6f9d221de5245` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:03.539795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c5082b34edc4381b6b6f9d221de5245)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:03.544875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:03.743705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5082b34edc4381b6b6f9d221de5245', 'request_id': 'req-c3837cd3-0754-4161-9029-ef41b3cb3f7e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:03.772127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5082b34edc4381b6b6f9d221de5245', 'request_id': 'req-c3837cd3-0754-4161-9029-ef41b3cb3f7e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:03.880733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5082b34edc4381b6b6f9d221de5245', 'request_id': 'req-c3837cd3-0754-4161-9029-ef41b3cb3f7e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:03.903256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 5c5082b34edc4381b6b6f9d221de5245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:03.904234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:03.905054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:03.906698 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2941/5924] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:03 2022] DELETE /identity/v3/projects/5c5082b34edc4381b6b6f9d221de5245 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:03.911516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:03.914647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:03.928836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81b710-2a61-4450-90f8-aad5a47bc28f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:04.017025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:04.018586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:04.018946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:04.019610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/4bb3fc04b1394b00a85c316d1a4cac60` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:04.026353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4bb3fc04b1394b00a85c316d1a4cac60)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:04.029524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:04.261518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb3fc04b1394b00a85c316d1a4cac60', 'request_id': 'req-6a8ce78b-554e-47c8-a869-6aed9058853a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.272183 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:04.273954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb3fc04b1394b00a85c316d1a4cac60', 'request_id': 'req-6a8ce78b-554e-47c8-a869-6aed9058853a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.406795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb3fc04b1394b00a85c316d1a4cac60', 'request_id': 'req-6a8ce78b-554e-47c8-a869-6aed9058853a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.439077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 4bb3fc04b1394b00a85c316d1a4cac60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:04.440342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.441600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.444914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2984/5925] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:03 2022] DELETE /identity/v3/projects/4bb3fc04b1394b00a85c316d1a4cac60 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:04.449377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:04.464085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3837cd3-0754-4161-9029-ef41b3cb3f7e tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:04.602638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:04.603296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:04.603582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:04.604054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains/2114c41afbb447c48e562bdad6cb220e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:04.605670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2114c41afbb447c48e562bdad6cb220e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:04.607801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:04.645929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2114c41afbb447c48e562bdad6cb220e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.646694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2114c41afbb447c48e562bdad6cb220e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.824405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2114c41afbb447c48e562bdad6cb220e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.825344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2114c41afbb447c48e562bdad6cb220e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:04.830498 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2942/5926] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:39:04 2022] PATCH /identity/v3/domains/2114c41afbb447c48e562bdad6cb220e => generated 277 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:39:04.837371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:04.839332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:04.863920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ce78b-554e-47c8-a869-6aed9058853a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:05.006643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:05.007704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:05.008208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:05.008749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains/2114c41afbb447c48e562bdad6cb220e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:05.035259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2114c41afbb447c48e562bdad6cb220e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:05.038389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:05.085423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2114c41afbb447c48e562bdad6cb220e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.098962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2114c41afbb447c48e562bdad6cb220e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.336862 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:05.436529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2114c41afbb447c48e562bdad6cb220e', 'request_id': 'req-c4d895b8-6833-4fe0-8b25-670eb2da8243'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.474230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2114c41afbb447c48e562bdad6cb220e', 'request_id': 'req-c4d895b8-6833-4fe0-8b25-670eb2da8243'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.572388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2114c41afbb447c48e562bdad6cb220e', 'request_id': 'req-c4d895b8-6833-4fe0-8b25-670eb2da8243'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.593082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 2114c41afbb447c48e562bdad6cb220e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:05.593384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.594555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.610980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2114c41afbb447c48e562bdad6cb220e', 'request_id': 'req-c4d895b8-6833-4fe0-8b25-670eb2da8243'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.612534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2114c41afbb447c48e562bdad6cb220e', 'request_id': 'req-c4d895b8-6833-4fe0-8b25-670eb2da8243'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.615051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2114c41afbb447c48e562bdad6cb220e', 'request_id': 'req-c4d895b8-6833-4fe0-8b25-670eb2da8243'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:05.636871 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2985/5927] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:39:04 2022] DELETE /identity/v3/domains/2114c41afbb447c48e562bdad6cb220e => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:05.641911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:05.645324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:05.673154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118dbc0-08a3-4522-b2f9-e0af54f79ef9 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:05.826143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:05.827091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:05.827745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:05.828190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:05.829912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:05.833716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:05.984082 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2943/5928] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:05 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:05.985470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:05.988542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:06.015903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d895b8-6833-4fe0-8b25-670eb2da8243 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:06.105790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:06.107444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:06.110992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:06.110992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/a8b218ade54447fdbda15bfde1b77990` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:06.110992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=a8b218ade54447fdbda15bfde1b77990)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:06.116774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:06.125626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:06.127758 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2986/5929] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:39:05 2022] GET /identity/v3/projects/a8b218ade54447fdbda15bfde1b77990 => generated 377 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:06.146002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783ba2a-ef53-46c3-89b1-fcd456870842 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:06.168535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:06.169147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:06.170851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:06.171142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:06.174911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:06.179580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:06.228713 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2944/5930] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:39:06 2022] GET /identity/v3/projects => generated 6953 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:06.233856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:06.248662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2767b-35c6-4285-8810-548bf75d0bac tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:06.257223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:06.258183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:06.260157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:06.260157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/a8b218ade54447fdbda15bfde1b77990` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:06.266729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8b218ade54447fdbda15bfde1b77990)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:06.272390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:06.583667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b218ade54447fdbda15bfde1b77990', 'request_id': 'req-e5beefa1-83fc-438d-bdf6-41c2c4892a88'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:06.599560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b218ade54447fdbda15bfde1b77990', 'request_id': 'req-e5beefa1-83fc-438d-bdf6-41c2c4892a88'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:06.735778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b218ade54447fdbda15bfde1b77990', 'request_id': 'req-e5beefa1-83fc-438d-bdf6-41c2c4892a88'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:06.764790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project a8b218ade54447fdbda15bfde1b77990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:06.765058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:06.767907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:06.773156 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2987/5931] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:06 2022] DELETE /identity/v3/projects/a8b218ade54447fdbda15bfde1b77990 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:06.778997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:06.782205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:06.800636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77844c-a596-4410-b471-a4c26c951c7d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:06.887887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:06.889678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:06.889678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:06.889678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:06.892615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:06.895751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:06.932979 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:07.006558 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2945/5932] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:39:06 2022] POST /identity/v3/projects => generated 347 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:07.008257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:07.021036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5beefa1-83fc-438d-bdf6-41c2c4892a88 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:07.123402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:07.124083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:07.124365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:07.124752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/f174689092c149c5b6c2d830b0639f84` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:07.126037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:update_project(project_id=f174689092c149c5b6c2d830b0639f84)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:07.127092 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:39:07.127092 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:39:07.127092 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:39:07.128413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:07.243936 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2988/5933] 10.222.0.59 () {60 vars in 1252 bytes} [Sun Aug 28 01:39:07 2022] PATCH /identity/v3/projects/f174689092c149c5b6c2d830b0639f84 => generated 359 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:07.248523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:07.261199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63baf19-c9c6-4896-bec6-2e65056ef30d tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:07.274938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:07.275614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:07.275897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:07.276410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/f174689092c149c5b6c2d830b0639f84` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:07.301345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=f174689092c149c5b6c2d830b0639f84)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:07.304118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:07.306325 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2946/5934] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:39:07 2022] GET /identity/v3/projects/f174689092c149c5b6c2d830b0639f84 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:07.313647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:07.327365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50787b1-31d9-494e-86b8-ab82aa8d31fe tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:07.363318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:07.365390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:07.365975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:07.370835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/f174689092c149c5b6c2d830b0639f84` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:07.370835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f174689092c149c5b6c2d830b0639f84)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:07.370835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:07.519614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f174689092c149c5b6c2d830b0639f84', 'request_id': 'req-16154338-0ea5-46e9-8954-51ebce23f837'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:07.528522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f174689092c149c5b6c2d830b0639f84', 'request_id': 'req-16154338-0ea5-46e9-8954-51ebce23f837'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:07.618702 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:07.619027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f174689092c149c5b6c2d830b0639f84', 'request_id': 'req-16154338-0ea5-46e9-8954-51ebce23f837'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:07.650391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project f174689092c149c5b6c2d830b0639f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:07.654118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:07.655496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:07.667849 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2989/5935] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:07 2022] DELETE /identity/v3/projects/f174689092c149c5b6c2d830b0639f84 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:07.668960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:07.671140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:07.722174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3d816-5606-46e7-b552-2a0fbea575eb tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:07.961996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:07.962698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:07.962900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:07.963310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:07.963960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:07.969270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:08.117600 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2947/5936] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:07 2022] POST /identity/v3/projects => generated 361 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:08.122847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:08.139237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16154338-0ea5-46e9-8954-51ebce23f837 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:08.231111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:08.231856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:08.232207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:08.232551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/a9dd1c145f0a49e491bf0df5741e3737` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:08.233978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:update_project(project_id=a9dd1c145f0a49e491bf0df5741e3737)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:08.237506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:08.304697 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:08.412787 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2990/5937] 10.222.0.59 () {60 vars in 1252 bytes} [Sun Aug 28 01:39:08 2022] PATCH /identity/v3/projects/a9dd1c145f0a49e491bf0df5741e3737 => generated 373 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:08.416502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:08.431099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65616-f84e-4a63-9d32-c58043aa263a tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:08.447521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:08.448531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:08.448886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:08.449568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/a9dd1c145f0a49e491bf0df5741e3737` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:08.466517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9dd1c145f0a49e491bf0df5741e3737)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:08.469110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:08.477286 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2948/5938] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:39:08 2022] GET /identity/v3/projects/a9dd1c145f0a49e491bf0df5741e3737 => generated 360 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:08.477509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:08.501987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e666cd3-7265-4a90-b166-17501e0e168f tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:08.527517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:08.528826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:08.534684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:08.535197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/a9dd1c145f0a49e491bf0df5741e3737` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:08.536841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9dd1c145f0a49e491bf0df5741e3737)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:08.543550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:08.717260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9dd1c145f0a49e491bf0df5741e3737', 'request_id': 'req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:08.726464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9dd1c145f0a49e491bf0df5741e3737', 'request_id': 'req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:08.807605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9dd1c145f0a49e491bf0df5741e3737', 'request_id': 'req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:08.828695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project a9dd1c145f0a49e491bf0df5741e3737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:08.829005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:08.838939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:08.850208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:08.853294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:08.855651 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2991/5939] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:08 2022] DELETE /identity/v3/projects/a9dd1c145f0a49e491bf0df5741e3737 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:08.875844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf6cd5-9dfb-423b-95b9-d07295f2bd27 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:08.989279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:08.991045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:08.992296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:08.993099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:08.994525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:08.996870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:09.080271 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:09.153057 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2949/5940] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:08 2022] POST /identity/v3/projects => generated 352 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:09.154434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:09.168820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dd7b1-1d5f-465b-8450-8d3bd39e091b tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:09.265415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:09.266698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:09.266940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:09.271419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/283834801929465daf805db6df5fc71d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:09.271419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:update_project(project_id=283834801929465daf805db6df5fc71d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:09.271419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:09.391245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:09.394119 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2992/5941] 10.222.0.59 () {60 vars in 1252 bytes} [Sun Aug 28 01:39:09 2022] PATCH /identity/v3/projects/283834801929465daf805db6df5fc71d => generated 366 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:09.433263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445cad4-6f00-4f80-805a-6f6e8f4dcd37 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:09.447599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:09.448532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:09.449153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:09.449903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/283834801929465daf805db6df5fc71d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:09.499335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:get_project(project_id=283834801929465daf805db6df5fc71d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:09.503065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:09.512826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:09.526921 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2950/5942] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:39:09 2022] GET /identity/v3/projects/283834801929465daf805db6df5fc71d => generated 353 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:39:09.527879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f51beb-3881-4e14-a726-5bbf16751671 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:09.550001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:09.550672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:09.550956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:09.551235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/projects/283834801929465daf805db6df5fc71d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:09.554755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorizing `identity:delete_project(project_id=283834801929465daf805db6df5fc71d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:09.564353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:09.758920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283834801929465daf805db6df5fc71d', 'request_id': 'req-3d680341-4da4-4135-b79b-506d3d005ad7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:09.775944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283834801929465daf805db6df5fc71d', 'request_id': 'req-3d680341-4da4-4135-b79b-506d3d005ad7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:09.878505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283834801929465daf805db6df5fc71d', 'request_id': 'req-3d680341-4da4-4135-b79b-506d3d005ad7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:09.896425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] The token cache is being invalidate because project 283834801929465daf805db6df5fc71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:09.898189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:09.899435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:09.904810 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2993/5943] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:09 2022] DELETE /identity/v3/projects/283834801929465daf805db6df5fc71d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:09.910727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:09.913091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:09.943781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84443163-06d5-4e86-9c8b-0f92d51530d3 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:09.975918 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:10.018427 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:10.111250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:10.111920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:10.112204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:10.112483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains/2114c41afbb447c48e562bdad6cb220e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:10.148103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Could not find domain: 2114c41afbb447c48e562bdad6cb220e.: keystone.exception.DomainNotFound: Could not find domain: 2114c41afbb447c48e562bdad6cb220e. Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2114c41afbb447c48e562bdad6cb220e. Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:39:10.157591 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:39:10.159260 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2114c41afbb447c48e562bdad6cb220e. Aug 28 01:39:10.160671 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:39:10.162170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2951/5944] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:39:09 2022] PATCH /identity/v3/domains/2114c41afbb447c48e562bdad6cb220e => generated 112 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:39:10.163278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:10.178920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d680341-4da4-4135-b79b-506d3d005ad7 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:10.195358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9460-25c1-444e-a327-630edac73d47 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c69197d0a4017a46ec7478b4fa775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '610ce57f2c56406bad7211fd03bf20c1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:10.196017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9460-25c1-444e-a327-630edac73d47 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:10.196301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9460-25c1-444e-a327-630edac73d47 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:10.203467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9460-25c1-444e-a327-630edac73d47 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] PATH_INFO: `/v3/domains/3752f1dac9b844399e4c1ce5264f79f1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:10.217440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc9460-25c1-444e-a327-630edac73d47 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-2afc9460-25c1-444e-a327-630edac73d47 tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Could not find domain: 3752f1dac9b844399e4c1ce5264f79f1.: keystone.exception.DomainNotFound: Could not find domain: 3752f1dac9b844399e4c1ce5264f79f1. Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3752f1dac9b844399e4c1ce5264f79f1. Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:39:10.222855 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:39:10.227497 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3752f1dac9b844399e4c1ce5264f79f1. Aug 28 01:39:10.228649 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:39:10.230103 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2994/5945] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:39:10 2022] PATCH /identity/v3/domains/3752f1dac9b844399e4c1ce5264f79f1 => generated 112 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:39:10.230319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:10.239999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:10.340262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6345-5f5f-41cc-b9cb-f816629e0dde tempest-ProjectsTestJSON-108897532 tempest-ProjectsTestJSON-108897532-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:10.365988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:10.368015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:10.369129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:10.369600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] PATH_INFO: `/v3/users/8c242abedca64987a5c4e94db8587f7c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:10.372395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c242abedca64987a5c4e94db8587f7c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:10.375341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:10.669527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c242abedca64987a5c4e94db8587f7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:10.702351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c242abedca64987a5c4e94db8587f7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:10.741164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c242abedca64987a5c4e94db8587f7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:10.748286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c242abedca64987a5c4e94db8587f7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:10.867769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c242abedca64987a5c4e94db8587f7c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:10.879441 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2952/5946] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:39:10 2022] DELETE /identity/v3/users/8c242abedca64987a5c4e94db8587f7c => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:10.886079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:10.886935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:10.887287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:10.926466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:10.929289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:11.076473 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2995/5947] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:11.117582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:11.122815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:11.250357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c950f1-a940-4829-b1fa-3ec1917f66a4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:11.256075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:11.257387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:11.257782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:11.258195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:11.276826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:11.276826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:11.289771 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2953/5948] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:11.441923 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:11.793315 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:12.962918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:12.965356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:12.982416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e424046-3fa9-40be-9671-28e3333053e8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:12.990481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:12.991499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:12.992044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:12.992539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] PATH_INFO: `/v3/projects/1026daada77d49f7ad16d1f0485e183f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:12.994913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1026daada77d49f7ad16d1f0485e183f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:13.002448 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:13.002448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:13.186383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1026daada77d49f7ad16d1f0485e183f', 'request_id': 'req-f004e48f-4070-4381-ba22-d9a6164c7f34'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.201043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1026daada77d49f7ad16d1f0485e183f', 'request_id': 'req-f004e48f-4070-4381-ba22-d9a6164c7f34'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.280536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1026daada77d49f7ad16d1f0485e183f', 'request_id': 'req-f004e48f-4070-4381-ba22-d9a6164c7f34'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.301206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] The token cache is being invalidate because project 1026daada77d49f7ad16d1f0485e183f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:13.301531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.302268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.303904 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2996/5949] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:12 2022] DELETE /identity/v3/projects/1026daada77d49f7ad16d1f0485e183f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:13.308263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:13.322663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14cf51-7d5d-465c-847d-1ecf15c56bfb service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:13.510721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:13.511696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:13.512148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:13.512606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] PATH_INFO: `/v3/users/a05c69197d0a4017a46ec7478b4fa775` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:13.515297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05c69197d0a4017a46ec7478b4fa775)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:13.519034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:13.735742 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:13.869843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05c69197d0a4017a46ec7478b4fa775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.913492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05c69197d0a4017a46ec7478b4fa775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.928717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05c69197d0a4017a46ec7478b4fa775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:13.929493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05c69197d0a4017a46ec7478b4fa775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:14.016138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0e6758a8-3388-40cf-a09e-86ec2e74eb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05c69197d0a4017a46ec7478b4fa775'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:14.031413 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2954/5950] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:39:13 2022] DELETE /identity/v3/users/a05c69197d0a4017a46ec7478b4fa775 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:39:15.047263 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:15.120848 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:15.572425 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:15.787482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:15.789166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:15.809677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e48f-4070-4381-ba22-d9a6164c7f34 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:15.912269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:15.912950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:15.913319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:15.913494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] PATH_INFO: `/v3/projects/610ce57f2c56406bad7211fd03bf20c1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:15.915259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610ce57f2c56406bad7211fd03bf20c1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:15.918153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:16.110772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610ce57f2c56406bad7211fd03bf20c1', 'request_id': 'req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:16.152664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610ce57f2c56406bad7211fd03bf20c1', 'request_id': 'req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:16.245269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610ce57f2c56406bad7211fd03bf20c1', 'request_id': 'req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:16.274786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] The token cache is being invalidate because project 610ce57f2c56406bad7211fd03bf20c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:16.275155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:16.275896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63ca5e37-32c6-45c3-aaa3-cf12fb2faa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:16.281788 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2997/5951] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:15 2022] DELETE /identity/v3/projects/610ce57f2c56406bad7211fd03bf20c1 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:16.287476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c34cf-de8f-4598-8f85-62ded59b67d4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:16.288011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c34cf-de8f-4598-8f85-62ded59b67d4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:16.288123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c34cf-de8f-4598-8f85-62ded59b67d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:16.351445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0e0c34cf-de8f-4598-8f85-62ded59b67d4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:16.352767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0e0c34cf-de8f-4598-8f85-62ded59b67d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:16.368720 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:16.493977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ddd6c-bb0f-411d-9f57-fffe18a8e291 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:16.493977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ddd6c-bb0f-411d-9f57-fffe18a8e291 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:16.494273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ddd6c-bb0f-411d-9f57-fffe18a8e291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:16.494977 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2955/5952] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:39:16.551453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-de6ddd6c-bb0f-411d-9f57-fffe18a8e291 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:16.552739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-de6ddd6c-bb0f-411d-9f57-fffe18a8e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:16.584289 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2998/5953] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:39:16.591495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c34cf-de8f-4598-8f85-62ded59b67d4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:16.669620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c34cf-de8f-4598-8f85-62ded59b67d4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:16.699541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:16.700270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:16.700615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:16.700888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:16.701730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:39:16.704081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:16.704081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:16.778490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ddd6c-bb0f-411d-9f57-fffe18a8e291 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:16.788140 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2956/5954] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:16.791401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ddd6c-bb0f-411d-9f57-fffe18a8e291 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:16.809589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9b48e-7097-4089-a5df-cdfea6b42e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:16.810241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9b48e-7097-4089-a5df-cdfea6b42e43 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:16.810670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9b48e-7097-4089-a5df-cdfea6b42e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:16.811261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9b48e-7097-4089-a5df-cdfea6b42e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:16.812085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9b48e-7097-4089-a5df-cdfea6b42e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:16.814993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9b48e-7097-4089-a5df-cdfea6b42e43 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:16.928048 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 2999/5955] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:16 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:39:16.932112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:16.958793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c4b3c-3c2e-42ed-8ce4-6bcdbaa702f3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:16.959706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a8bf-ee4d-4198-9f28-4e5e2f9738c1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:16.960044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a8bf-ee4d-4198-9f28-4e5e2f9738c1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:16.960305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a8bf-ee4d-4198-9f28-4e5e2f9738c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.035496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-35c2a8bf-ee4d-4198-9f28-4e5e2f9738c1 None None] MFA Rules not processed for user `0c626a937b8c4554867af55667f115d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:17.037031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35c2a8bf-ee4d-4198-9f28-4e5e2f9738c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:17.067196 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:17.067573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:17.068606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:17.068988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:17.069539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.070292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:17.072688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:17.179716 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2957/5956] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:39:16 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:39:17.183563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:17.211414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb2576-3a4f-46a8-90e0-32d9120837df admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:17.212221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3000/5957] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:17.223880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:17.224564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:17.224843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:17.225113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.227412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:17.234244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:17.236980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450738ab-6328-4dd8-af69-14b9bd684df7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:17.237838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450738ab-6328-4dd8-af69-14b9bd684df7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:17.238156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450738ab-6328-4dd8-af69-14b9bd684df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.251399 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2958/5958] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:17.275564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:17.294197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b5bbf-161b-44ed-bf56-793c0e3f05cc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:17.301845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-450738ab-6328-4dd8-af69-14b9bd684df7 None None] MFA Rules not processed for user `0c626a937b8c4554867af55667f115d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:17.303419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:17.304242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:17.304876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:17.305529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.306572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:17.308915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-450738ab-6328-4dd8-af69-14b9bd684df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:17.310244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:17.326417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2959/5959] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:17.335009 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3001/5960] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:17.344311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:17.373381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3a7a-5e1a-47a4-a05e-bfa5e90e1914 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:17.390541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:17.391748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:17.395909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:17.396462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] PATH_INFO: `/v3/projects/359f9ec3216f414cbbf311e2a5d85291/users/faa5d3b165674636b7f4a7a427a3fa28/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.447900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=359f9ec3216f414cbbf311e2a5d85291, user_id=faa5d3b165674636b7f4a7a427a3fa28, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:17.450712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:17.528871 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2960/5961] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:17 2022] PUT /identity/v3/projects/359f9ec3216f414cbbf311e2a5d85291/users/faa5d3b165674636b7f4a7a427a3fa28/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:39:17.636201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:17.636576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:17.642182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.701727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] MFA Rules not processed for user `faa5d3b165674636b7f4a7a427a3fa28`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:17.712065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:17.715274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:17.717020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:17.853224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022780bf-6064-4f29-bc19-88b7fcb188d9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:17.884691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:17.886788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:17.888341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:17.888895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:17.894915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:17.900735 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3002/5962] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:17.901917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:17.905708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:18.075935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.077937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.115061 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2961/5963] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:18.116250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:18.138268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a699677-acfa-463d-892b-280b80e8133f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.143685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.144677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.145169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.145850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.146780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:create_application_credential(user_id=faa5d3b165674636b7f4a7a427a3fa28)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.149824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.150411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a354e-ea69-462f-ad4c-6fe05902f9e4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.175839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.176628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.176996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.177347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.289752 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:18.315781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.322646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.357751 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3003/5964] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:18.393426 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2962/5965] 10.222.0.59 () {60 vars in 1315 bytes} [Sun Aug 28 01:39:18 2022] POST /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials => generated 921 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:18.398044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:18.418835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbc59b-048c-4ea6-9bb7-15327c62c029 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.451453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.452140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.458740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.458740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules/31af24a0a22c4ffaaa0735b4f92a5a31` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.460214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:delete_access_rule(user_id=faa5d3b165674636b7f4a7a427a3fa28, access_rule_id=31af24a0a22c4ffaaa0735b4f92a5a31)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.464651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application session.delete(ref) Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application yield resource Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application next(self.gen) Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 01:39:18.547225 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise self.value Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application session.commit() Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.session.flush() Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 01:39:18.549572 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application compat.raise_( Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._synchronize( Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise AssertionError( Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 28 01:39:18.551110 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:39:18.552844 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:39:18.554431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 28 01:39:18.554431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 28 01:39:18.554431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 28 01:39:18.554431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 01:39:18.554431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 01:39:18.554431 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:39:18.555542 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3004/5966] 10.222.0.59 () {58 vars in 1362 bytes} [Sun Aug 28 01:39:18 2022] DELETE /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules/31af24a0a22c4ffaaa0735b4f92a5a31 => generated 89 bytes in 157 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 28 01:39:18.556071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:18.566043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06970d-30f2-4242-87a1-0939d900998b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.571300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.573413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.573413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.573413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials/bc3c9295291f4d4bb717a21e3a24c512` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.593328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:delete_application_credential(user_id=faa5d3b165674636b7f4a7a427a3fa28, application_credential_id=bc3c9295291f4d4bb717a21e3a24c512)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.596068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.696382 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2963/5967] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:39:18 2022] DELETE /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials/bc3c9295291f4d4bb717a21e3a24c512 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:18.700654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:18.713006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924beb-06f9-4f38-b85b-17a66a7cc11d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.719329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.720859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.721691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.722194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.723718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:list_access_rules(user_id=faa5d3b165674636b7f4a7a427a3fa28)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.725859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.733026 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3005/5968] 10.222.0.59 () {58 vars in 1260 bytes} [Sun Aug 28 01:39:18 2022] GET /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules => generated 369 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:18.737695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:18.749070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0edd-f88b-411a-b33c-6d0d96d5b23b tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.754363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.755306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.756156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.756456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules/31af24a0a22c4ffaaa0735b4f92a5a31` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.758459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:delete_access_rule(user_id=faa5d3b165674636b7f4a7a427a3fa28, access_rule_id=31af24a0a22c4ffaaa0735b4f92a5a31)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.759879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.877210 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2964/5969] 10.222.0.59 () {58 vars in 1362 bytes} [Sun Aug 28 01:39:18 2022] DELETE /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules/31af24a0a22c4ffaaa0735b4f92a5a31 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:18.877488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:18.895986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b91d3-5473-4ede-9d30-379810584b19 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.898999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.900082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.900966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.901638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.909479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:list_access_rules(user_id=faa5d3b165674636b7f4a7a427a3fa28)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.919983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:18.938568 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3006/5970] 10.222.0.59 () {58 vars in 1260 bytes} [Sun Aug 28 01:39:18 2022] GET /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules => generated 158 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:39:18.944158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:18.968522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a943ae-f60a-4d6c-867c-59b646b0456f tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:18.975189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:18.976350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:18.977060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:18.977581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:18.978545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:create_application_credential(user_id=faa5d3b165674636b7f4a7a427a3fa28)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:18.980809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:19.194753 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2965/5971] 10.222.0.59 () {60 vars in 1315 bytes} [Sun Aug 28 01:39:18 2022] POST /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials => generated 920 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:19.196154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:19.209994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4f67b-186e-433d-b6ab-ad5cd99e6181 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:19.222976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:19.223730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:19.224040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:19.228586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:19.228586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:list_access_rules(user_id=faa5d3b165674636b7f4a7a427a3fa28)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:19.228586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:19.237603 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3007/5972] 10.222.0.59 () {58 vars in 1260 bytes} [Sun Aug 28 01:39:19 2022] GET /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules => generated 369 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:19.238838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:19.251352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df4a6-e407-43e0-aeba-6b1629fb481d tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:19.258893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:19.260757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:19.261149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:19.261551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:19.274253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:create_application_credential(user_id=faa5d3b165674636b7f4a7a427a3fa28)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:19.275892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:19.348796 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:19.503280 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2966/5973] 10.222.0.59 () {60 vars in 1315 bytes} [Sun Aug 28 01:39:19 2022] POST /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/application_credentials => generated 921 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:19.508753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:19.530752 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:19.534826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb8766-dce8-4612-8780-f92fb41b13d6 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:19.547611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b20b-2813-4a21-a77f-c3095ae912d5 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faa5d3b165674636b7f4a7a427a3fa28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '359f9ec3216f414cbbf311e2a5d85291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:19.552552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b20b-2813-4a21-a77f-c3095ae912d5 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:19.553142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b20b-2813-4a21-a77f-c3095ae912d5 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:19.557584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b20b-2813-4a21-a77f-c3095ae912d5 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules/556e7572a53647dc8e708560b3c0888b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:19.557584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b20b-2813-4a21-a77f-c3095ae912d5 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorizing `identity:get_access_rule(user_id=faa5d3b165674636b7f4a7a427a3fa28, access_rule_id=556e7572a53647dc8e708560b3c0888b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:19.557584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b20b-2813-4a21-a77f-c3095ae912d5 tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:19.579343 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3008/5974] 10.222.0.59 () {58 vars in 1359 bytes} [Sun Aug 28 01:39:19 2022] GET /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28/access_rules/556e7572a53647dc8e708560b3c0888b => generated 229 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:19.580639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:19.694948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ac24-6d1c-4c8c-b99c-23ee85c28acf tempest-AccessRulesV3Test-1891340115 tempest-AccessRulesV3Test-1891340115-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:19.700131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:19.700791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:19.701074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:19.701527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] PATH_INFO: `/v3/users/faa5d3b165674636b7f4a7a427a3fa28` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:19.703618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa5d3b165674636b7f4a7a427a3fa28)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:19.706449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:19.772278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca03d-de41-43aa-8a26-76346ea72666 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:19.772278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca03d-de41-43aa-8a26-76346ea72666 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:19.772278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca03d-de41-43aa-8a26-76346ea72666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:19.802627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ac9ca03d-de41-43aa-8a26-76346ea72666 None None] MFA Rules not processed for user `40464c801b5a4ea3a0d489afc9f46d92`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:19.804771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac9ca03d-de41-43aa-8a26-76346ea72666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:19.918705 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3009/5975] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:20.042819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa5d3b165674636b7f4a7a427a3fa28'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:20.384738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa5d3b165674636b7f4a7a427a3fa28'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:20.399858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa5d3b165674636b7f4a7a427a3fa28'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:20.411744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa5d3b165674636b7f4a7a427a3fa28'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:20.547560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa5d3b165674636b7f4a7a427a3fa28'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:20.567365 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2967/5976] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:39:19 2022] DELETE /identity/v3/users/faa5d3b165674636b7f4a7a427a3fa28 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:39:20.569878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:20.570771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:20.571244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:20.598320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:20.599832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:20.699547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3010/5977] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:20.720742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:20.722520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:20.843827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66e7df-1f22-451e-b979-6be5970f1bc2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:20.848708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e964-ffab-4fb7-b267-aefa37338b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:20.849350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e964-ffab-4fb7-b267-aefa37338b43 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:20.849756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e964-ffab-4fb7-b267-aefa37338b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:20.850059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e964-ffab-4fb7-b267-aefa37338b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:20.860609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e964-ffab-4fb7-b267-aefa37338b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:20.862636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e964-ffab-4fb7-b267-aefa37338b43 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:20.874528 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2968/5978] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:21.993242 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:22.390213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:22.393055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:22.456561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59c2ac-18e9-4464-a077-77698416d6ee None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:22.477662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:22.481768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:22.482921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:22.483753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] PATH_INFO: `/v3/projects/359f9ec3216f414cbbf311e2a5d85291` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:22.487164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=359f9ec3216f414cbbf311e2a5d85291)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:22.490160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:22.687428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359f9ec3216f414cbbf311e2a5d85291', 'request_id': 'req-4f8b59d9-f34b-4682-a566-458e1c63d330'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:22.696153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359f9ec3216f414cbbf311e2a5d85291', 'request_id': 'req-4f8b59d9-f34b-4682-a566-458e1c63d330'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:22.791506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359f9ec3216f414cbbf311e2a5d85291', 'request_id': 'req-4f8b59d9-f34b-4682-a566-458e1c63d330'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:22.819356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] The token cache is being invalidate because project 359f9ec3216f414cbbf311e2a5d85291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:22.826261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:22.828899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4f8b59d9-f34b-4682-a566-458e1c63d330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:22.833209 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3011/5979] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:22 2022] DELETE /identity/v3/projects/359f9ec3216f414cbbf311e2a5d85291 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:22.839153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25ddba-b372-476e-a298-3036f89ca37b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:22.839756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25ddba-b372-476e-a298-3036f89ca37b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:22.840298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25ddba-b372-476e-a298-3036f89ca37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:22.895199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2a25ddba-b372-476e-a298-3036f89ca37b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:22.903617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2a25ddba-b372-476e-a298-3036f89ca37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:23.018451 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2969/5980] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:23.029873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6526c95-e95b-42f1-b0f2-bfb3928e0403 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.030595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6526c95-e95b-42f1-b0f2-bfb3928e0403 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.031091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6526c95-e95b-42f1-b0f2-bfb3928e0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:23.086817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b6526c95-e95b-42f1-b0f2-bfb3928e0403 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:23.088189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6526c95-e95b-42f1-b0f2-bfb3928e0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:23.128037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3012/5981] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:23.137236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25ddba-b372-476e-a298-3036f89ca37b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:23.138607 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:23.160237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25ddba-b372-476e-a298-3036f89ca37b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:23.166491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:23.174168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.174168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.174168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:23.174168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:39:23.174168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:23.174168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:23.188525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2970/5982] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:23.189904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6526c95-e95b-42f1-b0f2-bfb3928e0403 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:23.202503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6526c95-e95b-42f1-b0f2-bfb3928e0403 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:23.208156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:23.208819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.209104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.209377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:23.210056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:23.212136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:23.338468 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3013/5983] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:23.342754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:23.356844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8354c-1dea-4675-b1c9-7f892610a7a8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:23.453455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:23.453904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.454068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.454624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:23.455976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:23.458250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:23.593285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2971/5984] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:39:23 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:23.594267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:23.606770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62394e67-7636-42ed-ae46-b1f256e8384a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:23.612075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:23.612970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.625322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.625322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:23.625322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:23.626805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:23.660017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3014/5985] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:39:23.664620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:23.679648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9477e85-72ca-4ba1-b080-40e714fb3d25 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:23.708541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b666b4a-8024-445c-9252-584585408dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:23.708541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b666b4a-8024-445c-9252-584585408dde admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.708541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b666b4a-8024-445c-9252-584585408dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.708541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b666b4a-8024-445c-9252-584585408dde admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:23.708924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b666b4a-8024-445c-9252-584585408dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:23.708924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b666b4a-8024-445c-9252-584585408dde admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:23.727110 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2972/5986] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:23.727280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:23.738846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b35de-d849-431d-918b-4a0ee21c8f44 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:23.744953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:23.745636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.745960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.746443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] PATH_INFO: `/v3/projects/7203e3fe4fe5412caa8580ab4373b6e6/users/948dcd44048b484daaa16c0dcfe0c8bc/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:23.819974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7203e3fe4fe5412caa8580ab4373b6e6, user_id=948dcd44048b484daaa16c0dcfe0c8bc, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:23.827044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:23.933576 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3015/5987] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:23 2022] PUT /identity/v3/projects/7203e3fe4fe5412caa8580ab4373b6e6/users/948dcd44048b484daaa16c0dcfe0c8bc/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:23.945286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cad44-6fbb-46a9-88e8-7326c4641fed None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:23.945570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cad44-6fbb-46a9-88e8-7326c4641fed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:23.946084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cad44-6fbb-46a9-88e8-7326c4641fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:24.015055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-962cad44-6fbb-46a9-88e8-7326c4641fed None None] MFA Rules not processed for user `948dcd44048b484daaa16c0dcfe0c8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:24.022396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-962cad44-6fbb-46a9-88e8-7326c4641fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:24.132998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2973/5988] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:24.150704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:24.161940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:24.366082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72381f6-9d67-4a50-93a1-32749f0a1951 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:24.369975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe3d9d-6fe7-4e81-af6c-005d19462f75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:24.370727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3d9d-6fe7-4e81-af6c-005d19462f75 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:24.371016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3d9d-6fe7-4e81-af6c-005d19462f75 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:24.371294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3d9d-6fe7-4e81-af6c-005d19462f75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:24.381433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe3d9d-6fe7-4e81-af6c-005d19462f75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:24.382932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe3d9d-6fe7-4e81-af6c-005d19462f75 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:24.393118 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3016/5989] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:24.533313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cad44-6fbb-46a9-88e8-7326c4641fed None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:24.621148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cad44-6fbb-46a9-88e8-7326c4641fed None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:24.636955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:24.638485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:24.639734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:24.640399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] PATH_INFO: `/v3/users/948dcd44048b484daaa16c0dcfe0c8bc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:24.644810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948dcd44048b484daaa16c0dcfe0c8bc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:24.647779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:24.918800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948dcd44048b484daaa16c0dcfe0c8bc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:24.926593 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:24.963018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948dcd44048b484daaa16c0dcfe0c8bc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:24.972672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948dcd44048b484daaa16c0dcfe0c8bc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:24.973622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948dcd44048b484daaa16c0dcfe0c8bc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:25.066522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948dcd44048b484daaa16c0dcfe0c8bc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:25.085162 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2974/5990] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:39:24 2022] DELETE /identity/v3/users/948dcd44048b484daaa16c0dcfe0c8bc => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:25.089682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:25.090230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:25.090360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:25.130580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:25.130580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:25.274031 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3017/5991] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:25.295326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:25.296936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:25.403837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095dbe8-7017-490a-bb86-78cde43c7278 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:25.410725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175beaad-828b-4285-81c4-d50885a300ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:25.421006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175beaad-828b-4285-81c4-d50885a300ad service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:25.421006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175beaad-828b-4285-81c4-d50885a300ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:25.421006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175beaad-828b-4285-81c4-d50885a300ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:25.442979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175beaad-828b-4285-81c4-d50885a300ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:25.451731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175beaad-828b-4285-81c4-d50885a300ad service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:25.470241 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2975/5992] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:25.666731 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:27.032331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:27.049838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:27.065729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057b5b6-3a79-4315-82c0-6c2872d53848 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:27.072642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:27.073440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:27.076269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:27.076687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] PATH_INFO: `/v3/projects/7203e3fe4fe5412caa8580ab4373b6e6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:27.078172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7203e3fe4fe5412caa8580ab4373b6e6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:27.081032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:27.294794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7203e3fe4fe5412caa8580ab4373b6e6', 'request_id': 'req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:27.311641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7203e3fe4fe5412caa8580ab4373b6e6', 'request_id': 'req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:27.462803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7203e3fe4fe5412caa8580ab4373b6e6', 'request_id': 'req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:27.486748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] The token cache is being invalidate because project 7203e3fe4fe5412caa8580ab4373b6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:27.487242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:27.490440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4ce342d2-b5ef-4a58-b9ec-0807fb82f8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:27.496463 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3018/5993] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:27 2022] DELETE /identity/v3/projects/7203e3fe4fe5412caa8580ab4373b6e6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:27.498321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067135-1890-4bd0-a632-c616ee637a22 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:27.498811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067135-1890-4bd0-a632-c616ee637a22 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:27.498939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067135-1890-4bd0-a632-c616ee637a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:27.539137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-01067135-1890-4bd0-a632-c616ee637a22 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:27.540407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-01067135-1890-4bd0-a632-c616ee637a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:27.646396 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:27.669565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a333-bb06-403c-805b-4f4738649d8c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:27.669775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2976/5994] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:27.669935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a333-bb06-403c-805b-4f4738649d8c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:27.670169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a333-bb06-403c-805b-4f4738649d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:27.705765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e7c4a333-bb06-403c-805b-4f4738649d8c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:27.705765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e7c4a333-bb06-403c-805b-4f4738649d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:27.714007 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3019/5995] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:39:27.718201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067135-1890-4bd0-a632-c616ee637a22 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:27.726054 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:27.737847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067135-1890-4bd0-a632-c616ee637a22 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:27.747555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:27.748534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:27.749046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:27.749634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:27.750738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:39:27.752889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:27.755082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:27.789255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a333-bb06-403c-805b-4f4738649d8c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:27.793577 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2977/5996] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:27.805378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a333-bb06-403c-805b-4f4738649d8c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:27.824276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:27.825571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:27.827680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:27.828272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:27.830352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:27.834249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:27.962816 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3020/5997] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:27 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:39:27.966420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:27.989466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23870e-f984-45f1-bdbd-8dd465ab352f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:28.156446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:28.157462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:28.158446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:28.159319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:28.160465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:28.163280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:28.312571 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2978/5998] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:39:27 2022] POST /identity/v3/users => generated 296 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:28.314544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:28.327577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577c65-8277-4c35-a1c1-d7fda7c891ea admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:28.334107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:28.335159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:28.335606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:28.336067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:28.337312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:28.339687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:28.354615 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3021/5999] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:28.358825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:28.373798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd58c-b90d-4d79-b4b8-5647bf20daae admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:28.384118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beee8e5-f39a-4ba1-9e7e-891d4eccd936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:28.386707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee8e5-f39a-4ba1-9e7e-891d4eccd936 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:28.388477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee8e5-f39a-4ba1-9e7e-891d4eccd936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:28.388477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beee8e5-f39a-4ba1-9e7e-891d4eccd936 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:28.388477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beee8e5-f39a-4ba1-9e7e-891d4eccd936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:28.390866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beee8e5-f39a-4ba1-9e7e-891d4eccd936 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:28.417221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2979/6000] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:28.424289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:28.442828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191d56e-3864-4115-82e7-4a9b435c9b05 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:28.457792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:28.459352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:28.459661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:28.460576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] PATH_INFO: `/v3/projects/6e9ceaa616e14f27bba1b7007f54f8e5/users/05e218d817c5465a89720ec02c74de26/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:28.493548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9ceaa616e14f27bba1b7007f54f8e5, user_id=05e218d817c5465a89720ec02c74de26, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:28.497375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:28.503689 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:28.589143 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3022/6001] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:28 2022] PUT /identity/v3/projects/6e9ceaa616e14f27bba1b7007f54f8e5/users/05e218d817c5465a89720ec02c74de26/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:28.604745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9065e-24f7-4974-b30b-42d14ca508fa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:28.605394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9065e-24f7-4974-b30b-42d14ca508fa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:28.605667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9065e-24f7-4974-b30b-42d14ca508fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:28.660729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e4f9065e-24f7-4974-b30b-42d14ca508fa None None] MFA Rules not processed for user `05e218d817c5465a89720ec02c74de26`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:28.665708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e4f9065e-24f7-4974-b30b-42d14ca508fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:28.771653 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2980/6002] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:28.777011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:28.977716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4f737-e28b-4699-95c3-34df63614381 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:28.991978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:28.992612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:28.994362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:28.994679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:28.995352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:28.998436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:29.145367 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3023/6003] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:28 2022] POST /identity/v3/projects => generated 391 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:29.149382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9065e-24f7-4974-b30b-42d14ca508fa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:29.171349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9065e-24f7-4974-b30b-42d14ca508fa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:29.304273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:29.305616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:29.306119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:29.306582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:29.307766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:29.310402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:29.423488 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2981/6004] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:39:29 2022] POST /identity/v3/users => generated 302 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:29.424052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:29.437436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e9581-ca8e-4b7f-8428-de766cd65b3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:29.451814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:29.456767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:29.456767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:29.456767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:29.458404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:29.458901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:29.511095 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3024/6005] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:29.511291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:29.511291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89867-7148-43fb-9a55-7d3f03e394e2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:29.531769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:29.534473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:29.534843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:29.535194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] PATH_INFO: `/v3/projects/81ceecb4039d4d6b817fe558d16d5a6f/users/797758c03e0646a7aab06dd2e07c13d5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:29.594517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ceecb4039d4d6b817fe558d16d5a6f, user_id=797758c03e0646a7aab06dd2e07c13d5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:29.605311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:29.698096 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:29.708873 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2982/6006] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:29 2022] PUT /identity/v3/projects/81ceecb4039d4d6b817fe558d16d5a6f/users/797758c03e0646a7aab06dd2e07c13d5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:29.713162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:29.724494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a710-e6c0-463f-90b2-84c99c27d716 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:29.886897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a762b8-bed0-4632-a529-b2189b7bae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:29.892842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a762b8-bed0-4632-a529-b2189b7bae02 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:29.892842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a762b8-bed0-4632-a529-b2189b7bae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:29.892842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a762b8-bed0-4632-a529-b2189b7bae02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:29.892842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a762b8-bed0-4632-a529-b2189b7bae02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:29.892842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a762b8-bed0-4632-a529-b2189b7bae02 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:29.920277 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3025/6007] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:39:29.924229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:29.937703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724664cb-6ea9-4031-8fcd-843b6aec88bb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:29.948427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:29.949598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:29.955595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:29.955595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] PATH_INFO: `/v3/projects/81ceecb4039d4d6b817fe558d16d5a6f/users/797758c03e0646a7aab06dd2e07c13d5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:29.955595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ceecb4039d4d6b817fe558d16d5a6f, user_id=797758c03e0646a7aab06dd2e07c13d5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:29.958556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:29.999443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2983/6008] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:29 2022] PUT /identity/v3/projects/81ceecb4039d4d6b817fe558d16d5a6f/users/797758c03e0646a7aab06dd2e07c13d5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:30.015690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:30.020100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:30.020100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:30.086432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] MFA Rules not processed for user `797758c03e0646a7aab06dd2e07c13d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:30.090693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:30.314704 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3026/6009] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:30.330320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:30.334646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:30.425564 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:30.481262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe434f1-78c6-4bf3-b7eb-e4e20ec9ee44 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:30.491676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:30.492373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:30.492829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:30.493119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:30.647059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:30.663327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:30.701481 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2984/6010] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:31.615067 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:37.542326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:37.543847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:37.564880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac117b26-c689-4081-84f7-21bc75eba5fc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:37.570640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5c300-26c0-48a1-b58a-7c4afced9079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:37.571690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5c300-26c0-48a1-b58a-7c4afced9079 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:37.571949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5c300-26c0-48a1-b58a-7c4afced9079 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:37.572337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5c300-26c0-48a1-b58a-7c4afced9079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:37.581115 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:37.586647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5c300-26c0-48a1-b58a-7c4afced9079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:37.588518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5c300-26c0-48a1-b58a-7c4afced9079 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:37.603400 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3027/6011] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:43.629078 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:45.383414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:45.589801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ade94-40b5-4584-ab82-d3d24d91c003 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:45.599864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:45.600863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:45.604273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:45.604741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] PATH_INFO: `/v3/users/05e218d817c5465a89720ec02c74de26` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:45.606306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e218d817c5465a89720ec02c74de26)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:45.608482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:45.908910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e218d817c5465a89720ec02c74de26'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:45.946882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e218d817c5465a89720ec02c74de26'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:45.966426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e218d817c5465a89720ec02c74de26'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:45.967440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e218d817c5465a89720ec02c74de26'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:46.103555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e218d817c5465a89720ec02c74de26'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:46.111086 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2985/6012] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:39:45 2022] DELETE /identity/v3/users/05e218d817c5465a89720ec02c74de26 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:46.116006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:46.116494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:46.116580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:46.139051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:46.140513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:46.217346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3028/6013] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:46.242447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:46.244661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:46.352242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27161a-ffdd-4df7-ac5e-9fb43f56b47a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:46.367611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:46.368123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:46.368480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:46.368830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:46.381356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:46.382818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:46.397182 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2986/6014] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:47.536218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:47.537707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:47.587328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7590a8-c0dc-4c13-9503-1bb5ccb76bc6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:47.604418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:47.605633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:47.606262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:47.606731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] PATH_INFO: `/v3/projects/6e9ceaa616e14f27bba1b7007f54f8e5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:47.609621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9ceaa616e14f27bba1b7007f54f8e5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:47.617598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:47.771095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9ceaa616e14f27bba1b7007f54f8e5', 'request_id': 'req-478baffa-93c3-495e-9a76-c054c0a50422'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:47.777775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9ceaa616e14f27bba1b7007f54f8e5', 'request_id': 'req-478baffa-93c3-495e-9a76-c054c0a50422'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:47.861502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9ceaa616e14f27bba1b7007f54f8e5', 'request_id': 'req-478baffa-93c3-495e-9a76-c054c0a50422'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:47.884924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] The token cache is being invalidate because project 6e9ceaa616e14f27bba1b7007f54f8e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:47.884924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:47.885404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-478baffa-93c3-495e-9a76-c054c0a50422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:47.894206 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3029/6015] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:47 2022] DELETE /identity/v3/projects/6e9ceaa616e14f27bba1b7007f54f8e5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:47.899298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:47.912204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b388d7-6ef6-4fe5-935f-e2b5d769d8ac service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:47.950179 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:48.040360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:48.041022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:48.041321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:48.041593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] PATH_INFO: `/v3/users/797758c03e0646a7aab06dd2e07c13d5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:48.042811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=797758c03e0646a7aab06dd2e07c13d5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:48.045397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:48.425941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797758c03e0646a7aab06dd2e07c13d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:48.451319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797758c03e0646a7aab06dd2e07c13d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:48.460190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797758c03e0646a7aab06dd2e07c13d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:48.461256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797758c03e0646a7aab06dd2e07c13d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:48.600040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797758c03e0646a7aab06dd2e07c13d5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:48.611647 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2987/6016] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:39:47 2022] DELETE /identity/v3/users/797758c03e0646a7aab06dd2e07c13d5 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:49.074637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabe17-38d3-468e-aa4f-01f3934aa91e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:49.075131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabe17-38d3-468e-aa4f-01f3934aa91e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:49.075209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beabe17-38d3-468e-aa4f-01f3934aa91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:49.097489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5beabe17-38d3-468e-aa4f-01f3934aa91e None None] MFA Rules not processed for user `13d47aaea13a458299f133080c5e3004`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:49.099580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5beabe17-38d3-468e-aa4f-01f3934aa91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:49.178636 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3030/6017] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:49.845110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:49.847412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:49.944226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724fb2-bf2d-454d-8f25-149dd484b825 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:49.950105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:49.950791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:49.951069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:49.951636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] PATH_INFO: `/v3/projects/81ceecb4039d4d6b817fe558d16d5a6f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:49.952932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ceecb4039d4d6b817fe558d16d5a6f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:49.955534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:50.087676 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:50.092810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ceecb4039d4d6b817fe558d16d5a6f', 'request_id': 'req-7c152a8e-abfb-4239-818e-4f1c4f5f9284'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:50.099737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ceecb4039d4d6b817fe558d16d5a6f', 'request_id': 'req-7c152a8e-abfb-4239-818e-4f1c4f5f9284'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:50.207923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ceecb4039d4d6b817fe558d16d5a6f', 'request_id': 'req-7c152a8e-abfb-4239-818e-4f1c4f5f9284'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:50.226995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] The token cache is being invalidate because project 81ceecb4039d4d6b817fe558d16d5a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:39:50.227386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:50.228219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7c152a8e-abfb-4239-818e-4f1c4f5f9284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:39:50.230863 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2988/6018] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:39:49 2022] DELETE /identity/v3/projects/81ceecb4039d4d6b817fe558d16d5a6f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:50.237026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf3a0-1bd4-4b07-a4d9-b1c270ee9432 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:50.238999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf3a0-1bd4-4b07-a4d9-b1c270ee9432 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:50.239517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf3a0-1bd4-4b07-a4d9-b1c270ee9432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:50.260215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-12bbf3a0-1bd4-4b07-a4d9-b1c270ee9432 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:50.261538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-12bbf3a0-1bd4-4b07-a4d9-b1c270ee9432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:50.294463 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:50.373099 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3031/6019] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:50.380874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2857-b9f5-4d95-b824-7363c18f92bf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:50.381160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2857-b9f5-4d95-b824-7363c18f92bf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:50.381431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2857-b9f5-4d95-b824-7363c18f92bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:50.426803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-063d2857-b9f5-4d95-b824-7363c18f92bf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:50.429517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-063d2857-b9f5-4d95-b824-7363c18f92bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:50.456841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2989/6020] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:50.462242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf3a0-1bd4-4b07-a4d9-b1c270ee9432 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:50.477049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf3a0-1bd4-4b07-a4d9-b1c270ee9432 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:50.485508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:50.486439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:50.486829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:50.487396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:50.488290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:39:50.488788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:50.494125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:50.529994 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3032/6021] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:39:50.532970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2857-b9f5-4d95-b824-7363c18f92bf None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:50.552329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2857-b9f5-4d95-b824-7363c18f92bf None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:50.570203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:50.570955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:50.571435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:50.571730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:50.572424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:50.577390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:50.704212 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2990/6022] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:50 2022] POST /identity/v3/projects => generated 397 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:50.707968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:50.728208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81e20-f946-4d0b-9f6a-9b2f5aecf0c7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:50.841475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:50.845628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:50.847560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:50.847560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:50.847560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:50.849234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:50.958840 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3033/6023] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:39:50 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:50.979781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:50.996393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9b30-fbad-41af-9d78-dd31d50a7ec7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:51.010355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:51.011149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:51.011554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:51.011948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:51.012713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:51.017640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:51.035437 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2991/6024] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:51.039992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:51.052863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a4a6d-b32a-4804-b44d-f4b2f71ff753 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:51.059038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7d34d-07e9-4037-b2cb-c6db0094cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:51.059692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d34d-07e9-4037-b2cb-c6db0094cdcc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:51.059977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d34d-07e9-4037-b2cb-c6db0094cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:51.060252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d34d-07e9-4037-b2cb-c6db0094cdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:51.061709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7d34d-07e9-4037-b2cb-c6db0094cdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:51.063429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7d34d-07e9-4037-b2cb-c6db0094cdcc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:51.080731 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3034/6025] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:51.085025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:51.100460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7de4-6e70-4e49-96c8-e7b97c2e8e61 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:51.113564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:51.114528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:51.115003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:51.115833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] PATH_INFO: `/v3/projects/3fde632fb77f45d6acef754f5be2e81c/users/01c41f9d25de43a080067cf84229e7fe/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:51.147203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fde632fb77f45d6acef754f5be2e81c, user_id=01c41f9d25de43a080067cf84229e7fe, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:51.150108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:51.323789 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2992/6026] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:51 2022] PUT /identity/v3/projects/3fde632fb77f45d6acef754f5be2e81c/users/01c41f9d25de43a080067cf84229e7fe/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:51.336785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcc105-bd6f-45a7-ac60-78603d1e578f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:51.337673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcc105-bd6f-45a7-ac60-78603d1e578f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:51.338242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcc105-bd6f-45a7-ac60-78603d1e578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:51.372765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-abdcc105-bd6f-45a7-ac60-78603d1e578f None None] MFA Rules not processed for user `01c41f9d25de43a080067cf84229e7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:51.373967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-abdcc105-bd6f-45a7-ac60-78603d1e578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:51.456685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3035/6027] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:51.457979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:51.530947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f331f1-0b20-46e2-a0fb-045325ecfd64 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:51.539012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:51.539840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:51.539995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:51.540270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:51.541696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:51.544071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:51.708235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2993/6028] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:39:51 2022] POST /identity/v3/projects => generated 399 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:39:51.711436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcc105-bd6f-45a7-ac60-78603d1e578f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:51.730275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcc105-bd6f-45a7-ac60-78603d1e578f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:51.828441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:51.829395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:51.830279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:51.830692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:51.831544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:51.834366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:51.920814 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3036/6029] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:39:51 2022] POST /identity/v3/users => generated 306 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:39:51.926909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:51.950920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfd31e-4c48-42d3-804b-dfefec7b7c8d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:51.965512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:51.966168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:51.967226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:51.967513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:51.968343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:51.971119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:52.006880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:52.012213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2994/6030] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:39:52.020104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d95157-0cd8-4e2a-8063-e0440728fe28 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:52.038265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:52.038265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:52.038265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:52.038265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] PATH_INFO: `/v3/projects/63a79cc33543439b888300803f2bc2f4/users/5c232416cffe44909575918022c7dbc1/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:52.061271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a79cc33543439b888300803f2bc2f4, user_id=5c232416cffe44909575918022c7dbc1, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:52.065724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:52.142246 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3037/6031] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:52 2022] PUT /identity/v3/projects/63a79cc33543439b888300803f2bc2f4/users/5c232416cffe44909575918022c7dbc1/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:52.146125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:52.157503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2c6c7-b28a-44ae-b9a9-51f03d2b2b59 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:52.230860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2945b-090a-4939-b928-5534e59ac4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:52.231552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2945b-090a-4939-b928-5534e59ac4ec admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:52.232035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2945b-090a-4939-b928-5534e59ac4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:52.232370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2945b-090a-4939-b928-5534e59ac4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:52.233109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2945b-090a-4939-b928-5534e59ac4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:52.234795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2945b-090a-4939-b928-5534e59ac4ec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:52.257574 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2995/6032] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:39:52.261308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:52.275505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ab321-9ce4-4e44-b619-cb45607c5678 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:52.280604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:52.281290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:52.281575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:52.281946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] PATH_INFO: `/v3/projects/63a79cc33543439b888300803f2bc2f4/users/5c232416cffe44909575918022c7dbc1/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:52.284598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a79cc33543439b888300803f2bc2f4, user_id=5c232416cffe44909575918022c7dbc1, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:52.287292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:52.299751 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3038/6033] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:39:52 2022] PUT /identity/v3/projects/63a79cc33543439b888300803f2bc2f4/users/5c232416cffe44909575918022c7dbc1/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:39:52.312739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:52.313120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:52.314047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:52.346714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] MFA Rules not processed for user `5c232416cffe44909575918022c7dbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:52.347936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:52.427263 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2996/6034] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:52.437020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:52.440602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:52.514973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad3116-30fd-4906-9ec2-134ee4674d8e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:52.519133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:52.519749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:52.520023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:52.520294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:52.601178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:52.603164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:52.625515 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3039/6035] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:52.992221 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:53.089458 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:54.883974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:54.886163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:55.018022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7008-621d-4083-ac67-eb62477ef304 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:55.027887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:55.028781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:55.029508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:55.030108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:55.041091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:55.043110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:55.058074 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2997/6036] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:05.269267 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:05.789160 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=78 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:08.681054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:08.686477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:08.809097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b4c64-4092-458c-951c-9da24b5b064c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:08.819583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:08.820489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:08.821019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:08.821313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] PATH_INFO: `/v3/users/40464c801b5a4ea3a0d489afc9f46d92` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:08.822606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40464c801b5a4ea3a0d489afc9f46d92)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:08.826282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:09.080968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40464c801b5a4ea3a0d489afc9f46d92'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:09.084174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40464c801b5a4ea3a0d489afc9f46d92'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:09.182606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40464c801b5a4ea3a0d489afc9f46d92'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:09.197650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40464c801b5a4ea3a0d489afc9f46d92'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:09.198740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40464c801b5a4ea3a0d489afc9f46d92'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:09.225875 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3040/6037] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:40:08 2022] DELETE /identity/v3/users/40464c801b5a4ea3a0d489afc9f46d92 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:09.941388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:09.956319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe405b-70e1-460c-b622-a53483badffe service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:10.027616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:10.029125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:10.124462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:10.125475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:10.125955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:10.126847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] PATH_INFO: `/v3/projects/6de5f879b878484e94af834c1df008e8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:10.129919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de5f879b878484e94af834c1df008e8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:10.132131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:10.156216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3409b35-9150-4f6d-bcdb-7eb459ed3214 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:10.164281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:10.178437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:10.178437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:10.178437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] PATH_INFO: `/v3/users/0c626a937b8c4554867af55667f115d4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:10.178437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c626a937b8c4554867af55667f115d4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:10.183627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:10.239019 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:10.311720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de5f879b878484e94af834c1df008e8', 'request_id': 'req-ee94f9b8-5390-4f67-a804-e2ad9161f94e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.318559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de5f879b878484e94af834c1df008e8', 'request_id': 'req-ee94f9b8-5390-4f67-a804-e2ad9161f94e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.458678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de5f879b878484e94af834c1df008e8', 'request_id': 'req-ee94f9b8-5390-4f67-a804-e2ad9161f94e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.478136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c626a937b8c4554867af55667f115d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.484928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c626a937b8c4554867af55667f115d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.493127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] The token cache is being invalidate because project 6de5f879b878484e94af834c1df008e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:40:10.493995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.496182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ee94f9b8-5390-4f67-a804-e2ad9161f94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.498986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2998/6038] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:40:09 2022] DELETE /identity/v3/projects/6de5f879b878484e94af834c1df008e8 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:10.506268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6051-f089-4906-9d6f-182b40534338 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:10.511559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6051-f089-4906-9d6f-182b40534338 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:10.511559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6051-f089-4906-9d6f-182b40534338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:10.540737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3a8c6051-f089-4906-9d6f-182b40534338 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:10.542676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3a8c6051-f089-4906-9d6f-182b40534338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:10.605785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c626a937b8c4554867af55667f115d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.623159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c626a937b8c4554867af55667f115d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.624136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c626a937b8c4554867af55667f115d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:10.652268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 2999/6039] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:40:10.653993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc0bce-0169-4592-8972-b88d72bd9af5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:10.654445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc0bce-0169-4592-8972-b88d72bd9af5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:10.654803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc0bce-0169-4592-8972-b88d72bd9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:10.675270 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3041/6040] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:40:10 2022] DELETE /identity/v3/users/0c626a937b8c4554867af55667f115d4 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:40:10.719182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1efc0bce-0169-4592-8972-b88d72bd9af5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:10.727163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1efc0bce-0169-4592-8972-b88d72bd9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:10.847197 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:10.929060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3000/6041] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:10.931042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:10.946755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd7473-8c73-4d92-81b2-79074ad68cd1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:10.969622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:10.974274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:10.974274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:10.974274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:10.974274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:40:10.974274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:10.974811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:11.023777 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3042/6042] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:40:11.025104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc0bce-0169-4592-8972-b88d72bd9af5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:11.038539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc0bce-0169-4592-8972-b88d72bd9af5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:11.061310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:11.065345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:11.066678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:11.068227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:11.069156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:11.079454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:11.243585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:11.252942 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3001/6043] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:40:11 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:40:11.261908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494557dd-be8a-44c4-a88b-85227c385391 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:11.375779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:11.376061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:11.377683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:11.378040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:11.378718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:11.382694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:11.481654 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3043/6044] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:40:11 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:40:11.482936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:11.500331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe92f0-1699-41db-a7cd-c12b467576e4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:11.507068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:11.508033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:11.508492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:11.508944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:11.510677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:11.512630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:11.531768 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3002/6045] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:40:11.535525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:11.553756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42779809-07fe-40fd-8908-760f04ede072 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:11.565208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:11.565920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:11.566209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:11.566846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:11.567919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:11.569698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:11.614781 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3044/6046] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:40:11.618824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:11.648178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:11.648742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9d665-bce4-4370-a9f7-3e7a999b7959 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:11.651292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:11.655107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568a332-90bf-4b6c-bab1-a1b37fec2a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:11.655107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568a332-90bf-4b6c-bab1-a1b37fec2a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:11.655107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568a332-90bf-4b6c-bab1-a1b37fec2a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:11.656042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568a332-90bf-4b6c-bab1-a1b37fec2a92 admin admin] PATH_INFO: `/v3/projects/2e19f4252d644c0ab860b2dd1efe0288/users/fa766c9179b341adb2e774d97ddc3bb3/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:11.693492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8575f-68a3-4380-9810-87d254831e86 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:11.706666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:11.709081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:11.710394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:11.711520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] PATH_INFO: `/v3/projects/9033d301c1af46b39eae0dd38905d9fb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:11.712254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568a332-90bf-4b6c-bab1-a1b37fec2a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e19f4252d644c0ab860b2dd1efe0288, user_id=fa766c9179b341adb2e774d97ddc3bb3, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:11.715822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568a332-90bf-4b6c-bab1-a1b37fec2a92 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:11.716732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9033d301c1af46b39eae0dd38905d9fb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:11.719025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:11.940974 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3003/6047] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:40:11 2022] PUT /identity/v3/projects/2e19f4252d644c0ab860b2dd1efe0288/users/fa766c9179b341adb2e774d97ddc3bb3/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:11.957265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548378-ea08-4f88-98d6-d641d47fb316 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:11.958082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548378-ea08-4f88-98d6-d641d47fb316 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:11.958543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0548378-ea08-4f88-98d6-d641d47fb316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:11.962700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9033d301c1af46b39eae0dd38905d9fb', 'request_id': 'req-34ccede6-5b81-4c19-9e64-5d67aed771b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:11.971148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9033d301c1af46b39eae0dd38905d9fb', 'request_id': 'req-34ccede6-5b81-4c19-9e64-5d67aed771b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:12.000465 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:12.024480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b0548378-ea08-4f88-98d6-d641d47fb316 None None] MFA Rules not processed for user `fa766c9179b341adb2e774d97ddc3bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:12.026021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b0548378-ea08-4f88-98d6-d641d47fb316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:12.062926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9033d301c1af46b39eae0dd38905d9fb', 'request_id': 'req-34ccede6-5b81-4c19-9e64-5d67aed771b2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:12.086641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] The token cache is being invalidate because project 9033d301c1af46b39eae0dd38905d9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:40:12.088000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:12.089681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-34ccede6-5b81-4c19-9e64-5d67aed771b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:12.092685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3045/6048] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:40:11 2022] DELETE /identity/v3/projects/9033d301c1af46b39eae0dd38905d9fb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:12.099986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:12.100380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:12.101418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:12.179667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:12.180973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:12.211718 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3004/6049] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:12.227578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372161-6a68-44a8-a9e5-fdca4ee840cd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:12.227871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372161-6a68-44a8-a9e5-fdca4ee840cd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:12.228155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01372161-6a68-44a8-a9e5-fdca4ee840cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:12.284177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3046/6050] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:12.285392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-01372161-6a68-44a8-a9e5-fdca4ee840cd None None] MFA Rules not processed for user `fa766c9179b341adb2e774d97ddc3bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:12.286687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-01372161-6a68-44a8-a9e5-fdca4ee840cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:12.294913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:12.296331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:12.307079 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3005/6051] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:12.316823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:12.334454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:12.335076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:12.347132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4985-a7d8-4462-b146-b5a4a6c7cfae None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:12.369617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:12.370746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:12.375785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:12.379425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:12.379716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:12.380000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] PATH_INFO: `/v3/users/01c41f9d25de43a080067cf84229e7fe` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:12.386940 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3006/6052] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:12.388300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:12.388581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c41f9d25de43a080067cf84229e7fe)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:12.389906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:12.390614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:12.572463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0890e93-9156-47e6-b9aa-5eb7190876fb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:12.588843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:12.589571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:12.589960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:12.590730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:12.611840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:12.614625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:12.639440 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3007/6053] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:12.641797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:12.666380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481389-9310-4abe-8e4d-62b7be21c2af service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:12.671449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:12.672764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:12.673639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:12.674327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:12.675113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:40:12.676089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:12.677945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:12.698647 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3008/6054] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:40:12.700558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:12.724856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3a161-8001-4bd5-ab28-96090c1ecded admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:12.753242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:12.753242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:12.753242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:12.753242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:12.754607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:12.754607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:13.051615 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:13.052219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c41f9d25de43a080067cf84229e7fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:13.052219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c41f9d25de43a080067cf84229e7fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:13.479191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c41f9d25de43a080067cf84229e7fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:13.514040 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3009/6055] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:40:12 2022] POST /identity/v3/projects => generated 373 bytes in 812 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:40:13.519211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c41f9d25de43a080067cf84229e7fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:13.523069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:13.523195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ec64ada0-95cf-4289-8fda-b4e7444bd99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c41f9d25de43a080067cf84229e7fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:13.586439 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3047/6056] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:40:12 2022] DELETE /identity/v3/users/01c41f9d25de43a080067cf84229e7fe => generated 0 bytes in 1292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:40:13.590616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:13.591152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:13.591723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:13.669314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:13.671435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:13.679322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f19ef-3cf5-45d9-82bf-0d1c70f9a304 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:13.785004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:13.785844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:13.786681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:13.787054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:13.787982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:13.829406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:13.889602 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3048/6057] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:13.899196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:13.901625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:14.004151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e085571-2f2c-4d9c-9971-71ff4c4cad01 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:14.007888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:14.009888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:14.009888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:14.009888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:14.036163 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3010/6058] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:40:13 2022] POST /identity/v3/users => generated 287 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:40:14.038994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:14.040626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:14.043075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:14.043775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:14.065089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001b89-19b7-4a2a-8b93-c72fa8e4809d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:14.067639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:14.068521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:14.069503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:14.070006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:14.070889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:14.073781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:14.093786 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3011/6059] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:40:14.093786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:14.103517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a3bd-67a8-4159-9519-4dc260e22251 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:14.110760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cf001-5466-4fb0-b074-a92d9790d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:14.111388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf001-5466-4fb0-b074-a92d9790d988 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:14.111675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf001-5466-4fb0-b074-a92d9790d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:14.111953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf001-5466-4fb0-b074-a92d9790d988 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:14.112712 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3049/6060] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:14.112915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf001-5466-4fb0-b074-a92d9790d988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:14.122453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf001-5466-4fb0-b074-a92d9790d988 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:14.143128 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3012/6061] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:40:14.159375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:14.185384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f8ee1-86c1-4c68-8522-fbea2edafcd8 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:14.217915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:14.218842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:14.219568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:14.220367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] PATH_INFO: `/v3/projects/eed74016588b4c67a9bdab48f488d4ed/users/dc854690edaa498e883a115b2c7448d8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:14.254762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed74016588b4c67a9bdab48f488d4ed, user_id=dc854690edaa498e883a115b2c7448d8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:14.259656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:14.409727 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3050/6062] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:40:14 2022] PUT /identity/v3/projects/eed74016588b4c67a9bdab48f488d4ed/users/dc854690edaa498e883a115b2c7448d8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:14.411153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb8e0-fbb9-4c94-8ee2-c3638ccbfb35 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:14.411442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb8e0-fbb9-4c94-8ee2-c3638ccbfb35 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:14.411765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecb8e0-fbb9-4c94-8ee2-c3638ccbfb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:14.467362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dbecb8e0-fbb9-4c94-8ee2-c3638ccbfb35 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:14.487088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:14.489834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:14.505484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dbecb8e0-fbb9-4c94-8ee2-c3638ccbfb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:14.704379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ee1f5-755d-439b-a1b3-3c08e4833c76 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:14.709934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:14.710864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:14.711154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:14.711522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] PATH_INFO: `/v3/projects/3fde632fb77f45d6acef754f5be2e81c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:14.713104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fde632fb77f45d6acef754f5be2e81c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:14.715290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:14.730918 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3013/6063] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:14.738287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecb8e0-fbb9-4c94-8ee2-c3638ccbfb35 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:14.796588 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:14.903743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecb8e0-fbb9-4c94-8ee2-c3638ccbfb35 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:14.923937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fde632fb77f45d6acef754f5be2e81c', 'request_id': 'req-486e0219-046b-49a1-8d50-5ef5b9ebda49'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:14.944887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fde632fb77f45d6acef754f5be2e81c', 'request_id': 'req-486e0219-046b-49a1-8d50-5ef5b9ebda49'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:14.965479 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:15.002633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:15.002633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:15.002633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:15.002633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:15.049027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fde632fb77f45d6acef754f5be2e81c', 'request_id': 'req-486e0219-046b-49a1-8d50-5ef5b9ebda49'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.092139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] The token cache is being invalidate because project 3fde632fb77f45d6acef754f5be2e81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:40:15.092442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.099176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.119385 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3051/6064] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:40:14 2022] DELETE /identity/v3/projects/3fde632fb77f45d6acef754f5be2e81c => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:40:15.123063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:15.128160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:15.143098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:15.146947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:15.171028 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3014/6065] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:40:15.175742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e0219-046b-49a1-8d50-5ef5b9ebda49 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:15.197475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:15.199562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:15.200052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:15.200513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] PATH_INFO: `/v3/users/5c232416cffe44909575918022c7dbc1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:15.205467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c232416cffe44909575918022c7dbc1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:15.217219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:15.595791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c232416cffe44909575918022c7dbc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.597683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c232416cffe44909575918022c7dbc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.741996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c232416cffe44909575918022c7dbc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.751098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c232416cffe44909575918022c7dbc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.752383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10d34837-7f6d-4024-8e27-d253d0131592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c232416cffe44909575918022c7dbc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:15.788021 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3052/6066] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:40:15 2022] DELETE /identity/v3/users/5c232416cffe44909575918022c7dbc1 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:16.248444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:16.283435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75823f-99bf-43dd-9569-751735a2f544 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:16.517386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:16.517386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:16.517386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:16.517386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] PATH_INFO: `/v3/projects/63a79cc33543439b888300803f2bc2f4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:16.520120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a79cc33543439b888300803f2bc2f4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:16.527966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:17.431341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a79cc33543439b888300803f2bc2f4', 'request_id': 'req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:17.454725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a79cc33543439b888300803f2bc2f4', 'request_id': 'req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:17.679372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a79cc33543439b888300803f2bc2f4', 'request_id': 'req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:17.697436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] The token cache is being invalidate because project 63a79cc33543439b888300803f2bc2f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:40:17.698025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:17.701626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ec0f0c-dd72-4b79-82a3-5c06dfb8abf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:17.704935 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3015/6067] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:40:16 2022] DELETE /identity/v3/projects/63a79cc33543439b888300803f2bc2f4 => generated 0 bytes in 1457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:17.710113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc7e8-e280-4c8e-bbd1-1d9df32888e5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:17.710964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc7e8-e280-4c8e-bbd1-1d9df32888e5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:17.711419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccc7e8-e280-4c8e-bbd1-1d9df32888e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:17.745393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-baccc7e8-e280-4c8e-bbd1-1d9df32888e5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:17.746995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-baccc7e8-e280-4c8e-bbd1-1d9df32888e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:17.877331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a6ae-a229-4a7b-9d3d-4fce0d15be63 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:17.877614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a6ae-a229-4a7b-9d3d-4fce0d15be63 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:17.878016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58a6ae-a229-4a7b-9d3d-4fce0d15be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:17.882434 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3053/6068] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:17.901074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2d58a6ae-a229-4a7b-9d3d-4fce0d15be63 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:17.902145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2d58a6ae-a229-4a7b-9d3d-4fce0d15be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:17.913844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3016/6069] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:17.919677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc7e8-e280-4c8e-bbd1-1d9df32888e5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:17.939061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccc7e8-e280-4c8e-bbd1-1d9df32888e5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:17.949722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:17.950502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:17.951567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:17.952594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:17.958319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:40:17.964848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:17.964848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:17.987436 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3054/6070] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:40:17.988691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a6ae-a229-4a7b-9d3d-4fce0d15be63 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:18.001216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58a6ae-a229-4a7b-9d3d-4fce0d15be63 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:18.007156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:18.007156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:18.007599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:18.007599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:18.008150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:18.010432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:18.033577 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:18.178737 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3017/6071] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:40:17 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:40:18.182766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:18.196170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe92a-24e2-42a3-87e3-855766e795b1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:18.272455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:18.273246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:18.273687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:18.274069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:18.274795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:18.277050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:18.460375 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3055/6072] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:40:18 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:40:18.465365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:18.481584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b343fe6-59a5-461d-9e8d-e8283e9cc5c3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:18.500437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:18.500437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:18.500437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:18.500437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:18.500904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:18.500904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:18.518858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3018/6073] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:40:18.526047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:18.551225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8a60-5ea0-4f61-941b-17ba8f75121f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:18.558849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474f115-a1d8-4a70-9b96-f0bca2e17eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:18.559477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474f115-a1d8-4a70-9b96-f0bca2e17eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:18.563199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474f115-a1d8-4a70-9b96-f0bca2e17eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:18.563344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474f115-a1d8-4a70-9b96-f0bca2e17eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:18.565652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474f115-a1d8-4a70-9b96-f0bca2e17eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:18.569643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474f115-a1d8-4a70-9b96-f0bca2e17eb3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:18.619821 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3056/6074] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:40:18.626832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:18.640539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb5b5-8981-480b-b64d-e1d4d5a9c24c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:18.652983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:18.652983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:18.652983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:18.652983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] PATH_INFO: `/v3/projects/83a4636b887e42618b9cead42ae4ddd8/users/ef31fbbe22504738ba5ddde0848ef8d0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:18.680943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a4636b887e42618b9cead42ae4ddd8, user_id=ef31fbbe22504738ba5ddde0848ef8d0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:18.690735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:18.919732 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3019/6075] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:40:18 2022] PUT /identity/v3/projects/83a4636b887e42618b9cead42ae4ddd8/users/ef31fbbe22504738ba5ddde0848ef8d0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:18.935550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228082b0-6b1b-4a37-9bbd-4c3b6a86f684 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:18.936038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228082b0-6b1b-4a37-9bbd-4c3b6a86f684 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:18.936244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228082b0-6b1b-4a37-9bbd-4c3b6a86f684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:19.024975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-228082b0-6b1b-4a37-9bbd-4c3b6a86f684 None None] MFA Rules not processed for user `ef31fbbe22504738ba5ddde0848ef8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:19.026425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-228082b0-6b1b-4a37-9bbd-4c3b6a86f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:19.120341 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3057/6076] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:40:19.124924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:19.238884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906f783-0dd8-4575-83ba-f6ec1a95861b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:19.251938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:19.251938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:19.252224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:19.252480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:19.254766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:19.259320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:19.411998 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:19.439712 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3020/6077] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:40:19 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:40:19.446872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228082b0-6b1b-4a37-9bbd-4c3b6a86f684 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:19.467102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228082b0-6b1b-4a37-9bbd-4c3b6a86f684 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:19.509288 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:19.552004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:19.570573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:19.570573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:19.570573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:19.570573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:19.570573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:19.658880 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3058/6078] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:40:19 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:40:19.663111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:19.684822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ae83-a182-4af5-880b-b3ee02753270 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:19.692726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:19.693992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:19.695517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:19.696067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:19.698008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:19.705109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:19.721989 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3021/6079] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:40:19.727946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:19.752900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92ec1-c0ef-43bf-87ff-509071ab7569 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:19.759366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:19.760546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:19.761070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:19.761478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] PATH_INFO: `/v3/projects/030d5438ad2945b0bfe89f61a82bc392/users/95835bf45d714dae8bc75bcd59056b3c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:19.797940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=030d5438ad2945b0bfe89f61a82bc392, user_id=95835bf45d714dae8bc75bcd59056b3c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:19.810870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:19.957194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3059/6080] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:40:19 2022] PUT /identity/v3/projects/030d5438ad2945b0bfe89f61a82bc392/users/95835bf45d714dae8bc75bcd59056b3c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:19.967225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:19.984858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d233-4b35-49f2-99ca-6909e32eafc6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:20.064901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de07e5-94fa-4a44-9901-dce322e0ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:20.065873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de07e5-94fa-4a44-9901-dce322e0ba60 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:20.066330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de07e5-94fa-4a44-9901-dce322e0ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:20.066796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de07e5-94fa-4a44-9901-dce322e0ba60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:20.069193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de07e5-94fa-4a44-9901-dce322e0ba60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:20.071262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de07e5-94fa-4a44-9901-dce322e0ba60 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:20.103268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3022/6081] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:40:20.110062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:20.122181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3c8af-f4d5-4277-b1c0-21f53775390a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:20.129139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:20.133313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:20.133313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:20.133313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] PATH_INFO: `/v3/projects/030d5438ad2945b0bfe89f61a82bc392/users/95835bf45d714dae8bc75bcd59056b3c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:20.133313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030d5438ad2945b0bfe89f61a82bc392, user_id=95835bf45d714dae8bc75bcd59056b3c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:20.136262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:20.150161 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3060/6082] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:40:20 2022] PUT /identity/v3/projects/030d5438ad2945b0bfe89f61a82bc392/users/95835bf45d714dae8bc75bcd59056b3c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:40:20.166406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c400-9817-4296-a07c-920ede01373a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:20.167070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c400-9817-4296-a07c-920ede01373a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:20.167619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c400-9817-4296-a07c-920ede01373a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:20.208692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9653c400-9817-4296-a07c-920ede01373a None None] MFA Rules not processed for user `95835bf45d714dae8bc75bcd59056b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:20.210517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9653c400-9817-4296-a07c-920ede01373a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:20.321525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3023/6083] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:40:20.333697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:20.335812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:20.535724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bc900-027d-4f04-bef5-1030bb85b717 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:20.541474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5207b9-b942-4c03-a3d4-96e5fa9ecfd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:20.542790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5207b9-b942-4c03-a3d4-96e5fa9ecfd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:20.543277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5207b9-b942-4c03-a3d4-96e5fa9ecfd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:20.543706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5207b9-b942-4c03-a3d4-96e5fa9ecfd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:20.559497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5207b9-b942-4c03-a3d4-96e5fa9ecfd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:20.562131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5207b9-b942-4c03-a3d4-96e5fa9ecfd2 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:20.579192 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3061/6084] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:40:21.738429 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:23.694012 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:24.475171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9173c-6619-42fa-afa3-c080ba59b495 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:24.475171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9173c-6619-42fa-afa3-c080ba59b495 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:24.478527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9173c-6619-42fa-afa3-c080ba59b495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:24.530011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-65b9173c-6619-42fa-afa3-c080ba59b495 None None] MFA Rules not processed for user `88c64df8e3034b71b25b6139a454bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:24.533609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-65b9173c-6619-42fa-afa3-c080ba59b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:24.635766 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:24.676915 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3024/6085] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:28.248641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:28.254885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:28.254885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:28.297513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] MFA Rules not processed for user `dc854690edaa498e883a115b2c7448d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:28.301007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:28.412937 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3062/6086] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:28.426866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2346a3-fa15-429e-8a7a-1825a88d84dd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:28.427378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2346a3-fa15-429e-8a7a-1825a88d84dd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:28.427497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2346a3-fa15-429e-8a7a-1825a88d84dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:28.468260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9c2346a3-fa15-429e-8a7a-1825a88d84dd None None] MFA Rules not processed for user `dc854690edaa498e883a115b2c7448d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:28.483033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c2346a3-fa15-429e-8a7a-1825a88d84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:28.507147 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3025/6087] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:28.557520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:28.559115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:28.671465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ffe32-7c30-4e67-8fad-659d6e0a4e53 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:28.683113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:28.684466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:28.685598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:28.685978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:28.698453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:28.714302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:28.740265 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3063/6088] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:31.488076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2346a3-fa15-429e-8a7a-1825a88d84dd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:31.507572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2346a3-fa15-429e-8a7a-1825a88d84dd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:31.522609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95835bf45d714dae8bc75bcd59056b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '030d5438ad2945b0bfe89f61a82bc392', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:31.523644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:31.524121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:31.524600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:31.525370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:40:31.525692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:31.527389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:31.558781 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3026/6089] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:40:31.563765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:31.578868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aebb02-9584-4054-8685-1aa26f52b128 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:31.590545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95835bf45d714dae8bc75bcd59056b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '030d5438ad2945b0bfe89f61a82bc392', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:31.591213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:31.591454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:31.591736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:31.592407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:31.598377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:31.768940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3064/6090] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:40:31 2022] POST /identity/v3/projects => generated 347 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:40:31.770365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:31.787205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c955c-59cf-4d50-a771-796409000535 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:31.929757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95835bf45d714dae8bc75bcd59056b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '030d5438ad2945b0bfe89f61a82bc392', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:31.930657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:31.931240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:31.931738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:31.932409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:40:31.932729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:31.936646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:31.966410 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3027/6091] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:40:33.311555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:33.333136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2facf0e-f57d-4415-b2fb-a76a3339274c tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:33.341185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95835bf45d714dae8bc75bcd59056b3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '030d5438ad2945b0bfe89f61a82bc392', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:33.342403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:33.343057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:33.344268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] PATH_INFO: `/v3/projects/b98517503c1944c68e8048cf6cb45f50` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:33.346136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b98517503c1944c68e8048cf6cb45f50)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:33.350443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:33.394493 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:33.592452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98517503c1944c68e8048cf6cb45f50', 'request_id': 'req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:33.614337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98517503c1944c68e8048cf6cb45f50', 'request_id': 'req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:33.730716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98517503c1944c68e8048cf6cb45f50', 'request_id': 'req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:33.760813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] The token cache is being invalidate because project b98517503c1944c68e8048cf6cb45f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:40:33.761123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:33.765727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:40:33.771689 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3065/6092] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:40:33 2022] DELETE /identity/v3/projects/b98517503c1944c68e8048cf6cb45f50 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:40:33.818652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:33.821403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:33.959872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d61c-fd71-4e8b-9e4a-ac7a7ee6417a tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:34.083531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3f643-b6ad-4478-8966-580cd6610950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:34.084161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3f643-b6ad-4478-8966-580cd6610950 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:34.084445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3f643-b6ad-4478-8966-580cd6610950 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:34.084721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3f643-b6ad-4478-8966-580cd6610950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:34.088282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-54a3f643-b6ad-4478-8966-580cd6610950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:34.157632 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:34.231209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3f643-b6ad-4478-8966-580cd6610950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:34.232685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3f643-b6ad-4478-8966-580cd6610950 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:34.254955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3028/6093] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:36.821397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:36.831208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:36.863670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1254-d6c5-40ba-bcd4-c82cf4a13004 tempest-RoutersIpV6AdminTest-824281065 tempest-RoutersIpV6AdminTest-824281065-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:36.877345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:36.880577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:36.881097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:36.881613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:36.884784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:37.088017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:37.090461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:37.117468 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3066/6094] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:38.193398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:38.193989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:38.194283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:38.226009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:40:38.227414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:38.450741 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3029/6095] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:40:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:40:47.108967 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:48.446395 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=49 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:58.235435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:58.237849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:40:58.454927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc1dbd-a6dd-48e8-aabc-3b846829aa2b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:58.461182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad258eb8-ea28-4304-b392-150a6a4c75ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:58.462637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad258eb8-ea28-4304-b392-150a6a4c75ea service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:58.468576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad258eb8-ea28-4304-b392-150a6a4c75ea service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:58.468576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad258eb8-ea28-4304-b392-150a6a4c75ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:58.474560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad258eb8-ea28-4304-b392-150a6a4c75ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:58.476322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad258eb8-ea28-4304-b392-150a6a4c75ea service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:58.534432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3067/6096] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:41:03.708626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:03.710189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:03.906717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1672140-2f9a-463d-98d5-da738f67c962 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:03.949227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:03.950222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:03.950764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:03.951176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] PATH_INFO: `/v3/users/d5ab22d31f864923bbf6d005d2f77504` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:03.955998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ab22d31f864923bbf6d005d2f77504)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:03.958475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:04.283738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ab22d31f864923bbf6d005d2f77504'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:04.314375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ab22d31f864923bbf6d005d2f77504'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:04.322864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ab22d31f864923bbf6d005d2f77504'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:04.323657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ab22d31f864923bbf6d005d2f77504'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:04.462194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ab22d31f864923bbf6d005d2f77504'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:04.478115 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3030/6097] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:03 2022] DELETE /identity/v3/users/d5ab22d31f864923bbf6d005d2f77504 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:04.495704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:04.500785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:04.502120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:04.533265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:04.533265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:04.610258 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3068/6098] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:04.634058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:04.635682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:04.784569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdff56-5fb8-4bf7-b551-c094eb3cc2a4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:04.792093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4b2b4-e765-42cc-b87d-f109548dda8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:04.793215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b2b4-e765-42cc-b87d-f109548dda8c service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:04.793693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b2b4-e765-42cc-b87d-f109548dda8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:04.794228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4b2b4-e765-42cc-b87d-f109548dda8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:04.873604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4b2b4-e765-42cc-b87d-f109548dda8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:04.888015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4b2b4-e765-42cc-b87d-f109548dda8c service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:04.929996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3031/6099] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:05.742346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:05.745228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:05.775712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c2ffb-bb35-48fb-9305-8f86290d5208 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:05.782077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:05.782971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:05.783320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:05.783665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] PATH_INFO: `/v3/projects/b72d461772bc4a55b182df526d82208c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:05.785303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72d461772bc4a55b182df526d82208c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:05.788393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:05.927598 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:05.977357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72d461772bc4a55b182df526d82208c', 'request_id': 'req-fc0699fd-e388-4ea0-9c1b-2c928454891e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:05.995261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72d461772bc4a55b182df526d82208c', 'request_id': 'req-fc0699fd-e388-4ea0-9c1b-2c928454891e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:06.121763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72d461772bc4a55b182df526d82208c', 'request_id': 'req-fc0699fd-e388-4ea0-9c1b-2c928454891e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:06.150614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] The token cache is being invalidate because project b72d461772bc4a55b182df526d82208c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:06.151154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:06.155910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fc0699fd-e388-4ea0-9c1b-2c928454891e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:06.158105 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3069/6100] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:05 2022] DELETE /identity/v3/projects/b72d461772bc4a55b182df526d82208c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:06.165010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495efd4-4119-4f5b-adf1-e8a5dc4fb86b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:06.166435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495efd4-4119-4f5b-adf1-e8a5dc4fb86b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:06.166991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495efd4-4119-4f5b-adf1-e8a5dc4fb86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:06.214716 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:06.244275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4495efd4-4119-4f5b-adf1-e8a5dc4fb86b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:06.246055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4495efd4-4119-4f5b-adf1-e8a5dc4fb86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:06.353679 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3032/6101] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:06.361023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773532b-110d-41da-a3cc-32cf85d9266c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:06.361493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773532b-110d-41da-a3cc-32cf85d9266c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:06.362135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773532b-110d-41da-a3cc-32cf85d9266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:06.458060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b773532b-110d-41da-a3cc-32cf85d9266c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:06.461156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b773532b-110d-41da-a3cc-32cf85d9266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:06.482407 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3070/6102] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:06.486791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495efd4-4119-4f5b-adf1-e8a5dc4fb86b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:06.505896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495efd4-4119-4f5b-adf1-e8a5dc4fb86b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:06.517496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:06.518192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:06.518476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:06.518751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:06.521080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:06.522438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:06.533249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:06.589443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3033/6103] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:06.593863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773532b-110d-41da-a3cc-32cf85d9266c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:06.613187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773532b-110d-41da-a3cc-32cf85d9266c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:06.625474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:06.626883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:06.628482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:06.628949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:06.630526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:06.640678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:06.752343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:06.754956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:06.936210 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3071/6104] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:06 2022] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:06.938931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:07.110015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c222a8-9117-4094-8702-d68f3a85a5e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:07.116594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:07.117486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:07.117973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:07.118403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:07.123450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:07.127705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:07.156183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f78d7-fe7b-4109-b36c-928b3b40a39b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:07.290850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:07.299658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:07.299658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:07.299658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:07.299658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:07.333210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:07.335562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:07.335707 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3072/6105] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:06 2022] POST /identity/v3/users => generated 289 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:07.337641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:07.386212 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3034/6106] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:07.445097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747412-da8c-4204-b873-cbe203710335 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:07.478871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:07.479519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:07.479808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:07.480081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:07.481031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:07.482603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:07.535410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:07.538242 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3073/6107] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:07.558981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c50752-f487-4d0f-a705-9729906e2d65 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:07.575360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7d6f5-9ab4-49a9-96e2-b3ceab03d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:07.576258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7d6f5-9ab4-49a9-96e2-b3ceab03d98f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:07.576778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7d6f5-9ab4-49a9-96e2-b3ceab03d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:07.579859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7d6f5-9ab4-49a9-96e2-b3ceab03d98f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:07.586369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7d6f5-9ab4-49a9-96e2-b3ceab03d98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:07.588380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7d6f5-9ab4-49a9-96e2-b3ceab03d98f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:07.622096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3035/6108] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:41:07.625166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:07.644710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d509a-c531-4ece-90d4-b21075724546 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:07.667151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:07.667973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:07.668368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:07.668771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] PATH_INFO: `/v3/projects/715d77898fb74adf9a775c3093748830/users/a5df8ee7b02e4712b6f4b34b62407b7a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:07.708737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=715d77898fb74adf9a775c3093748830, user_id=a5df8ee7b02e4712b6f4b34b62407b7a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:07.711665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:07.838982 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3074/6109] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:07 2022] PUT /identity/v3/projects/715d77898fb74adf9a775c3093748830/users/a5df8ee7b02e4712b6f4b34b62407b7a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:07.843917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e966-d645-4195-9da5-f90c1cad9286 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:07.844213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e966-d645-4195-9da5-f90c1cad9286 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:07.844491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e966-d645-4195-9da5-f90c1cad9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:07.861859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:07.864959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:07.900664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cca0e966-d645-4195-9da5-f90c1cad9286 None None] MFA Rules not processed for user `a5df8ee7b02e4712b6f4b34b62407b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:07.902115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cca0e966-d645-4195-9da5-f90c1cad9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:08.022771 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:08.057537 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3036/6110] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:08.136446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb57a18-eeaa-4e02-9875-851d4612b9bd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:08.143780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0e966-d645-4195-9da5-f90c1cad9286 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:08.152045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d207e8-9b11-4828-8716-f2c37d7e7f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:08.152045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d207e8-9b11-4828-8716-f2c37d7e7f13 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:08.152045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d207e8-9b11-4828-8716-f2c37d7e7f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:08.152045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d207e8-9b11-4828-8716-f2c37d7e7f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:08.152550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-00d207e8-9b11-4828-8716-f2c37d7e7f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:08.165435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0e966-d645-4195-9da5-f90c1cad9286 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:08.182960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:08.183752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:08.184305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:08.184747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:08.209499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:08.211492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:08.238457 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3037/6111] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:08.292988 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:08.355067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d207e8-9b11-4828-8716-f2c37d7e7f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:08.356936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d207e8-9b11-4828-8716-f2c37d7e7f13 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:08.381339 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3075/6112] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:08.435398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:08.437171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:08.460122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882cbe-6e6e-4f79-bc1e-2bfde3da2789 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:08.473760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:08.474917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:08.475388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:08.475847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] PATH_INFO: `/v3/users/fa766c9179b341adb2e774d97ddc3bb3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:08.477556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa766c9179b341adb2e774d97ddc3bb3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:08.482237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:09.003407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa766c9179b341adb2e774d97ddc3bb3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:09.048641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa766c9179b341adb2e774d97ddc3bb3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:09.059002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa766c9179b341adb2e774d97ddc3bb3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:09.059784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa766c9179b341adb2e774d97ddc3bb3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:09.193224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa766c9179b341adb2e774d97ddc3bb3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:09.205707 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3038/6113] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:08 2022] DELETE /identity/v3/users/fa766c9179b341adb2e774d97ddc3bb3 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:09.213830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:09.214636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:09.214935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:09.278498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:09.282048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:09.467812 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3076/6114] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:09.486338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:09.488493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:09.617398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea07e3-1c41-4a2a-8935-6b808ad1cd0f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:09.624522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfec1d-ebe5-4e4a-bd30-f5c624a46e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:09.625188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfec1d-ebe5-4e4a-bd30-f5c624a46e9b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:09.625466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfec1d-ebe5-4e4a-bd30-f5c624a46e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:09.625802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfec1d-ebe5-4e4a-bd30-f5c624a46e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:09.641032 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:09.651342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfec1d-ebe5-4e4a-bd30-f5c624a46e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:09.653342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfec1d-ebe5-4e4a-bd30-f5c624a46e9b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:09.667092 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3039/6115] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:10.991443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:10.995336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:11.019286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb9a35-dca2-4104-815a-8279456c8249 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:11.024613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:11.025376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:11.026577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:11.026577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] PATH_INFO: `/v3/projects/2e19f4252d644c0ab860b2dd1efe0288` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:11.028238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e19f4252d644c0ab860b2dd1efe0288)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:11.033142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:11.220900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e19f4252d644c0ab860b2dd1efe0288', 'request_id': 'req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:11.221299 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:11.228524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e19f4252d644c0ab860b2dd1efe0288', 'request_id': 'req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:11.377014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e19f4252d644c0ab860b2dd1efe0288', 'request_id': 'req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:11.391859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] The token cache is being invalidate because project 2e19f4252d644c0ab860b2dd1efe0288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:11.392398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:11.393408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bbb261a5-7389-4b1d-9185-d8eb1f11fbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:11.398401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3077/6116] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:10 2022] DELETE /identity/v3/projects/2e19f4252d644c0ab860b2dd1efe0288 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:11.409999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23ac7-41fe-4f6c-aed4-0c362d7d0b0d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:11.409999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23ac7-41fe-4f6c-aed4-0c362d7d0b0d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:11.409999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d23ac7-41fe-4f6c-aed4-0c362d7d0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:11.461405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-28d23ac7-41fe-4f6c-aed4-0c362d7d0b0d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:11.462679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-28d23ac7-41fe-4f6c-aed4-0c362d7d0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:11.552249 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3040/6117] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:11.560555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e54b4-a8a1-49f2-856c-92cb2c4804da None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:11.562614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e54b4-a8a1-49f2-856c-92cb2c4804da None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:11.562614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e54b4-a8a1-49f2-856c-92cb2c4804da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:11.594021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a91e54b4-a8a1-49f2-856c-92cb2c4804da None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:11.596051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a91e54b4-a8a1-49f2-856c-92cb2c4804da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:11.614498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3078/6118] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:11.616270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23ac7-41fe-4f6c-aed4-0c362d7d0b0d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:11.630601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d23ac7-41fe-4f6c-aed4-0c362d7d0b0d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:11.636762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:11.637399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:11.637678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:11.638025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:11.639288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:11.639727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:11.646907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:11.661201 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3041/6119] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:11.665607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e54b4-a8a1-49f2-856c-92cb2c4804da None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:11.676194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e54b4-a8a1-49f2-856c-92cb2c4804da None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:11.681161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:11.681777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:11.682145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:11.682459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:11.683109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:11.685074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:11.838902 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3079/6120] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:11 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:11.839598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:11.864940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192a882-fd22-4586-a7c2-66bf5ebfeda5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:11.995341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:11.996084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:11.996431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:11.996772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:11.997845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:12.000744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:12.155799 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3042/6121] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:11 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:12.160314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:12.171450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b8f06-e4d4-4260-8a13-b1fb61a98f30 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:12.179388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:12.179388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:12.179388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:12.179388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:12.179685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:12.181393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:12.198235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:12.199202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3080/6122] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:12.211909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5247-aa3f-418c-9be4-ac986fb097c9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:12.221217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ee09f-8161-4cc9-8089-ab74df7c1b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:12.222220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee09f-8161-4cc9-8089-ab74df7c1b97 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:12.222626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee09f-8161-4cc9-8089-ab74df7c1b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:12.223039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee09f-8161-4cc9-8089-ab74df7c1b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:12.223883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ee09f-8161-4cc9-8089-ab74df7c1b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:12.225992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ee09f-8161-4cc9-8089-ab74df7c1b97 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:12.258843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:12.282894 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3043/6123] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:12.288012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcbb79-107a-4658-b4a2-fc20e1003e01 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:12.301022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:12.303411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:12.313964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:12.313964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] PATH_INFO: `/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8/users/7ca93cf809fa4bea90df2fbae8df8e01/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:12.339600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23b8c28ef614c23a99c61ad27a23ca8, user_id=7ca93cf809fa4bea90df2fbae8df8e01, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:12.344513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:12.536174 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3081/6124] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:12 2022] PUT /identity/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8/users/7ca93cf809fa4bea90df2fbae8df8e01/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:12.553725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ae41-b390-4b9f-84fb-4d29f247b100 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:12.553725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ae41-b390-4b9f-84fb-4d29f247b100 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:12.553725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ae41-b390-4b9f-84fb-4d29f247b100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:12.637250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-40f2ae41-b390-4b9f-84fb-4d29f247b100 None None] MFA Rules not processed for user `7ca93cf809fa4bea90df2fbae8df8e01`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:12.638902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-40f2ae41-b390-4b9f-84fb-4d29f247b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:12.705111 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:12.816722 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3044/6125] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:12.833260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:12.846626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:12.976656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3925d1-ba41-47d8-8bfe-8c3545004549 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:12.983878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:12.985512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:12.985512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:12.985512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:12.995978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:12.998081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:13.011418 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3082/6126] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:13.029531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abbce3-299c-4d68-9ce5-b0fb9d4df0be None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.029949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abbce3-299c-4d68-9ce5-b0fb9d4df0be None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.030996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abbce3-299c-4d68-9ce5-b0fb9d4df0be None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.032545 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3045/6127] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:41:13.038564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:41:13.055525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:13.069485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8d2f6-bf14-4e12-9183-e671f0a8be6a service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:13.090745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca93cf809fa4bea90df2fbae8df8e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23b8c28ef614c23a99c61ad27a23ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:13.091466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.091763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.092045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] PATH_INFO: `/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.093270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorizing `identity:get_project(project_id=b23b8c28ef614c23a99c61ad27a23ca8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:13.095198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:13.096903 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3083/6128] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:41:13 2022] GET /identity/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8 => generated 365 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:13.136158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2719e8-0d50-4885-bfed-edb3fb7f9c63 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.136445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2719e8-0d50-4885-bfed-edb3fb7f9c63 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.136726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2719e8-0d50-4885-bfed-edb3fb7f9c63 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.138309 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3046/6129] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 01:41:13.143536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:41:13.158682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:13.166882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bc49f-f5cf-47de-a28e-0ca139cb38b5 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:13.171331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca93cf809fa4bea90df2fbae8df8e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23b8c28ef614c23a99c61ad27a23ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:13.172470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.172945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.173400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] PATH_INFO: `/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.174863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorizing `identity:get_project(project_id=b23b8c28ef614c23a99c61ad27a23ca8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:13.179142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:13.179142 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3084/6130] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:41:13 2022] GET /identity/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8 => generated 365 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:13.223487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24846bfe-867f-4908-9673-7932058ef9f3 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.223763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24846bfe-867f-4908-9673-7932058ef9f3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.224047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24846bfe-867f-4908-9673-7932058ef9f3 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.225713 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3047/6131] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:41:13.231410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:41:13.291481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:13.305569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5522-dc00-40c9-8a16-2ab8845ac327 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:13.312686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca93cf809fa4bea90df2fbae8df8e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23b8c28ef614c23a99c61ad27a23ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:13.313790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.314364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.321335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] PATH_INFO: `/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.327705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorizing `identity:get_project(project_id=b23b8c28ef614c23a99c61ad27a23ca8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:13.330109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:13.354348 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3085/6132] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:41:13 2022] GET /identity/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8 => generated 365 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:13.370353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32513b-c2a1-4f3b-a279-1faca53e22fc None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.370950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32513b-c2a1-4f3b-a279-1faca53e22fc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.371507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32513b-c2a1-4f3b-a279-1faca53e22fc None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.374539 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3048/6133] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:41:13.381618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:41:13.415318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:13.434066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a276e-0375-4fdd-b7fa-dda94e602f78 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:13.443331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca93cf809fa4bea90df2fbae8df8e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23b8c28ef614c23a99c61ad27a23ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:13.443992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.444281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.444920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] PATH_INFO: `/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.445780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorizing `identity:get_project(project_id=b23b8c28ef614c23a99c61ad27a23ca8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:13.449487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:13.454024 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3086/6134] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:41:13 2022] GET /identity/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8 => generated 365 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:13.504831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f3a0-41fc-4ae2-a23a-86ddcb9daa59 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.509618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f3a0-41fc-4ae2-a23a-86ddcb9daa59 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.509618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f3a0-41fc-4ae2-a23a-86ddcb9daa59 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.509618 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3049/6135] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 01:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:41:13.516330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating service token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:41:13.518922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:13.576722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:13.591615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeba38e-b1f4-4d7a-96a5-7e56644b2f28 tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:13.600318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c52cf0-1fb5-4082-aef1-a6d138533f3b tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ca93cf809fa4bea90df2fbae8df8e01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23b8c28ef614c23a99c61ad27a23ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:13.601556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52cf0-1fb5-4082-aef1-a6d138533f3b tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.602331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52cf0-1fb5-4082-aef1-a6d138533f3b tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.603150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52cf0-1fb5-4082-aef1-a6d138533f3b tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] PATH_INFO: `/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.605570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c52cf0-1fb5-4082-aef1-a6d138533f3b tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorizing `identity:get_project(project_id=b23b8c28ef614c23a99c61ad27a23ca8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:13.613658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c52cf0-1fb5-4082-aef1-a6d138533f3b tempest-QuotasTestJSON-1208598946 tempest-QuotasTestJSON-1208598946-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:13.613658 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3087/6136] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 01:41:13 2022] GET /identity/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8 => generated 365 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:13.658127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f3a0-41fc-4ae2-a23a-86ddcb9daa59 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:13.792532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f3a0-41fc-4ae2-a23a-86ddcb9daa59 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:13.802928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:13.803958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:13.804431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:13.804975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] PATH_INFO: `/v3/users/7ca93cf809fa4bea90df2fbae8df8e01` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:13.807280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca93cf809fa4bea90df2fbae8df8e01)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:13.812246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:14.077771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca93cf809fa4bea90df2fbae8df8e01'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:14.099066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca93cf809fa4bea90df2fbae8df8e01'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:14.107312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca93cf809fa4bea90df2fbae8df8e01'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:14.109374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca93cf809fa4bea90df2fbae8df8e01'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:14.443561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca93cf809fa4bea90df2fbae8df8e01'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:14.450937 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3050/6137] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:13 2022] DELETE /identity/v3/users/7ca93cf809fa4bea90df2fbae8df8e01 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:14.456170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:14.457004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:14.457434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:14.494199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:14.495445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:14.506045 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:14.576638 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3088/6138] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:14.599794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:14.606034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:14.788696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7264-7566-4633-a111-26b9b740a20d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:14.788696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b8dd1-068a-4359-96cb-7db712749454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:14.788696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8dd1-068a-4359-96cb-7db712749454 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:14.788696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8dd1-068a-4359-96cb-7db712749454 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:14.793131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8dd1-068a-4359-96cb-7db712749454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:14.803406 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:14.813299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b8dd1-068a-4359-96cb-7db712749454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:14.819744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b8dd1-068a-4359-96cb-7db712749454 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:14.844051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3051/6139] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:16.364042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:16.365532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:16.392039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3504bb-09d9-4e10-8369-cfb0a50c8eaa None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:16.404557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:16.407054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:16.407247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:16.411090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] PATH_INFO: `/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:16.414164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23b8c28ef614c23a99c61ad27a23ca8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:16.416231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:16.633938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23b8c28ef614c23a99c61ad27a23ca8', 'request_id': 'req-cd2d0afd-fba8-429a-8dca-cc3d181a7557'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:16.642599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23b8c28ef614c23a99c61ad27a23ca8', 'request_id': 'req-cd2d0afd-fba8-429a-8dca-cc3d181a7557'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:16.792809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23b8c28ef614c23a99c61ad27a23ca8', 'request_id': 'req-cd2d0afd-fba8-429a-8dca-cc3d181a7557'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:16.809519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] The token cache is being invalidate because project b23b8c28ef614c23a99c61ad27a23ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:16.809983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:16.810821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd2d0afd-fba8-429a-8dca-cc3d181a7557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:16.814075 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3089/6140] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:16 2022] DELETE /identity/v3/projects/b23b8c28ef614c23a99c61ad27a23ca8 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:16.821567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a04d-46d7-4a42-aa05-1bd2f0755150 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:16.822853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a04d-46d7-4a42-aa05-1bd2f0755150 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:16.823669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a04d-46d7-4a42-aa05-1bd2f0755150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:16.900469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c196a04d-46d7-4a42-aa05-1bd2f0755150 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:16.902671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c196a04d-46d7-4a42-aa05-1bd2f0755150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:17.087615 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3052/6141] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:17.091986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.091986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.091986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.145755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:17.148610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:17.167147 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3090/6142] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:17.171817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196a04d-46d7-4a42-aa05-1bd2f0755150 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:17.204445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196a04d-46d7-4a42-aa05-1bd2f0755150 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:17.216225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:17.216865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.217152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.218040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.218720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:17.219032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:17.220716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:17.247969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:17.249671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:17.273608 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3053/6143] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:17.274985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:17.277759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015f84-927e-4511-b9bd-d96fb57ae134 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:17.294847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:17.296296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.296739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.297416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] PATH_INFO: `/v3/users/dc854690edaa498e883a115b2c7448d8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.299123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce70b5-a001-435e-a357-33c92b875a73 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:17.299832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc854690edaa498e883a115b2c7448d8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:17.302732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:17.328425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:17.329373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.329757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.330154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.330902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:17.337579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:17.496710 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3054/6144] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:17 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:17.501506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:17.579295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc854690edaa498e883a115b2c7448d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:17.590394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc854690edaa498e883a115b2c7448d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:17.629339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e261bd-2273-4352-b80e-3922c0a78558 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:17.636506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:17.640141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.640141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.640141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.640141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:17.641251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:17.692331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc854690edaa498e883a115b2c7448d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:17.704320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc854690edaa498e883a115b2c7448d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:17.705289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc854690edaa498e883a115b2c7448d8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:17.732630 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3055/6146] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:17 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:17.734520 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3091/6146] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:17 2022] DELETE /identity/v3/users/dc854690edaa498e883a115b2c7448d8 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:17.736965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:17.738806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:17.754198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b9819-783e-41fc-9654-d416260c33b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:17.825517 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:17.837172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:17.838073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.838360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.838645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.839300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:17.840935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:17.865645 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3056/6147] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:41:17.870437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:17.878364 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:17.882733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bd444-4ec0-4628-8d1d-12cd8e7ecb29 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:17.888918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8379fc5-6e7d-42b1-98dd-85a678346b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:17.891340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8379fc5-6e7d-42b1-98dd-85a678346b5e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.893756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8379fc5-6e7d-42b1-98dd-85a678346b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.893756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8379fc5-6e7d-42b1-98dd-85a678346b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.893756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8379fc5-6e7d-42b1-98dd-85a678346b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:17.894810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8379fc5-6e7d-42b1-98dd-85a678346b5e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:17.909711 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3092/6148] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:17.913789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:17.928951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813689-32cc-4809-b8bd-7a6b8882b466 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:17.937772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:17.938773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:17.939616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:17.940234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] PATH_INFO: `/v3/projects/50201a04ba8e45ebb2d3e11c5781b130/users/21943a2079964ac392ec6f2343f40511/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:17.963775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=50201a04ba8e45ebb2d3e11c5781b130, user_id=21943a2079964ac392ec6f2343f40511, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:17.966794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.038529 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3057/6149] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:17 2022] PUT /identity/v3/projects/50201a04ba8e45ebb2d3e11c5781b130/users/21943a2079964ac392ec6f2343f40511/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:18.062803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f962-bc6a-485f-b9cb-f0a175371aa1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.063256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f962-bc6a-485f-b9cb-f0a175371aa1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.063541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750f962-bc6a-485f-b9cb-f0a175371aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.099429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f750f962-bc6a-485f-b9cb-f0a175371aa1 None None] MFA Rules not processed for user `21943a2079964ac392ec6f2343f40511`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:18.100655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f750f962-bc6a-485f-b9cb-f0a175371aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:18.192310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.204694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:18.204973 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3093/6150] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:18.204973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750f962-bc6a-485f-b9cb-f0a175371aa1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.276781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750f962-bc6a-485f-b9cb-f0a175371aa1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:18.282314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:18.283025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.283377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.283723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.283913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1656c5-b3e8-42c1-9846-8bc39f3d5dae admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:18.284498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:18.286827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.289492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:18.290421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.290767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.291111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] PATH_INFO: `/v3/projects/eed74016588b4c67a9bdab48f488d4ed` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.292541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed74016588b4c67a9bdab48f488d4ed)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:18.294759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.405738 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3094/6151] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:18 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:18.407098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.444515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed74016588b4c67a9bdab48f488d4ed', 'request_id': 'req-e4a7abe7-a9ac-47d8-82bf-2143978b244f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:18.460989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed74016588b4c67a9bdab48f488d4ed', 'request_id': 'req-e4a7abe7-a9ac-47d8-82bf-2143978b244f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:18.478868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d434-db12-457e-a566-c596bf0becb4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:18.552434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed74016588b4c67a9bdab48f488d4ed', 'request_id': 'req-e4a7abe7-a9ac-47d8-82bf-2143978b244f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:18.579442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] The token cache is being invalidate because project eed74016588b4c67a9bdab48f488d4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:18.579744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:18.580572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a7abe7-a9ac-47d8-82bf-2143978b244f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:18.587998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3058/6152] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:18 2022] DELETE /identity/v3/projects/eed74016588b4c67a9bdab48f488d4ed => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:18.598873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5297-d7bb-4bee-bca7-0137039bf24a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.598873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5297-d7bb-4bee-bca7-0137039bf24a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.598873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c5297-d7bb-4bee-bca7-0137039bf24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.610605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:18.611706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.611994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.613566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.625621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:18.630805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.652571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f94c5297-d7bb-4bee-bca7-0137039bf24a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:18.653829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f94c5297-d7bb-4bee-bca7-0137039bf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:18.674102 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3059/6153] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:18.681501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffb25-8f42-421a-b83e-28e4f6c4d280 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.682097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffb25-8f42-421a-b83e-28e4f6c4d280 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.682559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffb25-8f42-421a-b83e-28e4f6c4d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.725183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-939ffb25-8f42-421a-b83e-28e4f6c4d280 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:18.727665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-939ffb25-8f42-421a-b83e-28e4f6c4d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:18.743928 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3060/6154] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:18.748943 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3095/6155] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:18 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:18.751433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.752507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ffb25-8f42-421a-b83e-28e4f6c4d280 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.753444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:18.763906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ffb25-8f42-421a-b83e-28e4f6c4d280 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:18.775361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb069b-5772-443e-a6f0-1802f14f5b82 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:18.778519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:18.779144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.779421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.779693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.780441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:18.780744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:18.785140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.788177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:18.789097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.789548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.790009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.790807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:18.793402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.799895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3061/6156] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:18.804105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.810846 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3096/6157] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:18.812939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.816923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9d37-66a8-4bf4-96da-9ccc146fdebf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:18.823810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:18.827432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.827432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.827432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.827432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:18.829903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.833455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2019a7-aa78-430d-b7a0-8e0effa3022a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:18.844326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:18.845015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:18.845302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:18.846192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] PATH_INFO: `/v3/projects/d5077fe0a7d84dcfaa925c9e743d0c4c/users/635423ab0a6943e3813250b810d35cbf/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:18.865547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5077fe0a7d84dcfaa925c9e743d0c4c, user_id=635423ab0a6943e3813250b810d35cbf, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:18.868318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:18.980445 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3062/6159] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:18 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:18.984117 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3097/6159] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:18 2022] PUT /identity/v3/projects/d5077fe0a7d84dcfaa925c9e743d0c4c/users/635423ab0a6943e3813250b810d35cbf/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:18.984465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:18.985229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.140458 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:19.147418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e70d-fa88-4b26-aad4-7dccbf06ffde admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.154726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d68e9-9e66-4602-a99d-455308245dc5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.163474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.164426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.164916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.165386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.167335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.169792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.169970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.170851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.170851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.171110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.172458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.177443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.189131 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3063/6160] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:19.193230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.206004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e23c2b-7b40-4928-bd48-1cb8efa4e202 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.211802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfc41f-03ce-41ae-873f-a1caaa4375f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.212632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfc41f-03ce-41ae-873f-a1caaa4375f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.213115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfc41f-03ce-41ae-873f-a1caaa4375f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.213485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfc41f-03ce-41ae-873f-a1caaa4375f9 admin admin] PATH_INFO: `/v3/projects/d5077fe0a7d84dcfaa925c9e743d0c4c/users/635423ab0a6943e3813250b810d35cbf/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.217254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfc41f-03ce-41ae-873f-a1caaa4375f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5077fe0a7d84dcfaa925c9e743d0c4c, user_id=635423ab0a6943e3813250b810d35cbf, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.221206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfc41f-03ce-41ae-873f-a1caaa4375f9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.238376 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3064/6161] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:19 2022] PUT /identity/v3/projects/d5077fe0a7d84dcfaa925c9e743d0c4c/users/635423ab0a6943e3813250b810d35cbf/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:19.250212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d797c-d020-4d5f-8342-af2cd247b702 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.250534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d797c-d020-4d5f-8342-af2cd247b702 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.250911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d797c-d020-4d5f-8342-af2cd247b702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.280821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a56d797c-d020-4d5f-8342-af2cd247b702 None None] MFA Rules not processed for user `635423ab0a6943e3813250b810d35cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:19.282608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a56d797c-d020-4d5f-8342-af2cd247b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:19.330453 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3098/6162] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:18 2022] POST /identity/v3/users => generated 292 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:19.334153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.345538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ba7f-96cd-49f3-9dc4-bbbf5145ea24 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.379165 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3065/6163] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:19.383861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d797c-d020-4d5f-8342-af2cd247b702 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.404538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d797c-d020-4d5f-8342-af2cd247b702 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.412891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.413508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.413795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.414121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.414787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.416625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.418687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.419990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.420796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.421316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.422788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.424947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.445907 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3099/6164] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:19.447900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.466476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d351e9-fe59-4df2-ada0-6f45f57be270 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.481958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.482751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.483316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.483862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.484748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.491229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.515612 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3100/6165] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:19.516830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.537657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d84b3-e8bb-49f6-8167-e0e8b6753aed admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.544276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de3acb-99c5-47e1-bb1d-2eeab9cbb2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.545492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de3acb-99c5-47e1-bb1d-2eeab9cbb2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.546375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de3acb-99c5-47e1-bb1d-2eeab9cbb2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.546871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de3acb-99c5-47e1-bb1d-2eeab9cbb2a1 admin admin] PATH_INFO: `/v3/projects/15e8bf26659a4dfda16c7c817e2bb456/users/8f6bde87323c40bb8c9d289d7d38d8be/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.574043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de3acb-99c5-47e1-bb1d-2eeab9cbb2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e8bf26659a4dfda16c7c817e2bb456, user_id=8f6bde87323c40bb8c9d289d7d38d8be, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.575594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de3acb-99c5-47e1-bb1d-2eeab9cbb2a1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.582876 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3066/6166] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:19 2022] POST /identity/v3/services => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:19.588741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.654402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9d9f-0c64-41de-90a8-2852f593616f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.665746 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3101/6167] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:19 2022] PUT /identity/v3/projects/15e8bf26659a4dfda16c7c817e2bb456/users/8f6bde87323c40bb8c9d289d7d38d8be/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:19.671229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.671761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.672694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.719340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:19.722786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:19.798313 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:19.800953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.804791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.809085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.809545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.810387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.812264 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:19.812264 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:41:19.812264 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:41:19.813371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.879165 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3102/6168] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:19 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:19.892236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.896604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:19.899194 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3067/6169] 10.222.0.59 () {60 vars in 1213 bytes} [Sun Aug 28 01:41:19 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:19.903801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:19.920156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3563a-5a57-463c-aece-fba6d9b7600c tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:19.934938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:19.935561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:19.935847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:19.936714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:19.937621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:19.939264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:19.997118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279889b-bebc-461d-8ac8-3cb8051af588 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.003707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.005554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.005902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.006639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.026463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.028919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.036284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3068/6170] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:19 2022] POST /identity/v3/services => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:20.040015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.044805 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3103/6171] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:19 2022] GET /identity/v3/auth/tokens => generated 3373 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:20.088596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555d31d-f876-4054-9e1d-63735733c7d4 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.100799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.101862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.102303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.102724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.103761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.106261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.120142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.121734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:20.202931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3069/6172] 10.222.0.59 () {60 vars in 1213 bytes} [Sun Aug 28 01:41:20 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:20.206636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.225708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec251-18b7-4c27-b972-1203c8705680 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.236398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.237296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.237753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.238205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.239001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.240173 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:20.240173 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:41:20.240173 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:41:20.243620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.260690 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3070/6173] 10.222.0.59 () {58 vars in 1191 bytes} [Sun Aug 28 01:41:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:41:20.265622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.291332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a92fd-1582-435c-8a36-94d024fdda69 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.302232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.302890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.303177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.303464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.304069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a8116ea13aa044c0af609031168ed014)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.305094 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:20.305094 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:41:20.305094 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:41:20.306069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.329214 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3071/6174] 10.222.0.59 () {58 vars in 1290 bytes} [Sun Aug 28 01:41:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014 => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:20.332874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.347223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438be8c-8dbe-4af5-a5ce-ecd85136096f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.358474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.359218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.359605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.359779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.360393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a8116ea13aa044c0af609031168ed014)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.374331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.379774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3072/6175] 10.222.0.59 () {58 vars in 1291 bytes} [Sun Aug 28 01:41:20 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:20.383856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.385739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fc26d-948f-4262-bf00-f8eb218b797c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.401715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbb4ce-1dc1-451c-ace8-844d18525da8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.407547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fe523-9332-4a36-8657-d4972757006d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.410343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe523-9332-4a36-8657-d4972757006d service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.410808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe523-9332-4a36-8657-d4972757006d service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.411235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe523-9332-4a36-8657-d4972757006d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.415597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.416672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.416672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.417080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.417736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-110fe523-9332-4a36-8657-d4972757006d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:20.417888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a8116ea13aa044c0af609031168ed014)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.430749 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:20.430749 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:41:20.430749 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:41:20.430749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.501731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fe523-9332-4a36-8657-d4972757006d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.503758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fe523-9332-4a36-8657-d4972757006d service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.507160 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3073/6176] 10.222.0.59 () {58 vars in 1293 bytes} [Sun Aug 28 01:41:20 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:20.510836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.528479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86146c-1966-4fc5-902c-8a79f65cf25f tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.545384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.546599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.547533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.548021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.548864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.550817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.578403 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3074/6178] 10.222.0.59 () {58 vars in 1191 bytes} [Sun Aug 28 01:41:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:41:20.578697 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3104/6178] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:20 2022] GET /identity/v3/auth/tokens => generated 3530 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:20.580438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.601092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34578a-75bc-44b5-8a26-3e11b7a8befb tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.631773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.632038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.638467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.639319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.640577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a8116ea13aa044c0af609031168ed014)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.642349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Could not find Endpoint Group: a8116ea13aa044c0af609031168ed014.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a8116ea13aa044c0af609031168ed014. Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 28 01:41:20.659505 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 28 01:41:20.660672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 28 01:41:20.660672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 28 01:41:20.660672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 28 01:41:20.660672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 28 01:41:20.660672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a8116ea13aa044c0af609031168ed014. Aug 28 01:41:20.660672 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:41:20.662198 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3075/6179] 10.222.0.59 () {58 vars in 1293 bytes} [Sun Aug 28 01:41:20 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a8116ea13aa044c0af609031168ed014 => generated 120 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:41:20.666537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fe523-9332-4a36-8657-d4972757006d service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.688471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fe523-9332-4a36-8657-d4972757006d service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.701527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.703648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.703648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.703999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services/ccbe1d5893a9492b8eef1ff4e29e3a5a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.704667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ccbe1d5893a9492b8eef1ff4e29e3a5a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.722123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:20.730419 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:20.787795 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:20.859274 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3105/6180] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:20 2022] DELETE /identity/v3/services/ccbe1d5893a9492b8eef1ff4e29e3a5a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:20.860384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:20.877264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00621377-0bbe-4fbb-8314-df5193a53915 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:20.923699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:20.924366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:20.924681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:20.925028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:20.925771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:20.927463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:21.029149 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3076/6181] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:20 2022] POST /identity/v3/services => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:21.035280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:21.066434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab358d18-665d-4a36-825f-bfdbef644501 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:21.092363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:21.093661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:21.093979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:21.097433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:21.097433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:21.097433 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:21.097433 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:41:21.097433 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:41:21.097433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:21.222914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3106/6182] 10.222.0.59 () {60 vars in 1213 bytes} [Sun Aug 28 01:41:21 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:21.225268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:21.245920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55dc6f-01ab-466e-9ceb-3194a008b155 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:21.259479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:21.260118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:21.260400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:21.260679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:21.261341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:21.263178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:21.454311 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3077/6183] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:21 2022] POST /identity/v3/services => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:21.458680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:21.470091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4653e-f544-4e21-b4ee-d4a4f511367d tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:21.488521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:21.489422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:21.489909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:21.490374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/fd9f414967474207995fa60e44471838` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:21.491201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=fd9f414967474207995fa60e44471838)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:21.492368 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:21.492368 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:41:21.492368 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:41:21.493581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:21.596168 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3107/6184] 10.222.0.59 () {60 vars in 1313 bytes} [Sun Aug 28 01:41:21 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/fd9f414967474207995fa60e44471838 => generated 336 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:21.600478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:21.612960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5060a67-ec10-4e45-bdda-6fd62443f6be tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:21.618643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:21.619411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:21.619769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:21.620164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services/66213480e85b4c1f9e9250bfa1d55ade` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:21.620826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_service(service_id=66213480e85b4c1f9e9250bfa1d55ade)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:21.622641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:21.740598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:21.741074 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3078/6185] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:21 2022] DELETE /identity/v3/services/66213480e85b4c1f9e9250bfa1d55ade => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:21.753719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fea66-0fd1-4266-841c-4af52770ad30 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:21.785084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:21.786059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:21.786449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:21.786829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/fd9f414967474207995fa60e44471838` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:21.787669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=fd9f414967474207995fa60e44471838)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:21.788897 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:21.788897 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:41:21.788897 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:41:21.790115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:21.864758 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3108/6186] 10.222.0.59 () {58 vars in 1293 bytes} [Sun Aug 28 01:41:21 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/fd9f414967474207995fa60e44471838 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:21.869724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:21.885205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c06e7-2942-4b2a-97db-37272dc3e591 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:21.895660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:21.896688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:21.897171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:21.897594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services/aae7971bf92d4b00ba452cb08c907826` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:21.898358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aae7971bf92d4b00ba452cb08c907826)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:21.900096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:22.042543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:22.060714 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3079/6187] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:21 2022] DELETE /identity/v3/services/aae7971bf92d4b00ba452cb08c907826 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:22.072449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8105711-1d78-4e0b-9c98-c514ab34d329 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:22.115918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:22.119582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:22.119582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:22.119582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3d81fd85c3e24ab69ed2cee5ee57b6ba` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:22.119582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3d81fd85c3e24ab69ed2cee5ee57b6ba)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:22.120365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:22.172442 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:22.224713 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3109/6188] 10.222.0.59 () {58 vars in 1293 bytes} [Sun Aug 28 01:41:22 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3d81fd85c3e24ab69ed2cee5ee57b6ba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:22.229564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:22.244533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507c9ae-284a-4257-8233-44bcccc7c358 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:22.247145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4d942-c920-4d6a-bade-9b499fe72ca8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '635423ab0a6943e3813250b810d35cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:22.247878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d942-c920-4d6a-bade-9b499fe72ca8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:22.248331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d942-c920-4d6a-bade-9b499fe72ca8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:22.248723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d942-c920-4d6a-bade-9b499fe72ca8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] PATH_INFO: `/v3/services/6afbf8f7d2c641b1b7c225cc9e8d248d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:22.249439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4d942-c920-4d6a-bade-9b499fe72ca8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6afbf8f7d2c641b1b7c225cc9e8d248d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:22.251182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4d942-c920-4d6a-bade-9b499fe72ca8 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:22.413933 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3080/6189] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:22 2022] DELETE /identity/v3/services/6afbf8f7d2c641b1b7c225cc9e8d248d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:22.417406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:22.440396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b35797-655b-4754-948a-17176609c897 tempest-EndPointGroupsTest-2124899671 tempest-EndPointGroupsTest-2124899671-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:22.458033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:22.459194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:22.459570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:22.460065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] PATH_INFO: `/v3/users/21943a2079964ac392ec6f2343f40511` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:22.461326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21943a2079964ac392ec6f2343f40511)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:22.463762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:22.695213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21943a2079964ac392ec6f2343f40511'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:22.696066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21943a2079964ac392ec6f2343f40511'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:22.820834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21943a2079964ac392ec6f2343f40511'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:22.836951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21943a2079964ac392ec6f2343f40511'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:22.837734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21943a2079964ac392ec6f2343f40511'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:22.882347 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3110/6190] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:22 2022] DELETE /identity/v3/users/21943a2079964ac392ec6f2343f40511 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:22.888548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:22.890385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:22.891470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:22.933883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:22.935705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:22.953387 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:23.059348 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3081/6191] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:23.069137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:23.070584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:23.159869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf7b7-984f-4a4c-ac4a-f91f26c56056 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:23.165543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:23.165543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:23.165543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:23.165886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:23.178400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:23.179975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:23.203465 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3111/6192] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:23.223706 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:23.747084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:23.749209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:23.766808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86be4aa-e10f-4de3-aa1a-c17b987a1f8c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:23.781801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:23.782550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:23.782841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:23.783118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] PATH_INFO: `/v3/projects/50201a04ba8e45ebb2d3e11c5781b130` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:23.785631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50201a04ba8e45ebb2d3e11c5781b130)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:23.789947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:23.982347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50201a04ba8e45ebb2d3e11c5781b130', 'request_id': 'req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:23.990439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50201a04ba8e45ebb2d3e11c5781b130', 'request_id': 'req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.086709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50201a04ba8e45ebb2d3e11c5781b130', 'request_id': 'req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.105233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] The token cache is being invalidate because project 50201a04ba8e45ebb2d3e11c5781b130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:24.105608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.106373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.109226 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3082/6193] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:23 2022] DELETE /identity/v3/projects/50201a04ba8e45ebb2d3e11c5781b130 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:24.112807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:24.126796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fb19b-0387-4542-bafa-bc9a14563539 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:24.215481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:24.216371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:24.216962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:24.218078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] PATH_INFO: `/v3/users/635423ab0a6943e3813250b810d35cbf` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:24.219755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=635423ab0a6943e3813250b810d35cbf)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:24.222252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:24.459622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635423ab0a6943e3813250b810d35cbf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.460990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635423ab0a6943e3813250b810d35cbf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.593927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635423ab0a6943e3813250b810d35cbf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.611694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635423ab0a6943e3813250b810d35cbf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.618819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635423ab0a6943e3813250b810d35cbf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:24.678690 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3112/6194] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:24 2022] DELETE /identity/v3/users/635423ab0a6943e3813250b810d35cbf => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:25.518576 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:25.574839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:25.576419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:25.602202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde334d-dda7-4e6c-9a54-f7bec0137b9f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:25.740910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:25.741569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:25.742114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:25.742566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] PATH_INFO: `/v3/users/6f1befb6a1cc4bbcab7afe9d69483891` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:25.745684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1befb6a1cc4bbcab7afe9d69483891)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:25.749994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:25.963588 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:25.991961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1befb6a1cc4bbcab7afe9d69483891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.027099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1befb6a1cc4bbcab7afe9d69483891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.041577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1befb6a1cc4bbcab7afe9d69483891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.042387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1befb6a1cc4bbcab7afe9d69483891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.133393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1befb6a1cc4bbcab7afe9d69483891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.177848 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3083/6195] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:25 2022] DELETE /identity/v3/users/6f1befb6a1cc4bbcab7afe9d69483891 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:26.384860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:26.386450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:26.446159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f470241-019f-4cd3-827f-f5bd23004911 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:26.610505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:26.611961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:26.612473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:26.612987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] PATH_INFO: `/v3/projects/d5077fe0a7d84dcfaa925c9e743d0c4c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:26.615048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5077fe0a7d84dcfaa925c9e743d0c4c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:26.617205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:26.834728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'request_id': 'req-9cb85763-4c8c-4577-a3e5-832273071f95'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.846335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'request_id': 'req-9cb85763-4c8c-4577-a3e5-832273071f95'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.939062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5077fe0a7d84dcfaa925c9e743d0c4c', 'request_id': 'req-9cb85763-4c8c-4577-a3e5-832273071f95'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.941183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:26.943630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:26.968665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] The token cache is being invalidate because project d5077fe0a7d84dcfaa925c9e743d0c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:26.969042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.975656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9cb85763-4c8c-4577-a3e5-832273071f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:26.975656 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3113/6196] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:26 2022] DELETE /identity/v3/projects/d5077fe0a7d84dcfaa925c9e743d0c4c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:26.976891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685a4c-b801-48c5-824e-4fbf84851137 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:26.977193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685a4c-b801-48c5-824e-4fbf84851137 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:26.977472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685a4c-b801-48c5-824e-4fbf84851137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:26.977729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834dcc3-b952-47c9-b308-6fa8be8d5e25 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:27.047374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-13685a4c-b801-48c5-824e-4fbf84851137 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:27.051818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13685a4c-b801-48c5-824e-4fbf84851137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:27.177194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:27.180269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:27.180566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:27.180850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] PATH_INFO: `/v3/projects/f63605b9d41f4a0c8b416d0155201c03` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:27.188150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63605b9d41f4a0c8b416d0155201c03)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:27.211397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:27.300827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3114/6197] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:27.309609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4d08-e104-40c8-bfd1-d485048ca90c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:27.309947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4d08-e104-40c8-bfd1-d485048ca90c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:27.310212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4d08-e104-40c8-bfd1-d485048ca90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:27.384392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-35ef4d08-e104-40c8-bfd1-d485048ca90c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:27.388394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35ef4d08-e104-40c8-bfd1-d485048ca90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:27.446380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3115/6198] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:27.450621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4d08-e104-40c8-bfd1-d485048ca90c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:27.464648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4d08-e104-40c8-bfd1-d485048ca90c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:27.470961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63605b9d41f4a0c8b416d0155201c03', 'request_id': 'req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.497963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63605b9d41f4a0c8b416d0155201c03', 'request_id': 'req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.566829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:27.567458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:27.567750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:27.568268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:27.568680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:27.568986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:27.571629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:27.585931 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3116/6199] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:27.590124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:27.600961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c957-29d6-4849-8885-231c1c55fdb0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:27.606762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:27.607373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:27.608900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:27.610376 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:27.611039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:27.611714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:27.613758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:27.637721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63605b9d41f4a0c8b416d0155201c03', 'request_id': 'req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.656268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] The token cache is being invalidate because project f63605b9d41f4a0c8b416d0155201c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:27.657366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.658251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.660131 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3084/6200] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:26 2022] DELETE /identity/v3/projects/f63605b9d41f4a0c8b416d0155201c03 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:27.664849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:27.667046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:27.683398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6b33-6bcc-4638-8d3d-2f58b94c80f0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:27.689406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:27.689771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:27.690094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:27.690744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] PATH_INFO: `/v3/users/5dbbc757b66c42ee84761cbc610e8f49` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:27.692184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbbc757b66c42ee84761cbc610e8f49)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:27.694550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:27.734471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3117/6201] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:27 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:27.736229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:27.738148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:27.832789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e883-311c-411c-ac5a-148f69609e95 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:27.838140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:27.838818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:27.843018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:27.843018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:27.843018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:27.843018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:27.906069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbbc757b66c42ee84761cbc610e8f49'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.919144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbbc757b66c42ee84761cbc610e8f49'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.926576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbbc757b66c42ee84761cbc610e8f49'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.930174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbbc757b66c42ee84761cbc610e8f49'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:27.935394 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3118/6202] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:27 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:27.939614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:27.941414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:27.955096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd344-ddef-4232-ae66-4728e1117edd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:27.960290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:27.960985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:27.961334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:27.961845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:27.962555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:27.964236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:27.976107 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:27.980153 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3119/6203] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:27.981482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:27.997239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42a6c7-6884-4d1d-8ce3-771d1befcf1b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:28.003435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:28.004202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:28.004548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:28.004886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:28.005649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:28.007624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:28.025909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3120/6204] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:28.027335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:28.032645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f25aacb6-77b5-4d80-b866-3ba87310d362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbbc757b66c42ee84761cbc610e8f49'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:28.040481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8873c-80c3-4fb8-bdfd-7ad197f5c98e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:28.043892 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3085/6205] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:27 2022] DELETE /identity/v3/users/5dbbc757b66c42ee84761cbc610e8f49 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:28.146258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:28.147103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:28.147508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:28.147907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] PATH_INFO: `/v3/projects/709ade1475fb47779c69a8d3b5b3454a/users/166f8f3d062d4cc68d5c00804a6d90a7/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:28.167234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709ade1475fb47779c69a8d3b5b3454a, user_id=166f8f3d062d4cc68d5c00804a6d90a7, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:28.172255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:28.288305 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3121/6206] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:28 2022] PUT /identity/v3/projects/709ade1475fb47779c69a8d3b5b3454a/users/166f8f3d062d4cc68d5c00804a6d90a7/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:28.300628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8643de-531c-460c-acd0-029872be9b6a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:28.300945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8643de-531c-460c-acd0-029872be9b6a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:28.301228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8643de-531c-460c-acd0-029872be9b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:28.342753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6c8643de-531c-460c-acd0-029872be9b6a None None] MFA Rules not processed for user `166f8f3d062d4cc68d5c00804a6d90a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:28.344624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6c8643de-531c-460c-acd0-029872be9b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:28.434474 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3086/6207] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:28.438540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:28.519893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e4557-f93b-4f62-ac7d-1658ef53a2e0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:28.535442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:28.535442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:28.535442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:28.535442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:28.535857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:28.535857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:28.706622 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3122/6208] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:28 2022] POST /identity/v3/projects => generated 367 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:28.711013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8643de-531c-460c-acd0-029872be9b6a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:28.740065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8643de-531c-460c-acd0-029872be9b6a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:28.828883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:28.831795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:28.928461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:28.929532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:28.930064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:28.930868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:28.932210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:28.934830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:29.034070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860af5-2fe4-4f43-ab57-7152c5451340 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:29.040017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:29.040849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:29.041288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:29.041766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] PATH_INFO: `/v3/projects/d157e736cd92438badcb63a18bab291c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:29.043429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d157e736cd92438badcb63a18bab291c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:29.045992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:29.051871 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3087/6209] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:28 2022] POST /identity/v3/users => generated 290 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:29.054338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:29.060450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:29.110850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f0f3f-7317-4c0a-8282-51c4224ee248 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:29.124923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:29.125598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:29.125915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:29.126192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] PATH_INFO: `/v3/users/a5df8ee7b02e4712b6f4b34b62407b7a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:29.128821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5df8ee7b02e4712b6f4b34b62407b7a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:29.130854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:29.213800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd157e736cd92438badcb63a18bab291c', 'request_id': 'req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.228185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd157e736cd92438badcb63a18bab291c', 'request_id': 'req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.361606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5df8ee7b02e4712b6f4b34b62407b7a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.369407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd157e736cd92438badcb63a18bab291c', 'request_id': 'req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.384164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] The token cache is being invalidate because project d157e736cd92438badcb63a18bab291c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:29.384507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.386768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.391320 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3123/6210] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:28 2022] DELETE /identity/v3/projects/d157e736cd92438badcb63a18bab291c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:29.392366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:29.395344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:29.424182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5df8ee7b02e4712b6f4b34b62407b7a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.463774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5df8ee7b02e4712b6f4b34b62407b7a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.469320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5df8ee7b02e4712b6f4b34b62407b7a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.609339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1d9f46d3-9961-4cc0-85f9-558d4ad80070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5df8ee7b02e4712b6f4b34b62407b7a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:29.615739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f0d3f-61fc-4a0e-9337-e6039da667d2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:29.621415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3088/6211] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:29 2022] DELETE /identity/v3/users/a5df8ee7b02e4712b6f4b34b62407b7a => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:29.626900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e1db-c179-4d4a-88d3-3793c0fb53e2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:29.627180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e1db-c179-4d4a-88d3-3793c0fb53e2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:29.632902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e1db-c179-4d4a-88d3-3793c0fb53e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:29.673223 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:29.688435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-35b7e1db-c179-4d4a-88d3-3793c0fb53e2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:29.692274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-35b7e1db-c179-4d4a-88d3-3793c0fb53e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:29.772330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:29.772994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:29.773699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:29.774033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:29.774707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:29.780667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:29.812103 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3124/6212] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:29.813260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:29.819383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:29.843789 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:29.852107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ae0d0-10be-4c19-896f-57234f5029e4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:29.881442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:29.882172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:29.882458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:29.884546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] PATH_INFO: `/v3/projects/df671f0883084f60b6bf19c12bb0c516/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:29.930901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df671f0883084f60b6bf19c12bb0c516, user_id=ff36cef18f7343039b2b9e7fb46bae73, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:29.939500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:29.959169 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3089/6213] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:30.024961 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3125/6214] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:29 2022] PUT /identity/v3/projects/df671f0883084f60b6bf19c12bb0c516/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:30.030565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e1db-c179-4d4a-88d3-3793c0fb53e2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:30.050160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e1db-c179-4d4a-88d3-3793c0fb53e2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:30.054609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:30.056606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:30.198071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:30.198707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:30.198995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:30.199512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:30.199974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:30.208961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:30.227401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79024-ecd8-4769-905e-df833d8f55d6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:30.230836 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3090/6215] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:30.233646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:30.238731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a762d-3385-4e3d-b416-aac85d159873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:30.239374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a762d-3385-4e3d-b416-aac85d159873 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:30.239660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a762d-3385-4e3d-b416-aac85d159873 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:30.239937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a762d-3385-4e3d-b416-aac85d159873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:30.260491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee13501-3677-44c2-903e-e33d75d158e8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:30.263610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a762d-3385-4e3d-b416-aac85d159873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:30.265630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a762d-3385-4e3d-b416-aac85d159873 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:30.276589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:30.277129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:30.277414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:30.277694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] PATH_INFO: `/v3/projects/df671f0883084f60b6bf19c12bb0c516/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:30.279911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df671f0883084f60b6bf19c12bb0c516, user_id=ff36cef18f7343039b2b9e7fb46bae73, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:30.282727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:30.292898 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3126/6216] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:30.319171 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3091/6217] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:30 2022] PUT /identity/v3/projects/df671f0883084f60b6bf19c12bb0c516/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:30.330298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43ca4-4ba3-4340-bd62-0bc809036086 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:30.330591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43ca4-4ba3-4340-bd62-0bc809036086 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:30.330873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a43ca4-4ba3-4340-bd62-0bc809036086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:30.399518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b5a43ca4-4ba3-4340-bd62-0bc809036086 None None] MFA Rules not processed for user `ff36cef18f7343039b2b9e7fb46bae73`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:30.401216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b5a43ca4-4ba3-4340-bd62-0bc809036086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:30.458489 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:30.611797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3127/6218] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:30.612194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:30.751408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e7bb-7ff5-48e3-a669-a93620c95dd4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:30.759452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:30.760488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:30.760831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:30.761157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:30.761840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:30.765824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:30.804293 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:30.896377 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3092/6219] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:30 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:30.900151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a43ca4-4ba3-4340-bd62-0bc809036086 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:30.914971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a43ca4-4ba3-4340-bd62-0bc809036086 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:31.064568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:31.065404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.065688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.067134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.067820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:31.078113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:31.090499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:31.092956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:31.217879 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3128/6220] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:30 2022] POST /identity/v3/users => generated 284 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:31.221838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:31.252520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c977-5cf3-40bc-8450-c70ec161d54b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:31.268632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:31.269306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.269593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.269899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.270682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:31.271231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e26ca-6bf2-4bee-806a-7839b0c72e83 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:31.272461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:31.286497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:31.287385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.287385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.288197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.293358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:31.298307 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3129/6221] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:31.301356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:31.320581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe9d0-e6f3-4abd-a4db-97de4b3ba5ee admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:31.323063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:31.326342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:31.335365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:31.336314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.336700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.337160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.337965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:31.340378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:31.346435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3093/6222] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:31.364376 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3130/6223] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:41:31.365794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:31.385895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:31.389829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:31.402286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833c028-34f5-4f21-acb5-a5a020f284d0 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:31.414047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baad8d3-7e92-48bd-a092-43027b159106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:31.414419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad8d3-7e92-48bd-a092-43027b159106 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.414700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad8d3-7e92-48bd-a092-43027b159106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.414977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad8d3-7e92-48bd-a092-43027b159106 admin admin] PATH_INFO: `/v3/projects/4672ef0f08fa4c9689eb72b02b38a604/users/cec95d8d88b84b019bfdabb989dc3672/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.427936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812495d-f4eb-41e5-974a-549013e076c8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:31.452263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baad8d3-7e92-48bd-a092-43027b159106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4672ef0f08fa4c9689eb72b02b38a604, user_id=cec95d8d88b84b019bfdabb989dc3672, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:31.464903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:31.465421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baad8d3-7e92-48bd-a092-43027b159106 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:31.466798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.467487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.467919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] PATH_INFO: `/v3/projects/715d77898fb74adf9a775c3093748830` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.469501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715d77898fb74adf9a775c3093748830)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:31.472739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:31.532684 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:31.574061 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3094/6224] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:31 2022] PUT /identity/v3/projects/4672ef0f08fa4c9689eb72b02b38a604/users/cec95d8d88b84b019bfdabb989dc3672/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:31.586255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.586504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.586696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.646034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715d77898fb74adf9a775c3093748830', 'request_id': 'req-c5b67b4a-cc87-43d3-a895-c5a13220d110'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:31.671172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715d77898fb74adf9a775c3093748830', 'request_id': 'req-c5b67b4a-cc87-43d3-a895-c5a13220d110'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:31.699891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] MFA Rules not processed for user `cec95d8d88b84b019bfdabb989dc3672`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:31.701370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:31.769084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715d77898fb74adf9a775c3093748830', 'request_id': 'req-c5b67b4a-cc87-43d3-a895-c5a13220d110'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:31.787646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] The token cache is being invalidate because project 715d77898fb74adf9a775c3093748830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:31.788316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:31.792138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c5b67b4a-cc87-43d3-a895-c5a13220d110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:31.800461 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3131/6225] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:31 2022] DELETE /identity/v3/projects/715d77898fb74adf9a775c3093748830 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:31.809579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e3c0-ad27-40fd-9c3d-f3882b292797 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.809579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e3c0-ad27-40fd-9c3d-f3882b292797 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.809579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e3c0-ad27-40fd-9c3d-f3882b292797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:31.817526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3095/6226] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:31.822013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:31.823598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:31.846708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a9e3e3c0-ad27-40fd-9c3d-f3882b292797 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:31.848057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a9e3e3c0-ad27-40fd-9c3d-f3882b292797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:31.960768 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3132/6227] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:31.976838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef281ec-dca1-490c-a0a3-baa6ae892ef5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:31.980008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef281ec-dca1-490c-a0a3-baa6ae892ef5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:31.981049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef281ec-dca1-490c-a0a3-baa6ae892ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.023604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3cc9b-0c90-40c6-b01a-74304cb3f8e4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.026252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1ef281ec-dca1-490c-a0a3-baa6ae892ef5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:32.028102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ef281ec-dca1-490c-a0a3-baa6ae892ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:32.030211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.030901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.031523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.031630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.032307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.034219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.042297 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3133/6228] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:32.044843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef281ec-dca1-490c-a0a3-baa6ae892ef5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.064474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef281ec-dca1-490c-a0a3-baa6ae892ef5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.070039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.070608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.071629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.071965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.072649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:32.072958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.074913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.091639 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3134/6229] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:41:32.096416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.120550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda9572-a40e-4475-addc-d3b1ab5a4814 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.125798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.126506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.126848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.127136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.127790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.131354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.148858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3096/6230] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:41:31 2022] POST /identity/v3/domains => generated 277 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:32.150319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.260358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677771f-0a1b-419c-9a2c-43e1e13c7318 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.268754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.269464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.269904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.270299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.271211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.273226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.286362 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3135/6231] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:32 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:32.288017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.312419 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:32.378422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c1bd-46ad-45af-b103-8c9e68263c45 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.385343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.391264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.391264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.391264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.391549 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3097/6232] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:41:32 2022] POST /identity/v3/roles => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:32.391627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.391627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.392267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.411746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fbe5-ad17-4405-b5e3-21699028f51a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.499034 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3136/6233] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:32 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:32.503243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.530576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333776-5b63-40a0-8055-2b7bd989deb0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.549337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.553406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.553590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.553749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.554280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.554405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.554568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.554914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/23efaee748e545c8980ed602b44c1218/users/cec95d8d88b84b019bfdabb989dc3672/roles/4c6ac96ba9eb4fb5836576ad4634161e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.555558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.557315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.584179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=23efaee748e545c8980ed602b44c1218, user_id=cec95d8d88b84b019bfdabb989dc3672, role_id=4c6ac96ba9eb4fb5836576ad4634161e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.587883 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3137/6234] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:32 2022] GET /identity/v3/roles => generated 1651 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:32.588909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.591291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.605834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a6e5-9adf-49b1-bd50-4f300415e389 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.611595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.612477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.612946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.614547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.615627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.618840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.666818 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3138/6235] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:32 2022] GET /identity/v3/roles => generated 1651 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:32.667894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.692072 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3098/6236] 10.222.0.59 () {60 vars in 1480 bytes} [Sun Aug 28 01:41:32 2022] PUT /identity/v3/domains/23efaee748e545c8980ed602b44c1218/users/cec95d8d88b84b019bfdabb989dc3672/roles/4c6ac96ba9eb4fb5836576ad4634161e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:32.692432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad42f4-9766-434b-a3f1-06dfbeb54f3d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.696022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:32.827333 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:32.858920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3c83-bb12-4202-87ef-a797a261dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.859617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3c83-bb12-4202-87ef-a797a261dc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.859896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3c83-bb12-4202-87ef-a797a261dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.860219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3c83-bb12-4202-87ef-a797a261dc95 admin admin] PATH_INFO: `/v3/projects/dcbe90e2573046609b34c240fcc89361/users/fdeb7c015fd44fb09984773da7c35b16/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.880608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d58ea7-63e3-4e18-80fa-3a56e82a3922 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:32.898386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:32.899784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:32.900244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:32.900771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:32.903379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.909180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3c83-bb12-4202-87ef-a797a261dc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbe90e2573046609b34c240fcc89361, user_id=fdeb7c015fd44fb09984773da7c35b16, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:32.910041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:32.911989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee3c83-bb12-4202-87ef-a797a261dc95 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:33.007639 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3099/6237] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:41:32 2022] POST /identity/v3/domains => generated 274 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:33.012443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:33.013490 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3139/6238] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:32 2022] PUT /identity/v3/projects/dcbe90e2573046609b34c240fcc89361/users/fdeb7c015fd44fb09984773da7c35b16/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:33.030852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9c0c3-d082-48fb-a6ab-b4c688f71012 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:33.033846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9c0c3-d082-48fb-a6ab-b4c688f71012 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:33.034524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9c0c3-d082-48fb-a6ab-b4c688f71012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:33.070041 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:33.130812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-adc9c0c3-d082-48fb-a6ab-b4c688f71012 None None] MFA Rules not processed for user `fdeb7c015fd44fb09984773da7c35b16`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:33.134402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-adc9c0c3-d082-48fb-a6ab-b4c688f71012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:33.205095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326fc08-50f6-4f15-9c6e-a4a637fde695 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:33.212997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:33.213910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:33.214042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:33.214393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:33.214902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:33.216851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:33.320571 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3140/6239] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:33.324648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9c0c3-d082-48fb-a6ab-b4c688f71012 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:33.361305 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3100/6240] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:41:33 2022] POST /identity/v3/roles => generated 239 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:33.367859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:33.397396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37a1d-5f7b-4471-a17d-470f6da064fc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:33.410174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:33.412512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:33.415105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:33.415409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:33.416230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:33.423482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:33.504308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9c0c3-d082-48fb-a6ab-b4c688f71012 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:33.509577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:33.510468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:33.510973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:33.511460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:33.512345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:33.514956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:33.606326 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:33.607427 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3101/6241] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:41:33 2022] POST /identity/v3/groups => generated 326 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:33.611958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:33.620943 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3141/6242] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:33 2022] POST /identity/v3/projects => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:33.625915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:33.634263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec90a3-44fc-41fb-9c62-7c87222c612b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:33.783536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41386f1-f9c1-46a7-afd4-8d13c4de8b31 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:33.789990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:33.790678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:33.790964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:33.791241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups/89a97c5ebe254ad282a4b27303bb415e/users/cec95d8d88b84b019bfdabb989dc3672` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:33.794131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:33.796557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:33.797981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:33.798337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:33.798496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=89a97c5ebe254ad282a4b27303bb415e, user_id=cec95d8d88b84b019bfdabb989dc3672)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:33.799213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:33.799662 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:41:33.799662 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:41:33.799662 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:41:33.800856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:33.804193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:33.898060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3102/6243] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:41:33 2022] PUT /identity/v3/groups/89a97c5ebe254ad282a4b27303bb415e/users/cec95d8d88b84b019bfdabb989dc3672 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:33.902242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:33.937431 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3142/6244] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:33 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:33.939637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:33.965854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ab3bd-3007-4915-8486-91dc428a12a2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.003133 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:34.048626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7e67b-695e-49db-ba78-10f3c75a22ce tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.054748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.056277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.056639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.056996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7/groups/89a97c5ebe254ad282a4b27303bb415e/roles/e5447018d258472ca8732a96f2af6512` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.059685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a7c532f3ba5a4d3ba3ae9261aeb7b8f7, group_id=89a97c5ebe254ad282a4b27303bb415e, role_id=e5447018d258472ca8732a96f2af6512)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.063380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:34.098026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.099449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.100016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.100645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.101515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.103881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:34.131285 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3143/6245] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:33 2022] GET /identity/v3/roles => generated 1881 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:41:34.132577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:34.133553 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3103/6246] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:33 2022] PUT /identity/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7/groups/89a97c5ebe254ad282a4b27303bb415e/roles/e5447018d258472ca8732a96f2af6512 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:34.137428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:34.150500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf361-e535-43e6-85ef-ec25181d1099 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.251682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba2b8-ffa6-4418-a32a-24c50dee39a5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.254202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.255190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.256132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.256632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] PATH_INFO: `/v3/projects/6f5f50d5c8d648f8ab9cbfc3254cc40c/users/4f17d256ed924e0c99b443ffc725ebe9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.257209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.257865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.258306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.258612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.259632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.261284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:34.280559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5f50d5c8d648f8ab9cbfc3254cc40c, user_id=4f17d256ed924e0c99b443ffc725ebe9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.283818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:34.351755 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3104/6247] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:41:34 2022] POST /identity/v3/domains => generated 274 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:34.355589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:34.372288 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3144/6248] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:34 2022] PUT /identity/v3/projects/6f5f50d5c8d648f8ab9cbfc3254cc40c/users/4f17d256ed924e0c99b443ffc725ebe9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:34.377251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:34.462428 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:34.487117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301713b-539c-4d77-9b33-da9ba763d2ff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.492451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.493144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.493608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.493845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.494521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.496452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:34.502013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19bdd6-b849-4da0-bbf2-380938bf3dae tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.509546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3145/6249] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:34 2022] GET /identity/v3/roles => generated 1881 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:34.513337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:34.527116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99ae94-bb8a-452d-92be-a7b9acdd4ad9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.535895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cff62-1de6-4bcc-8f2d-d0a2b6b71b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.536635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cff62-1de6-4bcc-8f2d-d0a2b6b71b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.536952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cff62-1de6-4bcc-8f2d-d0a2b6b71b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.537295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cff62-1de6-4bcc-8f2d-d0a2b6b71b1a admin admin] PATH_INFO: `/v3/projects/6f5f50d5c8d648f8ab9cbfc3254cc40c/users/4f17d256ed924e0c99b443ffc725ebe9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.541017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cff62-1de6-4bcc-8f2d-d0a2b6b71b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5f50d5c8d648f8ab9cbfc3254cc40c, user_id=4f17d256ed924e0c99b443ffc725ebe9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.544037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cff62-1de6-4bcc-8f2d-d0a2b6b71b1a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:34.571683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3146/6250] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:34 2022] PUT /identity/v3/projects/6f5f50d5c8d648f8ab9cbfc3254cc40c/users/4f17d256ed924e0c99b443ffc725ebe9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:34.583676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18e4b-8617-4062-b00a-0f2348ea9f07 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.583676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18e4b-8617-4062-b00a-0f2348ea9f07 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.583676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e18e4b-8617-4062-b00a-0f2348ea9f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.605153 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:34.647670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d3e18e4b-8617-4062-b00a-0f2348ea9f07 None None] MFA Rules not processed for user `4f17d256ed924e0c99b443ffc725ebe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:34.649856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d3e18e4b-8617-4062-b00a-0f2348ea9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:34.661580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d55a-e2ea-43ac-a63e-fdbdf035a53d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.675344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d55a-e2ea-43ac-a63e-fdbdf035a53d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.675860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d55a-e2ea-43ac-a63e-fdbdf035a53d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.676379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d55a-e2ea-43ac-a63e-fdbdf035a53d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.677315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d55a-e2ea-43ac-a63e-fdbdf035a53d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.679330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d55a-e2ea-43ac-a63e-fdbdf035a53d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:34.759994 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3147/6251] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:34.798586 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3105/6252] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:41:34 2022] POST /identity/v3/roles => generated 240 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:34.804162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e18e4b-8617-4062-b00a-0f2348ea9f07 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:34.946476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e18e4b-8617-4062-b00a-0f2348ea9f07 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:34.952506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:34.954773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:34.954773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:34.954773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/1febe7c7d1374e4382a44da0afd17a11/users/cec95d8d88b84b019bfdabb989dc3672/roles/314b420337064304a6575eb657e3bf1b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:34.972117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1febe7c7d1374e4382a44da0afd17a11, user_id=cec95d8d88b84b019bfdabb989dc3672, role_id=314b420337064304a6575eb657e3bf1b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:34.975830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:35.042759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:35.044493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:35.044855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:35.072580 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3148/6253] 10.222.0.59 () {60 vars in 1480 bytes} [Sun Aug 28 01:41:34 2022] PUT /identity/v3/domains/1febe7c7d1374e4382a44da0afd17a11/users/cec95d8d88b84b019bfdabb989dc3672/roles/314b420337064304a6575eb657e3bf1b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:35.084837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:35.187099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:35.203700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:35.209607 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:35.312363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db985a-f9a0-47f5-ba12-f09d2e3389de tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:35.324371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de566b-920a-4790-876e-ee77faab0e5d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:35.324371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de566b-920a-4790-876e-ee77faab0e5d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:35.324772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de566b-920a-4790-876e-ee77faab0e5d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:35.325048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de566b-920a-4790-876e-ee77faab0e5d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:35.327222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de566b-920a-4790-876e-ee77faab0e5d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:35.328979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de566b-920a-4790-876e-ee77faab0e5d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:35.406904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3106/6254] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:35.406904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:35.406904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:35.423866 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3149/6255] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:41:35 2022] POST /identity/v3/domains => generated 275 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:35.425539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982b1c6-9435-4f40-94d0-b407b1340864 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:35.428723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982b1c6-9435-4f40-94d0-b407b1340864 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:35.431350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982b1c6-9435-4f40-94d0-b407b1340864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:35.517416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7982b1c6-9435-4f40-94d0-b407b1340864 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:35.524317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7982b1c6-9435-4f40-94d0-b407b1340864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:35.599195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930323-8db9-463f-90b5-b3ef18ceb281 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:35.733082 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3150/6256] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:35.734496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982b1c6-9435-4f40-94d0-b407b1340864 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:35.759811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:35.760733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:35.761126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:35.761670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:35.796642 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:35.835329 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:35.842203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982b1c6-9435-4f40-94d0-b407b1340864 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:35.848631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:35.849404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:35.849943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:35.850318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:35.851868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:35.854579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:35.895473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:35.896966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:35.920171 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3107/6257] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:35.924455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:35.933906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:35.961613 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3151/6258] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:41:35 2022] POST /identity/v3/roles => generated 239 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:35.965291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:35.990863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72db9-b74f-4a97-9994-313239c73fe6 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:36.003416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:36.004111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:36.004405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:36.004687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:36.005345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:36.007951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:36.090159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead66b0-19cc-44a1-af15-18d8fb9809cf service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:36.097881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:36.098653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:36.099000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:36.099336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:36.109970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:36.117121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:36.125489 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3108/6259] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:36.144484 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3152/6260] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:41:35 2022] POST /identity/v3/groups => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:36.150288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:36.168675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65976-6ae7-46be-8d76-34633ae792eb service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:36.184413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:36.185082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:36.185543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:36.186626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/users/cec95d8d88b84b019bfdabb989dc3672` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:36.202873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=82aa6b572ef74d66a3d8c1fb732fb2e2, user_id=cec95d8d88b84b019bfdabb989dc3672)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:36.205046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:36.335332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3109/6261] 10.222.0.59 () {60 vars in 1360 bytes} [Sun Aug 28 01:41:36 2022] PUT /identity/v3/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/users/cec95d8d88b84b019bfdabb989dc3672 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:36.342723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:36.356010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907d43b-b884-4b58-b7d7-008e5158a71f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:36.471969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:36.472710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:36.472998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:36.473367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/de7a6614b99d4d89b2f77ea671eecedd/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/roles/f0d53d40b64b4fec80eeeb8a986dcb6f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:36.485357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=de7a6614b99d4d89b2f77ea671eecedd, group_id=82aa6b572ef74d66a3d8c1fb732fb2e2, role_id=f0d53d40b64b4fec80eeeb8a986dcb6f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:36.489039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:36.580153 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3153/6262] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:36 2022] PUT /identity/v3/domains/de7a6614b99d4d89b2f77ea671eecedd/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/roles/f0d53d40b64b4fec80eeeb8a986dcb6f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:36.584494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:36.599346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:36.599346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:36.801915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35d83-509d-41c8-9701-1ba342a8f72d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:36.805656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:36.806405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:36.806668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:36.806944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:36.808943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:36.822287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee121-d831-485f-b9dc-71f577dab79e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:36.824415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:36.828556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:36.850711 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3154/6263] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:36.853325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:36.960755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec95d8d88b84b019bfdabb989dc3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4672ef0f08fa4c9689eb72b02b38a604', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:36.960975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c71432-2b1d-4e93-879d-39f5fd8a8312 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:36.961997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:36.962551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:36.963061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] PATH_INFO: `/v3/auth/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:36.964030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:36.966158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:36.970323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:36.971003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:36.971288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:36.971569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:37.099878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3110/6264] 10.222.0.59 () {58 vars in 1143 bytes} [Sun Aug 28 01:41:36 2022] GET /identity/v3/auth/domains => generated 1168 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:37.104710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:37.117529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:37.119135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:37.130562 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3155/6265] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:37.243384 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:37.272137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca4f5e-5be7-4842-afa4-a0d9a57e7104 tempest-TokensV3TestJSON-790238795 tempest-TokensV3TestJSON-790238795-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:37.288032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:37.288718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:37.289006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:37.289287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/de7a6614b99d4d89b2f77ea671eecedd/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/roles/f0d53d40b64b4fec80eeeb8a986dcb6f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:37.291807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=de7a6614b99d4d89b2f77ea671eecedd, group_id=82aa6b572ef74d66a3d8c1fb732fb2e2, role_id=f0d53d40b64b4fec80eeeb8a986dcb6f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:37.295348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:37.302856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role f0d53d40b64b4fec80eeeb8a986dcb6f was removed from group 82aa6b572ef74d66a3d8c1fb732fb2e2 on domain de7a6614b99d4d89b2f77ea671eecedd. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:37.305446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:37.305446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:37.442043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:37.443557 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3111/6266] 10.222.0.59 () {58 vars in 1467 bytes} [Sun Aug 28 01:41:37 2022] DELETE /identity/v3/domains/de7a6614b99d4d89b2f77ea671eecedd/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/roles/f0d53d40b64b4fec80eeeb8a986dcb6f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:37.461966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea937a-c617-4c34-a5af-af0fa70ff455 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:37.547881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:37.548620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:37.548912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:37.549192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/users/cec95d8d88b84b019bfdabb989dc3672` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:37.552982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=82aa6b572ef74d66a3d8c1fb732fb2e2, user_id=cec95d8d88b84b019bfdabb989dc3672)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:37.555378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:37.595616 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:37.640810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cec95d8d88b84b019bfdabb989dc3672'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:37.780569 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3156/6267] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:41:37 2022] DELETE /identity/v3/groups/82aa6b572ef74d66a3d8c1fb732fb2e2/users/cec95d8d88b84b019bfdabb989dc3672 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:37.785747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:37.787522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:37.814655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32145-1363-4362-9555-5f3a719f270e tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:37.926523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:37.927224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:37.927224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:37.927404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups/82aa6b572ef74d66a3d8c1fb732fb2e2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:37.928616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_group(group_id=82aa6b572ef74d66a3d8c1fb732fb2e2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:37.930549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:38.087760 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3112/6268] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:41:37 2022] DELETE /identity/v3/groups/82aa6b572ef74d66a3d8c1fb732fb2e2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:38.091741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:38.104742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5efeb6-37d6-4ecd-9f94-9248b1795b7d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:38.202554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:38.203572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:38.204042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:38.204511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles/f0d53d40b64b4fec80eeeb8a986dcb6f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:38.206458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f0d53d40b64b4fec80eeeb8a986dcb6f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:38.209197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:38.344844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role f0d53d40b64b4fec80eeeb8a986dcb6f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:38.345237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.346690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.348600 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3157/6269] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:38 2022] DELETE /identity/v3/roles/f0d53d40b64b4fec80eeeb8a986dcb6f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:38.353048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:38.354836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:38.371314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb1dce-955e-4d86-ab74-2d174299bfd2 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:38.457621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:38.459054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:38.459372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:38.460137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/de7a6614b99d4d89b2f77ea671eecedd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:38.462866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=de7a6614b99d4d89b2f77ea671eecedd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:38.472012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:38.492317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.493088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.616967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.617795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1116dfbe-f13c-4543-a009-44b844412a25 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.623507 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3113/6270] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:38 2022] PATCH /identity/v3/domains/de7a6614b99d4d89b2f77ea671eecedd => generated 276 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:38.624988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:38.637081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff5a31-81f0-4f49-96d9-66f4b47d3f77 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:38.705945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:38.707123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:38.707662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:38.707947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/de7a6614b99d4d89b2f77ea671eecedd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:38.721994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=de7a6614b99d4d89b2f77ea671eecedd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:38.725385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:38.757916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.762673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.906650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd', 'request_id': 'req-3da488e6-968e-480e-9cfd-3b1a6d944f76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:38.917436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd', 'request_id': 'req-3da488e6-968e-480e-9cfd-3b1a6d944f76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.084973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd', 'request_id': 'req-3da488e6-968e-480e-9cfd-3b1a6d944f76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.100462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4c8f-d231-42f1-9e6a-4caab8a2aa59 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:39.101448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4c8f-d231-42f1-9e6a-4caab8a2aa59 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:39.101741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b4c8f-d231-42f1-9e6a-4caab8a2aa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:39.110106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] The token cache is being invalidate because project de7a6614b99d4d89b2f77ea671eecedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:39.110470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.111957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.128234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-973b4c8f-d231-42f1-9e6a-4caab8a2aa59 None None] MFA Rules not processed for user `13d47aaea13a458299f133080c5e3004`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:39.131221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-973b4c8f-d231-42f1-9e6a-4caab8a2aa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:39.143853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd', 'request_id': 'req-3da488e6-968e-480e-9cfd-3b1a6d944f76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.144640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd', 'request_id': 'req-3da488e6-968e-480e-9cfd-3b1a6d944f76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.145501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'de7a6614b99d4d89b2f77ea671eecedd', 'request_id': 'req-3da488e6-968e-480e-9cfd-3b1a6d944f76'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.162464 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:39.166396 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3158/6271] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:41:38 2022] DELETE /identity/v3/domains/de7a6614b99d4d89b2f77ea671eecedd => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:39.173261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:39.175036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:39.259005 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3114/6272] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:39.321063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da488e6-968e-480e-9cfd-3b1a6d944f76 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:39.327784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:39.337427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:39.337427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:39.337427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/1febe7c7d1374e4382a44da0afd17a11/users/cec95d8d88b84b019bfdabb989dc3672/roles/314b420337064304a6575eb657e3bf1b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:39.337427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1febe7c7d1374e4382a44da0afd17a11, user_id=cec95d8d88b84b019bfdabb989dc3672, role_id=314b420337064304a6575eb657e3bf1b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:39.338247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:39.347505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role 314b420337064304a6575eb657e3bf1b was removed from user cec95d8d88b84b019bfdabb989dc3672 on domain 1febe7c7d1374e4382a44da0afd17a11. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:39.347644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.348881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.450249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3159/6273] 10.222.0.59 () {58 vars in 1464 bytes} [Sun Aug 28 01:41:39 2022] DELETE /identity/v3/domains/1febe7c7d1374e4382a44da0afd17a11/users/cec95d8d88b84b019bfdabb989dc3672/roles/314b420337064304a6575eb657e3bf1b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:39.455317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4c8f-d231-42f1-9e6a-4caab8a2aa59 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:39.487089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b4c8f-d231-42f1-9e6a-4caab8a2aa59 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:39.558083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:39.559433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:39.559721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:39.559989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles/314b420337064304a6575eb657e3bf1b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:39.561844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_role(role_id=314b420337064304a6575eb657e3bf1b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:39.563454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:39.644208 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:39.688717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role 314b420337064304a6575eb657e3bf1b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:39.689388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.690215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.692728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3115/6274] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:39 2022] DELETE /identity/v3/roles/314b420337064304a6575eb657e3bf1b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:39.697059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:39.698711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:39.713566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068be4-d49e-4848-9d81-5df2bc68b8aa tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:39.797079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:39.798042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:39.798495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:39.798776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/1febe7c7d1374e4382a44da0afd17a11` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:39.800067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1febe7c7d1374e4382a44da0afd17a11)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:39.801890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:39.835222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.836030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.935726 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:39.952059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.953148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:39.958682 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3160/6275] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:39 2022] PATCH /identity/v3/domains/1febe7c7d1374e4382a44da0afd17a11 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:39.962836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:39.964375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:39.994856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f675a3-fa10-4cb7-8b1d-ef682a6d6d3d tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:40.103381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:40.104125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:40.104302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:40.104582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/1febe7c7d1374e4382a44da0afd17a11` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:40.115923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1febe7c7d1374e4382a44da0afd17a11)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:40.117774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:40.145648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.149877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.301891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11', 'request_id': 'req-d44cba1d-560a-4ec2-8847-3445edc0aeeb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.317442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11', 'request_id': 'req-d44cba1d-560a-4ec2-8847-3445edc0aeeb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.401103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11', 'request_id': 'req-d44cba1d-560a-4ec2-8847-3445edc0aeeb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.447431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] The token cache is being invalidate because project 1febe7c7d1374e4382a44da0afd17a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:40.447431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.447431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.479499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11', 'request_id': 'req-d44cba1d-560a-4ec2-8847-3445edc0aeeb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.480341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11', 'request_id': 'req-d44cba1d-560a-4ec2-8847-3445edc0aeeb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.481198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1febe7c7d1374e4382a44da0afd17a11', 'request_id': 'req-d44cba1d-560a-4ec2-8847-3445edc0aeeb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.493113 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3116/6276] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:41:39 2022] DELETE /identity/v3/domains/1febe7c7d1374e4382a44da0afd17a11 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:40.501403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:40.503064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:40.517201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434713fc-e0cb-4e69-899a-7b4bfa777119 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:40.594340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:40.595392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:40.596230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:40.596865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7/groups/89a97c5ebe254ad282a4b27303bb415e/roles/e5447018d258472ca8732a96f2af6512` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:40.601698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a7c532f3ba5a4d3ba3ae9261aeb7b8f7, group_id=89a97c5ebe254ad282a4b27303bb415e, role_id=e5447018d258472ca8732a96f2af6512)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:40.604575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:40.613787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role e5447018d258472ca8732a96f2af6512 was removed from group 89a97c5ebe254ad282a4b27303bb415e on domain a7c532f3ba5a4d3ba3ae9261aeb7b8f7. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:40.619100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.619100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.694335 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3161/6277] 10.222.0.59 () {58 vars in 1467 bytes} [Sun Aug 28 01:41:40 2022] DELETE /identity/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7/groups/89a97c5ebe254ad282a4b27303bb415e/roles/e5447018d258472ca8732a96f2af6512 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:40.698375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:40.700030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:40.716019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cba1d-560a-4ec2-8847-3445edc0aeeb tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:40.797097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:40.798162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:40.798600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:40.799025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups/89a97c5ebe254ad282a4b27303bb415e/users/cec95d8d88b84b019bfdabb989dc3672` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:40.801362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=89a97c5ebe254ad282a4b27303bb415e, user_id=cec95d8d88b84b019bfdabb989dc3672)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:40.805981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:40.894127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cec95d8d88b84b019bfdabb989dc3672'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:40.997725 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3117/6278] 10.222.0.59 () {58 vars in 1344 bytes} [Sun Aug 28 01:41:40 2022] DELETE /identity/v3/groups/89a97c5ebe254ad282a4b27303bb415e/users/cec95d8d88b84b019bfdabb989dc3672 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:41.002332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:41.003775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:41.017534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07ee02-b448-441f-b42c-dd61b0be5554 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:41.128289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:41.130138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:41.130585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:41.131021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/groups/89a97c5ebe254ad282a4b27303bb415e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:41.132420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_group(group_id=89a97c5ebe254ad282a4b27303bb415e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:41.139397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:41.241053 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:41.334474 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3162/6279] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:41:41 2022] DELETE /identity/v3/groups/89a97c5ebe254ad282a4b27303bb415e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:41.339194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:41.369274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158baa9-7387-4a9d-8686-f72055b331a4 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:41.500203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:41.500947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:41.501452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:41.501947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles/e5447018d258472ca8732a96f2af6512` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:41.503612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e5447018d258472ca8732a96f2af6512)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:41.505258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:41.596727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role e5447018d258472ca8732a96f2af6512 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:41.597090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:41.598015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:41.599998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3118/6280] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:41 2022] DELETE /identity/v3/roles/e5447018d258472ca8732a96f2af6512 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:41.604154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:41.606021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:41.618540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9ef8e-c4fa-449f-8cf8-c19c1302a37c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:41.697944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:41.697944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:41.697944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:41.698625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:41.698625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a7c532f3ba5a4d3ba3ae9261aeb7b8f7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:41.699255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:41.722688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:41.723421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:41.872727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:41.874005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:41.879752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3163/6281] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:41 2022] PATCH /identity/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:41.880865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:41.892538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7080d7-fc0a-48f1-99b4-7c28f750567a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:41.954732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:41.955394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:41.956455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:41.956455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:41.968186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a7c532f3ba5a4d3ba3ae9261aeb7b8f7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:41.969802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:41.994823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:41.999249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.142843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7', 'request_id': 'req-2a95e938-c5eb-4e0a-ad65-5af498e90d23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.149065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7', 'request_id': 'req-2a95e938-c5eb-4e0a-ad65-5af498e90d23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.269197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7', 'request_id': 'req-2a95e938-c5eb-4e0a-ad65-5af498e90d23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.284078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] The token cache is being invalidate because project a7c532f3ba5a4d3ba3ae9261aeb7b8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:42.284429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.285500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.293178 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:42.298579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7', 'request_id': 'req-2a95e938-c5eb-4e0a-ad65-5af498e90d23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.299322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7', 'request_id': 'req-2a95e938-c5eb-4e0a-ad65-5af498e90d23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.299982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a7c532f3ba5a4d3ba3ae9261aeb7b8f7', 'request_id': 'req-2a95e938-c5eb-4e0a-ad65-5af498e90d23'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.308402 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3119/6282] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:41:41 2022] DELETE /identity/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:42.313987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:42.315404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:42.327961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291cceb-f5b3-45b8-874d-558ae8f1ec14 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:42.385965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:42.386547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:42.386856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:42.387134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/23efaee748e545c8980ed602b44c1218/users/cec95d8d88b84b019bfdabb989dc3672/roles/4c6ac96ba9eb4fb5836576ad4634161e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:42.389441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=23efaee748e545c8980ed602b44c1218, user_id=cec95d8d88b84b019bfdabb989dc3672, role_id=4c6ac96ba9eb4fb5836576ad4634161e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:42.392114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:42.397743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role 4c6ac96ba9eb4fb5836576ad4634161e was removed from user cec95d8d88b84b019bfdabb989dc3672 on domain 23efaee748e545c8980ed602b44c1218. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:42.398385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.399969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.485485 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3164/6283] 10.222.0.59 () {58 vars in 1464 bytes} [Sun Aug 28 01:41:42 2022] DELETE /identity/v3/domains/23efaee748e545c8980ed602b44c1218/users/cec95d8d88b84b019bfdabb989dc3672/roles/4c6ac96ba9eb4fb5836576ad4634161e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:42.489838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:42.491399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:42.506029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95e938-c5eb-4e0a-ad65-5af498e90d23 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:42.570882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:42.572033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:42.572554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:42.573067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles/4c6ac96ba9eb4fb5836576ad4634161e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:42.575716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4c6ac96ba9eb4fb5836576ad4634161e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:42.579758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:42.724601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role 4c6ac96ba9eb4fb5836576ad4634161e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:42.725122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.726103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.728530 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3120/6284] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:42 2022] DELETE /identity/v3/roles/4c6ac96ba9eb4fb5836576ad4634161e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:42.733462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:42.735920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:42.760397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4cdb-6fcc-42b3-abb3-ff04b2dad422 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:42.877521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:42.878022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:42.878310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:42.878588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/23efaee748e545c8980ed602b44c1218` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:42.881469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=23efaee748e545c8980ed602b44c1218)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:42.883425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:42.907772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '23efaee748e545c8980ed602b44c1218'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:42.908594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '23efaee748e545c8980ed602b44c1218'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.017164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '23efaee748e545c8980ed602b44c1218'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.019508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '23efaee748e545c8980ed602b44c1218'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.029249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3165/6285] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:42 2022] PATCH /identity/v3/domains/23efaee748e545c8980ed602b44c1218 => generated 278 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:43.031376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:43.032900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:43.052536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e2d86-918c-4f42-82ef-8055f4321034 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:43.164618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:43.165182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:43.165423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:43.165707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/23efaee748e545c8980ed602b44c1218` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:43.227215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=23efaee748e545c8980ed602b44c1218)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:43.231361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:43.237838 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:43.320889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '23efaee748e545c8980ed602b44c1218'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.330350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '23efaee748e545c8980ed602b44c1218'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.392329 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:43.486560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23efaee748e545c8980ed602b44c1218', 'request_id': 'req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.495346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23efaee748e545c8980ed602b44c1218', 'request_id': 'req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.610675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23efaee748e545c8980ed602b44c1218', 'request_id': 'req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.629547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] The token cache is being invalidate because project 23efaee748e545c8980ed602b44c1218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:43.629869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.632272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.649518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '23efaee748e545c8980ed602b44c1218', 'request_id': 'req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.652950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '23efaee748e545c8980ed602b44c1218', 'request_id': 'req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.654244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '23efaee748e545c8980ed602b44c1218', 'request_id': 'req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:43.675255 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3121/6286] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:41:43 2022] DELETE /identity/v3/domains/23efaee748e545c8980ed602b44c1218 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:43.681194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:43.683346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:43.720129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df1cf7-4b2b-4ac4-b80d-5a80403bce9c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:43.855652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:43.856450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:43.856825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:43.857198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:43.858667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:43.861106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:43.876944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3166/6287] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:43.877508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:43.879143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:43.895355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f43d-ffa2-48f0-87ed-9a643760fa1f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:43.900736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:43.901756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:43.902276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:43.902750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects/709ade1475fb47779c69a8d3b5b3454a/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:43.908111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_grant(project_id=709ade1475fb47779c69a8d3b5b3454a, user_id=ff36cef18f7343039b2b9e7fb46bae73, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:43.911225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:43.996130 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3122/6288] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:43 2022] PUT /identity/v3/projects/709ade1475fb47779c69a8d3b5b3454a/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:44.001044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:44.024507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd18027-747d-498f-a668-83246944c845 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:44.104243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:44.104872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:44.105153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:44.105448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:44.106075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:44.107165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:44.186972 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3167/6289] 10.222.0.59 () {58 vars in 1146 bytes} [Sun Aug 28 01:41:43 2022] GET /identity/v3/auth/projects => generated 824 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:44.187329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:44.207981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c094b8-5049-439c-a140-ddc70f0a904f tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:44.221200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:44.222500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:44.222791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:44.223076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects/709ade1475fb47779c69a8d3b5b3454a/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:44.231476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=709ade1475fb47779c69a8d3b5b3454a, user_id=ff36cef18f7343039b2b9e7fb46bae73, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:44.236819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:44.253248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role 6ef968d350d64b4496757a252fa42707 was removed from user ff36cef18f7343039b2b9e7fb46bae73 on project 709ade1475fb47779c69a8d3b5b3454a. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:44.253563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:44.255831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:44.383818 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3123/6290] 10.222.0.59 () {58 vars in 1467 bytes} [Sun Aug 28 01:41:44 2022] DELETE /identity/v3/projects/709ade1475fb47779c69a8d3b5b3454a/users/ff36cef18f7343039b2b9e7fb46bae73/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:44.385192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:44.387988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:44.419078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396563ad-df6c-4ade-8959-ca1239a6aabc tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:44.508850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:44.509699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:44.510076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:44.510440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:44.511160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:44.513301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:44.647688 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3168/6291] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:44 2022] POST /identity/v3/users => generated 321 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:44.655728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:44.679016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f9a5-fdfd-4204-8d1f-c937004a04d5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:44.691720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:44.692286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:44.692579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:44.692860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:44.693526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:44.695557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:44.914502 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:44.999363 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3124/6292] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:44 2022] POST /identity/v3/projects => generated 364 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:45.005295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:45.019750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf19df-cd7a-4d9c-b4d5-8ffb560a76f1 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:45.132736 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:45.142363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:45.142363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:45.142363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:45.142997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:45.142997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:45.142997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:45.332721 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3169/6293] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:45 2022] POST /identity/v3/projects => generated 362 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:45.333698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:45.363184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e63616-a7ca-4f85-b64c-a2c24e350d44 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:45.444017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:45.444651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:45.444938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:45.445899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:45.446780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:45.448865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:45.555722 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3125/6294] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:41:45 2022] POST /identity/v3/roles => generated 239 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:45.559817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:45.559950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:45.560041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:45.582998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bc6c5-76e2-4b9d-9a51-a360c32ff842 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:45.645207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:45.645207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:45.645207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:45.645601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects/51ec683fe4614473ac10f7be428fd1ce/users/feb724de00754f2e9d8c3ee595dc3549/roles/8ae5ea42af5344ad80612c1cd89d9f5d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:45.695123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_grant(project_id=51ec683fe4614473ac10f7be428fd1ce, user_id=feb724de00754f2e9d8c3ee595dc3549, role_id=8ae5ea42af5344ad80612c1cd89d9f5d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:45.699126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:45.727569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067e4a-daa5-46ab-b4be-4fa42d0aded9 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:45.743377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:45.744212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:45.744667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:45.744852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] PATH_INFO: `/v3/users/ef31fbbe22504738ba5ddde0848ef8d0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:45.749378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef31fbbe22504738ba5ddde0848ef8d0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:45.751449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:45.815180 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3126/6295] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:45 2022] PUT /identity/v3/projects/51ec683fe4614473ac10f7be428fd1ce/users/feb724de00754f2e9d8c3ee595dc3549/roles/8ae5ea42af5344ad80612c1cd89d9f5d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:45.819249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:45.909612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f87c6-2e9a-4f06-b44a-4c72fffdfe99 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:45.921091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28802c-9227-408f-b66f-5e1eb2a941d0 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:45.922272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28802c-9227-408f-b66f-5e1eb2a941d0 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:45.922634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28802c-9227-408f-b66f-5e1eb2a941d0 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:45.922981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28802c-9227-408f-b66f-5e1eb2a941d0 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects/59cb723cd9434c66b18484a8a6506827/users/feb724de00754f2e9d8c3ee595dc3549/roles/8ae5ea42af5344ad80612c1cd89d9f5d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:45.925840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28802c-9227-408f-b66f-5e1eb2a941d0 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:create_grant(project_id=59cb723cd9434c66b18484a8a6506827, user_id=feb724de00754f2e9d8c3ee595dc3549, role_id=8ae5ea42af5344ad80612c1cd89d9f5d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:45.928814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28802c-9227-408f-b66f-5e1eb2a941d0 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:46.030919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef31fbbe22504738ba5ddde0848ef8d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:46.034881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef31fbbe22504738ba5ddde0848ef8d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:46.036324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3127/6296] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:45 2022] PUT /identity/v3/projects/59cb723cd9434c66b18484a8a6506827/users/feb724de00754f2e9d8c3ee595dc3549/roles/8ae5ea42af5344ad80612c1cd89d9f5d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:46.043719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.044423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.045774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.093842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] MFA Rules not processed for user `feb724de00754f2e9d8c3ee595dc3549`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:46.095377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.099895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3128/6297] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:46 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:41:46.106284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:46.108409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.151833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef31fbbe22504738ba5ddde0848ef8d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:46.172323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef31fbbe22504738ba5ddde0848ef8d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:46.172520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c9504bb5-2d21-4b2b-b5b4-06888b052329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef31fbbe22504738ba5ddde0848ef8d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:46.208478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3170/6298] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:45 2022] DELETE /identity/v3/users/ef31fbbe22504738ba5ddde0848ef8d0 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:46.208478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545926b-1eb5-42fc-a81b-21ec29cc82ec None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.208478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545926b-1eb5-42fc-a81b-21ec29cc82ec None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.208478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545926b-1eb5-42fc-a81b-21ec29cc82ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.222030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1329e-ba50-4c90-ac9e-bc0083a27e17 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:46.223531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a545926b-1eb5-42fc-a81b-21ec29cc82ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.240597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a545926b-1eb5-42fc-a81b-21ec29cc82ec None None] MFA Rules not processed for user `feb724de00754f2e9d8c3ee595dc3549`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:46.240597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a545926b-1eb5-42fc-a81b-21ec29cc82ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.343326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:46.344623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.345031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.345565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.347621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.356180 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3171/6299] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 01:41:46.361133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.361133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.361133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.374686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:46.376315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:46.386002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:46.389947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.410198 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:46.411614 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3129/6300] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:46.412897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:46.415242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.472668 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:46.539699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa52ed-86ec-46f4-ab92-d71ee9ef6090 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:46.550810 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3172/6301] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:46.560288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93642ad-a62d-4955-a0aa-7989f04390e5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:46.560288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93642ad-a62d-4955-a0aa-7989f04390e5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.560288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93642ad-a62d-4955-a0aa-7989f04390e5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.562237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93642ad-a62d-4955-a0aa-7989f04390e5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.568650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:46.571231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.574708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93642ad-a62d-4955-a0aa-7989f04390e5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:46.577065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93642ad-a62d-4955-a0aa-7989f04390e5 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:46.679303 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3130/6302] 10.222.0.59 () {56 vars in 1308 bytes} [Sun Aug 28 01:41:46 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:46.683544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f4ce-2298-4023-b789-0509ab0611ca None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:46.686618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660215-4b5b-45ca-b53e-0131404209c6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.686618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660215-4b5b-45ca-b53e-0131404209c6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.686618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d660215-4b5b-45ca-b53e-0131404209c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.691629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:46.692352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.692749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.692941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.701923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0d660215-4b5b-45ca-b53e-0131404209c6 None None] MFA Rules not processed for user `feb724de00754f2e9d8c3ee595dc3549`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:46.703082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0d660215-4b5b-45ca-b53e-0131404209c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:46.715111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:46.717310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:46.749924 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3173/6303] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:46.787774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3131/6304] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 01:41:46.792708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:46.807905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3fc7-63d8-42bb-9171-b0a8bb281f7d service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:46.818399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:46.818399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:46.818399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:46.818645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/roles/8ae5ea42af5344ad80612c1cd89d9f5d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:46.818645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ae5ea42af5344ad80612c1cd89d9f5d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:46.820651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:46.980720 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:47.022623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invalidating the token cache because role 8ae5ea42af5344ad80612c1cd89d9f5d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:47.024362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.024854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.028446 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3174/6305] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:46 2022] DELETE /identity/v3/roles/8ae5ea42af5344ad80612c1cd89d9f5d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:47.033802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660215-4b5b-45ca-b53e-0131404209c6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:47.061747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d660215-4b5b-45ca-b53e-0131404209c6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:47.174183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:47.175133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:47.175649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:47.176265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects/59cb723cd9434c66b18484a8a6506827` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:47.177746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59cb723cd9434c66b18484a8a6506827)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:47.180714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:47.243749 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:47.374010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cb723cd9434c66b18484a8a6506827', 'request_id': 'req-d978770b-a040-48bb-9c75-2052b167683a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.384526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cb723cd9434c66b18484a8a6506827', 'request_id': 'req-d978770b-a040-48bb-9c75-2052b167683a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.517770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cb723cd9434c66b18484a8a6506827', 'request_id': 'req-d978770b-a040-48bb-9c75-2052b167683a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.535611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] The token cache is being invalidate because project 59cb723cd9434c66b18484a8a6506827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:47.536402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.538051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.542978 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3132/6306] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:47 2022] DELETE /identity/v3/projects/59cb723cd9434c66b18484a8a6506827 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:47.545601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:47.547382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:47.564493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac84c4-58d2-414e-ac5d-dcb6f7855d0c tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:47.639193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:47.639762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:47.640057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:47.640338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects/59cb723cd9434c66b18484a8a6506827` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:47.648019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59cb723cd9434c66b18484a8a6506827)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:47.650425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Could not find project: 59cb723cd9434c66b18484a8a6506827.: keystone.exception.ProjectNotFound: Could not find project: 59cb723cd9434c66b18484a8a6506827. Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 01:41:47.665326 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 59cb723cd9434c66b18484a8a6506827. Aug 28 01:41:47.666412 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:47.667059 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3175/6307] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:47 2022] DELETE /identity/v3/projects/59cb723cd9434c66b18484a8a6506827 => generated 113 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:41:47.677700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:47.679403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:47.694276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978770b-a040-48bb-9c75-2052b167683a tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:47.699494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:47.701881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:47.701881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:47.701881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/projects/51ec683fe4614473ac10f7be428fd1ce` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:47.706077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_project(project_id=51ec683fe4614473ac10f7be428fd1ce)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:47.709924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:47.820919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ec683fe4614473ac10f7be428fd1ce', 'request_id': 'req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.828690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ec683fe4614473ac10f7be428fd1ce', 'request_id': 'req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.906252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ec683fe4614473ac10f7be428fd1ce', 'request_id': 'req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.923187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] The token cache is being invalidate because project 51ec683fe4614473ac10f7be428fd1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:47.923508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.924224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:47.926151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3133/6308] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:47 2022] DELETE /identity/v3/projects/51ec683fe4614473ac10f7be428fd1ce => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:47.930324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:47.938959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:47.962531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51701ce4-a9c0-449c-8fee-04ad107f8491 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:47.999556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:48.001049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:48.100583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.104128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.104424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.104706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/users/feb724de00754f2e9d8c3ee595dc3549` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.106166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorizing `identity:delete_user(user_id=feb724de00754f2e9d8c3ee595dc3549)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:48.110342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:48.134702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4938f3b-8aa2-42f2-8dfa-fc3935b6c601 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:48.142514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.143464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.143464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.143754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] PATH_INFO: `/v3/projects/83a4636b887e42618b9cead42ae4ddd8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.144988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a4636b887e42618b9cead42ae4ddd8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:48.147364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:48.250493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb724de00754f2e9d8c3ee595dc3549'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.251356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb724de00754f2e9d8c3ee595dc3549'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.293760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a4636b887e42618b9cead42ae4ddd8', 'request_id': 'req-4b3766c4-99c0-427f-826e-d88e7678ad2c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.306895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a4636b887e42618b9cead42ae4ddd8', 'request_id': 'req-4b3766c4-99c0-427f-826e-d88e7678ad2c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.432058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb724de00754f2e9d8c3ee595dc3549'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.440075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb724de00754f2e9d8c3ee595dc3549'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.440819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb724de00754f2e9d8c3ee595dc3549'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.459057 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3176/6309] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:47 2022] DELETE /identity/v3/users/feb724de00754f2e9d8c3ee595dc3549 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:48.464578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:48.467808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:48.540764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fac16-941b-4164-bc0d-100c900c3fda tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:48.547094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.550228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.550513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.550808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/de7a6614b99d4d89b2f77ea671eecedd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.563149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a4636b887e42618b9cead42ae4ddd8', 'request_id': 'req-4b3766c4-99c0-427f-826e-d88e7678ad2c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.566714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Could not find domain: de7a6614b99d4d89b2f77ea671eecedd.: keystone.exception.DomainNotFound: Could not find domain: de7a6614b99d4d89b2f77ea671eecedd. Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: de7a6614b99d4d89b2f77ea671eecedd. Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:41:48.573909 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:41:48.575762 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: de7a6614b99d4d89b2f77ea671eecedd. Aug 28 01:41:48.580303 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.581709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3177/6310] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:48 2022] PATCH /identity/v3/domains/de7a6614b99d4d89b2f77ea671eecedd => generated 112 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:41:48.581798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] The token cache is being invalidate because project 83a4636b887e42618b9cead42ae4ddd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:48.581798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.582130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:48.582359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:48.584965 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3134/6311] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:47 2022] DELETE /identity/v3/projects/83a4636b887e42618b9cead42ae4ddd8 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:48.588945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:48.591440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:48.595026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4faa-0f11-47e4-8754-780d00194e90 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:48.602870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.603657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.603942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.604219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/1febe7c7d1374e4382a44da0afd17a11` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.614340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Could not find domain: 1febe7c7d1374e4382a44da0afd17a11.: keystone.exception.DomainNotFound: Could not find domain: 1febe7c7d1374e4382a44da0afd17a11. Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1febe7c7d1374e4382a44da0afd17a11. Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:41:48.620371 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:41:48.621535 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1febe7c7d1374e4382a44da0afd17a11. Aug 28 01:41:48.627449 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.629913 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3178/6312] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:48 2022] PATCH /identity/v3/domains/1febe7c7d1374e4382a44da0afd17a11 => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:41:48.629913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:48.635047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:48.658107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2f4c-743a-458b-958d-75f2601d4049 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:48.669653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.670701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.670984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.671265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.693604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Could not find domain: a7c532f3ba5a4d3ba3ae9261aeb7b8f7.: keystone.exception.DomainNotFound: Could not find domain: a7c532f3ba5a4d3ba3ae9261aeb7b8f7. Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a7c532f3ba5a4d3ba3ae9261aeb7b8f7. Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:41:48.698949 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:41:48.699960 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a7c532f3ba5a4d3ba3ae9261aeb7b8f7. Aug 28 01:41:48.700839 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.702919 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3179/6313] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:48 2022] PATCH /identity/v3/domains/a7c532f3ba5a4d3ba3ae9261aeb7b8f7 => generated 112 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:41:48.704807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:48.712016 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:48.724473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3b68-6779-4d1f-9ed5-9c58ad8eb773 tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:48.730025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff36cef18f7343039b2b9e7fb46bae73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df671f0883084f60b6bf19c12bb0c516', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.730885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.731269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.731679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] PATH_INFO: `/v3/domains/23efaee748e545c8980ed602b44c1218` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.743827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:41:48.753566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3766c4-99c0-427f-826e-d88e7678ad2c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Could not find domain: 23efaee748e545c8980ed602b44c1218.: keystone.exception.DomainNotFound: Could not find domain: 23efaee748e545c8980ed602b44c1218. Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 23efaee748e545c8980ed602b44c1218. Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:41:48.759315 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:41:48.760516 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 23efaee748e545c8980ed602b44c1218. Aug 28 01:41:48.761405 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:41:48.763038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3180/6314] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:41:48 2022] PATCH /identity/v3/domains/23efaee748e545c8980ed602b44c1218 => generated 112 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:41:48.770456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:48.775712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:48.817356 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:48.863468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.864415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.864872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.865327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] PATH_INFO: `/v3/users/95835bf45d714dae8bc75bcd59056b3c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.867194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95835bf45d714dae8bc75bcd59056b3c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:48.871096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:48.897100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8714e9-2d7a-48ed-b678-dd08b093cd8b tempest-TokensV3TestJSON-579593564 tempest-TokensV3TestJSON-579593564-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:48.902331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:48.903056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:48.903404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:48.903851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] PATH_INFO: `/v3/users/166f8f3d062d4cc68d5c00804a6d90a7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:48.906149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] RBAC: Authorizing `identity:delete_user(user_id=166f8f3d062d4cc68d5c00804a6d90a7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:48.908077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:49.082005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166f8f3d062d4cc68d5c00804a6d90a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.082690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166f8f3d062d4cc68d5c00804a6d90a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.100401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95835bf45d714dae8bc75bcd59056b3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.128485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95835bf45d714dae8bc75bcd59056b3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.136343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95835bf45d714dae8bc75bcd59056b3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.137235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95835bf45d714dae8bc75bcd59056b3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.183162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166f8f3d062d4cc68d5c00804a6d90a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.193006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166f8f3d062d4cc68d5c00804a6d90a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.194206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860bc112-d3de-4058-a192-5493b453650a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166f8f3d062d4cc68d5c00804a6d90a7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.213284 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3181/6315] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:48 2022] DELETE /identity/v3/users/166f8f3d062d4cc68d5c00804a6d90a7 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:49.223601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:49.224153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:49.224600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:49.244188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95835bf45d714dae8bc75bcd59056b3c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.248693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:49.250366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:49.254859 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3135/6316] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:48 2022] DELETE /identity/v3/users/95835bf45d714dae8bc75bcd59056b3c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:49.338140 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3182/6317] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:49.359480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:49.361077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:49.486904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857381c-4fe7-4154-8756-d64a285e40c7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:49.491760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f921af-f6d6-45ee-905f-1fa73f9031c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:49.492547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f921af-f6d6-45ee-905f-1fa73f9031c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:49.493244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f921af-f6d6-45ee-905f-1fa73f9031c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:49.493244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f921af-f6d6-45ee-905f-1fa73f9031c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:49.579508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f921af-f6d6-45ee-905f-1fa73f9031c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:49.581188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f921af-f6d6-45ee-905f-1fa73f9031c0 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:49.593862 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3136/6318] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:49.676083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:49.677409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:49.691245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5ecd9-3c81-4b8a-8365-89cfb2fa649c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:49.696792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:49.697531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:49.697845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:49.698431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] PATH_INFO: `/v3/projects/030d5438ad2945b0bfe89f61a82bc392` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:49.699672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] RBAC: Authorizing `identity:delete_project(project_id=030d5438ad2945b0bfe89f61a82bc392)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:49.702388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:49.709522 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:49.879070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030d5438ad2945b0bfe89f61a82bc392', 'request_id': 'req-964bd0d2-4799-42b6-acbd-ffa7c140977e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.890930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030d5438ad2945b0bfe89f61a82bc392', 'request_id': 'req-964bd0d2-4799-42b6-acbd-ffa7c140977e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:49.986333 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:50.018886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030d5438ad2945b0bfe89f61a82bc392', 'request_id': 'req-964bd0d2-4799-42b6-acbd-ffa7c140977e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.037111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] The token cache is being invalidate because project 030d5438ad2945b0bfe89f61a82bc392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:50.037459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.039222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-964bd0d2-4799-42b6-acbd-ffa7c140977e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.046384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3183/6319] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:49 2022] DELETE /identity/v3/projects/030d5438ad2945b0bfe89f61a82bc392 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:50.054073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bcc0b-b8f8-47e3-8b57-2be1c93462d3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:50.054073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bcc0b-b8f8-47e3-8b57-2be1c93462d3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:50.054073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bcc0b-b8f8-47e3-8b57-2be1c93462d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:50.086083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5e4bcc0b-b8f8-47e3-8b57-2be1c93462d3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:50.092272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5e4bcc0b-b8f8-47e3-8b57-2be1c93462d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:50.278181 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3137/6320] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:50.299722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:50.299722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:50.299722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:50.330095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:50.334196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:50.344607 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3184/6321] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:50.349190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bcc0b-b8f8-47e3-8b57-2be1c93462d3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:50.365271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bcc0b-b8f8-47e3-8b57-2be1c93462d3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:50.370720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:50.371349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:50.371637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:50.372460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:50.373250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:50.373799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:50.376036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:50.400627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:50.403542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:50.428422 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3138/6322] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:50.429400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:50.433734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e440b7-a2f3-454e-9ef0-a30df84342a2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:50.450802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4ddc1-95d8-4c24-856e-ae61d1958e54 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:50.451624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:50.454580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:50.456290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:50.459980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] PATH_INFO: `/v3/projects/709ade1475fb47779c69a8d3b5b3454a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:50.461152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709ade1475fb47779c69a8d3b5b3454a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:50.473462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:50.473610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:50.473711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:50.473711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:50.473711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:50.473711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:50.473711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:50.601904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3139/6323] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:50 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:50.603075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:50.659409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709ade1475fb47779c69a8d3b5b3454a', 'request_id': 'req-7ced9f06-5fae-498e-8cc2-3e510244b7f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.675718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709ade1475fb47779c69a8d3b5b3454a', 'request_id': 'req-7ced9f06-5fae-498e-8cc2-3e510244b7f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.757429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709ade1475fb47779c69a8d3b5b3454a', 'request_id': 'req-7ced9f06-5fae-498e-8cc2-3e510244b7f1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.768032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091ef5-313c-4c5c-a586-09f0c1e43b7c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:50.774062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] The token cache is being invalidate because project 709ade1475fb47779c69a8d3b5b3454a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:50.774362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.775175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:50.778430 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3185/6324] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:50 2022] DELETE /identity/v3/projects/709ade1475fb47779c69a8d3b5b3454a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:50.784662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:50.789138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:50.906626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:50.907263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:50.907734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:50.908027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:50.909219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:50.909992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced9f06-5fae-498e-8cc2-3e510244b7f1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:50.911803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:50.915559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:50.916427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:50.916856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:50.920364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] PATH_INFO: `/v3/users/ff36cef18f7343039b2b9e7fb46bae73` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:50.920364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff36cef18f7343039b2b9e7fb46bae73)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:50.921969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:50.995435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3140/6325] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:50 2022] POST /identity/v3/users => generated 295 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:51.003342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:51.003342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:51.014969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddc0b8-3ee0-4e0a-bcde-0be174c68069 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:51.019823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:51.020559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:51.020944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:51.021321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:51.022576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:51.025862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:51.041872 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3141/6326] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:51.043035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:51.055459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cfa36-1c4b-4ddf-abbb-cecf669d0b60 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:51.061112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:51.061683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:51.061992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:51.062267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:51.062902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:51.064476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:51.075953 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3142/6327] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:51.080146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:51.090059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6816b-5f67-48b7-8f49-0d5679a1b172 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:51.094856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18615bf-f5a9-4b64-81ba-e1706b7e7119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:51.095499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18615bf-f5a9-4b64-81ba-e1706b7e7119 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:51.095879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18615bf-f5a9-4b64-81ba-e1706b7e7119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:51.096143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18615bf-f5a9-4b64-81ba-e1706b7e7119 admin admin] PATH_INFO: `/v3/projects/1cb4158b34f3445b9a310a32f34ad14d/users/5b96195abebc4fc683c9bf3f31840358/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:51.119091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18615bf-f5a9-4b64-81ba-e1706b7e7119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb4158b34f3445b9a310a32f34ad14d, user_id=5b96195abebc4fc683c9bf3f31840358, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:51.121655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18615bf-f5a9-4b64-81ba-e1706b7e7119 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:51.129661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff36cef18f7343039b2b9e7fb46bae73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:51.130510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff36cef18f7343039b2b9e7fb46bae73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:51.218365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff36cef18f7343039b2b9e7fb46bae73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:51.228246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3143/6328] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:51 2022] PUT /identity/v3/projects/1cb4158b34f3445b9a310a32f34ad14d/users/5b96195abebc4fc683c9bf3f31840358/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:41:51.229915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff36cef18f7343039b2b9e7fb46bae73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:51.231066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff36cef18f7343039b2b9e7fb46bae73'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:51.248134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:51.248577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:51.249033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:51.263306 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3186/6329] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:50 2022] DELETE /identity/v3/users/ff36cef18f7343039b2b9e7fb46bae73 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:51.299490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] MFA Rules not processed for user `5b96195abebc4fc683c9bf3f31840358`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:51.300849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:51.423071 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3144/6330] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:51.434275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:51.436086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:51.520642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b578-763d-458b-b1be-69048bbdd402 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:51.524588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:51.525275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:51.525622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:51.526030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:51.539898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:51.541511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:51.561189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3187/6331] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:51.615735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:51.617915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:51.688994 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:51.705496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95302b-b803-457a-a14a-18b7e08cf094 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:51.710303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:51.711984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:51.711984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:51.711984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] PATH_INFO: `/v3/users/5b96195abebc4fc683c9bf3f31840358` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:51.713079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b96195abebc4fc683c9bf3f31840358)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:51.714538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:51.912023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:51.912023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:51.932353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f807e30-70f3-4f46-a8bf-9d102dde2fa5 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:51.938917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:51.944767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:51.944767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:51.944767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] PATH_INFO: `/v3/projects/df671f0883084f60b6bf19c12bb0c516` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:51.944767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df671f0883084f60b6bf19c12bb0c516)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:51.944767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:51.986045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b96195abebc4fc683c9bf3f31840358'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.001655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b96195abebc4fc683c9bf3f31840358'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.010198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b96195abebc4fc683c9bf3f31840358'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.011470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b96195abebc4fc683c9bf3f31840358'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.068712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df671f0883084f60b6bf19c12bb0c516', 'request_id': 'req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.081901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df671f0883084f60b6bf19c12bb0c516', 'request_id': 'req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.103161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6f71eeef-b3bf-4777-9712-75d405c8a021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b96195abebc4fc683c9bf3f31840358'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.112714 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3145/6332] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:51 2022] DELETE /identity/v3/users/5b96195abebc4fc683c9bf3f31840358 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:52.116905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:52.117181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:52.117475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:52.138002 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:52.138202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:52.139424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:52.206156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df671f0883084f60b6bf19c12bb0c516', 'request_id': 'req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.223718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] The token cache is being invalidate because project df671f0883084f60b6bf19c12bb0c516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:52.224214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.225372 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3146/6333] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:52.225509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.228830 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3188/6334] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:51 2022] DELETE /identity/v3/projects/df671f0883084f60b6bf19c12bb0c516 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:52.233123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:52.234639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:52.237730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:52.243977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:52.261116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84884c-a912-4b73-b7fe-5530381dd0a7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:52.267110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:52.268148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:52.268148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:52.268486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] PATH_INFO: `/v3/users/cec95d8d88b84b019bfdabb989dc3672` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:52.269876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec95d8d88b84b019bfdabb989dc3672)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:52.271941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:52.336718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4e7b6-5aa6-41ad-9231-b8bd6e5e5178 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:52.407353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:52.408294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:52.408294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:52.408576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:52.410324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:52.424168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:52.425778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:52.436510 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3189/6335] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:52.581974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec95d8d88b84b019bfdabb989dc3672'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.599516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec95d8d88b84b019bfdabb989dc3672'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.613114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec95d8d88b84b019bfdabb989dc3672'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.613773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec95d8d88b84b019bfdabb989dc3672'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.732652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec95d8d88b84b019bfdabb989dc3672'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:52.748717 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3147/6336] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:52 2022] DELETE /identity/v3/users/cec95d8d88b84b019bfdabb989dc3672 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:53.191382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:53.199348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:53.233497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48acca7-ed0a-4284-9b52-eb7514916c4b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:53.315338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:53.316194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:53.316603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:53.316872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] PATH_INFO: `/v3/projects/1cb4158b34f3445b9a310a32f34ad14d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:53.318123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb4158b34f3445b9a310a32f34ad14d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:53.321087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:53.503346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:53.505417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:53.521186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb4158b34f3445b9a310a32f34ad14d', 'request_id': 'req-c88c739d-985b-47b6-a108-6902ed6a253e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.524499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53777564-a185-47ef-b02c-b7cb05022116 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:53.529635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb4158b34f3445b9a310a32f34ad14d', 'request_id': 'req-c88c739d-985b-47b6-a108-6902ed6a253e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.583773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:53.584427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:53.584750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:53.584976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] PATH_INFO: `/v3/projects/4672ef0f08fa4c9689eb72b02b38a604` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:53.586238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4672ef0f08fa4c9689eb72b02b38a604)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:53.588172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:53.711606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb4158b34f3445b9a310a32f34ad14d', 'request_id': 'req-c88c739d-985b-47b6-a108-6902ed6a253e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.725942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] The token cache is being invalidate because project 1cb4158b34f3445b9a310a32f34ad14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:53.726577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.727249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c88c739d-985b-47b6-a108-6902ed6a253e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.733657 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3190/6337] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:53 2022] DELETE /identity/v3/projects/1cb4158b34f3445b9a310a32f34ad14d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:53.736597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f925cea-a484-44fe-b352-187a16935009 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:53.736597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f925cea-a484-44fe-b352-187a16935009 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:53.736597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f925cea-a484-44fe-b352-187a16935009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:53.762107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8f925cea-a484-44fe-b352-187a16935009 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:53.767090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f925cea-a484-44fe-b352-187a16935009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:53.781432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4672ef0f08fa4c9689eb72b02b38a604', 'request_id': 'req-a489c219-4d9e-4fdf-b51c-09bfc508f49c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.792022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4672ef0f08fa4c9689eb72b02b38a604', 'request_id': 'req-a489c219-4d9e-4fdf-b51c-09bfc508f49c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.852185 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3191/6338] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:53.860864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb9068-ed51-4bfb-92e4-77f5112c56e6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:53.861159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb9068-ed51-4bfb-92e4-77f5112c56e6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:53.861446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb9068-ed51-4bfb-92e4-77f5112c56e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:53.882253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f0eb9068-ed51-4bfb-92e4-77f5112c56e6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:53.883725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f0eb9068-ed51-4bfb-92e4-77f5112c56e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:53.894077 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3192/6339] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:53.900114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb9068-ed51-4bfb-92e4-77f5112c56e6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:53.910878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb9068-ed51-4bfb-92e4-77f5112c56e6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:53.923755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4672ef0f08fa4c9689eb72b02b38a604', 'request_id': 'req-a489c219-4d9e-4fdf-b51c-09bfc508f49c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.923935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:53.923935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:53.923935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:53.923935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:53.924808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:53.924808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:53.934476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:53.955399 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3193/6340] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:53.956548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:53.962078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] The token cache is being invalidate because project 4672ef0f08fa4c9689eb72b02b38a604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:41:53.962415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.969296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bcbd8-5b85-4ced-a018-c8e73b0e0b6e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:53.972303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a489c219-4d9e-4fdf-b51c-09bfc508f49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:41:53.975360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:53.976299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:53.976738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:53.977164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:53.978049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:53.980673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:53.982498 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3148/6341] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:41:53 2022] DELETE /identity/v3/projects/4672ef0f08fa4c9689eb72b02b38a604 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:53.996708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06320a8e-0479-4441-b629-6d3d1ed773a1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:53.996998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06320a8e-0479-4441-b629-6d3d1ed773a1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:53.997281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06320a8e-0479-4441-b629-6d3d1ed773a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.008691 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:54.044122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-06320a8e-0479-4441-b629-6d3d1ed773a1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:54.045480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-06320a8e-0479-4441-b629-6d3d1ed773a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:54.076393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3149/6342] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:54.077902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ea41e-9a29-4161-8bf6-b947c8ad00e5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.078193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ea41e-9a29-4161-8bf6-b947c8ad00e5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.078488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ea41e-9a29-4161-8bf6-b947c8ad00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.107443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-951ea41e-9a29-4161-8bf6-b947c8ad00e5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:54.109964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-951ea41e-9a29-4161-8bf6-b947c8ad00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:54.127897 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3150/6343] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:54.131814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ea41e-9a29-4161-8bf6-b947c8ad00e5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.142346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ea41e-9a29-4161-8bf6-b947c8ad00e5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.147727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:54.148361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.148643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.148918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.149623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:41:54.150046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:54.151851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:54.155359 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3194/6344] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:53 2022] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:54.159470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.161226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:54.170135 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3151/6345] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:41:54.186900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.212828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b254345-c215-4f14-91cd-8cf25f4066d5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.351697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f347aa3-9359-45fe-b4f7-bbbc884c916d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.359980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:54.360842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.361263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.361687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.363625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:54.365851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:54.418514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:54.420620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.421145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.421931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.422896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:54.438997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:54.471397 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3195/6346] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:54 2022] POST /identity/v3/users => generated 295 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:54.477565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.500331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce40c3-6073-42fb-919c-602ae5a67782 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.519077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:54.519829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.520162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.520556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.521118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:54.522985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:54.544342 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3196/6347] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:54.549925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.584286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0be3f-20d3-489a-9f71-81196672f2c3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.589515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:54.590373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.590814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.591246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.592599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:54.594764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:54.625151 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3197/6348] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:41:54.626885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.633510 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3152/6349] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:54 2022] POST /identity/v3/projects => generated 375 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:54.639612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7925076-f8c7-49bd-83d9-5276499353da admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.643579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.717243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9df365-d9f1-4397-986e-4f28574d89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:54.722551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df365-d9f1-4397-986e-4f28574d89e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.722884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df365-d9f1-4397-986e-4f28574d89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.723181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9df365-d9f1-4397-986e-4f28574d89e4 admin admin] PATH_INFO: `/v3/projects/2c35eea901884257adf3cf80f005eb73/users/70b21d05bc874d5d829b45593296582f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.741872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df365-d9f1-4397-986e-4f28574d89e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c35eea901884257adf3cf80f005eb73, user_id=70b21d05bc874d5d829b45593296582f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:54.744644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9df365-d9f1-4397-986e-4f28574d89e4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:54.782079 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:54.797838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b9b1-0c0f-42bd-b10d-3f752414ea7c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.816545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:54.816545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.816545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.816545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.816950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:54.816950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:54.841096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3198/6350] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:54 2022] PUT /identity/v3/projects/2c35eea901884257adf3cf80f005eb73/users/70b21d05bc874d5d829b45593296582f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:54.859804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:54.860238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:54.860525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:54.896425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] MFA Rules not processed for user `70b21d05bc874d5d829b45593296582f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:54.897891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:54.913481 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3153/6351] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:54 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:54.918162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.931414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459578f4-1285-4d45-80df-93b748a5aa29 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:54.978025 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3199/6352] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:54.986116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:54.987527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:55.003459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:55.004080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.004394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.004861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.010610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:55.014107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:55.025881 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3154/6353] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:55.030527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:55.047839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3c659-f0d3-4fc9-9f66-ac0bdd91a482 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:55.053778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:55.054456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.054741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.055019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.056740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:55.057618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:55.071689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c96bc3-6121-48aa-9b56-4a2aad94960a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:55.079203 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3155/6354] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:41:55.082262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:55.082369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abf1a0-638b-4125-a33d-e82263b0ee9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:55.082369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf1a0-638b-4125-a33d-e82263b0ee9a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.082369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf1a0-638b-4125-a33d-e82263b0ee9a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.082369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abf1a0-638b-4125-a33d-e82263b0ee9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.092884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf1a0-638b-4125-a33d-e82263b0ee9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:55.094715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abf1a0-638b-4125-a33d-e82263b0ee9a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:55.095095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06456-aa33-4a64-9299-f68e2b85e951 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:55.100087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:55.100828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.101220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.101537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] PATH_INFO: `/v3/projects/e4902d3f035b4110bdbdd61c2b1cb7f3/users/cb93aa415317436caab20eddb75225e8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.106140 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3200/6355] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:55.140545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4902d3f035b4110bdbdd61c2b1cb7f3, user_id=cb93aa415317436caab20eddb75225e8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:55.143321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:55.318976 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3156/6356] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:55 2022] PUT /identity/v3/projects/e4902d3f035b4110bdbdd61c2b1cb7f3/users/cb93aa415317436caab20eddb75225e8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:55.330230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635110f-094a-46cc-bb9d-032e28a96cb3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.335200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635110f-094a-46cc-bb9d-032e28a96cb3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.335200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635110f-094a-46cc-bb9d-032e28a96cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.373755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0635110f-094a-46cc-bb9d-032e28a96cb3 None None] MFA Rules not processed for user `cb93aa415317436caab20eddb75225e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:55.375105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0635110f-094a-46cc-bb9d-032e28a96cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:55.465532 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3201/6357] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:55.470758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:55.555996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4a041-5ee4-4233-9190-54e20439962f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:55.563822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad1b6-284e-4349-b37e-ff087974abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:55.564499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad1b6-284e-4349-b37e-ff087974abb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.564783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad1b6-284e-4349-b37e-ff087974abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.565054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad1b6-284e-4349-b37e-ff087974abb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.565757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad1b6-284e-4349-b37e-ff087974abb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:55.568120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad1b6-284e-4349-b37e-ff087974abb8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:55.691803 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3157/6358] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:41:55 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:41:55.697872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635110f-094a-46cc-bb9d-032e28a96cb3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:55.725882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a336e8-10c1-493d-8ac2-79710e1a8627 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.729596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a336e8-10c1-493d-8ac2-79710e1a8627 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.729596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a336e8-10c1-493d-8ac2-79710e1a8627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.739387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635110f-094a-46cc-bb9d-032e28a96cb3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:55.761143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f8a336e8-10c1-493d-8ac2-79710e1a8627 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:55.762451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f8a336e8-10c1-493d-8ac2-79710e1a8627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:55.830188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:55.846382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:55.846624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:55.850635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:55.850798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:55.852837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:55.896602 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3158/6359] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:41:56.001166 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3202/6360] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:41:55 2022] POST /identity/v3/users => generated 288 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:41:56.007263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a336e8-10c1-493d-8ac2-79710e1a8627 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:56.026144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a336e8-10c1-493d-8ac2-79710e1a8627 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:56.032487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:56.033287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:56.033586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:56.033900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:56.034559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:56.036435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:56.053323 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3159/6361] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:56.060743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:56.073111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfba682-bbdf-4c0d-8168-6c2723f456a1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:56.080530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3ac38-026a-4f90-86f2-91185d3fc90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:56.081226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ac38-026a-4f90-86f2-91185d3fc90f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:56.081656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ac38-026a-4f90-86f2-91185d3fc90f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:56.082334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ac38-026a-4f90-86f2-91185d3fc90f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:56.086982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3ac38-026a-4f90-86f2-91185d3fc90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:56.088938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3ac38-026a-4f90-86f2-91185d3fc90f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:56.104371 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3203/6362] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:41:56.112019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:56.135125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058e160-cba5-43a5-a8c5-a79dcbe57c95 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:56.143088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:56.144722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:56.145123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:56.145535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] PATH_INFO: `/v3/projects/dbdaf002ce664a52a322057faae43778/users/ac94ae1eb46e4a278d065c2532d6d8c7/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:56.173258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdaf002ce664a52a322057faae43778, user_id=ac94ae1eb46e4a278d065c2532d6d8c7, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:56.177363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:56.352793 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3160/6363] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:41:56 2022] PUT /identity/v3/projects/dbdaf002ce664a52a322057faae43778/users/ac94ae1eb46e4a278d065c2532d6d8c7/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:41:56.364699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeda1c-a2fa-44e3-af40-078ce01e3fbd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:56.365006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeda1c-a2fa-44e3-af40-078ce01e3fbd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:56.365389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeda1c-a2fa-44e3-af40-078ce01e3fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:56.401018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f4aeda1c-a2fa-44e3-af40-078ce01e3fbd None None] MFA Rules not processed for user `ac94ae1eb46e4a278d065c2532d6d8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:56.405211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f4aeda1c-a2fa-44e3-af40-078ce01e3fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:56.515385 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3204/6364] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:56.540957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:56.542924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:56.709748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52f0d7-8845-440f-85fa-522e63741e12 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:56.717927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:56.718560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:56.718839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:56.719114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:56.801642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:56.803240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:56.816575 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3161/6365] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:56.847280 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:57.288867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:57.289183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:57.289850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:57.359095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:57.366936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:57.508977 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:57.522498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3205/6366] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:41:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:57.768851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:57.774668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:57.949344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8aa8-4994-4444-a696-0fe2198e60e3 service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:57.965394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbec73-a425-4978-86c0-98adec21ae50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:57.965394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbec73-a425-4978-86c0-98adec21ae50 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:57.965394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbec73-a425-4978-86c0-98adec21ae50 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:57.965394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbec73-a425-4978-86c0-98adec21ae50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:57.984919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbec73-a425-4978-86c0-98adec21ae50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:57.987075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbec73-a425-4978-86c0-98adec21ae50 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:58.002671 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3162/6367] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:41:58.698842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:58.703445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:58.735526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3769519-b710-4c71-a2bb-560ee89745e8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:58.743313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:58.746745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:58.747527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:58.752653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:58.773040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:58.802467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:58.824030 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3206/6368] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:58.975343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565886-87c9-4fe9-ac6e-5b366d2efb8f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:58.976356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565886-87c9-4fe9-ac6e-5b366d2efb8f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:58.980584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565886-87c9-4fe9-ac6e-5b366d2efb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:59.065769 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:59.077734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a8565886-87c9-4fe9-ac6e-5b366d2efb8f None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:59.079192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a8565886-87c9-4fe9-ac6e-5b366d2efb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:59.100797 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3163/6369] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:41:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:59.116108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:59.141323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1eed7-c2aa-4e9f-be98-5c9d43f6c584 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:59.148865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432d23-2123-4c6d-a409-74fc33e75e8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:59.155036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432d23-2123-4c6d-a409-74fc33e75e8a service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:59.155748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432d23-2123-4c6d-a409-74fc33e75e8a service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:59.156248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432d23-2123-4c6d-a409-74fc33e75e8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:59.178522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432d23-2123-4c6d-a409-74fc33e75e8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:59.178522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432d23-2123-4c6d-a409-74fc33e75e8a service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:59.226797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3207/6370] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:41:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:41:59.398094 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:59.833504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565886-87c9-4fe9-ac6e-5b366d2efb8f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:59.985754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565886-87c9-4fe9-ac6e-5b366d2efb8f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:59.992435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:59.993168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:59.993461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:59.993793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] PATH_INFO: `/v3/users/cb93aa415317436caab20eddb75225e8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:59.997692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb93aa415317436caab20eddb75225e8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:00.003042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:00.369327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb93aa415317436caab20eddb75225e8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:00.398585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb93aa415317436caab20eddb75225e8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:00.422652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb93aa415317436caab20eddb75225e8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:00.423557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb93aa415317436caab20eddb75225e8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:00.530807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb93aa415317436caab20eddb75225e8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:00.548768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:00.550987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:00.551502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:00.555799 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3164/6371] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:41:59 2022] DELETE /identity/v3/users/cb93aa415317436caab20eddb75225e8 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:00.582224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:00.585132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:00.794790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3208/6372] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:00.800533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:00.811823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:00.921898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5ba29-a201-46e9-bf1a-b1ba6110c641 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:00.931390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:00.932854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:00.933146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:00.933425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:00.987824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:00.989786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:01.009718 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3165/6373] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:42:01.026296 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:01.991147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:01.993021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:02.043473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfb2ae-c830-4522-b529-fe15419408e0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:02.070475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:02.071685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:02.073027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:02.080923 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:02.082443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] PATH_INFO: `/v3/projects/e4902d3f035b4110bdbdd61c2b1cb7f3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:02.084268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4902d3f035b4110bdbdd61c2b1cb7f3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:02.090922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:02.255651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4902d3f035b4110bdbdd61c2b1cb7f3', 'request_id': 'req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.269095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4902d3f035b4110bdbdd61c2b1cb7f3', 'request_id': 'req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.351997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4902d3f035b4110bdbdd61c2b1cb7f3', 'request_id': 'req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.371010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] The token cache is being invalidate because project e4902d3f035b4110bdbdd61c2b1cb7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:02.371524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.372411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.374851 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3209/6374] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:01 2022] DELETE /identity/v3/projects/e4902d3f035b4110bdbdd61c2b1cb7f3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:02.382909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:02.396592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b119-76fc-46df-beb1-781c62dde15b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:02.500644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:02.501634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:02.502661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:02.503217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] PATH_INFO: `/v3/users/ac94ae1eb46e4a278d065c2532d6d8c7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:02.504775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac94ae1eb46e4a278d065c2532d6d8c7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:02.507225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:02.704491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac94ae1eb46e4a278d065c2532d6d8c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.720249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac94ae1eb46e4a278d065c2532d6d8c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.729368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac94ae1eb46e4a278d065c2532d6d8c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.731583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac94ae1eb46e4a278d065c2532d6d8c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.843230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cac30ead-a7ec-40de-9605-7c451744b7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac94ae1eb46e4a278d065c2532d6d8c7'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:02.851783 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3166/6375] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:02 2022] DELETE /identity/v3/users/ac94ae1eb46e4a278d065c2532d6d8c7 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:02.976791 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:03.547459 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:03.824556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:03.824556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:03.848860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aeeff-df0c-44c0-a15c-7cceb3e6863e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:03.986507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:03.987158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:03.987617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:03.988097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] PATH_INFO: `/v3/projects/dbdaf002ce664a52a322057faae43778` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:03.990033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdaf002ce664a52a322057faae43778)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:03.991984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:04.065703 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:04.266672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdaf002ce664a52a322057faae43778', 'request_id': 'req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:04.288579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdaf002ce664a52a322057faae43778', 'request_id': 'req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:04.430906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdaf002ce664a52a322057faae43778', 'request_id': 'req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:04.444289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] The token cache is being invalidate because project dbdaf002ce664a52a322057faae43778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:04.444289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:04.444920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c32ad2f8-e48e-4e69-ad7a-5c7f58cd81eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:04.458382 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3210/6376] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:03 2022] DELETE /identity/v3/projects/dbdaf002ce664a52a322057faae43778 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:04.464281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a182-5e0a-40bc-b601-1bbcc9b54062 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:04.465848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a182-5e0a-40bc-b601-1bbcc9b54062 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:04.473325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09a182-5e0a-40bc-b601-1bbcc9b54062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:04.495677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6b09a182-5e0a-40bc-b601-1bbcc9b54062 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:04.496927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6b09a182-5e0a-40bc-b601-1bbcc9b54062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:04.584114 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3167/6377] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:04.593221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385fd1-333e-4e41-bb95-f9d88f4cbcf6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:04.593793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385fd1-333e-4e41-bb95-f9d88f4cbcf6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:04.593793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385fd1-333e-4e41-bb95-f9d88f4cbcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:04.628950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-77385fd1-333e-4e41-bb95-f9d88f4cbcf6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:04.630242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-77385fd1-333e-4e41-bb95-f9d88f4cbcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:04.647896 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3211/6378] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:04.652895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09a182-5e0a-40bc-b601-1bbcc9b54062 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:04.667687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09a182-5e0a-40bc-b601-1bbcc9b54062 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:04.676277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:04.676900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:04.677363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:04.677798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:04.682674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:04.683344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:04.685802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:04.738772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3168/6379] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:42:04.750802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77385fd1-333e-4e41-bb95-f9d88f4cbcf6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:04.760217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77385fd1-333e-4e41-bb95-f9d88f4cbcf6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:04.769096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:04.769845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:04.770375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:04.770375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:04.771008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:04.772914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:04.889395 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3212/6380] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:04 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:04.893659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:04.904925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d38b5-2319-4aeb-a4b0-e61988485826 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:04.987181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:04.987830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:04.988115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:04.988393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:04.989127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:04.991377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:05.087208 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:05.137603 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:05.137603 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3169/6381] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:04 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:05.140165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:05.156210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b8a3d-bd3c-4338-9846-c0fc76e29de1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:05.175576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:05.176206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:05.176536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:05.176826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:05.177594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:05.179269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:05.223315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3213/6382] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:05.225202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:05.242329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fc99-b58e-4585-aab9-7f0c8ab3fd03 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:05.255702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67000cb-4920-4406-97bb-5035a00c4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:05.256421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67000cb-4920-4406-97bb-5035a00c4883 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:05.256709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67000cb-4920-4406-97bb-5035a00c4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:05.259511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67000cb-4920-4406-97bb-5035a00c4883 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:05.260819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67000cb-4920-4406-97bb-5035a00c4883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:05.262554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67000cb-4920-4406-97bb-5035a00c4883 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:05.287387 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3170/6383] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:05.292619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:05.324258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640151-4a4d-4063-9942-1c602c38e6b2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:05.336600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:05.338030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:05.339541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:05.339541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] PATH_INFO: `/v3/projects/3b47c2f81bc249fd9b98d78d8994083f/users/a10e9b4dd62644d7977ca515efedf294/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:05.360035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b47c2f81bc249fd9b98d78d8994083f, user_id=a10e9b4dd62644d7977ca515efedf294, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:05.366654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:05.562858 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3214/6384] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:05 2022] PUT /identity/v3/projects/3b47c2f81bc249fd9b98d78d8994083f/users/a10e9b4dd62644d7977ca515efedf294/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:05.574511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5bec6-af6f-4dec-afb4-dbd873701f20 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:05.575452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5bec6-af6f-4dec-afb4-dbd873701f20 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:05.576448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5bec6-af6f-4dec-afb4-dbd873701f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:05.673530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cec5bec6-af6f-4dec-afb4-dbd873701f20 None None] MFA Rules not processed for user `a10e9b4dd62644d7977ca515efedf294`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:05.677564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cec5bec6-af6f-4dec-afb4-dbd873701f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:05.956191 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3171/6385] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:05.960618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:06.073335 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:06.119520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46405da1-59ed-4e68-9885-074c89829b59 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:06.123126 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:06.134105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:06.134548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:06.134839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:06.135119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:06.135858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:06.137848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:06.315249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3215/6386] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:05 2022] POST /identity/v3/projects => generated 385 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:06.320988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5bec6-af6f-4dec-afb4-dbd873701f20 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:06.354484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5bec6-af6f-4dec-afb4-dbd873701f20 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:06.504815 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:06.516817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:06.518236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:06.519196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:06.519994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:06.521309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:06.533999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:06.643466 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3172/6387] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:06 2022] POST /identity/v3/users => generated 299 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:06.650044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:06.672325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30961-1e3e-4e26-ac47-94f26326e677 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:06.687064 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:06.697792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:06.699080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:06.699561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:06.700024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:06.702396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:06.705579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:06.729499 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3216/6388] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:06.734073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:06.748702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3300f6-3817-46ef-89f4-e6cd56529844 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:06.759630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:06.760418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:06.760915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:06.761379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] PATH_INFO: `/v3/projects/16d6ba673d564f8e8cd787c65de83076/users/d35c0a807d1c4ee8999afac89d5ea93c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:06.793705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d6ba673d564f8e8cd787c65de83076, user_id=d35c0a807d1c4ee8999afac89d5ea93c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:06.798385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:06.945060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3173/6389] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:06 2022] PUT /identity/v3/projects/16d6ba673d564f8e8cd787c65de83076/users/d35c0a807d1c4ee8999afac89d5ea93c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:06.953692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:06.972811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b874fd-b80e-468d-897b-bdb9ed071deb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:07.073322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31c097-24d4-4e35-a289-23ecc5c21a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:07.074897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31c097-24d4-4e35-a289-23ecc5c21a32 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:07.075565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31c097-24d4-4e35-a289-23ecc5c21a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:07.076880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31c097-24d4-4e35-a289-23ecc5c21a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:07.078223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31c097-24d4-4e35-a289-23ecc5c21a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:07.080087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31c097-24d4-4e35-a289-23ecc5c21a32 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:07.102261 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3217/6390] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:07.118344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:07.137204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f7143-6793-4e9b-9eec-e0c536313daa admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:07.148295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:07.149344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:07.150248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:07.150596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] PATH_INFO: `/v3/projects/16d6ba673d564f8e8cd787c65de83076/users/d35c0a807d1c4ee8999afac89d5ea93c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:07.152799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d6ba673d564f8e8cd787c65de83076, user_id=d35c0a807d1c4ee8999afac89d5ea93c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:07.158659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:07.193075 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3174/6391] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:07 2022] PUT /identity/v3/projects/16d6ba673d564f8e8cd787c65de83076/users/d35c0a807d1c4ee8999afac89d5ea93c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:07.200117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:07.201497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:07.206835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:07.259609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] MFA Rules not processed for user `d35c0a807d1c4ee8999afac89d5ea93c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:07.261518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:07.404295 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3218/6392] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:07.429170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:07.436154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:07.506152 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:07.528095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97380a48-2c65-4c68-9c9a-cec3e394798a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:07.535145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aae931-b58e-4ebc-81e2-ec15e92eadfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:07.545011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aae931-b58e-4ebc-81e2-ec15e92eadfc service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:07.545011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aae931-b58e-4ebc-81e2-ec15e92eadfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:07.545011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aae931-b58e-4ebc-81e2-ec15e92eadfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:07.612087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aae931-b58e-4ebc-81e2-ec15e92eadfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:07.613641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aae931-b58e-4ebc-81e2-ec15e92eadfc service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:07.625990 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3175/6393] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:07.830238 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:08.588855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:08.590407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:08.605368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef21fa-3c83-4104-b724-058d42f0092b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:08.618499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:08.619635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:08.619635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:08.619635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:08.636661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:08.639017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:08.655437 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3219/6394] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:09.059931 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:09.525750 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:11.541639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:11.542322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:11.542441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:11.567446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] MFA Rules not processed for user `88c64df8e3034b71b25b6139a454bdf1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:11.568964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:11.727927 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3176/6395] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:20.280577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:20.284020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:20.370358 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:20.432679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca66ebb-3602-4156-8557-fd5358c0b433 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:20.446907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad037f1-1d64-4c5a-a0bd-b950d1a113b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:20.447916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad037f1-1d64-4c5a-a0bd-b950d1a113b3 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:20.448354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad037f1-1d64-4c5a-a0bd-b950d1a113b3 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:20.448968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad037f1-1d64-4c5a-a0bd-b950d1a113b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:20.452641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fad037f1-1d64-4c5a-a0bd-b950d1a113b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:20.486433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad037f1-1d64-4c5a-a0bd-b950d1a113b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:20.488382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad037f1-1d64-4c5a-a0bd-b950d1a113b3 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:20.520336 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3220/6396] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:20.594415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:20.596068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:20.823289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212ad92-9b7a-45e8-9701-3a9d2f3ab36f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:20.830563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:20.831412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:20.832029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:20.832468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] PATH_INFO: `/v3/users/70b21d05bc874d5d829b45593296582f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:20.835022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b21d05bc874d5d829b45593296582f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:20.848355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:20.994816 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:21.112102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b21d05bc874d5d829b45593296582f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:21.144353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b21d05bc874d5d829b45593296582f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:21.156778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b21d05bc874d5d829b45593296582f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:21.157939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b21d05bc874d5d829b45593296582f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:21.234850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b21d05bc874d5d829b45593296582f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:21.242401 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3177/6397] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:20 2022] DELETE /identity/v3/users/70b21d05bc874d5d829b45593296582f => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:21.247296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:21.247864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:21.248310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:21.286605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:21.287942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:21.397065 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3221/6398] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:21.410617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:21.412282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:21.551743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cda12-1479-4625-9ec5-758626e8c1bb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:21.556689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ddda-35ee-49b6-af36-268f20af3b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:21.559429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ddda-35ee-49b6-af36-268f20af3b1f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:21.559429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ddda-35ee-49b6-af36-268f20af3b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:21.559429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ddda-35ee-49b6-af36-268f20af3b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:21.578474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ddda-35ee-49b6-af36-268f20af3b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:21.580605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ddda-35ee-49b6-af36-268f20af3b1f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:21.596359 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3178/6399] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:22.363793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:22.365842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:22.386995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c82a-23af-4293-b671-ca47eac971cf None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:22.423679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:22.424639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:22.425741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:22.425906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] PATH_INFO: `/v3/projects/2c35eea901884257adf3cf80f005eb73` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:22.437792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c35eea901884257adf3cf80f005eb73)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:22.441875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:22.623591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c35eea901884257adf3cf80f005eb73', 'request_id': 'req-43a29b1b-c583-4db6-b031-deaaea25edb1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:22.642459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c35eea901884257adf3cf80f005eb73', 'request_id': 'req-43a29b1b-c583-4db6-b031-deaaea25edb1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:22.749264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c35eea901884257adf3cf80f005eb73', 'request_id': 'req-43a29b1b-c583-4db6-b031-deaaea25edb1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:22.770597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] The token cache is being invalidate because project 2c35eea901884257adf3cf80f005eb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:22.770894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:22.771578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-43a29b1b-c583-4db6-b031-deaaea25edb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:22.773138 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3222/6400] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:22 2022] DELETE /identity/v3/projects/2c35eea901884257adf3cf80f005eb73 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:22.778186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c99d9-8785-41b5-b79a-13a767640284 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:22.778763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c99d9-8785-41b5-b79a-13a767640284 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:22.778975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c99d9-8785-41b5-b79a-13a767640284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:22.817580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fa3c99d9-8785-41b5-b79a-13a767640284 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:22.819800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa3c99d9-8785-41b5-b79a-13a767640284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:22.904154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3179/6401] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:22.909648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94c56d-1fce-49de-91af-924c2378367a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:22.910299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94c56d-1fce-49de-91af-924c2378367a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:22.911836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94c56d-1fce-49de-91af-924c2378367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:22.943031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cf94c56d-1fce-49de-91af-924c2378367a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:22.947664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cf94c56d-1fce-49de-91af-924c2378367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:22.975349 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3223/6402] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:22.982909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c99d9-8785-41b5-b79a-13a767640284 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:23.000867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c99d9-8785-41b5-b79a-13a767640284 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:23.008385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:23.010419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.010419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.010419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.011732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:23.012392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:23.018159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:23.052690 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3180/6403] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:42:23.056800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94c56d-1fce-49de-91af-924c2378367a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:23.074618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94c56d-1fce-49de-91af-924c2378367a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:23.081078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd226b56-93ea-4e87-a416-95429e6ead0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:23.081705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226b56-93ea-4e87-a416-95429e6ead0b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.082033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226b56-93ea-4e87-a416-95429e6ead0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.082310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226b56-93ea-4e87-a416-95429e6ead0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.083154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd226b56-93ea-4e87-a416-95429e6ead0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:23.085439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd226b56-93ea-4e87-a416-95429e6ead0b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:23.189576 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3224/6404] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:23 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:23.196045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:23.217845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5f5b-c41a-4875-bb73-92b328351dd0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:23.259646 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:23.299134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:23.300948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.303720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.306824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.306824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:23.307511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:23.336472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b2047-0fd0-4ee9-be7b-fcb5730f038e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.339517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b2047-0fd0-4ee9-be7b-fcb5730f038e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.339517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b2047-0fd0-4ee9-be7b-fcb5730f038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.360704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0f9b2047-0fd0-4ee9-be7b-fcb5730f038e None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:23.363119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f9b2047-0fd0-4ee9-be7b-fcb5730f038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:23.399072 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:23.434533 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3181/6405] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:23 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:23.440188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:23.441692 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3225/6406] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:23.456419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d978e4c-f56e-4eda-b431-e23c3e4c887e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:23.461890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:23.470451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.470451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.470451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.470451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:23.470451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:23.489139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3182/6407] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:42:23.489683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b2047-0fd0-4ee9-be7b-fcb5730f038e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:23.502753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b2047-0fd0-4ee9-be7b-fcb5730f038e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:23.510542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab490e-d583-4175-9b94-d7dd9d9c59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:23.511178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab490e-d583-4175-9b94-d7dd9d9c59ae admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.511526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab490e-d583-4175-9b94-d7dd9d9c59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.511814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab490e-d583-4175-9b94-d7dd9d9c59ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.512470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab490e-d583-4175-9b94-d7dd9d9c59ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:23.526807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab490e-d583-4175-9b94-d7dd9d9c59ae admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:23.557977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3226/6408] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:42:23.562022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:23.576682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842ad36-524f-45c4-9a5a-e7bc73d13f44 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:23.587909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:23.602156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.602156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.602156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] PATH_INFO: `/v3/projects/4f61f728d4a44e64979f976c87af0d8c/users/800640bc3e764378ae79ae8416ed3430/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.612161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f61f728d4a44e64979f976c87af0d8c, user_id=800640bc3e764378ae79ae8416ed3430, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:23.615637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:23.691798 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3183/6409] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:23 2022] PUT /identity/v3/projects/4f61f728d4a44e64979f976c87af0d8c/users/800640bc3e764378ae79ae8416ed3430/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:23.702534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:23.702831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:23.703114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:23.764175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] MFA Rules not processed for user `800640bc3e764378ae79ae8416ed3430`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:23.769176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:23.945385 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3227/6410] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:23.975996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:23.980134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:24.112951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23684298-3d9d-42c1-9a6e-612f861bd991 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:24.117117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1e570-fb32-4365-b619-d8b234133430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:24.118131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e570-fb32-4365-b619-d8b234133430 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:24.118131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e570-fb32-4365-b619-d8b234133430 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:24.118405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1e570-fb32-4365-b619-d8b234133430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:24.178081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1e570-fb32-4365-b619-d8b234133430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:24.180540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1e570-fb32-4365-b619-d8b234133430 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:24.203581 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3184/6411] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:24.432828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:24.434934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:24.603912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba319c-daf6-4ee9-8bda-03f80c112348 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:24.616640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:24.616640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:24.616640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:24.616640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] PATH_INFO: `/v3/users/a10e9b4dd62644d7977ca515efedf294` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:24.617022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10e9b4dd62644d7977ca515efedf294)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:24.619003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:24.917034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10e9b4dd62644d7977ca515efedf294'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:24.920738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10e9b4dd62644d7977ca515efedf294'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.041091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10e9b4dd62644d7977ca515efedf294'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.049377 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:25.053028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10e9b4dd62644d7977ca515efedf294'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.054031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10e9b4dd62644d7977ca515efedf294'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.081895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3228/6412] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:24 2022] DELETE /identity/v3/users/a10e9b4dd62644d7977ca515efedf294 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:25.086316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:25.087201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:25.087716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:25.111604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:25.113170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:25.208635 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3185/6413] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:25.209096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:25.209849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:25.303428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403aa86-6ffa-470f-a0d8-fbf56433bb34 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:25.307441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:25.308268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:25.308616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:25.309007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:25.322457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:25.324589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:25.340232 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3229/6414] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:25.610601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:25.617016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:25.646323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480abf9-de94-4d09-b264-074bac522ad1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:25.654077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:25.655739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:25.656032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:25.656312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] PATH_INFO: `/v3/projects/3b47c2f81bc249fd9b98d78d8994083f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:25.657484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b47c2f81bc249fd9b98d78d8994083f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:25.659790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:25.777565 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:25.809197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b47c2f81bc249fd9b98d78d8994083f', 'request_id': 'req-b195c733-0483-45c3-b1f4-914bbba14af8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.817619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b47c2f81bc249fd9b98d78d8994083f', 'request_id': 'req-b195c733-0483-45c3-b1f4-914bbba14af8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.911655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b47c2f81bc249fd9b98d78d8994083f', 'request_id': 'req-b195c733-0483-45c3-b1f4-914bbba14af8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.931507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] The token cache is being invalidate because project 3b47c2f81bc249fd9b98d78d8994083f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:25.931807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.933515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:25.937216 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3186/6415] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:25 2022] DELETE /identity/v3/projects/3b47c2f81bc249fd9b98d78d8994083f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:25.941157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:25.954098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b35b07-1adf-4c72-a61a-14333864b5d1 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:26.088985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:26.091026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:26.092300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:26.093380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] PATH_INFO: `/v3/users/d35c0a807d1c4ee8999afac89d5ea93c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:26.096707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35c0a807d1c4ee8999afac89d5ea93c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:26.099455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:26.522014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35c0a807d1c4ee8999afac89d5ea93c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:26.522705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35c0a807d1c4ee8999afac89d5ea93c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:26.628432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35c0a807d1c4ee8999afac89d5ea93c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:26.639421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35c0a807d1c4ee8999afac89d5ea93c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:26.640405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-86d2815f-7605-4a79-b099-515c59317b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35c0a807d1c4ee8999afac89d5ea93c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:26.665284 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3230/6416] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:25 2022] DELETE /identity/v3/users/d35c0a807d1c4ee8999afac89d5ea93c => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:26.988317 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:27.073184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:27.074692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:27.092584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195c733-0483-45c3-b1f4-914bbba14af8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:27.217115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:27.217956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:27.218927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:27.219221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] PATH_INFO: `/v3/projects/16d6ba673d564f8e8cd787c65de83076` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:27.222648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d6ba673d564f8e8cd787c65de83076)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:27.225058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:27.450147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d6ba673d564f8e8cd787c65de83076', 'request_id': 'req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:27.457178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d6ba673d564f8e8cd787c65de83076', 'request_id': 'req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:27.516337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d6ba673d564f8e8cd787c65de83076', 'request_id': 'req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:27.539979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] The token cache is being invalidate because project 16d6ba673d564f8e8cd787c65de83076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:27.541442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:27.543107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bfe0e48-cf33-4a76-9dc7-4aaa2af5f9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:27.546782 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3187/6417] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:27 2022] DELETE /identity/v3/projects/16d6ba673d564f8e8cd787c65de83076 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:27.570230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26000-6a2c-4b14-aaf6-716a86e7cb68 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:27.570230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26000-6a2c-4b14-aaf6-716a86e7cb68 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:27.570230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26000-6a2c-4b14-aaf6-716a86e7cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:27.584772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a1a79-2848-472a-b800-1480b889e455 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:27.585071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a1a79-2848-472a-b800-1480b889e455 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:27.585342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a1a79-2848-472a-b800-1480b889e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:27.610632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b3e26000-6a2c-4b14-aaf6-716a86e7cb68 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:27.612970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b3e26000-6a2c-4b14-aaf6-716a86e7cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:27.628092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-817a1a79-2848-472a-b800-1480b889e455 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:27.630314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-817a1a79-2848-472a-b800-1480b889e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:27.762040 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3231/6418] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:27.769225 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:27.771140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746695-17a6-493b-a53f-718245da4176 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:27.775694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746695-17a6-493b-a53f-718245da4176 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:27.776197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746695-17a6-493b-a53f-718245da4176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:27.823428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4f746695-17a6-493b-a53f-718245da4176 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:27.828593 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3188/6419] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:27.830881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f746695-17a6-493b-a53f-718245da4176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:27.847369 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3232/6420] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:27.848454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a1a79-2848-472a-b800-1480b889e455 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:27.861948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a1a79-2848-472a-b800-1480b889e455 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:27.876566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:27.879052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:27.880139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:27.881401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:27.883371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:27.884300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:27.890021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:27.909992 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3189/6421] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:42:27.914136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f746695-17a6-493b-a53f-718245da4176 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:27.930225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f746695-17a6-493b-a53f-718245da4176 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:27.947149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:27.949770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:27.951904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:27.952725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:27.953476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:27.958432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:28.141224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:28.141989 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3233/6422] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:27 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:28.167416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c88770-0f6b-418d-9e3b-c6eb81a26ffd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:28.363947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:28.364591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:28.364869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:28.365138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:28.365778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:28.369701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:28.505385 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3190/6423] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:28 2022] POST /identity/v3/users => generated 287 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:42:28.505490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:28.520583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2d1bd-edfa-4f08-95c3-d843fc64958c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:28.527705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:28.528387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:28.528670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:28.529441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:28.529740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:28.532380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:28.553713 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3234/6424] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:28.554011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:28.568091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb7cf5-8258-4bc0-9ecf-b001cbc1bbcc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:28.574329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffd2d5-4adc-4e9f-b9f3-9aa003bc52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:28.575007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffd2d5-4adc-4e9f-b9f3-9aa003bc52f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:28.575300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffd2d5-4adc-4e9f-b9f3-9aa003bc52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:28.575619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffd2d5-4adc-4e9f-b9f3-9aa003bc52f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:28.576546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffd2d5-4adc-4e9f-b9f3-9aa003bc52f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:28.578635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffd2d5-4adc-4e9f-b9f3-9aa003bc52f6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:28.592591 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3191/6425] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:42:28.597532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:28.613184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaef85-4707-4490-a212-df3d165377a0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:28.622052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:28.623020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:28.623305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:28.626990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] PATH_INFO: `/v3/projects/dbc3b189b40b47ebac5a219e32c23e62/users/edf322faeb694aec9a4ecd160f7c4e02/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:28.644146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc3b189b40b47ebac5a219e32c23e62, user_id=edf322faeb694aec9a4ecd160f7c4e02, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:28.647023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:28.751946 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3235/6426] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:28 2022] PUT /identity/v3/projects/dbc3b189b40b47ebac5a219e32c23e62/users/edf322faeb694aec9a4ecd160f7c4e02/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:28.752745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dafeb1-ed1c-4df8-a6e6-61d099771f2b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:28.753034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dafeb1-ed1c-4df8-a6e6-61d099771f2b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:28.753316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dafeb1-ed1c-4df8-a6e6-61d099771f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:28.785252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a5dafeb1-ed1c-4df8-a6e6-61d099771f2b None None] MFA Rules not processed for user `edf322faeb694aec9a4ecd160f7c4e02`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:28.786813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a5dafeb1-ed1c-4df8-a6e6-61d099771f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:28.891057 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3192/6427] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:28.895462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:28.986536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8496-9533-42dd-b8ca-3ec044d2c28a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:28.992092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:28.992738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:28.993096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:28.993447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:28.994220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:28.997569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:29.092609 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3236/6428] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:28 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:29.097130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dafeb1-ed1c-4df8-a6e6-61d099771f2b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:29.120165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dafeb1-ed1c-4df8-a6e6-61d099771f2b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:29.211870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:29.213709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:29.214974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:29.216720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:29.219386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:29.221987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:29.343077 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3193/6429] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:29 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:29.343456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:29.363693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebbef8-c493-45c8-af9e-fbd2c908820d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:29.364567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:29.365174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:29.365460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:29.365752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:29.366814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:29.370258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:29.386130 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3237/6430] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:29.388688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:29.412006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31bb49-f2a3-4fdc-9b93-f6b530ae79b7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:29.420787 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:29.450545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:29.454608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:29.455331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:29.457545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] PATH_INFO: `/v3/projects/bef2d4691d4f44bb88d3b04313b44e78/users/616c13a583d447d3aa7c8f9f008a1ade/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:29.496579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef2d4691d4f44bb88d3b04313b44e78, user_id=616c13a583d447d3aa7c8f9f008a1ade, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:29.507905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:29.749528 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3194/6431] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:29 2022] PUT /identity/v3/projects/bef2d4691d4f44bb88d3b04313b44e78/users/616c13a583d447d3aa7c8f9f008a1ade/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:29.753830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:29.772057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896e9e5-ed35-49b3-a034-ee8fdae5a050 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:29.800418 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:29.900050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08639b0f-6163-461b-b502-93c77ac032d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:29.900809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08639b0f-6163-461b-b502-93c77ac032d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:29.904413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08639b0f-6163-461b-b502-93c77ac032d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:29.905177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08639b0f-6163-461b-b502-93c77ac032d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:29.905753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08639b0f-6163-461b-b502-93c77ac032d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:29.908242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08639b0f-6163-461b-b502-93c77ac032d7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:29.944108 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3238/6432] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:42:29.949302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:29.963827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eca4d-13ed-4bdd-a157-8ce2db0ee6ac admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:29.972170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:29.972978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:29.973408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:29.973771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] PATH_INFO: `/v3/projects/bef2d4691d4f44bb88d3b04313b44e78/users/616c13a583d447d3aa7c8f9f008a1ade/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:29.976077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef2d4691d4f44bb88d3b04313b44e78, user_id=616c13a583d447d3aa7c8f9f008a1ade, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:29.983458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:29.999770 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3195/6433] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:29 2022] PUT /identity/v3/projects/bef2d4691d4f44bb88d3b04313b44e78/users/616c13a583d447d3aa7c8f9f008a1ade/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:30.010587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667f707-521a-4183-868c-9511647f7057 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:30.011936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667f707-521a-4183-868c-9511647f7057 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:30.014755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667f707-521a-4183-868c-9511647f7057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:30.082945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d667f707-521a-4183-868c-9511647f7057 None None] MFA Rules not processed for user `616c13a583d447d3aa7c8f9f008a1ade`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:30.085382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d667f707-521a-4183-868c-9511647f7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:30.242066 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3239/6434] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:30.246639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:30.261950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477f7b-6bcf-491e-a141-b2144fdc4041 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:30.270203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616c13a583d447d3aa7c8f9f008a1ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bef2d4691d4f44bb88d3b04313b44e78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:30.270841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:30.271128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:30.271469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:30.272270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:30.272584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:30.274447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:30.294176 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3196/6435] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:42:30.299045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667f707-521a-4183-868c-9511647f7057 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:30.314040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667f707-521a-4183-868c-9511647f7057 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:30.322149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616c13a583d447d3aa7c8f9f008a1ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bef2d4691d4f44bb88d3b04313b44e78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:30.326572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:30.326572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:30.326572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:30.326572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:30.329078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:30.444872 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3240/6436] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:30 2022] POST /identity/v3/projects => generated 349 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:30.446033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:30.456568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585212-761c-4060-9336-9081344e6ff9 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:30.542458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb981b-0375-43bb-a909-a45832dbb642 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616c13a583d447d3aa7c8f9f008a1ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bef2d4691d4f44bb88d3b04313b44e78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:30.548682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb981b-0375-43bb-a909-a45832dbb642 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:30.548682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb981b-0375-43bb-a909-a45832dbb642 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:30.548682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb981b-0375-43bb-a909-a45832dbb642 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:30.548682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb981b-0375-43bb-a909-a45832dbb642 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:30.548682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb981b-0375-43bb-a909-a45832dbb642 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:30.552286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb981b-0375-43bb-a909-a45832dbb642 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:30.594652 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3197/6437] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:42:30.602633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:30.605002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:30.718108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcfeb-319b-45ff-bcfc-a964db8a94e0 tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:30.722102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8bccc-2dcf-495d-957f-d75e13079103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:30.722928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8bccc-2dcf-495d-957f-d75e13079103 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:30.723313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8bccc-2dcf-495d-957f-d75e13079103 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:30.723708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8bccc-2dcf-495d-957f-d75e13079103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:30.736758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8bccc-2dcf-495d-957f-d75e13079103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:30.738657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8bccc-2dcf-495d-957f-d75e13079103 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:30.751330 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3241/6438] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:31.744498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ab5e5-e00f-480f-a28b-e5f39d978d64 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:31.745046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ab5e5-e00f-480f-a28b-e5f39d978d64 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:31.745046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ab5e5-e00f-480f-a28b-e5f39d978d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:31.806397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2f8ab5e5-e00f-480f-a28b-e5f39d978d64 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:31.807573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2f8ab5e5-e00f-480f-a28b-e5f39d978d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:31.950457 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3198/6439] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:32.926054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08d41-e936-4362-ba45-ca5a8065303c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:32.926054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08d41-e936-4362-ba45-ca5a8065303c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:32.927544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08d41-e936-4362-ba45-ca5a8065303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:32.983472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5be08d41-e936-4362-ba45-ca5a8065303c None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:32.987740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5be08d41-e936-4362-ba45-ca5a8065303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:32.997888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3242/6440] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:33.924185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4af6-5565-4c81-a1a0-10aee908d887 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:33.924687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4af6-5565-4c81-a1a0-10aee908d887 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:33.924783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4af6-5565-4c81-a1a0-10aee908d887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:33.947995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b6ba4af6-5565-4c81-a1a0-10aee908d887 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:33.953712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b6ba4af6-5565-4c81-a1a0-10aee908d887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:33.976569 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3199/6441] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:34.733783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5621-94cf-4b1f-8fc5-278cbf56591d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:34.735170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5621-94cf-4b1f-8fc5-278cbf56591d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:34.735779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5621-94cf-4b1f-8fc5-278cbf56591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:34.757255 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:34.779211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-07df5621-94cf-4b1f-8fc5-278cbf56591d None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:34.781320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-07df5621-94cf-4b1f-8fc5-278cbf56591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:34.792480 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3243/6442] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:35.525637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4af6-5565-4c81-a1a0-10aee908d887 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:35.547908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4af6-5565-4c81-a1a0-10aee908d887 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:35.563366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '616c13a583d447d3aa7c8f9f008a1ade', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bef2d4691d4f44bb88d3b04313b44e78', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:35.564126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:35.564339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:35.564617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] PATH_INFO: `/v3/projects/4685ed2e1f8a490eb2016377cb73915d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:35.566252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4685ed2e1f8a490eb2016377cb73915d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:35.571022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:35.600279 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:35.673112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f7ba-98b1-4ce6-9dd0-cda2156f80fa None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:35.673400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f7ba-98b1-4ce6-9dd0-cda2156f80fa None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:35.673686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30f7ba-98b1-4ce6-9dd0-cda2156f80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:35.742008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9c30f7ba-98b1-4ce6-9dd0-cda2156f80fa None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:35.747281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9c30f7ba-98b1-4ce6-9dd0-cda2156f80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:35.779928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4685ed2e1f8a490eb2016377cb73915d', 'request_id': 'req-8c672673-9b33-44f8-9f8a-07982746c00c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:35.797248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4685ed2e1f8a490eb2016377cb73915d', 'request_id': 'req-8c672673-9b33-44f8-9f8a-07982746c00c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:35.854318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3244/6443] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:35.902300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4685ed2e1f8a490eb2016377cb73915d', 'request_id': 'req-8c672673-9b33-44f8-9f8a-07982746c00c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:35.924768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] The token cache is being invalidate because project 4685ed2e1f8a490eb2016377cb73915d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:35.925069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:35.929268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:35.937196 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3200/6444] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:35 2022] DELETE /identity/v3/projects/4685ed2e1f8a490eb2016377cb73915d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:35.943072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30f7ba-98b1-4ce6-9dd0-cda2156f80fa None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:36.040739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30f7ba-98b1-4ce6-9dd0-cda2156f80fa None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:36.048208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:36.051205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:36.051205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:36.051205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] PATH_INFO: `/v3/users/edf322faeb694aec9a4ecd160f7c4e02` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:36.051757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf322faeb694aec9a4ecd160f7c4e02)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:36.055723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:36.339494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf322faeb694aec9a4ecd160f7c4e02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:36.341615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf322faeb694aec9a4ecd160f7c4e02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:36.363825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:36.365764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:36.411385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf322faeb694aec9a4ecd160f7c4e02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:36.433257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf322faeb694aec9a4ecd160f7c4e02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:36.434038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f56a7d58-095e-445a-853d-37a5c79bd533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf322faeb694aec9a4ecd160f7c4e02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:36.456882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672673-9b33-44f8-9f8a-07982746c00c tempest-QuotasNegativeTest-966442946 tempest-QuotasNegativeTest-966442946-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:36.461113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3245/6445] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:35 2022] DELETE /identity/v3/users/edf322faeb694aec9a4ecd160f7c4e02 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:36.466002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:36.469522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:36.469844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:36.496310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:36.498452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:36.516962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e6eac-8561-4ba1-9975-f43c74b2cd74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:36.517593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6eac-8561-4ba1-9975-f43c74b2cd74 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:36.518567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6eac-8561-4ba1-9975-f43c74b2cd74 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:36.518567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6eac-8561-4ba1-9975-f43c74b2cd74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:36.520265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-853e6eac-8561-4ba1-9975-f43c74b2cd74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:36.574527 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:36.654635 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:36.660426 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3246/6446] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:36.661031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e6eac-8561-4ba1-9975-f43c74b2cd74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:36.662886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e6eac-8561-4ba1-9975-f43c74b2cd74 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:36.671876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:36.673656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:36.701783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b6ecb-26b0-47c1-95ef-1e2a03689bc9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:36.702907 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3201/6447] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:42:36.706188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:36.707047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:36.707494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:36.707920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:36.721166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:36.722995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:36.736972 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3247/6448] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:42:36.899615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2bb5-5b0f-45a6-a749-2e371532ac25 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:36.899907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2bb5-5b0f-45a6-a749-2e371532ac25 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:36.900448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2bb5-5b0f-45a6-a749-2e371532ac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:36.923875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3ebb2bb5-5b0f-45a6-a749-2e371532ac25 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:36.925343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3ebb2bb5-5b0f-45a6-a749-2e371532ac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:36.990408 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3202/6449] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:37.545020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:37.547069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:37.562645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbffd-0912-48d0-8818-bde5e5d9aeb7 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:37.568639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:37.572965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:37.572965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:37.572965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] PATH_INFO: `/v3/projects/dbc3b189b40b47ebac5a219e32c23e62` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:37.572965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc3b189b40b47ebac5a219e32c23e62)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:37.574366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:37.658715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f034-b58d-43d7-9728-696101788a40 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:37.659524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f034-b58d-43d7-9728-696101788a40 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:37.659524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f034-b58d-43d7-9728-696101788a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:37.690195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc3b189b40b47ebac5a219e32c23e62', 'request_id': 'req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:37.693655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2b78f034-b58d-43d7-9728-696101788a40 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:37.695133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2b78f034-b58d-43d7-9728-696101788a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:37.698290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc3b189b40b47ebac5a219e32c23e62', 'request_id': 'req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:37.766641 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3203/6450] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:37.801462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc3b189b40b47ebac5a219e32c23e62', 'request_id': 'req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:37.814750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] The token cache is being invalidate because project dbc3b189b40b47ebac5a219e32c23e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:37.815344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:37.816184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7c01a861-dfe6-4b19-909e-2a8c2c8a80a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:37.818759 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3248/6451] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:37 2022] DELETE /identity/v3/projects/dbc3b189b40b47ebac5a219e32c23e62 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:37.822829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f034-b58d-43d7-9728-696101788a40 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:37.976019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f034-b58d-43d7-9728-696101788a40 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:37.991543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:37.992441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:37.992948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:37.993121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] PATH_INFO: `/v3/users/616c13a583d447d3aa7c8f9f008a1ade` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:37.994407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616c13a583d447d3aa7c8f9f008a1ade)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:37.998617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:38.227738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616c13a583d447d3aa7c8f9f008a1ade'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:38.229408 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:38.268282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616c13a583d447d3aa7c8f9f008a1ade'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:38.289449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616c13a583d447d3aa7c8f9f008a1ade'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:38.291199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616c13a583d447d3aa7c8f9f008a1ade'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:38.396551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616c13a583d447d3aa7c8f9f008a1ade'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:38.414603 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3204/6452] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:37 2022] DELETE /identity/v3/users/616c13a583d447d3aa7c8f9f008a1ade => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:42:38.893864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf7d2-9e6f-42c9-a6de-910c3d51cdd4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:38.895237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf7d2-9e6f-42c9-a6de-910c3d51cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:38.895726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf7d2-9e6f-42c9-a6de-910c3d51cdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:38.917536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7c2cf7d2-9e6f-42c9-a6de-910c3d51cdd4 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:38.919699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c2cf7d2-9e6f-42c9-a6de-910c3d51cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:39.039050 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3249/6453] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:39.171405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:39.174129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:39.285133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecd2ef-f9b8-4ecf-b2a9-edfea3ac8698 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:39.289947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:39.290598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:39.290888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:39.291168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] PATH_INFO: `/v3/projects/bef2d4691d4f44bb88d3b04313b44e78` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:39.292373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef2d4691d4f44bb88d3b04313b44e78)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:39.294462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:39.448560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef2d4691d4f44bb88d3b04313b44e78', 'request_id': 'req-20107f96-9b90-4584-aacd-436837f41a4a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:39.458039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef2d4691d4f44bb88d3b04313b44e78', 'request_id': 'req-20107f96-9b90-4584-aacd-436837f41a4a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:39.532660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef2d4691d4f44bb88d3b04313b44e78', 'request_id': 'req-20107f96-9b90-4584-aacd-436837f41a4a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:39.558976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] The token cache is being invalidate because project bef2d4691d4f44bb88d3b04313b44e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:39.559368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:39.563734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:39.563734 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3205/6454] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:39 2022] DELETE /identity/v3/projects/bef2d4691d4f44bb88d3b04313b44e78 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:39.566921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b2aab-52c9-441e-9271-25501bb78267 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:39.567216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b2aab-52c9-441e-9271-25501bb78267 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:39.567493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b2aab-52c9-441e-9271-25501bb78267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:39.586555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:39.588385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:39.598251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-816b2aab-52c9-441e-9271-25501bb78267 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:39.599654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-816b2aab-52c9-441e-9271-25501bb78267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:39.644755 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:39.690633 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3250/6455] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:39.692384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787f6f0-e653-48d7-8917-293a6b419501 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:39.692854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787f6f0-e653-48d7-8917-293a6b419501 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:39.693623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787f6f0-e653-48d7-8917-293a6b419501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:39.718258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20107f96-9b90-4584-aacd-436837f41a4a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:39.730359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:39.731257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:39.731825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:39.732111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:39.733781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0787f6f0-e653-48d7-8917-293a6b419501 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:39.735382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0787f6f0-e653-48d7-8917-293a6b419501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:39.736994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:39.750110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3251/6456] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:39.752497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787f6f0-e653-48d7-8917-293a6b419501 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:39.767267 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:39.767909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787f6f0-e653-48d7-8917-293a6b419501 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:39.780195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:39.781562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:39.782895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:39.784495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:39.785234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:39.785539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:39.787779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:39.817346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3252/6457] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:42:39.817346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:39.819651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:39.885139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:39.890353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:39.933725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396d616-e8d6-4d8a-accb-71b703611797 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:39.938589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3206/6458] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:42:39.939517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:39.940022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:39.940581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:39.941066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:39.941733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:39.954374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:39.956252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:39.967581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bd331-0466-4526-9f4c-3c3c3350eef4 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:39.968920 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3253/6459] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:39.979708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:39.980659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:39.981693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:39.983058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:39.987320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:39.987320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:40.099136 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3207/6460] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:39 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:40.100696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:40.119251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a643ac-602b-4753-bf26-27364a01d7ea service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:40.274704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:40.275360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:40.275646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:40.275926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:40.279007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:40.281728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:40.367611 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3254/6461] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:40 2022] POST /identity/v3/users => generated 282 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:40.369661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:40.381964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a19af2-8fcf-4c8c-aa4d-c46a0f32a3b7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:40.387994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:40.388631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:40.388914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:40.409467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:40.409467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:40.409467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:40.438273 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3208/6462] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:40.438376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:40.438461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ffe3-42a9-4052-b00a-9da6cb2527f8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:40.458419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174708-d294-479a-8bf2-7cd1dc47f195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:40.458419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174708-d294-479a-8bf2-7cd1dc47f195 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:40.462694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174708-d294-479a-8bf2-7cd1dc47f195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:40.462694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174708-d294-479a-8bf2-7cd1dc47f195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:40.462694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b174708-d294-479a-8bf2-7cd1dc47f195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:40.473776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b174708-d294-479a-8bf2-7cd1dc47f195 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:40.506326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3255/6463] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:42:40.507708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:40.525103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9efc7-9c38-42f1-9bb0-a4dd747d1975 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:40.536255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:40.537083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:40.537364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:40.537638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] PATH_INFO: `/v3/projects/6f952bddff13485e9007a8a7c808f448/users/8d2f4e94c99440c9a9429f9720e6dafb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:40.571347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f952bddff13485e9007a8a7c808f448, user_id=8d2f4e94c99440c9a9429f9720e6dafb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:40.574701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:40.661888 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3209/6464] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:40 2022] PUT /identity/v3/projects/6f952bddff13485e9007a8a7c808f448/users/8d2f4e94c99440c9a9429f9720e6dafb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:40.677436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011381f-92f1-4dbc-b6c4-097234441c5b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:40.677436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011381f-92f1-4dbc-b6c4-097234441c5b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:40.677436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011381f-92f1-4dbc-b6c4-097234441c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:40.709460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c011381f-92f1-4dbc-b6c4-097234441c5b None None] MFA Rules not processed for user `8d2f4e94c99440c9a9429f9720e6dafb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:40.711555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c011381f-92f1-4dbc-b6c4-097234441c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:40.817518 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:40.870924 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3256/6465] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:40.876139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:41.040020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606627da-65fc-4b22-9b9a-5ea883862b11 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:41.046620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:41.047507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:41.047981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:41.048450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:41.049280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:41.054838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:41.171696 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3210/6466] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:40 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:41.172556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011381f-92f1-4dbc-b6c4-097234441c5b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:41.192970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011381f-92f1-4dbc-b6c4-097234441c5b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:41.333162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:41.333818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:41.334235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:41.334465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:41.335117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:41.340950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:41.463383 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3257/6467] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:41 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:42:41.467914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:41.479297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4fc1d-7602-47f3-9040-58303998fe98 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:41.491348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:41.491976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:41.492255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:41.492526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:41.493454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:41.496394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:41.530099 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3211/6468] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:41.537317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:41.561118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab409-56d5-451a-93e2-7df8489ab195 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:41.567894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:41.568595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:41.568946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:41.569163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] PATH_INFO: `/v3/projects/4db190b2cb2e425bad8e9f8f63809298/users/e83d60d73bfc4b88aa0fb52c3b6d6f6c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:41.616643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db190b2cb2e425bad8e9f8f63809298, user_id=e83d60d73bfc4b88aa0fb52c3b6d6f6c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:41.621423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:41.742211 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3258/6469] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:41 2022] PUT /identity/v3/projects/4db190b2cb2e425bad8e9f8f63809298/users/e83d60d73bfc4b88aa0fb52c3b6d6f6c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:41.746978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:41.770566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde605-e99c-4df9-bcf5-6af992ce9da6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:41.840961 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:41.942128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:41.943162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:41.943692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:41.944179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:41.945044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:41.946966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:41.963055 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3212/6470] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:41.967112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:41.986515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:41.988533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe01d-d614-4bfa-b3c6-84862b5532b6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:41.989730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:41.996290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb16b94-9984-420a-90f9-957aa162d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:41.996290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16b94-9984-420a-90f9-957aa162d22a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:41.996290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16b94-9984-420a-90f9-957aa162d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:41.996290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb16b94-9984-420a-90f9-957aa162d22a admin admin] PATH_INFO: `/v3/projects/4db190b2cb2e425bad8e9f8f63809298/users/e83d60d73bfc4b88aa0fb52c3b6d6f6c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:42.000123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb16b94-9984-420a-90f9-957aa162d22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db190b2cb2e425bad8e9f8f63809298, user_id=e83d60d73bfc4b88aa0fb52c3b6d6f6c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:42.011228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb16b94-9984-420a-90f9-957aa162d22a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:42.037217 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3259/6471] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:41 2022] PUT /identity/v3/projects/4db190b2cb2e425bad8e9f8f63809298/users/e83d60d73bfc4b88aa0fb52c3b6d6f6c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:42.048756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad950-e830-4f5e-a601-195b10111cea None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:42.049088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad950-e830-4f5e-a601-195b10111cea None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:42.049314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad950-e830-4f5e-a601-195b10111cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:42.108909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-664ad950-e830-4f5e-a601-195b10111cea None None] MFA Rules not processed for user `e83d60d73bfc4b88aa0fb52c3b6d6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:42.110362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-664ad950-e830-4f5e-a601-195b10111cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:42.124288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557a627-d293-4dc9-9bc6-a6161396cc6b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:42.238866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540e20a-7f2e-4c52-90a4-2bfb566e1259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:42.242539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e20a-7f2e-4c52-90a4-2bfb566e1259 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:42.244242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e20a-7f2e-4c52-90a4-2bfb566e1259 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:42.245878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e20a-7f2e-4c52-90a4-2bfb566e1259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:42.252864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d540e20a-7f2e-4c52-90a4-2bfb566e1259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:42.314251 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3260/6472] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:42.323095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad950-e830-4f5e-a601-195b10111cea None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:42.326164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-664ad950-e830-4f5e-a601-195b10111cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:42.350939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad950-e830-4f5e-a601-195b10111cea None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:42.355504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c45b-7988-4264-aa34-2423e5d36301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:42.356628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c45b-7988-4264-aa34-2423e5d36301 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:42.357136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c45b-7988-4264-aa34-2423e5d36301 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:42.357532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c45b-7988-4264-aa34-2423e5d36301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:42.364687 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:42.370091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8c45b-7988-4264-aa34-2423e5d36301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:42.372433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8c45b-7988-4264-aa34-2423e5d36301 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:42.396483 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3261/6473] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:42.479753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540e20a-7f2e-4c52-90a4-2bfb566e1259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:42.481488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540e20a-7f2e-4c52-90a4-2bfb566e1259 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:42.511507 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3213/6474] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:42:45.604913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347bf4-b44f-4405-a65b-632eefe241a9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:45.605457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347bf4-b44f-4405-a65b-632eefe241a9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:45.605558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347bf4-b44f-4405-a65b-632eefe241a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:45.657204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b5347bf4-b44f-4405-a65b-632eefe241a9 None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:45.662822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b5347bf4-b44f-4405-a65b-632eefe241a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:45.845327 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3262/6475] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:46.938572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0691-01e8-4aba-a9b2-c4bd253e488f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:46.940091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0691-01e8-4aba-a9b2-c4bd253e488f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:46.940915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0691-01e8-4aba-a9b2-c4bd253e488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:46.970659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3c2b0691-01e8-4aba-a9b2-c4bd253e488f None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:46.972540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c2b0691-01e8-4aba-a9b2-c4bd253e488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:46.990776 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3214/6476] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:47.166751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5347bf4-b44f-4405-a65b-632eefe241a9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:47.182094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5347bf4-b44f-4405-a65b-632eefe241a9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:47.187173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6b609-8e02-48b8-b284-c7413b74bc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:47.188020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b609-8e02-48b8-b284-c7413b74bc43 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:47.188465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b609-8e02-48b8-b284-c7413b74bc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:47.189480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b609-8e02-48b8-b284-c7413b74bc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:47.338343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6b609-8e02-48b8-b284-c7413b74bc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:47.340952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6b609-8e02-48b8-b284-c7413b74bc43 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:47.367601 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3263/6477] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:49.377541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b0691-01e8-4aba-a9b2-c4bd253e488f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:49.383952 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:49.487926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b0691-01e8-4aba-a9b2-c4bd253e488f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:49.493555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:49.494991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:49.494991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:49.494991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] PATH_INFO: `/v3/users/8d2f4e94c99440c9a9429f9720e6dafb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:49.495984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2f4e94c99440c9a9429f9720e6dafb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:49.498636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:49.702471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2f4e94c99440c9a9429f9720e6dafb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.728839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2f4e94c99440c9a9429f9720e6dafb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.739277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2f4e94c99440c9a9429f9720e6dafb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.740329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2f4e94c99440c9a9429f9720e6dafb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.893202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2f4e94c99440c9a9429f9720e6dafb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.901324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3215/6478] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:49 2022] DELETE /identity/v3/users/8d2f4e94c99440c9a9429f9720e6dafb => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:49.906353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:49.906889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:49.907360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:49.937619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:49.940964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:50.062736 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3264/6479] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:50.124624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.126626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:50.281204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab36f2-f845-443f-8886-6b25dff3fbb0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.285587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.286549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.289728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.290420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.302091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.303917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.326393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3216/6480] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:50.915163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.916654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:50.936400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec728b-dfda-421a-9721-157e6f0f77a5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.945445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.946667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.947053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.947434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] PATH_INFO: `/v3/projects/6f952bddff13485e9007a8a7c808f448` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.949304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f952bddff13485e9007a8a7c808f448)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.953312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:51.156757 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:51.187826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f952bddff13485e9007a8a7c808f448', 'request_id': 'req-92aff0da-bb63-446b-ab12-f0bfe76c1d64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.195649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f952bddff13485e9007a8a7c808f448', 'request_id': 'req-92aff0da-bb63-446b-ab12-f0bfe76c1d64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.336358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f952bddff13485e9007a8a7c808f448', 'request_id': 'req-92aff0da-bb63-446b-ab12-f0bfe76c1d64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.349214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] The token cache is being invalidate because project 6f952bddff13485e9007a8a7c808f448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:51.349705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.351019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.356392 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3265/6481] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:50 2022] DELETE /identity/v3/projects/6f952bddff13485e9007a8a7c808f448 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:51.357515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:51.368119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305a6ab-1596-4073-93f0-16a2b43d6a6d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:51.401147 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:51.461080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:51.461728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:51.462042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:51.462319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] PATH_INFO: `/v3/users/e83d60d73bfc4b88aa0fb52c3b6d6f6c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:51.463721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83d60d73bfc4b88aa0fb52c3b6d6f6c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:51.466451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:51.735422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83d60d73bfc4b88aa0fb52c3b6d6f6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.751461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83d60d73bfc4b88aa0fb52c3b6d6f6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.760961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83d60d73bfc4b88aa0fb52c3b6d6f6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.761741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83d60d73bfc4b88aa0fb52c3b6d6f6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.913366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-83065528-f566-4fbe-9a93-dc6d1541eb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83d60d73bfc4b88aa0fb52c3b6d6f6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:51.920829 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3217/6482] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:51 2022] DELETE /identity/v3/users/e83d60d73bfc4b88aa0fb52c3b6d6f6c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:52.720643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:52.722108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:52.770435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aff0da-bb63-446b-ab12-f0bfe76c1d64 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:52.937619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:52.938231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:52.938520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:52.938797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] PATH_INFO: `/v3/projects/4db190b2cb2e425bad8e9f8f63809298` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:52.940816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db190b2cb2e425bad8e9f8f63809298)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:52.947889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:53.236105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db190b2cb2e425bad8e9f8f63809298', 'request_id': 'req-96ce283c-08a2-4da4-8ac0-79fd143f048c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:53.251572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db190b2cb2e425bad8e9f8f63809298', 'request_id': 'req-96ce283c-08a2-4da4-8ac0-79fd143f048c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:53.390338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db190b2cb2e425bad8e9f8f63809298', 'request_id': 'req-96ce283c-08a2-4da4-8ac0-79fd143f048c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:53.403634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] The token cache is being invalidate because project 4db190b2cb2e425bad8e9f8f63809298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:53.404300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:53.405421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-96ce283c-08a2-4da4-8ac0-79fd143f048c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:53.407511 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3266/6483] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:52 2022] DELETE /identity/v3/projects/4db190b2cb2e425bad8e9f8f63809298 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:53.413067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bbe9-984d-43fd-b1a5-486a1473aacb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:53.413574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bbe9-984d-43fd-b1a5-486a1473aacb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:53.413663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bbe9-984d-43fd-b1a5-486a1473aacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:53.492961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c783bbe9-984d-43fd-b1a5-486a1473aacb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:53.510079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c783bbe9-984d-43fd-b1a5-486a1473aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:53.625575 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3218/6484] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:53.627743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3804-eea7-4282-bfad-412d38912750 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:53.628084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3804-eea7-4282-bfad-412d38912750 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:53.628367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3804-eea7-4282-bfad-412d38912750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:53.663396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-475c3804-eea7-4282-bfad-412d38912750 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:53.665454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-475c3804-eea7-4282-bfad-412d38912750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:53.686011 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3267/6485] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:53.690763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bbe9-984d-43fd-b1a5-486a1473aacb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:53.712726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bbe9-984d-43fd-b1a5-486a1473aacb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:53.731576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:53.732535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:53.732828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:53.734059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:53.738387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:53.738714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:53.744682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:53.807778 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3219/6486] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:42:53.813153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3804-eea7-4282-bfad-412d38912750 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:53.829273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3804-eea7-4282-bfad-412d38912750 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:53.844660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:53.846497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:53.846979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:53.847480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:53.848726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:53.857306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:54.114015 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3268/6487] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:53 2022] POST /identity/v3/projects => generated 397 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:54.118390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:54.139090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8f98-1fc0-4e5a-b384-a44a30331465 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:54.198767 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:54.235286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:54.236845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:54.237544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:54.238122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:54.238929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:54.241606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:54.486058 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3220/6488] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:54 2022] POST /identity/v3/users => generated 299 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:54.491751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:54.513152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11c0ff-4d97-4f56-9a80-3859d8b2f983 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:54.520119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:54.521544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:54.522187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:54.522801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:54.528054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:54.530466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:54.550147 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3269/6489] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:54.554160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:54.568479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad2bd-61aa-41fa-9482-966045864531 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:54.580500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672d3fc-7d5f-4023-bb06-4074d7b5e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:54.581655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672d3fc-7d5f-4023-bb06-4074d7b5e8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:54.582754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672d3fc-7d5f-4023-bb06-4074d7b5e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:54.584697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672d3fc-7d5f-4023-bb06-4074d7b5e8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:54.585574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672d3fc-7d5f-4023-bb06-4074d7b5e8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:54.590885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672d3fc-7d5f-4023-bb06-4074d7b5e8d0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:54.647580 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3221/6490] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:54.649175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:54.663861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec828d7-514b-4bd6-809e-533b8ebc7f01 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:54.679355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:54.679355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:54.679722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:54.680042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] PATH_INFO: `/v3/projects/81071383113045d4a6b52946459c8579/users/b65aa621f71d481aba737f2f7443bf31/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:54.708386 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:54.719257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81071383113045d4a6b52946459c8579, user_id=b65aa621f71d481aba737f2f7443bf31, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:54.722978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:54.877684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3270/6491] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:54 2022] PUT /identity/v3/projects/81071383113045d4a6b52946459c8579/users/b65aa621f71d481aba737f2f7443bf31/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:54.900811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:54.901101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:54.901491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:54.942669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] MFA Rules not processed for user `b65aa621f71d481aba737f2f7443bf31`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:54.944051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:55.125758 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3222/6492] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:55.218113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:55.219842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:55.391011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da280-6bc8-4ca4-8c27-2608b2b08b0b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:55.402259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:55.403236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:55.403659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:55.404177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:55.414267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:55.416718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:55.448220 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3271/6493] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:56.374041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:56.375568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:56.402202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a69cd-e6bb-43e3-acdb-3816e8920949 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:56.423584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1786f-cb21-4f86-b452-5f297bccb28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:56.432112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1786f-cb21-4f86-b452-5f297bccb28a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:56.432472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1786f-cb21-4f86-b452-5f297bccb28a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:56.432762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1786f-cb21-4f86-b452-5f297bccb28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:56.440833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-16a1786f-cb21-4f86-b452-5f297bccb28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:56.461787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1786f-cb21-4f86-b452-5f297bccb28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:56.477273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:56.479390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:56.481853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1786f-cb21-4f86-b452-5f297bccb28a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:56.519177 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3223/6494] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:56.651836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6b4f7-0ee6-40c6-8772-f63ce00ea58a service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:56.657513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:56.659413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:56.659939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:56.660399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] PATH_INFO: `/v3/users/800640bc3e764378ae79ae8416ed3430` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:56.673392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800640bc3e764378ae79ae8416ed3430)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:56.676373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:56.967765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800640bc3e764378ae79ae8416ed3430'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:56.968842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800640bc3e764378ae79ae8416ed3430'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:57.058765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800640bc3e764378ae79ae8416ed3430'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:57.069862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800640bc3e764378ae79ae8416ed3430'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:57.071026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800640bc3e764378ae79ae8416ed3430'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:57.116187 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3272/6495] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:56 2022] DELETE /identity/v3/users/800640bc3e764378ae79ae8416ed3430 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:57.116674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:57.116968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:57.117246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:57.172877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:57.183352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:57.309865 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3224/6496] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:57.319854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:57.322102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:57.336849 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:57.444351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b0e67-8d0e-4011-8933-13c88e76f592 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:57.449891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c72bc4-894c-4c74-94ac-b7629d6a4fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:57.450682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72bc4-894c-4c74-94ac-b7629d6a4fdd service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:57.451069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72bc4-894c-4c74-94ac-b7629d6a4fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:57.451451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72bc4-894c-4c74-94ac-b7629d6a4fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:57.467705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c72bc4-894c-4c74-94ac-b7629d6a4fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:57.469770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c72bc4-894c-4c74-94ac-b7629d6a4fdd service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:57.484562 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3273/6497] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:57.899140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:57.901444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:57.923689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd1ce4-8d30-4370-bc04-fad3a653fc65 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:57.940469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:57.941831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:57.942544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:57.942976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] PATH_INFO: `/v3/projects/4f61f728d4a44e64979f976c87af0d8c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:57.944787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f61f728d4a44e64979f976c87af0d8c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:57.947120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:58.001844 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:58.143366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f61f728d4a44e64979f976c87af0d8c', 'request_id': 'req-d81e6493-b384-43ee-9311-57dc4e38c566'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:58.155313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f61f728d4a44e64979f976c87af0d8c', 'request_id': 'req-d81e6493-b384-43ee-9311-57dc4e38c566'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:58.257214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f61f728d4a44e64979f976c87af0d8c', 'request_id': 'req-d81e6493-b384-43ee-9311-57dc4e38c566'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:58.275797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] The token cache is being invalidate because project 4f61f728d4a44e64979f976c87af0d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:58.276333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:58.278191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d81e6493-b384-43ee-9311-57dc4e38c566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:58.281050 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3225/6498] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:57 2022] DELETE /identity/v3/projects/4f61f728d4a44e64979f976c87af0d8c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:58.286229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab6f8-cf67-449a-abe9-2f6f6c007cb2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:58.286748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab6f8-cf67-449a-abe9-2f6f6c007cb2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:58.287190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab6f8-cf67-449a-abe9-2f6f6c007cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:58.340486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d2dab6f8-cf67-449a-abe9-2f6f6c007cb2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:58.342293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d2dab6f8-cf67-449a-abe9-2f6f6c007cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:58.486312 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3274/6499] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:58.494297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc4b5-4b99-4c32-8329-783bbad14c96 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:58.494596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc4b5-4b99-4c32-8329-783bbad14c96 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:58.494867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc4b5-4b99-4c32-8329-783bbad14c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:58.535483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-362cc4b5-4b99-4c32-8329-783bbad14c96 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:58.536852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-362cc4b5-4b99-4c32-8329-783bbad14c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:58.557420 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3226/6500] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:58.562376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dab6f8-cf67-449a-abe9-2f6f6c007cb2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:58.586457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dab6f8-cf67-449a-abe9-2f6f6c007cb2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:58.607343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:58.607343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:58.607343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:58.607343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:58.612192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:58.612192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:58.612192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:58.634434 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3275/6501] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:42:58.639392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cc4b5-4b99-4c32-8329-783bbad14c96 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:58.649872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cc4b5-4b99-4c32-8329-783bbad14c96 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:58.657106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650f423-dc86-4991-84fc-d58e9ff12b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:58.662286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f423-dc86-4991-84fc-d58e9ff12b1f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:58.662286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f423-dc86-4991-84fc-d58e9ff12b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:58.662286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650f423-dc86-4991-84fc-d58e9ff12b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:58.662286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650f423-dc86-4991-84fc-d58e9ff12b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:58.662286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650f423-dc86-4991-84fc-d58e9ff12b1f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:58.794592 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3227/6502] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:58 2022] POST /identity/v3/projects => generated 357 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:58.799024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:58.818387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d6c8-4ac5-4f0d-88f6-8967bc64c300 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:58.986227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:58.986871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:58.987137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:58.987414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:58.988085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:58.990126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:59.073165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a287e46-f8a5-4c75-b8fb-9fe6c8b3ee87 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.073685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a287e46-f8a5-4c75-b8fb-9fe6c8b3ee87 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.078926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a287e46-f8a5-4c75-b8fb-9fe6c8b3ee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.108326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3276/6503] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:58 2022] POST /identity/v3/users => generated 279 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:59.112632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:59.152625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2149f-952a-4cf1-abd7-38f306273c00 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:59.153057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9a287e46-f8a5-4c75-b8fb-9fe6c8b3ee87 None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:59.153057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a287e46-f8a5-4c75-b8fb-9fe6c8b3ee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:59.156711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3e9a4-cf23-40cb-9918-e301d8c53cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:59.157522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3e9a4-cf23-40cb-9918-e301d8c53cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.158023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3e9a4-cf23-40cb-9918-e301d8c53cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.158445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3e9a4-cf23-40cb-9918-e301d8c53cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.159295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3e9a4-cf23-40cb-9918-e301d8c53cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:59.163378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3e9a4-cf23-40cb-9918-e301d8c53cd6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:59.189357 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3277/6504] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:42:59.192577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addb7e6-6a8f-4b4b-bba2-869df87f565d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.192970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addb7e6-6a8f-4b4b-bba2-869df87f565d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.193353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addb7e6-6a8f-4b4b-bba2-869df87f565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.213572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6addb7e6-6a8f-4b4b-bba2-869df87f565d None None] MFA Rules not processed for user `8f6bde87323c40bb8c9d289d7d38d8be`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:59.215038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6addb7e6-6a8f-4b4b-bba2-869df87f565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:59.248107 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:59.289513 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3228/6505] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:59.290820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a287e46-f8a5-4c75-b8fb-9fe6c8b3ee87 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:59.316623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a287e46-f8a5-4c75-b8fb-9fe6c8b3ee87 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:59.331917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145480d-4483-4ec3-9c85-45bd9da1076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:59.332980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145480d-4483-4ec3-9c85-45bd9da1076f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.333743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145480d-4483-4ec3-9c85-45bd9da1076f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.338062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145480d-4483-4ec3-9c85-45bd9da1076f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.338062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145480d-4483-4ec3-9c85-45bd9da1076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:59.340605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145480d-4483-4ec3-9c85-45bd9da1076f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:59.361283 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3278/6506] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:59.393349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addb7e6-6a8f-4b4b-bba2-869df87f565d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:59.402192 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3229/6507] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:59.416879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addb7e6-6a8f-4b4b-bba2-869df87f565d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:59.434223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:59.435141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.435429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.435712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] PATH_INFO: `/v3/projects/bd6dcca1abae42bc8d3e41bfae74092d/users/c96176f6b11c4f6b884c39302583437d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.457707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6dcca1abae42bc8d3e41bfae74092d, user_id=c96176f6b11c4f6b884c39302583437d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:59.461645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:59.608780 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3279/6508] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:59 2022] PUT /identity/v3/projects/bd6dcca1abae42bc8d3e41bfae74092d/users/c96176f6b11c4f6b884c39302583437d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:59.620793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.622778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.623253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.678297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] MFA Rules not processed for user `c96176f6b11c4f6b884c39302583437d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:59.680886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:59.878981 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3230/6509] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:59.885248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:59.888057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:00.083322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc023748-9714-40c9-ab87-29dbe6d0f482 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:00.087400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:00.088001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:00.088282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:00.088559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:00.098947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:00.100421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:00.110833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3280/6510] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:00.978554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:00.980256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:00.994908 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:01.190514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2faa7-b1b5-4fbd-a769-2c627e6e58e6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:01.215296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:01.218502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:01.221210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:01.222402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:01.229215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:01.278785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:01.278785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:01.360533 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3231/6511] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:07.706731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:07.708165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:07.963255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dd978-ecba-4c0b-907f-84f14376c036 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:07.978568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:07.979621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:07.979927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:07.980451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:07.982536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:08.025863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:08.050976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:08.115505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3281/6512] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:12.038614 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=29 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:18.081101 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:23.366273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:23.370658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:23.557666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83881946-af75-426e-a98f-2be134abcfe3 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:23.570059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:23.570582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:23.570869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:23.571148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] PATH_INFO: `/v3/users/fdeb7c015fd44fb09984773da7c35b16` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:23.576284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdeb7c015fd44fb09984773da7c35b16)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:23.601518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:23.753028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:23.775609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295379c4-da94-424f-8110-70a950c83e29 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:23.786115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:23.788394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:23.789940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:23.790336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] PATH_INFO: `/v3/users/c96176f6b11c4f6b884c39302583437d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:23.808367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96176f6b11c4f6b884c39302583437d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:23.814209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:23.829523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdeb7c015fd44fb09984773da7c35b16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:23.869725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdeb7c015fd44fb09984773da7c35b16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:23.902713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdeb7c015fd44fb09984773da7c35b16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:23.905401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdeb7c015fd44fb09984773da7c35b16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.017892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a423587c-a485-4b0c-86ae-dfdf51d99d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdeb7c015fd44fb09984773da7c35b16'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.033529 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3232/6513] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:23 2022] DELETE /identity/v3/users/fdeb7c015fd44fb09984773da7c35b16 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:24.037012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:24.037304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:24.037590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:24.091150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:24.091150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.125690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96176f6b11c4f6b884c39302583437d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.125690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96176f6b11c4f6b884c39302583437d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.271501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96176f6b11c4f6b884c39302583437d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.288718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96176f6b11c4f6b884c39302583437d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.289467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96176f6b11c4f6b884c39302583437d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.313865 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3233/6514] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:24.315807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:24.319718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.348950 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3282/6515] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:23 2022] DELETE /identity/v3/users/c96176f6b11c4f6b884c39302583437d => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:24.351955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d774c5-387f-4157-886f-ccde1892b85a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:24.352057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:24.354286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.412168 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:24.504768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:24.505382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:24.505671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:24.505963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] PATH_INFO: `/v3/users/b65aa621f71d481aba737f2f7443bf31` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:24.507307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65aa621f71d481aba737f2f7443bf31)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:24.509455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:24.527725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9cd1-f068-4f85-ae16-230f4d06a39b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:24.541420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167e35-0d69-4e84-9c55-c9feffb77634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:24.542143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167e35-0d69-4e84-9c55-c9feffb77634 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:24.542574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167e35-0d69-4e84-9c55-c9feffb77634 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:24.542834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167e35-0d69-4e84-9c55-c9feffb77634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:24.545642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2b167e35-0d69-4e84-9c55-c9feffb77634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.562254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167e35-0d69-4e84-9c55-c9feffb77634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:24.564359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167e35-0d69-4e84-9c55-c9feffb77634 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:24.577618 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3283/6516] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:24.579142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:24.579443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:24.579721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:24.606883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:24.608415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.619487 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3284/6517] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:24.621322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:24.623082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.735481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65aa621f71d481aba737f2f7443bf31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.752581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65aa621f71d481aba737f2f7443bf31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.760780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65aa621f71d481aba737f2f7443bf31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.762300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65aa621f71d481aba737f2f7443bf31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.765977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a71ae-30fc-4ead-b96f-93f08b3fd88a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:24.773248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358a3d9-4514-425f-ae8b-22c84099f83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:24.774503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a3d9-4514-425f-ae8b-22c84099f83e service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:24.774879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a3d9-4514-425f-ae8b-22c84099f83e service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:24.779879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a3d9-4514-425f-ae8b-22c84099f83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:24.779879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f358a3d9-4514-425f-ae8b-22c84099f83e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.786941 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:24.841172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65aa621f71d481aba737f2f7443bf31'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:24.850470 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3234/6518] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:24 2022] DELETE /identity/v3/users/b65aa621f71d481aba737f2f7443bf31 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:24.851437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:24.854356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:24.872522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358a3d9-4514-425f-ae8b-22c84099f83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:24.874210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358a3d9-4514-425f-ae8b-22c84099f83e service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:24.884966 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3285/6519] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:24.896964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134bc68-9e42-4ae7-be5d-9c23fd386a58 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:24.897756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134bc68-9e42-4ae7-be5d-9c23fd386a58 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:24.898230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134bc68-9e42-4ae7-be5d-9c23fd386a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:24.942429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d134bc68-9e42-4ae7-be5d-9c23fd386a58 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:24.944026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d134bc68-9e42-4ae7-be5d-9c23fd386a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:25.000308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fac5c-48bd-4677-a722-e763235b6917 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:25.014105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:25.014735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:25.015015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:25.015287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:25.017157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:25.059833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3286/6520] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:25.070483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134bc68-9e42-4ae7-be5d-9c23fd386a58 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:25.091393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134bc68-9e42-4ae7-be5d-9c23fd386a58 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:25.103223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:25.106069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:25.106534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:25.106999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:25.125093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:25.127222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:25.143861 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3287/6521] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:25.191355 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:25.221031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:25.222707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:25.242975 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3235/6522] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:25.439282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:25.441476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:25.472937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205e2a-d30d-4763-badb-ab59ccc96fac service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:25.489045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:25.494889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:25.495184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:25.495501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] PATH_INFO: `/v3/projects/dcbe90e2573046609b34c240fcc89361` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:25.498283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbe90e2573046609b34c240fcc89361)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:25.501167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:25.677207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbe90e2573046609b34c240fcc89361', 'request_id': 'req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:25.687968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbe90e2573046609b34c240fcc89361', 'request_id': 'req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:25.768909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbe90e2573046609b34c240fcc89361', 'request_id': 'req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:25.783859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] The token cache is being invalidate because project dcbe90e2573046609b34c240fcc89361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:25.785157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:25.786089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:25.788752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3288/6523] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:25 2022] DELETE /identity/v3/projects/dcbe90e2573046609b34c240fcc89361 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:25.795555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:25.813084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46e2d5-7961-4f03-9a50-bce20a1a3638 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:25.897586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:25.898279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:25.898601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:25.898881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] PATH_INFO: `/v3/users/4f17d256ed924e0c99b443ffc725ebe9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:25.900491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f17d256ed924e0c99b443ffc725ebe9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:25.903426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:25.928371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:25.930127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:25.959307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef87cbb-064a-4cd5-86b5-2692e6f4ad46 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:25.966398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:25.967072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:25.967356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:25.967631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] PATH_INFO: `/v3/projects/bd6dcca1abae42bc8d3e41bfae74092d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:25.969010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6dcca1abae42bc8d3e41bfae74092d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:25.971131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:25.992211 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:26.111547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f17d256ed924e0c99b443ffc725ebe9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.122531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6dcca1abae42bc8d3e41bfae74092d', 'request_id': 'req-82f0fef8-d937-4783-89ef-a5a62ab86d64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.132921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6dcca1abae42bc8d3e41bfae74092d', 'request_id': 'req-82f0fef8-d937-4783-89ef-a5a62ab86d64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.140920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f17d256ed924e0c99b443ffc725ebe9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.155531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f17d256ed924e0c99b443ffc725ebe9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.156465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f17d256ed924e0c99b443ffc725ebe9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.251946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6dcca1abae42bc8d3e41bfae74092d', 'request_id': 'req-82f0fef8-d937-4783-89ef-a5a62ab86d64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.265024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] The token cache is being invalidate because project bd6dcca1abae42bc8d3e41bfae74092d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:26.265400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.266154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-82f0fef8-d937-4783-89ef-a5a62ab86d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.268076 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3289/6524] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:25 2022] DELETE /identity/v3/projects/bd6dcca1abae42bc8d3e41bfae74092d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:26.272748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa2c0a-b7cb-409f-8e31-173de415e344 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:26.273112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa2c0a-b7cb-409f-8e31-173de415e344 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:26.273460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa2c0a-b7cb-409f-8e31-173de415e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:26.312404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f17d256ed924e0c99b443ffc725ebe9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.323618 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3236/6525] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:25 2022] DELETE /identity/v3/users/4f17d256ed924e0c99b443ffc725ebe9 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:26.324606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:26.326540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:26.331730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-54aa2c0a-b7cb-409f-8e31-173de415e344 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:26.333058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-54aa2c0a-b7cb-409f-8e31-173de415e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:26.451671 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3290/6526] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:26.459690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48909ebb-a073-47e3-bd2c-14adb5fdd343 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:26.460812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48909ebb-a073-47e3-bd2c-14adb5fdd343 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:26.461248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48909ebb-a073-47e3-bd2c-14adb5fdd343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:26.485660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-48909ebb-a073-47e3-bd2c-14adb5fdd343 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:26.488708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48909ebb-a073-47e3-bd2c-14adb5fdd343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:26.499276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6acc7e-5a65-4bae-a3bb-97ec8e70fa84 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:26.500696 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3291/6527] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:26.508488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48909ebb-a073-47e3-bd2c-14adb5fdd343 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:26.517038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:26.517735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:26.523269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:26.523595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] PATH_INFO: `/v3/projects/81071383113045d4a6b52946459c8579` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:26.529716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81071383113045d4a6b52946459c8579)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:26.529883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48909ebb-a073-47e3-bd2c-14adb5fdd343 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:26.537571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:26.538369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:26.538507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:26.539007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:26.539380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:26.540263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:26.541063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:26.543881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:26.560636 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3292/6528] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:43:26.567013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:26.572851 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:26.581980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaed0b0-a3e6-43af-99d8-61e3bd20976b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:26.593057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:26.593706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:26.594032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:26.594320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:26.597381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:26.599322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:26.732131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3293/6529] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:26 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:26.736562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:26.784184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81071383113045d4a6b52946459c8579', 'request_id': 'req-322f290f-5bb0-4dd7-81f1-edd735eccd33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.800331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81071383113045d4a6b52946459c8579', 'request_id': 'req-322f290f-5bb0-4dd7-81f1-edd735eccd33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.869242 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:26.888313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ab1b8-9633-4977-8868-6cd168addf1a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:26.929259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81071383113045d4a6b52946459c8579', 'request_id': 'req-322f290f-5bb0-4dd7-81f1-edd735eccd33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.946700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] The token cache is being invalidate because project 81071383113045d4a6b52946459c8579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:26.946999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.955077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-322f290f-5bb0-4dd7-81f1-edd735eccd33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:26.964118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3237/6530] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:26 2022] DELETE /identity/v3/projects/81071383113045d4a6b52946459c8579 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:26.973072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec23b5-0dab-443d-a658-c4af5a528f41 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:26.973072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec23b5-0dab-443d-a658-c4af5a528f41 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:26.973072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec23b5-0dab-443d-a658-c4af5a528f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.020933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.021569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.022848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-62ec23b5-0dab-443d-a658-c4af5a528f41 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:27.023107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.023415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.024956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.028753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-62ec23b5-0dab-443d-a658-c4af5a528f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:27.031644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.055117 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3238/6531] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:27.057739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c486-3870-4046-b7bd-37046605b5d5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.058285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c486-3870-4046-b7bd-37046605b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.059339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82c486-3870-4046-b7bd-37046605b5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.109953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-be82c486-3870-4046-b7bd-37046605b5d5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:27.111627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-be82c486-3870-4046-b7bd-37046605b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:27.137434 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3239/6532] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:27.147841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82c486-3870-4046-b7bd-37046605b5d5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.148804 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3294/6533] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:26 2022] POST /identity/v3/users => generated 303 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:43:27.154891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.162222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:27.181895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82c486-3870-4046-b7bd-37046605b5d5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.201953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.204115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.206794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.214192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.218775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:27.219197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.223071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.224265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9992660-a9eb-4a09-9e3c-7bd8ccde32a9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.242837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.244103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.245002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.245912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.250682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.254737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.263168 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3240/6534] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:43:27.265725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.282517 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3295/6535] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:27.284716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.287648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80405440-bfb6-4cf8-8c04-ac22d6cb083b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.319618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efe70a-2ceb-4c5b-b276-c6debd99880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.321233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efe70a-2ceb-4c5b-b276-c6debd99880d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.323389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efe70a-2ceb-4c5b-b276-c6debd99880d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.325014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efe70a-2ceb-4c5b-b276-c6debd99880d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.325968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efe70a-2ceb-4c5b-b276-c6debd99880d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.332693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fc6a-27d8-4ebc-be46-d407d9343669 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.333586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efe70a-2ceb-4c5b-b276-c6debd99880d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.349866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.352219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.353482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.353903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.359773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.375498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.418796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3296/6536] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:43:27.423546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.451945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee029-ab52-4169-b4d3-629ebc92d8f1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.458700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.459684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.461024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.461509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] PATH_INFO: `/v3/projects/8770eda6e03645618a33fcf16c255a11/users/9105cd1de7fe47568d8138c756fa35bb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.484261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] RBAC: Authorizing `identity:create_grant(project_id=8770eda6e03645618a33fcf16c255a11, user_id=9105cd1de7fe47568d8138c756fa35bb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.487743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.518783 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3241/6537] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:27 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:27.520104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320741b-7007-40cb-8a75-91fa1aea2525 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.520399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320741b-7007-40cb-8a75-91fa1aea2525 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.520678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320741b-7007-40cb-8a75-91fa1aea2525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.552990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d320741b-7007-40cb-8a75-91fa1aea2525 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:27.565204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d320741b-7007-40cb-8a75-91fa1aea2525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:27.570133 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3297/6538] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:27 2022] PUT /identity/v3/projects/8770eda6e03645618a33fcf16c255a11/users/9105cd1de7fe47568d8138c756fa35bb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:27.571070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.670240 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3242/6539] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:43:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:27.670571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcc2a-6725-4164-bc55-defceac8aade admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.673101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c51-c9ad-4aa4-86e0-4caf0900f9b6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.673625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c51-c9ad-4aa4-86e0-4caf0900f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.676287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.676542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c51-c9ad-4aa4-86e0-4caf0900f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.677163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.677452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.677729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.678386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.680920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.715836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1c0f8c51-c9ad-4aa4-86e0-4caf0900f9b6 None None] MFA Rules not processed for user `9105cd1de7fe47568d8138c756fa35bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:27.717168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1c0f8c51-c9ad-4aa4-86e0-4caf0900f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:27.771341 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:27.797769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3298/6540] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:27 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:27.797769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.798111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3243/6541] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:27.799530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c51-c9ad-4aa4-86e0-4caf0900f9b6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.801923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:27.811941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c51-c9ad-4aa4-86e0-4caf0900f9b6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.817533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.818209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.818490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.818761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.819415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.821096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.833297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5aaf0-cc7d-4571-9938-a60cfbd12e50 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.838355 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3244/6542] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:27.840158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:27.844726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.845782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.847832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.848373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] PATH_INFO: `/v3/projects/6f5f50d5c8d648f8ab9cbfc3254cc40c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.850208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5f50d5c8d648f8ab9cbfc3254cc40c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.854999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.857214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5dfb0-e12b-4b96-aa7d-619002121b8a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:27.863478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:27.864929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:27.865154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:27.865431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:27.866118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:27.868124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:27.932775 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:27.992568 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3245/6543] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:27 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:28.005335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:28.050642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5f50d5c8d648f8ab9cbfc3254cc40c', 'request_id': 'req-90424495-5017-40a8-8e1d-a04aa50ec43e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:28.063166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5f50d5c8d648f8ab9cbfc3254cc40c', 'request_id': 'req-90424495-5017-40a8-8e1d-a04aa50ec43e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:28.079866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059d963-b2e2-4da1-b7db-53d58d9544cb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:28.139391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5f50d5c8d648f8ab9cbfc3254cc40c', 'request_id': 'req-90424495-5017-40a8-8e1d-a04aa50ec43e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:28.152357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:28.153069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.153222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] The token cache is being invalidate because project 6f5f50d5c8d648f8ab9cbfc3254cc40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:28.153538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.153654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:28.154015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.154269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:28.154849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:28.156076 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3299/6544] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:27 2022] DELETE /identity/v3/projects/6f5f50d5c8d648f8ab9cbfc3254cc40c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:28.156897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:28.161554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:28.163115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:28.169105 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3246/6545] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:28.175755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:28.175755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:28.191460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e69864-ed35-4fbe-9c62-bad38db3d849 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:28.196857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c26c-9018-47a2-9b7e-9c927ee1f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:28.197561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c26c-9018-47a2-9b7e-9c927ee1f364 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.197998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c26c-9018-47a2-9b7e-9c927ee1f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.198507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c26c-9018-47a2-9b7e-9c927ee1f364 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.200445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c26c-9018-47a2-9b7e-9c927ee1f364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:28.204139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c26c-9018-47a2-9b7e-9c927ee1f364 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:28.254957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90424495-5017-40a8-8e1d-a04aa50ec43e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:28.261848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:28.263677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.263677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.263677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.265039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:28.335755 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3247/6546] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:28 2022] POST /identity/v3/users => generated 308 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:28.335755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b57d2-7c01-47d6-8045-1a8287637c71 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.335755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b57d2-7c01-47d6-8045-1a8287637c71 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.335755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b57d2-7c01-47d6-8045-1a8287637c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.347333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:28.349257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:28.398702 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3300/6547] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:43:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:43:28.399412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-003b57d2-7c01-47d6-8045-1a8287637c71 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:28.399412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-003b57d2-7c01-47d6-8045-1a8287637c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:28.409221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:28.417648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:28.446673 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3248/6548] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:28.452377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b57d2-7c01-47d6-8045-1a8287637c71 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:28.471641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95ff3e-8898-490c-863c-70311c2037a5 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:28.477002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b57d2-7c01-47d6-8045-1a8287637c71 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:28.487671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:28.491997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.491997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.491997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] PATH_INFO: `/v3/projects/ced2e395e85046afa9dacded5ce03e68/users/0d96a4b20a51415f8cb428c057f84515/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.508425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd8ce1-ee47-4130-b9a8-8e799d1a9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:28.509205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8ce1-ee47-4130-b9a8-8e799d1a9dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.509585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8ce1-ee47-4130-b9a8-8e799d1a9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.509995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8ce1-ee47-4130-b9a8-8e799d1a9dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.510752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8ce1-ee47-4130-b9a8-8e799d1a9dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:28.516861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8ce1-ee47-4130-b9a8-8e799d1a9dd9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:28.529534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced2e395e85046afa9dacded5ce03e68, user_id=0d96a4b20a51415f8cb428c057f84515, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:28.532923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:28.553003 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3249/6549] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:28.555154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b534-5168-4e1f-9f52-5248184ee532 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.565629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b534-5168-4e1f-9f52-5248184ee532 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.566109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b534-5168-4e1f-9f52-5248184ee532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.622268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-71c2b534-5168-4e1f-9f52-5248184ee532 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:28.623674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-71c2b534-5168-4e1f-9f52-5248184ee532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:28.629518 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3301/6550] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:28 2022] PUT /identity/v3/projects/ced2e395e85046afa9dacded5ce03e68/users/0d96a4b20a51415f8cb428c057f84515/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:28.630752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:28.748424 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3250/6551] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:28.750069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb490-3edb-4e52-a7ca-ce718dc7d95f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.750670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb490-3edb-4e52-a7ca-ce718dc7d95f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.751142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb490-3edb-4e52-a7ca-ce718dc7d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.822148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-08beb490-3edb-4e52-a7ca-ce718dc7d95f None None] MFA Rules not processed for user `0d96a4b20a51415f8cb428c057f84515`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:28.824469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-08beb490-3edb-4e52-a7ca-ce718dc7d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:28.884185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30302f-69b0-4f31-9010-22a875f71e61 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:28.890524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:28.891549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.892016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.892495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] PATH_INFO: `/v3/projects/e919720afa474fe9b7772dd95c73cea7/users/89fcafd0ff734ca998470ced033f85a1/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.929221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e919720afa474fe9b7772dd95c73cea7, user_id=89fcafd0ff734ca998470ced033f85a1, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:28.932497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:28.941219 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3251/6552] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:28.946865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beb490-3edb-4e52-a7ca-ce718dc7d95f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:28.958725 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:28.985597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beb490-3edb-4e52-a7ca-ce718dc7d95f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:28.991018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:28.992042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:28.992042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:28.992406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:28.993160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:28.993529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:28.995925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.010425 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3302/6553] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:28 2022] PUT /identity/v3/projects/e919720afa474fe9b7772dd95c73cea7/users/89fcafd0ff734ca998470ced033f85a1/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:29.014604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.017013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:29.020689 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3252/6554] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:43:29.023385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.061264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38deb899-ec99-42d6-b1a6-4698458e57a7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:29.199475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9038b-cfbe-4925-a333-46be0e47b94d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:29.225062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:29.225062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.225062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.225062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.232093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:29.232907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.233355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.233782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.234932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:29.238833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.266694 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3253/6555] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:29.270690 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:29.273838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.344786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4074c-d1c6-4a95-8e0c-e05419fd7de8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:29.361709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:29.362688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.363150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.363573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.364361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:29.366484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.411051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:29.414235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.439885 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3303/6556] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:29.451820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.475992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25072-45b7-468a-ab48-56e822360690 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:29.485736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92023294-25ca-4e09-af40-3add32ede527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:29.486946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023294-25ca-4e09-af40-3add32ede527 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.487564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023294-25ca-4e09-af40-3add32ede527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.491109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023294-25ca-4e09-af40-3add32ede527 admin admin] PATH_INFO: `/v3/projects/e919720afa474fe9b7772dd95c73cea7/users/89fcafd0ff734ca998470ced033f85a1/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.492287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92023294-25ca-4e09-af40-3add32ede527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e919720afa474fe9b7772dd95c73cea7, user_id=89fcafd0ff734ca998470ced033f85a1, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:29.496720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92023294-25ca-4e09-af40-3add32ede527 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.513091 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3304/6557] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:29 2022] PUT /identity/v3/projects/e919720afa474fe9b7772dd95c73cea7/users/89fcafd0ff734ca998470ced033f85a1/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:29.521472 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3254/6558] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:29 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:29.522559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.523356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.523988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.528851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.647142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] MFA Rules not processed for user `89fcafd0ff734ca998470ced033f85a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:29.650707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:29.711733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff7417-10e9-4f53-ba13-84ef40f34a45 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:29.726496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:29.727273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.728324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.729052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.731073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:29.743422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.831921 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3305/6559] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:29 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:29.842975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.845768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:29.846871 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:29.880334 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3255/6560] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:29 2022] POST /identity/v3/users => generated 285 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:29.894974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.907890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f1400-ba3a-4aed-bf91-27c4ff62b735 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:29.913302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:29.914155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.914599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.915026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.915834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:29.918272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.930731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3256/6561] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:29.934337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.945211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf0fe2-fe5d-4957-abb7-f60b307189a3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:29.954760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:29.955631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:29.956065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:29.958569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:29.959506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:29.961657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:29.982120 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3257/6562] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:29.983325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:29.994763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0c8bd-aaff-4a9b-b7ba-b1d1936c51a9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:30.000516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af82d80-c220-4b7a-9452-43a22e1ae047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:30.001594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af82d80-c220-4b7a-9452-43a22e1ae047 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:30.002309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af82d80-c220-4b7a-9452-43a22e1ae047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:30.002745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af82d80-c220-4b7a-9452-43a22e1ae047 admin admin] PATH_INFO: `/v3/projects/2ea60de97ada4e358b5e753996562f01/users/5d18f7d6b63e43b1a567372a7bc8bacb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:30.005936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a01247-0b04-413d-8f8f-c60c55dfd87c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:30.022052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af82d80-c220-4b7a-9452-43a22e1ae047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea60de97ada4e358b5e753996562f01, user_id=5d18f7d6b63e43b1a567372a7bc8bacb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:30.024784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af82d80-c220-4b7a-9452-43a22e1ae047 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:30.025622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:30.026893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:30.032043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:30.032511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:30.060082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:30.060082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:30.072119 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3306/6563] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:43:30.251999 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3258/6564] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:29 2022] PUT /identity/v3/projects/2ea60de97ada4e358b5e753996562f01/users/5d18f7d6b63e43b1a567372a7bc8bacb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:30.295242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:30.375289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c001dc-24ce-48c7-8350-4bb5bab48d3e service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:30.384147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eac4e-065f-4922-a247-c452e1e4eb0b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:30.391383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eac4e-065f-4922-a247-c452e1e4eb0b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:30.391383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eac4e-065f-4922-a247-c452e1e4eb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:30.437242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-822eac4e-065f-4922-a247-c452e1e4eb0b None None] MFA Rules not processed for user `5d18f7d6b63e43b1a567372a7bc8bacb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:30.439593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-822eac4e-065f-4922-a247-c452e1e4eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:30.490244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:30.491516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:30.492015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:30.492532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] PATH_INFO: `/v3/users/9105cd1de7fe47568d8138c756fa35bb` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:30.494621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9105cd1de7fe47568d8138c756fa35bb)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:30.496886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:30.772698 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3259/6565] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:30.772698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822eac4e-065f-4922-a247-c452e1e4eb0b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:30.790736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822eac4e-065f-4922-a247-c452e1e4eb0b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:30.803726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:30.803726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:30.803726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:30.803726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:30.804537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:30.804537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:31.032613 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:31.053273 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3260/6566] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:30 2022] POST /identity/v3/projects => generated 367 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:31.061475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:31.124966 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:31.139692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9105cd1de7fe47568d8138c756fa35bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:31.140643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9105cd1de7fe47568d8138c756fa35bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:31.240297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a4942-1fb2-4554-a0b1-13433bdafe20 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:31.243419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9105cd1de7fe47568d8138c756fa35bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:31.254232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9105cd1de7fe47568d8138c756fa35bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:31.255195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-860c2e6c-3add-448b-9ac5-9fa714c0ea69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9105cd1de7fe47568d8138c756fa35bb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:31.261504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:31.262358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:31.262490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:31.262712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:31.263476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:31.267343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:31.332957 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3307/6567] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:30 2022] DELETE /identity/v3/users/9105cd1de7fe47568d8138c756fa35bb => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:31.337126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:31.338391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:31.338391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:31.400082 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3261/6568] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:31 2022] POST /identity/v3/users => generated 290 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:31.404441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:31.411082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:31.419491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:31.422354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:31.444845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecf197-a7c4-4974-bfc1-8b54f68cfc84 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:31.599949 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3308/6569] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:31.612298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:31.613745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:31.614278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:31.615918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:31.617426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:31.620121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:31.628044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:31.634191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:31.657393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3262/6570] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:31.661578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:31.693040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adcbca-c5b1-4aea-956b-caf88e3dbc84 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:31.726438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:31.727125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:31.727409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:31.727689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] PATH_INFO: `/v3/projects/037cefae4f5342a69f7683f59706de0b/users/f339c7e1f08240809a67f4ae61e55d36/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:31.768173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] RBAC: Authorizing `identity:create_grant(project_id=037cefae4f5342a69f7683f59706de0b, user_id=f339c7e1f08240809a67f4ae61e55d36, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:31.772360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:31.799817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a39647-59bb-483a-851d-51d2815b4e85 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:31.805288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:31.806071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:31.806331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:31.806613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:31.821062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:31.823884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:31.853942 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3309/6571] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:43:31.880035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3263/6572] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:31 2022] PUT /identity/v3/projects/037cefae4f5342a69f7683f59706de0b/users/f339c7e1f08240809a67f4ae61e55d36/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:31.884990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:31.905766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab54a5d-50c3-45dd-873e-f0130de14074 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:32.013534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200962b2-f979-4e89-817c-6e07b5585806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:32.014403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200962b2-f979-4e89-817c-6e07b5585806 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:32.014784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200962b2-f979-4e89-817c-6e07b5585806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:32.015156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200962b2-f979-4e89-817c-6e07b5585806 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:32.015905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200962b2-f979-4e89-817c-6e07b5585806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:32.018039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200962b2-f979-4e89-817c-6e07b5585806 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:32.033146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3310/6573] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:32.036771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:32.049662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c550-8244-4673-abbe-e773ee0e850d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:32.058413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:32.062319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:32.062319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:32.062319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] PATH_INFO: `/v3/projects/037cefae4f5342a69f7683f59706de0b/users/f339c7e1f08240809a67f4ae61e55d36/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:32.063390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=037cefae4f5342a69f7683f59706de0b, user_id=f339c7e1f08240809a67f4ae61e55d36, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:32.071209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:32.086317 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3264/6574] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:32 2022] PUT /identity/v3/projects/037cefae4f5342a69f7683f59706de0b/users/f339c7e1f08240809a67f4ae61e55d36/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:32.096906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:32.097194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:32.097465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:32.141555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] MFA Rules not processed for user `f339c7e1f08240809a67f4ae61e55d36`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:32.142876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:32.243968 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:32.273635 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3311/6575] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:32.287890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:32.287890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:32.408877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e993cb-58c8-49a4-9aaf-f2596dca5cfd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:32.421016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb27d4-8266-4bda-a288-2aa7b8e84539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:32.421971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb27d4-8266-4bda-a288-2aa7b8e84539 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:32.422092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb27d4-8266-4bda-a288-2aa7b8e84539 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:32.422325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb27d4-8266-4bda-a288-2aa7b8e84539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:32.441075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb27d4-8266-4bda-a288-2aa7b8e84539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:32.442568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb27d4-8266-4bda-a288-2aa7b8e84539 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:32.473427 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3265/6576] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:32.549157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:32.549157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:32.774654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70a004-f7ff-487c-ba1b-0a6cc05c3705 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:32.791537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:32.793479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:32.793768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:32.796242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] PATH_INFO: `/v3/projects/8770eda6e03645618a33fcf16c255a11` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:32.797986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8770eda6e03645618a33fcf16c255a11)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:32.802166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:33.032655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8770eda6e03645618a33fcf16c255a11', 'request_id': 'req-04058d99-1211-42b8-877b-168534a2247f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.049761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8770eda6e03645618a33fcf16c255a11', 'request_id': 'req-04058d99-1211-42b8-877b-168534a2247f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.120782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:33.121319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:33.121436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:33.157955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8770eda6e03645618a33fcf16c255a11', 'request_id': 'req-04058d99-1211-42b8-877b-168534a2247f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.165565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:33.167253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:33.178852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] The token cache is being invalidate because project 8770eda6e03645618a33fcf16c255a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:33.181157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.183377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.186769 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:33.191151 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3312/6577] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:32 2022] DELETE /identity/v3/projects/8770eda6e03645618a33fcf16c255a11 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:33.193262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:33.195233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:33.316098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3266/6578] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:43:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:33.331436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:33.336390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:33.385115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058d99-1211-42b8-877b-168534a2247f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:33.388386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:33.390596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:33.390898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:33.391948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] PATH_INFO: `/v3/users/89fcafd0ff734ca998470ced033f85a1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:33.395486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] RBAC: Authorizing `identity:delete_user(user_id=89fcafd0ff734ca998470ced033f85a1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:33.399706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:33.458493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e2ce3-91a0-43d8-9bfc-f6fa8c27ffbf None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:33.466702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:33.468890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:33.469349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:33.469787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:33.484456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:33.487226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:33.499797 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3267/6579] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:43:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:43:33.867602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89fcafd0ff734ca998470ced033f85a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.868433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89fcafd0ff734ca998470ced033f85a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.946097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89fcafd0ff734ca998470ced033f85a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.968876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89fcafd0ff734ca998470ced033f85a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:33.970466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d23ada2-838f-4d97-bbc4-4862498b70db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89fcafd0ff734ca998470ced033f85a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:34.060978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3313/6580] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:33 2022] DELETE /identity/v3/users/89fcafd0ff734ca998470ced033f85a1 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:34.134496 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:34.654995 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:35.077908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:35.094857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d165ac-5a85-43d2-b573-26d6e37f8aa8 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:35.358759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:35.359611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:35.359994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:35.361138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] PATH_INFO: `/v3/projects/e919720afa474fe9b7772dd95c73cea7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:35.363865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e919720afa474fe9b7772dd95c73cea7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:35.369032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:35.606810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e919720afa474fe9b7772dd95c73cea7', 'request_id': 'req-47da2ebb-657f-4e00-85c2-386b5f3e2f08'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:35.608276 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:35.618857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e919720afa474fe9b7772dd95c73cea7', 'request_id': 'req-47da2ebb-657f-4e00-85c2-386b5f3e2f08'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:35.757682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e919720afa474fe9b7772dd95c73cea7', 'request_id': 'req-47da2ebb-657f-4e00-85c2-386b5f3e2f08'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:35.798326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] The token cache is being invalidate because project e919720afa474fe9b7772dd95c73cea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:35.802036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:35.802036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-47da2ebb-657f-4e00-85c2-386b5f3e2f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:35.810195 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3268/6581] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:35 2022] DELETE /identity/v3/projects/e919720afa474fe9b7772dd95c73cea7 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:35.814795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac5dd-34cd-4e42-b885-befb6014ac30 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:35.815658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac5dd-34cd-4e42-b885-befb6014ac30 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:35.816112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ac5dd-34cd-4e42-b885-befb6014ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:35.892788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c66ac5dd-34cd-4e42-b885-befb6014ac30 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:35.903595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c66ac5dd-34cd-4e42-b885-befb6014ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:36.040924 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3314/6582] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:36.042532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5789f-a9d2-4c37-ad51-e8723c1a9738 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:36.042912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5789f-a9d2-4c37-ad51-e8723c1a9738 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:36.043196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5789f-a9d2-4c37-ad51-e8723c1a9738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:36.072522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-62e5789f-a9d2-4c37-ad51-e8723c1a9738 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:36.074469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-62e5789f-a9d2-4c37-ad51-e8723c1a9738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:36.100693 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3269/6583] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:36.105351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ac5dd-34cd-4e42-b885-befb6014ac30 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:36.127093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ac5dd-34cd-4e42-b885-befb6014ac30 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:36.144555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:36.145219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:36.145490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:36.145772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:36.146471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:36.147914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:36.149775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:36.192353 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3315/6584] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:43:36.196815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5789f-a9d2-4c37-ad51-e8723c1a9738 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:36.224337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5789f-a9d2-4c37-ad51-e8723c1a9738 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:36.260296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:36.267793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:36.269700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:36.295269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:36.295269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:36.323990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:36.723318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:36.723318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:36.755958 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3270/6585] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:36 2022] POST /identity/v3/projects => generated 373 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:36.765677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:36.952636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf147b-043f-4180-a942-ce9e0b3c0da0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:36.966620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:36.967264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:36.967552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:36.967834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:36.968484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:36.971002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:36.993150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5077a-4293-455b-9370-fc9cf2722120 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:37.071677 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:37.128256 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3271/6586] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:36 2022] POST /identity/v3/users => generated 287 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:43:37.132450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:37.175288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237ef6f-1bac-4410-afd4-dc1f11aa9608 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:37.194972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:37.204271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:37.204550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:37.206175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:37.206786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:37.207751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:37.208038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:37.208314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:37.208985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:37.210648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:37.217218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:37.252084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:37.256548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:37.264180 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3272/6587] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:37.265684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:37.291359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235d763-3a53-4113-8993-d7e8bb196229 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:37.305934 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3316/6588] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:37.306233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e9496-cdf4-4092-9190-b314aa800233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:37.307122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e9496-cdf4-4092-9190-b314aa800233 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:37.308520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e9496-cdf4-4092-9190-b314aa800233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:37.308935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e9496-cdf4-4092-9190-b314aa800233 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:37.312175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e9496-cdf4-4092-9190-b314aa800233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:37.314676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e9496-cdf4-4092-9190-b314aa800233 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:37.344620 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3273/6589] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:37.346958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:37.368699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1aa5f3-6562-4dad-8bf9-85da4547e36b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:37.407536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260739d0-c090-45c9-938c-7bf20f0fb1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:37.411548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260739d0-c090-45c9-938c-7bf20f0fb1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:37.411825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260739d0-c090-45c9-938c-7bf20f0fb1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:37.415000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260739d0-c090-45c9-938c-7bf20f0fb1b6 admin admin] PATH_INFO: `/v3/projects/9b7a80ef35c448879fd78b8549372308/users/5f691912a57543c2b7657d4dc5d71da1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:37.445222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260739d0-c090-45c9-938c-7bf20f0fb1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7a80ef35c448879fd78b8549372308, user_id=5f691912a57543c2b7657d4dc5d71da1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:37.449751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260739d0-c090-45c9-938c-7bf20f0fb1b6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:37.528584 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3317/6590] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:37 2022] PUT /identity/v3/projects/9b7a80ef35c448879fd78b8549372308/users/5f691912a57543c2b7657d4dc5d71da1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:37.543004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:37.543311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:37.543578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:37.572652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11403d9-fec6-4956-97d6-8ce8f657a0b8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:37.573029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11403d9-fec6-4956-97d6-8ce8f657a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:37.574104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11403d9-fec6-4956-97d6-8ce8f657a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:37.614256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a11403d9-fec6-4956-97d6-8ce8f657a0b8 None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:37.614256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a11403d9-fec6-4956-97d6-8ce8f657a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:37.659532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] MFA Rules not processed for user `5f691912a57543c2b7657d4dc5d71da1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:37.663985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:37.833854 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3318/6591] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:37.945392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11403d9-fec6-4956-97d6-8ce8f657a0b8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:37.949547 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3274/6592] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:38.187668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11403d9-fec6-4956-97d6-8ce8f657a0b8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:38.199122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:38.200543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:38.200994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:38.201431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:38.202288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:38.204432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:38.296840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:38.298339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:38.336308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0b4e8-5ab4-4a23-b1a4-df8c5bf562f8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:38.346344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3319/6593] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:37 2022] POST /identity/v3/projects => generated 373 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:43:38.347543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:38.353533 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:38.448691 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:38.536201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:38.536923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:38.537185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:38.544609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] PATH_INFO: `/v3/users/5d18f7d6b63e43b1a567372a7bc8bacb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:38.546315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d18f7d6b63e43b1a567372a7bc8bacb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:38.548317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:38.556243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b8f7a-865b-491c-955a-cdb5b28fec60 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:38.579861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:38.580413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:38.580698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:38.580970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:38.581619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:38.583797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:38.705565 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3320/6594] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:38 2022] POST /identity/v3/users => generated 293 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:38.709599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:38.731752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e693d46-3241-46fb-97f5-c8397eb3b9b8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:38.743173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:38.743806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:38.744137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:38.744371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:38.745681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:38.747575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:38.774870 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3321/6595] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:38.780556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:38.787359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:38.835167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d18f7d6b63e43b1a567372a7bc8bacb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:38.882202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d18f7d6b63e43b1a567372a7bc8bacb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:38.901849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d18f7d6b63e43b1a567372a7bc8bacb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:38.904289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d18f7d6b63e43b1a567372a7bc8bacb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:38.949448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb39-5b8a-4822-a2f4-d1d4fd81ce6b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:38.965932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:38.966544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:38.966832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:38.967109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:38.968921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:38.980858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:38.982365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:38.992937 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3322/6596] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:38.993764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:38.995226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:39.010154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855b576-e6a3-4b7f-9ef5-c5f7c970ae8e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:39.015073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3ba86ce3-e4a5-4f47-964b-939a8025f60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d18f7d6b63e43b1a567372a7bc8bacb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:39.022081 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3275/6597] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:38 2022] DELETE /identity/v3/users/5d18f7d6b63e43b1a567372a7bc8bacb => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:39.027812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:39.028107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:39.028475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:39.032015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:39.032692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:39.032970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:39.033778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] PATH_INFO: `/v3/projects/0eb9a04a2aa74f38bb10c2fbd476bae8/users/56d394d9066a41269580a5a0c34a4adb/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:39.079338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb9a04a2aa74f38bb10c2fbd476bae8, user_id=56d394d9066a41269580a5a0c34a4adb, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:39.082064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:39.083204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:39.084449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:39.169317 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3323/6598] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:38 2022] PUT /identity/v3/projects/0eb9a04a2aa74f38bb10c2fbd476bae8/users/56d394d9066a41269580a5a0c34a4adb/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:39.171845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:39.337677 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3276/6599] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:39.364890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:39.367292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:39.405731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7a1d-cdfb-42b6-bd65-747e31c15ec1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:39.416928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:39.417536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:39.417844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:39.418450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:39.418972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:39.420876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:39.438332 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3324/6600] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:39.438666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:39.440479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:39.476257 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:39.493247 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:39.580479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f492ff9-f2b4-4a87-8a7f-c1c718bc0ff1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:39.604496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:39.606861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:39.607168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:39.611713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:39.617731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc773-6ba1-4c72-8911-3653736813bb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:39.634693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25480956-8f5f-4508-9ff2-40590cc6da73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:39.636146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:39.636250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480956-8f5f-4508-9ff2-40590cc6da73 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:39.636338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:39.636424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480956-8f5f-4508-9ff2-40590cc6da73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:39.636424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480956-8f5f-4508-9ff2-40590cc6da73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:39.654556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-25480956-8f5f-4508-9ff2-40590cc6da73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:39.676598 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3325/6601] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:39.677555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:39.688151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25480956-8f5f-4508-9ff2-40590cc6da73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:39.689618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25480956-8f5f-4508-9ff2-40590cc6da73 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:39.699547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bd12e-2d79-4521-8fd0-6f0282a98649 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:39.712919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:39.715265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:39.717755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:39.723675 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3277/6602] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:39.723846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] PATH_INFO: `/v3/projects/0eb9a04a2aa74f38bb10c2fbd476bae8/users/56d394d9066a41269580a5a0c34a4adb/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:39.725250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb9a04a2aa74f38bb10c2fbd476bae8, user_id=56d394d9066a41269580a5a0c34a4adb, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:39.729466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:39.763080 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3326/6603] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:39 2022] PUT /identity/v3/projects/0eb9a04a2aa74f38bb10c2fbd476bae8/users/56d394d9066a41269580a5a0c34a4adb/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:39.764859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85c5e-c03c-4a65-b3c9-4c49eef849a4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:39.765159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85c5e-c03c-4a65-b3c9-4c49eef849a4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:39.765439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85c5e-c03c-4a65-b3c9-4c49eef849a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:39.827482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-81d85c5e-c03c-4a65-b3c9-4c49eef849a4 None None] MFA Rules not processed for user `56d394d9066a41269580a5a0c34a4adb`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:39.828526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-81d85c5e-c03c-4a65-b3c9-4c49eef849a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:39.944776 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3278/6604] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:39.958119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:39.960287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:40.044162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4148417-cab0-4257-9e37-3ad1597bcb25 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:40.049904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4cd00-4efa-4527-a97c-631344e482b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:40.050982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cd00-4efa-4527-a97c-631344e482b1 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:40.051420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cd00-4efa-4527-a97c-631344e482b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:40.051878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4cd00-4efa-4527-a97c-631344e482b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:40.067311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4cd00-4efa-4527-a97c-631344e482b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:40.070207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4cd00-4efa-4527-a97c-631344e482b1 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:40.099895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3327/6605] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:41.584492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85c5e-c03c-4a65-b3c9-4c49eef849a4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:41.792455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85c5e-c03c-4a65-b3c9-4c49eef849a4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:41.806437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:41.807191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:41.808238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:41.808492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] PATH_INFO: `/v3/users/5f691912a57543c2b7657d4dc5d71da1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:41.809940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f691912a57543c2b7657d4dc5d71da1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:41.811897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:42.101140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f691912a57543c2b7657d4dc5d71da1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.117362 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:42.130034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f691912a57543c2b7657d4dc5d71da1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.140829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f691912a57543c2b7657d4dc5d71da1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.142493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f691912a57543c2b7657d4dc5d71da1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.247227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f691912a57543c2b7657d4dc5d71da1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.267176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:42.267670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:42.267780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:42.286221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3279/6606] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:41 2022] DELETE /identity/v3/users/5f691912a57543c2b7657d4dc5d71da1 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:42.315456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:42.318163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:42.469069 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3328/6607] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:42.497344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:42.500934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:42.514153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:42.519146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:42.550329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505cdc-2d68-4456-a57e-e7b6b7d71a77 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:42.576229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:42.576895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:42.577182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:42.577459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] PATH_INFO: `/v3/projects/2ea60de97ada4e358b5e753996562f01` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:42.583424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea60de97ada4e358b5e753996562f01)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:42.585389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:42.679606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e192c-d2f7-45cc-9aef-d6de3f6a5010 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:42.688792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:42.689454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:42.689743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:42.691721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:42.707993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:42.710074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:42.732809 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3280/6608] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:42.802031 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:42.808574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea60de97ada4e358b5e753996562f01', 'request_id': 'req-132a2930-58f6-4b99-975d-dae43ab9a2d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.830531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea60de97ada4e358b5e753996562f01', 'request_id': 'req-132a2930-58f6-4b99-975d-dae43ab9a2d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.925530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea60de97ada4e358b5e753996562f01', 'request_id': 'req-132a2930-58f6-4b99-975d-dae43ab9a2d1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.940496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] The token cache is being invalidate because project 2ea60de97ada4e358b5e753996562f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:42.940897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.950375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:42.952341 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3329/6609] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:42 2022] DELETE /identity/v3/projects/2ea60de97ada4e358b5e753996562f01 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:42.956297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:42.976323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebdac8-fdea-4bb4-9e4e-5a9b3c9897e0 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:43.136955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:43.137611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:43.137913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:43.138189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] PATH_INFO: `/v3/users/f339c7e1f08240809a67f4ae61e55d36` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:43.140028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f339c7e1f08240809a67f4ae61e55d36)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:43.149785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:43.430648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f339c7e1f08240809a67f4ae61e55d36'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:43.468780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f339c7e1f08240809a67f4ae61e55d36'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:43.488580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f339c7e1f08240809a67f4ae61e55d36'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:43.490678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f339c7e1f08240809a67f4ae61e55d36'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:43.504505 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:43.584897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f339c7e1f08240809a67f4ae61e55d36'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:43.593553 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3281/6610] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:42 2022] DELETE /identity/v3/users/f339c7e1f08240809a67f4ae61e55d36 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:45.150401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:45.153427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:45.183973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2930-58f6-4b99-975d-dae43ab9a2d1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:45.227708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:45.245745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:45.430869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:45.433481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:45.433994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:45.436107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] PATH_INFO: `/v3/projects/037cefae4f5342a69f7683f59706de0b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:45.440007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037cefae4f5342a69f7683f59706de0b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:45.447246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:45.467064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6986531-0223-42b1-a852-150eddbd3217 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:45.480516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:45.481446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:45.482029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:45.485145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] PATH_INFO: `/v3/projects/9b7a80ef35c448879fd78b8549372308` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:45.485145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7a80ef35c448879fd78b8549372308)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:45.487010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:45.717494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037cefae4f5342a69f7683f59706de0b', 'request_id': 'req-928bd434-72b4-495a-9fa6-4e94c0599886'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.745786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037cefae4f5342a69f7683f59706de0b', 'request_id': 'req-928bd434-72b4-495a-9fa6-4e94c0599886'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.780368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7a80ef35c448879fd78b8549372308', 'request_id': 'req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.810725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7a80ef35c448879fd78b8549372308', 'request_id': 'req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.863030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037cefae4f5342a69f7683f59706de0b', 'request_id': 'req-928bd434-72b4-495a-9fa6-4e94c0599886'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.883403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] The token cache is being invalidate because project 037cefae4f5342a69f7683f59706de0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:45.883620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.888224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-928bd434-72b4-495a-9fa6-4e94c0599886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.897117 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3330/6611] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:45 2022] DELETE /identity/v3/projects/037cefae4f5342a69f7683f59706de0b => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:45.903056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fb0e-c3b0-4fa5-a94f-8bfd9afb9bb0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:45.903388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fb0e-c3b0-4fa5-a94f-8bfd9afb9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:45.903608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26fb0e-c3b0-4fa5-a94f-8bfd9afb9bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:45.955070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7a80ef35c448879fd78b8549372308', 'request_id': 'req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.985001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] The token cache is being invalidate because project 9b7a80ef35c448879fd78b8549372308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:45.987254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.990174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:45.991324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2b26fb0e-c3b0-4fa5-a94f-8bfd9afb9bb0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:45.994023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2b26fb0e-c3b0-4fa5-a94f-8bfd9afb9bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:45.999730 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3282/6612] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:45 2022] DELETE /identity/v3/projects/9b7a80ef35c448879fd78b8549372308 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:46.005301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:46.007276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:46.203430 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3331/6613] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:46.210551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca16f-f043-4380-acef-d08483799dfe None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:46.211310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca16f-f043-4380-acef-d08483799dfe None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:46.212084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afca16f-f043-4380-acef-d08483799dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:46.247011 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:46.261519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9afca16f-f043-4380-acef-d08483799dfe None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:46.266315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9afca16f-f043-4380-acef-d08483799dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:46.280793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4e5bb-2317-406a-8f31-87f3d9ec9a98 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:46.296202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3332/6614] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:46.298583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca16f-f043-4380-acef-d08483799dfe None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:46.303563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:46.305147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:46.309298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:46.310646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] PATH_INFO: `/v3/users/56d394d9066a41269580a5a0c34a4adb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:46.316102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d394d9066a41269580a5a0c34a4adb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:46.320191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afca16f-f043-4380-acef-d08483799dfe None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:46.327390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:46.337978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:46.339654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:46.340091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:46.340523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:46.341540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:46.342042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:46.345589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:46.426396 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3333/6615] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:43:46.427419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:46.448930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f01213-72d8-455b-b19e-ed9e793911a4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:46.471535 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:46.474147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:46.478124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:46.478424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:46.478706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:46.483753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:46.492232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:46.585843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d394d9066a41269580a5a0c34a4adb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:46.640134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d394d9066a41269580a5a0c34a4adb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:46.655310 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3334/6616] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:46 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:46.660708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d394d9066a41269580a5a0c34a4adb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:46.664437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:46.664625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d394d9066a41269580a5a0c34a4adb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:46.674848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:46.754870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d394d9066a41269580a5a0c34a4adb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:46.766104 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3283/6617] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:46 2022] DELETE /identity/v3/users/56d394d9066a41269580a5a0c34a4adb => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:46.813289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33441-bf18-4249-b916-867033ee5773 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:46.894202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:46.895390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:46.896051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:46.896566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:46.897361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:46.902663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:47.012476 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3335/6618] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:46 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:47.016279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:47.050110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552f3f8-16a4-4dd1-bebe-5551f11e26ec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:47.072116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:47.072746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:47.073673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:47.074180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:47.075023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:47.076636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:47.115882 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3284/6619] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:47.119261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:47.136275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a02bb-7fe0-43ab-b223-3f68726f1f5b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:47.152432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba7d1f-50e7-42ea-bf1d-808a86ea518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:47.154431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7d1f-50e7-42ea-bf1d-808a86ea518f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:47.156137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7d1f-50e7-42ea-bf1d-808a86ea518f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:47.156619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba7d1f-50e7-42ea-bf1d-808a86ea518f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:47.158782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba7d1f-50e7-42ea-bf1d-808a86ea518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:47.163371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba7d1f-50e7-42ea-bf1d-808a86ea518f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:47.180658 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3336/6620] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:47.185669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:47.202639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c4b7-396a-4eaf-86aa-989dab47f167 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:47.212340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:47.213021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:47.213438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:47.213725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] PATH_INFO: `/v3/projects/336fa47768794becb69119558fa6eaae/users/0c969c270f8e40548984df6b651aebe8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:47.273680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=336fa47768794becb69119558fa6eaae, user_id=0c969c270f8e40548984df6b651aebe8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:47.277801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:47.413417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3285/6621] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:47 2022] PUT /identity/v3/projects/336fa47768794becb69119558fa6eaae/users/0c969c270f8e40548984df6b651aebe8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:47.428771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efd210-3fc9-4366-b17d-d0e1916475b7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:47.429316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efd210-3fc9-4366-b17d-d0e1916475b7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:47.429546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efd210-3fc9-4366-b17d-d0e1916475b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:47.486502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-46efd210-3fc9-4366-b17d-d0e1916475b7 None None] MFA Rules not processed for user `0c969c270f8e40548984df6b651aebe8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:47.487853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-46efd210-3fc9-4366-b17d-d0e1916475b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:47.617238 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:47.740211 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3337/6622] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:47.743655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:47.931090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89d2b-cb78-43bc-850c-132704beee7d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:47.939319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:47.940369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:47.940813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:47.941282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:47.942126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:47.950847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:48.097902 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3286/6623] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:47 2022] POST /identity/v3/projects => generated 385 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:43:48.098309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efd210-3fc9-4366-b17d-d0e1916475b7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:48.145932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efd210-3fc9-4366-b17d-d0e1916475b7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:48.374977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:48.376602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:48.376602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:48.376602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:48.378993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:48.383705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:48.560296 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3338/6624] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:48 2022] POST /identity/v3/users => generated 299 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:48.564257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:48.581458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88049e81-ed74-4330-8e5e-e442b31c3ea8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:48.606811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:48.607995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:48.610664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:48.610966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:48.616401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:48.616401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:48.702129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:48.713130 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3287/6625] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:48.715697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0e4f5-a604-44d7-a762-cda2b1671c61 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:48.721709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:48.722699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:48.723136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:48.723579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] PATH_INFO: `/v3/projects/2d445d6c24ee4f178482c75345aacb34/users/9b45e83814734e9bb3cb1039581c93f5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:48.751208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d445d6c24ee4f178482c75345aacb34, user_id=9b45e83814734e9bb3cb1039581c93f5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:48.754914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:48.866666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:48.867339 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3339/6626] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:48 2022] PUT /identity/v3/projects/2d445d6c24ee4f178482c75345aacb34/users/9b45e83814734e9bb3cb1039581c93f5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:48.899692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79870d0-4ae2-4e59-9587-ba99a1b562ed admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:48.995601 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:49.021083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146112ac-f1b4-4256-81b3-4ce67645e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:49.021670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146112ac-f1b4-4256-81b3-4ce67645e118 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:49.021986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146112ac-f1b4-4256-81b3-4ce67645e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:49.022434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146112ac-f1b4-4256-81b3-4ce67645e118 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:49.023157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146112ac-f1b4-4256-81b3-4ce67645e118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:49.024795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146112ac-f1b4-4256-81b3-4ce67645e118 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:49.042954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:49.044849 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3288/6627] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:49.060078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785608b-bfc1-4680-80e2-0df480fb3f2a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:49.077866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:49.079160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:49.079441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:49.079715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] PATH_INFO: `/v3/projects/2d445d6c24ee4f178482c75345aacb34/users/9b45e83814734e9bb3cb1039581c93f5/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:49.081798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d445d6c24ee4f178482c75345aacb34, user_id=9b45e83814734e9bb3cb1039581c93f5, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:49.085097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:49.122833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3340/6628] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:49 2022] PUT /identity/v3/projects/2d445d6c24ee4f178482c75345aacb34/users/9b45e83814734e9bb3cb1039581c93f5/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:49.134134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:49.136084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:49.136084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:49.176004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] MFA Rules not processed for user `9b45e83814734e9bb3cb1039581c93f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:49.177701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:49.266848 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3289/6629] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:49.274363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:49.277702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:49.503084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13a9b2-6955-4373-9b79-af4e61cbd95b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:49.513594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:49.514278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:49.515287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:49.515575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:49.547093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:49.554908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:49.595467 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3341/6630] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:50.470475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:50.473297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:50.618210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:50.620192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:50.722684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6ec49-3763-473c-a348-cdf4de49e07c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:50.736733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:50.737541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:50.738909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:50.738909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] PATH_INFO: `/v3/projects/0eb9a04a2aa74f38bb10c2fbd476bae8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:50.746519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb9a04a2aa74f38bb10c2fbd476bae8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:50.749051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:50.763965 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:50.848237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b01bd5-5725-4afe-8149-b67af5725dec service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:50.875789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c1c4-59c1-41da-9f7c-68cce2cb567a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:50.882773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c1c4-59c1-41da-9f7c-68cce2cb567a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:50.883422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c1c4-59c1-41da-9f7c-68cce2cb567a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:50.883727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c1c4-59c1-41da-9f7c-68cce2cb567a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:50.890728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c12c1c4-59c1-41da-9f7c-68cce2cb567a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:50.918998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12c1c4-59c1-41da-9f7c-68cce2cb567a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:50.925527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12c1c4-59c1-41da-9f7c-68cce2cb567a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:50.951734 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3342/6631] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:50.959777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb9a04a2aa74f38bb10c2fbd476bae8', 'request_id': 'req-862095eb-1829-4c56-8a2f-e2bd36f22af2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:50.978194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb9a04a2aa74f38bb10c2fbd476bae8', 'request_id': 'req-862095eb-1829-4c56-8a2f-e2bd36f22af2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:51.046219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb9a04a2aa74f38bb10c2fbd476bae8', 'request_id': 'req-862095eb-1829-4c56-8a2f-e2bd36f22af2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:51.049706 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:51.082790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] The token cache is being invalidate because project 0eb9a04a2aa74f38bb10c2fbd476bae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:51.089509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:51.096561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-862095eb-1829-4c56-8a2f-e2bd36f22af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:51.106278 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3290/6632] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:50 2022] DELETE /identity/v3/projects/0eb9a04a2aa74f38bb10c2fbd476bae8 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:51.110538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69678-2528-4a33-9ff4-c25a9ffebdf0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:51.110884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69678-2528-4a33-9ff4-c25a9ffebdf0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:51.111561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69678-2528-4a33-9ff4-c25a9ffebdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:51.172199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eba69678-2528-4a33-9ff4-c25a9ffebdf0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:51.178142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eba69678-2528-4a33-9ff4-c25a9ffebdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:51.405233 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3343/6633] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:51.405724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9731fd-478c-4953-b0c0-070617353c81 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:51.406172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9731fd-478c-4953-b0c0-070617353c81 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:51.406525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9731fd-478c-4953-b0c0-070617353c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:51.474077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dd9731fd-478c-4953-b0c0-070617353c81 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:51.481629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dd9731fd-478c-4953-b0c0-070617353c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:51.521342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69678-2528-4a33-9ff4-c25a9ffebdf0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:51.528642 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3291/6634] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:51.535290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69678-2528-4a33-9ff4-c25a9ffebdf0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:51.564576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:51.567905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:51.570978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:51.571341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:51.578411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:51.582106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:51.589326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:51.661798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3344/6635] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:43:51.666571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9731fd-478c-4953-b0c0-070617353c81 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:51.683141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9731fd-478c-4953-b0c0-070617353c81 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:51.708246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:51.711940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:51.712356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:51.715718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:51.716622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:51.728480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:51.741689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:51.745761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:51.791837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceafcd-3ee2-43a3-b5cc-81463eeb5a6c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:51.816053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:51.820673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:51.822256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:51.826017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] PATH_INFO: `/v3/users/0c969c270f8e40548984df6b651aebe8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:51.827942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c969c270f8e40548984df6b651aebe8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:51.837020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:51.888802 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3292/6636] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:51 2022] POST /identity/v3/projects => generated 391 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:51.891173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:52.218809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667ff4-d4a4-456e-a64a-8a587ade3264 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:52.241942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:52.241942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:52.241942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:52.255797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:52.260300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:52.271620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:52.274508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c969c270f8e40548984df6b651aebe8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:52.281618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c969c270f8e40548984df6b651aebe8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:52.410317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c969c270f8e40548984df6b651aebe8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:52.431860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c969c270f8e40548984df6b651aebe8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:52.433077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c6e85ff-bc05-41b0-9bee-d6e5e203e19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c969c270f8e40548984df6b651aebe8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:52.475338 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3293/6637] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:51 2022] POST /identity/v3/users => generated 296 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:52.476458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:52.478048 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3345/6638] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:51 2022] DELETE /identity/v3/users/0c969c270f8e40548984df6b651aebe8 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:52.483661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa15e4a-d24f-40c3-b269-f9d1f326df5f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:52.484126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa15e4a-d24f-40c3-b269-f9d1f326df5f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:52.484539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa15e4a-d24f-40c3-b269-f9d1f326df5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:52.485465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:52.519534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4d60-1770-4391-b90b-0af3c328b20c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:52.531901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-faa15e4a-d24f-40c3-b269-f9d1f326df5f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:52.533392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-faa15e4a-d24f-40c3-b269-f9d1f326df5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:52.616668 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:52.679831 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3346/6639] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:52.692754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:52.693438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:52.693729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:52.702113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:52.702113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:52.715698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:52.744007 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3294/6640] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:52.748223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa15e4a-d24f-40c3-b269-f9d1f326df5f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:52.764549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa15e4a-d24f-40c3-b269-f9d1f326df5f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:52.777441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:52.778292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:52.782480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:52.782480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:52.782480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:52.782480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:52.808396 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3347/6641] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:52.820702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:52.837086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580a44a-1d5f-4ab1-9ae4-874c36fe6625 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:52.854678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3bf46-5e1d-4ec4-bd9b-92ababdac098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:52.855534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3bf46-5e1d-4ec4-bd9b-92ababdac098 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:52.860920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3bf46-5e1d-4ec4-bd9b-92ababdac098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:52.861235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3bf46-5e1d-4ec4-bd9b-92ababdac098 admin admin] PATH_INFO: `/v3/projects/55e4177cb6b940178dce821be2e19702/users/c1a23debe3c447bbb33b63c6e925bc98/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:52.910562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3bf46-5e1d-4ec4-bd9b-92ababdac098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e4177cb6b940178dce821be2e19702, user_id=c1a23debe3c447bbb33b63c6e925bc98, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:52.928848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3bf46-5e1d-4ec4-bd9b-92ababdac098 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:52.959328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:52.962302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:53.100913 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3295/6642] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:52 2022] PUT /identity/v3/projects/55e4177cb6b940178dce821be2e19702/users/c1a23debe3c447bbb33b63c6e925bc98/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:53.113003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a71ac5-2794-4eca-af25-e9de44481248 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:53.114357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a71ac5-2794-4eca-af25-e9de44481248 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:53.114808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a71ac5-2794-4eca-af25-e9de44481248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:53.206367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f2a71ac5-2794-4eca-af25-e9de44481248 None None] MFA Rules not processed for user `c1a23debe3c447bbb33b63c6e925bc98`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:53.209722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f2a71ac5-2794-4eca-af25-e9de44481248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:53.268756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e1c6-27c2-405a-886f-3624f9c3cd3f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:53.290508 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:53.498649 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3296/6643] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:53.504731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a71ac5-2794-4eca-af25-e9de44481248 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:53.516084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:53.518015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:53.518651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:53.523579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:53.678197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:53.678197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:53.701437 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3348/6644] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:43:53.886719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a71ac5-2794-4eca-af25-e9de44481248 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:53.916286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:53.917469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:53.917749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:53.918041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:53.918696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:53.934155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:54.132920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3297/6645] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:53 2022] POST /identity/v3/projects => generated 391 bytes in 629 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:54.136869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:54.158032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684134d-7374-4db9-8a50-608d3b08a6d4 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:54.232934 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:54.314046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:54.316465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:54.316846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:54.320023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:54.321247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:54.325534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:54.456286 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3349/6646] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:54 2022] POST /identity/v3/users => generated 302 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:54.460215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:54.476329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a9254-065f-46fa-8fc0-7346cc26d2e5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:54.489827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:54.490652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:54.492087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:54.492481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:54.498112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:54.503566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:54.553264 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3298/6647] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:54.556735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:54.572390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753777ff-4a72-401e-b14d-79cd34b203dd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:54.583423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:54.584412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:54.584854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:54.585287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] PATH_INFO: `/v3/projects/a089ec3a7fb64722a81f2c3a445f78db/users/2cc5d21b8c6a4fba969477e67ad95cc3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:54.608884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a089ec3a7fb64722a81f2c3a445f78db, user_id=2cc5d21b8c6a4fba969477e67ad95cc3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:54.612193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:54.724955 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3350/6648] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:54 2022] PUT /identity/v3/projects/a089ec3a7fb64722a81f2c3a445f78db/users/2cc5d21b8c6a4fba969477e67ad95cc3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:54.729481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:54.743769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe15b-3459-45ab-aa4d-d34c6e6cf8e2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:54.760796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:54.763850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:54.861329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:54.862003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:54.862332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:54.862607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:54.863674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:54.865084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:54.883085 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3299/6649] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:43:54.887604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:54.903725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f24c-8d5a-4c23-85c0-d45f4b64cd68 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:54.911059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c2ac-1389-4fbb-8699-7677a3fee376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:54.912652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c2ac-1389-4fbb-8699-7677a3fee376 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:54.913170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c2ac-1389-4fbb-8699-7677a3fee376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:54.913698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c2ac-1389-4fbb-8699-7677a3fee376 admin admin] PATH_INFO: `/v3/projects/a089ec3a7fb64722a81f2c3a445f78db/users/2cc5d21b8c6a4fba969477e67ad95cc3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:54.916009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51c2ac-1389-4fbb-8699-7677a3fee376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a089ec3a7fb64722a81f2c3a445f78db, user_id=2cc5d21b8c6a4fba969477e67ad95cc3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:54.920180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51c2ac-1389-4fbb-8699-7677a3fee376 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:54.962998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3300/6650] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:54 2022] PUT /identity/v3/projects/a089ec3a7fb64722a81f2c3a445f78db/users/2cc5d21b8c6a4fba969477e67ad95cc3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:54.966552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:54.968138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:54.968637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:55.058936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] MFA Rules not processed for user `2cc5d21b8c6a4fba969477e67ad95cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:55.061377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:55.071453 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:55.241615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2c66e-0c59-4e9c-8444-4e0c50bf35fe admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:55.307563 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3301/6651] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:55.308542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:55.311673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:55.482084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845a73c-1d4a-4494-b94f-b7d4a61d661b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:55.501462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:55.502394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:55.502675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:55.502950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:55.504994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:55.512390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:55.513730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:55.514239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:55.514740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] PATH_INFO: `/v3/users/88c64df8e3034b71b25b6139a454bdf1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:55.516900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c64df8e3034b71b25b6139a454bdf1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:55.522175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:55.543934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:55.566044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:55.575865 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3351/6652] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 816 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:43:55.584792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:55.590992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:55.624481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324e709-59bc-49ef-91b0-814f019bd055 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:55.637023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:55.637682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:55.638013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:55.638330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] PATH_INFO: `/v3/users/13d47aaea13a458299f133080c5e3004` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:55.640002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d47aaea13a458299f133080c5e3004)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:55.642158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:56.038096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c64df8e3034b71b25b6139a454bdf1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.051059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c64df8e3034b71b25b6139a454bdf1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.057948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c64df8e3034b71b25b6139a454bdf1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.058692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c64df8e3034b71b25b6139a454bdf1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.142826 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:56.231899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c64df8e3034b71b25b6139a454bdf1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.246355 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3302/6653] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:55 2022] DELETE /identity/v3/users/88c64df8e3034b71b25b6139a454bdf1 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:56.248085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:56.249962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:56.271379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d47aaea13a458299f133080c5e3004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.272211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d47aaea13a458299f133080c5e3004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.337843 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:56.409527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d47aaea13a458299f133080c5e3004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.425616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d47aaea13a458299f133080c5e3004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.426815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d47aaea13a458299f133080c5e3004'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.427490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c1dcb-a21d-4ef2-a47d-a2bad3021249 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:56.439402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:56.440055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:56.440329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:56.440737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:56.448193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:56.505590 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3352/6654] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:55 2022] DELETE /identity/v3/users/13d47aaea13a458299f133080c5e3004 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:56.510557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:56.517726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:56.569471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:56.574277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:56.597387 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3303/6655] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:56.649772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:56.652476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:56.688204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16a1ef-a216-44e5-8586-ea6394f24f3b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:56.690169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153441-0c02-4b7d-a649-f289a7e85e91 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:56.703307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:56.704252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:56.704731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:56.705192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] PATH_INFO: `/v3/projects/336fa47768794becb69119558fa6eaae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:56.706948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336fa47768794becb69119558fa6eaae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:56.713385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:56.781845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:56.781845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:56.781845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:56.781845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:56.783726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:56.896270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:56.898349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:56.920353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336fa47768794becb69119558fa6eaae', 'request_id': 'req-4d565557-9d44-429f-a943-b7a71e706285'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:56.926887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3304/6656] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:56.944727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336fa47768794becb69119558fa6eaae', 'request_id': 'req-4d565557-9d44-429f-a943-b7a71e706285'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.039115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336fa47768794becb69119558fa6eaae', 'request_id': 'req-4d565557-9d44-429f-a943-b7a71e706285'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.088055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] The token cache is being invalidate because project 336fa47768794becb69119558fa6eaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:57.092404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.100894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.103318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3353/6657] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:56 2022] DELETE /identity/v3/projects/336fa47768794becb69119558fa6eaae => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:57.107755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:57.123386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795830c1-98f1-449a-b07b-83f82029f11e service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:57.141936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:57.144864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:57.250256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:57.251159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:57.251537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:57.251910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] PATH_INFO: `/v3/users/9b45e83814734e9bb3cb1039581c93f5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:57.253193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b45e83814734e9bb3cb1039581c93f5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:57.255464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:57.347793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d565557-9d44-429f-a943-b7a71e706285 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:57.358018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:57.359054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:57.359396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:57.359678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] PATH_INFO: `/v3/projects/2c0a3bc3d53b4ab886103d1868ce89b0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:57.361597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0a3bc3d53b4ab886103d1868ce89b0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:57.363582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:57.537214 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:57.599544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b45e83814734e9bb3cb1039581c93f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.606102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0a3bc3d53b4ab886103d1868ce89b0', 'request_id': 'req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.620020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0a3bc3d53b4ab886103d1868ce89b0', 'request_id': 'req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.653620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b45e83814734e9bb3cb1039581c93f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.670914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b45e83814734e9bb3cb1039581c93f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.672611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b45e83814734e9bb3cb1039581c93f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.707559 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:57.709162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0a3bc3d53b4ab886103d1868ce89b0', 'request_id': 'req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.741322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] The token cache is being invalidate because project 2c0a3bc3d53b4ab886103d1868ce89b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:57.741322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.741322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.741322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3354/6658] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:57 2022] DELETE /identity/v3/projects/2c0a3bc3d53b4ab886103d1868ce89b0 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:57.744989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:57.746168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:57.863394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a60e1079-b403-465f-8d09-d891d0a771cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b45e83814734e9bb3cb1039581c93f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:57.872268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3305/6659] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:43:57 2022] DELETE /identity/v3/users/9b45e83814734e9bb3cb1039581c93f5 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:43:57.934073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91586e-08f3-4138-b9a9-9d772badaa49 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:57.934073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91586e-08f3-4138-b9a9-9d772badaa49 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:57.934073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91586e-08f3-4138-b9a9-9d772badaa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:57.935305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69afee-f8bb-4d0d-b02d-48868cba0eb5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:57.935524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5c91586e-08f3-4138-b9a9-9d772badaa49 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:57.935524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c91586e-08f3-4138-b9a9-9d772badaa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:57.973831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:57.979150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:57.979150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:57.979150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] PATH_INFO: `/v3/projects/0295485d1ef54b5ca6a03a298b9dedd4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:57.979150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0295485d1ef54b5ca6a03a298b9dedd4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:57.979150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:58.035690 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3306/6660] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:58.056579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013587e-4e78-444b-8350-7bbffd8fc293 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.060188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013587e-4e78-444b-8350-7bbffd8fc293 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.060918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013587e-4e78-444b-8350-7bbffd8fc293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.094000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3013587e-4e78-444b-8350-7bbffd8fc293 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:58.095388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3013587e-4e78-444b-8350-7bbffd8fc293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:58.107512 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3307/6661] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:58.112600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013587e-4e78-444b-8350-7bbffd8fc293 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:58.139347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013587e-4e78-444b-8350-7bbffd8fc293 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:58.163491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0295485d1ef54b5ca6a03a298b9dedd4', 'request_id': 'req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:58.185439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0295485d1ef54b5ca6a03a298b9dedd4', 'request_id': 'req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:58.293554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:58.293554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.293554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.293554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.294005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:58.294005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:58.294005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:58.316170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3308/6662] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:43:58.317250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0295485d1ef54b5ca6a03a298b9dedd4', 'request_id': 'req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:58.321359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:58.336150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] The token cache is being invalidate because project 0295485d1ef54b5ca6a03a298b9dedd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:58.337192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:58.338637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-308a5ab7-6568-4ea7-86ca-fdbaffe1c5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:58.341997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f58c95-8637-4c96-beb9-9e778f757a52 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:58.342164 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3355/6663] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:57 2022] DELETE /identity/v3/projects/0295485d1ef54b5ca6a03a298b9dedd4 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:58.351238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1b71f-d98e-4c15-bae4-40106d607acb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.351625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1b71f-d98e-4c15-bae4-40106d607acb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.351989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1b71f-d98e-4c15-bae4-40106d607acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.352928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:58.353804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.354358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.354785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.355577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:58.363237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:58.390303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d0b1b71f-d98e-4c15-bae4-40106d607acb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:58.393541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d0b1b71f-d98e-4c15-bae4-40106d607acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:58.432678 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3356/6664] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:58.439399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d608f-35e6-48a8-8f7b-6185be65d1ae None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.439622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d608f-35e6-48a8-8f7b-6185be65d1ae None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.439901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d608f-35e6-48a8-8f7b-6185be65d1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.451745 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:58.465237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-682d608f-35e6-48a8-8f7b-6185be65d1ae None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:58.466755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-682d608f-35e6-48a8-8f7b-6185be65d1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:58.477833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3357/6665] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:58.482971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d608f-35e6-48a8-8f7b-6185be65d1ae None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:58.503681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d608f-35e6-48a8-8f7b-6185be65d1ae None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:58.530720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:58.531774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.532267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.533107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.533718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:58.534145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:58.535843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:58.559131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3358/6666] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:43:58.560847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:58.581617 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3309/6667] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:58 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:43:58.585430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:58.590884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:58.593019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd032-d8e9-4557-9549-dbc5074cbdaa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:58.695322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:58.695858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.696370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.696651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.697307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:58.700195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:58.839708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667ca8-6f21-442e-9a38-c5c002b23be8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:58.844931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:58.845558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:58.845862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:58.846144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:58.846797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:58.848736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:58.863366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3359/6668] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:58 2022] POST /identity/v3/projects => generated 401 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:58.863366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:58.874884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:58.987934 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3310/6669] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:58 2022] POST /identity/v3/users => generated 294 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:43:58.988764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:58.990087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93cb0-21a1-4d38-b457-d4dc372afa95 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.007264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.007922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.008208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.008491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] PATH_INFO: `/v3/projects/2d445d6c24ee4f178482c75345aacb34` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.009786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d445d6c24ee4f178482c75345aacb34)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.014626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.023047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcefc2-3a9d-4f17-b97b-910093395a04 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.042021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.042958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.043245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.043521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.044161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.047463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.368878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3311/6670] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:43:58 2022] POST /identity/v3/users => generated 301 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:43:59.370610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.395873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22005-5c95-4478-ae93-df961b265f19 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.397716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d445d6c24ee4f178482c75345aacb34', 'request_id': 'req-32a8a409-18dc-4d25-8958-baca5b9874fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:59.417679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d445d6c24ee4f178482c75345aacb34', 'request_id': 'req-32a8a409-18dc-4d25-8958-baca5b9874fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:59.503761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d445d6c24ee4f178482c75345aacb34', 'request_id': 'req-32a8a409-18dc-4d25-8958-baca5b9874fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:59.509403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dcd79-c4e5-449b-8fe7-4585c594372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.510163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dcd79-c4e5-449b-8fe7-4585c594372c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.510513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dcd79-c4e5-449b-8fe7-4585c594372c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.510513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dcd79-c4e5-449b-8fe7-4585c594372c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.511553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dcd79-c4e5-449b-8fe7-4585c594372c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.517232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dcd79-c4e5-449b-8fe7-4585c594372c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.526479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] The token cache is being invalidate because project 2d445d6c24ee4f178482c75345aacb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:43:59.526479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:59.527164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:43:59.528711 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3360/6671] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:43:58 2022] DELETE /identity/v3/projects/2d445d6c24ee4f178482c75345aacb34 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:59.529474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.531138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:59.540665 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3312/6672] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:59.545998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d968-cd9a-4ef9-a96e-f5208864de9c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.546191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d968-cd9a-4ef9-a96e-f5208864de9c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.547688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d968-cd9a-4ef9-a96e-f5208864de9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.553164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8a409-18dc-4d25-8958-baca5b9874fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.561781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.573607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.573607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.573607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.573607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.573607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.583890 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3361/6673] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:59.583890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.587131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:59.587564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b210d968-cd9a-4ef9-a96e-f5208864de9c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:59.593059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b210d968-cd9a-4ef9-a96e-f5208864de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:59.607745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b07322-05bc-4dce-88af-220961b86c3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.624358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9924e-9a0b-4608-9b92-25f053769037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.624358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9924e-9a0b-4608-9b92-25f053769037 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.624665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9924e-9a0b-4608-9b92-25f053769037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.624870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9924e-9a0b-4608-9b92-25f053769037 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.625437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9924e-9a0b-4608-9b92-25f053769037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.627121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9924e-9a0b-4608-9b92-25f053769037 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.628538 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3313/6674] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:59.639994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210d968-cd9a-4ef9-a96e-f5208864de9c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.653064 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3362/6675] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:59.654750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22a31-b426-4aea-81ba-2e6c42223e89 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.655152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22a31-b426-4aea-81ba-2e6c42223e89 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.655527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22a31-b426-4aea-81ba-2e6c42223e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.656756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210d968-cd9a-4ef9-a96e-f5208864de9c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.673268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.673268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.673935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.674373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.675353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.677875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.689654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2fb22a31-b426-4aea-81ba-2e6c42223e89 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:59.691014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2fb22a31-b426-4aea-81ba-2e6c42223e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:59.705325 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3363/6676] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:43:59.706486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22a31-b426-4aea-81ba-2e6c42223e89 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.708372 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3314/6677] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:43:59.709345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.718567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22a31-b426-4aea-81ba-2e6c42223e89 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.722626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb0d8-8d07-46c6-a784-3bf5454a76b2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.724153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.724900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.725610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.725739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] PATH_INFO: `/v3/projects/e6ff032c58b646a9b52bc87b23851f55/users/3150fe59bbbe496bb40fbb9eacaa0637/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.731830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.732675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.733132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.736641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.737424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:43:59.739230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.741733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.743366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ff032c58b646a9b52bc87b23851f55, user_id=3150fe59bbbe496bb40fbb9eacaa0637, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.746911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.759373 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3315/6678] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:43:59.760594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.780163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51406222-92a4-449b-8b3d-58fd9ff0b8b9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.788801 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:59.796294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ae3ba-535d-4bd2-bc5e-ec13fa60f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.797052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ae3ba-535d-4bd2-bc5e-ec13fa60f161 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.797332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ae3ba-535d-4bd2-bc5e-ec13fa60f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.797608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ae3ba-535d-4bd2-bc5e-ec13fa60f161 admin admin] PATH_INFO: `/v3/projects/78ddc893f35f43e9b7ca437bbe87ad1e/users/9198a80886d148299a305c91884f4b93/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.823575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ae3ba-535d-4bd2-bc5e-ec13fa60f161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ddc893f35f43e9b7ca437bbe87ad1e, user_id=9198a80886d148299a305c91884f4b93, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.825664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ae3ba-535d-4bd2-bc5e-ec13fa60f161 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.859076 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3364/6679] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:59 2022] PUT /identity/v3/projects/e6ff032c58b646a9b52bc87b23851f55/users/3150fe59bbbe496bb40fbb9eacaa0637/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:59.860026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:59.932090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88398fe0-e39d-436a-b42d-335ea8200ac9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:59.937732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc0d9d-e632-475b-9f74-178bf5ac3969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:59.939976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0d9d-e632-475b-9f74-178bf5ac3969 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.940430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0d9d-e632-475b-9f74-178bf5ac3969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.941124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0d9d-e632-475b-9f74-178bf5ac3969 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:59.942027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc0d9d-e632-475b-9f74-178bf5ac3969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:59.944766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc0d9d-e632-475b-9f74-178bf5ac3969 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:59.994444 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3316/6680] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:43:59 2022] PUT /identity/v3/projects/78ddc893f35f43e9b7ca437bbe87ad1e/users/9198a80886d148299a305c91884f4b93/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:43:59.998709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3cdd3-8f03-47ac-a126-e61715e6a892 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:59.999403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3cdd3-8f03-47ac-a126-e61715e6a892 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:59.999860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3cdd3-8f03-47ac-a126-e61715e6a892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.037869 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3365/6681] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:43:59 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:00.038747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-76f3cdd3-8f03-47ac-a126-e61715e6a892 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:00.040999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.041625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.042026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.042836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-76f3cdd3-8f03-47ac-a126-e61715e6a892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:00.099915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] MFA Rules not processed for user `9198a80886d148299a305c91884f4b93`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:00.101971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:00.117132 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3317/6682] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:00.121417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3cdd3-8f03-47ac-a126-e61715e6a892 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.138466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3cdd3-8f03-47ac-a126-e61715e6a892 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.150641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:00.152004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.152280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.152583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.153291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:00.159885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:00.233292 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3366/6683] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:00.235756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.238697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:00.296232 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3318/6684] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:00 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:00.297392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.325615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5726135-c0c8-49a1-9cb1-ff02ac03a70d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.339503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:00.342927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.343292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.343632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.346902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:00.349093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:00.395863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb6dc7-6149-4e9b-b5c1-49a258899abb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.407222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:00.407996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.408316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.408612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.428842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:00.432970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:00.466441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3367/6685] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:00.466441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.483795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2b59-1bb0-482c-94d6-2f0fe8c757d0 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.493090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:00.494971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.495306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.495525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.496244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:00.497781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:00.513341 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3368/6686] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:00.514320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.528387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0aa6b3-c122-42a5-a4cd-98d0ccdecc0b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.532085 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:00.536319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:00.536943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.537222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.537923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.538179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:00.539986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:00.547561 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3319/6687] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:00 2022] POST /identity/v3/projects => generated 403 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:00.554791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.566919 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3369/6688] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:00.577468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.608263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4400d81-b73c-421b-bbf1-0f2047bf26eb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.641283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6750918-0111-4ccc-b5b3-d66e9bde6ca2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.647043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:00.647893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.648610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.649209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.650051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:00.653304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:00.692160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1f7fa-43e4-4265-ae8c-6b88b282336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:00.692944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f7fa-43e4-4265-ae8c-6b88b282336c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.693289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f7fa-43e4-4265-ae8c-6b88b282336c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.693647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f7fa-43e4-4265-ae8c-6b88b282336c admin admin] PATH_INFO: `/v3/projects/5bd526ba0b704f16a489a484bd346d65/users/f873c2a9178840cebd3f564fd68759a1/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.711210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1f7fa-43e4-4265-ae8c-6b88b282336c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd526ba0b704f16a489a484bd346d65, user_id=f873c2a9178840cebd3f564fd68759a1, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:00.714783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1f7fa-43e4-4265-ae8c-6b88b282336c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:00.891130 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3320/6689] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:00 2022] POST /identity/v3/users => generated 308 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:00.892090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:00.912542 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3370/6690] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:00 2022] PUT /identity/v3/projects/5bd526ba0b704f16a489a484bd346d65/users/f873c2a9178840cebd3f564fd68759a1/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:00.923954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b63b25-6df1-4567-9a46-141f5a4235c0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:00.924266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b63b25-6df1-4567-9a46-141f5a4235c0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:00.924540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b63b25-6df1-4567-9a46-141f5a4235c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:00.940093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeea7d3-8d3f-40e6-8d61-30e29d26f715 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:00.999417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-78b63b25-6df1-4567-9a46-141f5a4235c0 None None] MFA Rules not processed for user `f873c2a9178840cebd3f564fd68759a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:01.002394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78b63b25-6df1-4567-9a46-141f5a4235c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:01.132989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.133614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.134056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.134176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.134840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.139014 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3371/6691] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:01.139189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.140085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b63b25-6df1-4567-9a46-141f5a4235c0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.163967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b63b25-6df1-4567-9a46-141f5a4235c0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.173321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.173669 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3321/6692] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:01.174053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.174324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.174596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.175237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.177208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.178035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.191477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abeda3-64d8-4f62-b660-b09aca15dd8c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.197576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.198956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.199239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.199522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] PATH_INFO: `/v3/projects/21bd567881ec4ba59c68a2c0bd867138/users/340c5c8fb70548ee9a076e3379769f3e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.221791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bd567881ec4ba59c68a2c0bd867138, user_id=340c5c8fb70548ee9a076e3379769f3e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.226919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.357745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3372/6693] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:01 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:01.360666 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3322/6694] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:01 2022] PUT /identity/v3/projects/21bd567881ec4ba59c68a2c0bd867138/users/340c5c8fb70548ee9a076e3379769f3e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:01.362320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.363211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.491745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cad43-60cc-4af7-8866-8d5eef8c05e1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.498704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.499423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.499723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.506054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.506054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.508408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c7564-a66e-4b24-817b-b82c3b0388bb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.508685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.518830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.526392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.526949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.528159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.529225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.535009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.539542 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3373/6695] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:01.541784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.555132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eb0dc-5a77-425f-a9aa-644c13adca93 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.563179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c650eb-2db0-416c-a0e2-a1bc87222488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.564921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c650eb-2db0-416c-a0e2-a1bc87222488 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.565337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c650eb-2db0-416c-a0e2-a1bc87222488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.565673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c650eb-2db0-416c-a0e2-a1bc87222488 admin admin] PATH_INFO: `/v3/projects/21bd567881ec4ba59c68a2c0bd867138/users/340c5c8fb70548ee9a076e3379769f3e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.567837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c650eb-2db0-416c-a0e2-a1bc87222488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bd567881ec4ba59c68a2c0bd867138, user_id=340c5c8fb70548ee9a076e3379769f3e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.572220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c650eb-2db0-416c-a0e2-a1bc87222488 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.591065 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3374/6696] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:01 2022] PUT /identity/v3/projects/21bd567881ec4ba59c68a2c0bd867138/users/340c5c8fb70548ee9a076e3379769f3e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:01.601218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cd51-1bde-4161-aebf-70863a235161 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.601531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cd51-1bde-4161-aebf-70863a235161 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.601777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037cd51-1bde-4161-aebf-70863a235161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.634103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b037cd51-1bde-4161-aebf-70863a235161 None None] MFA Rules not processed for user `340c5c8fb70548ee9a076e3379769f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:01.635870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b037cd51-1bde-4161-aebf-70863a235161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:01.691383 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3323/6697] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:01 2022] POST /identity/v3/users => generated 299 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:01.695203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.712696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d646642-1644-401f-835f-e0c8a295b828 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.757854 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3375/6698] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:01.762585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037cd51-1bde-4161-aebf-70863a235161 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.785130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037cd51-1bde-4161-aebf-70863a235161 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.790117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340c5c8fb70548ee9a076e3379769f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21bd567881ec4ba59c68a2c0bd867138', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.791066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.792113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.792409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.793553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.795446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.810815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.813593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.813593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.813593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.813593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.814663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.825367 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3324/6699] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:01.829854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.841867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d18f7-ded7-412d-90ca-372402dc8679 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.846944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.847608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.847889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.848164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] PATH_INFO: `/v3/projects/5a6938631c3d4a1ba5102e12d808fa5f/users/c3723cf0930c4c25a23d38df6f16e081/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.864925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6938631c3d4a1ba5102e12d808fa5f, user_id=c3723cf0930c4c25a23d38df6f16e081, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:01.867919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:01.944417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3376/6700] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:44:01 2022] POST /identity/v3/roles => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:01.945579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:01.966458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b475850-49ad-42a6-9468-813e2d99fec5 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:01.972506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340c5c8fb70548ee9a076e3379769f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21bd567881ec4ba59c68a2c0bd867138', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:01.973402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:01.974024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:01.974638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] PATH_INFO: `/v3/projects/78ddc893f35f43e9b7ca437bbe87ad1e/users/9198a80886d148299a305c91884f4b93/roles/a7098e166fd141af92593a49d905b3e9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:01.998185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=78ddc893f35f43e9b7ca437bbe87ad1e, user_id=9198a80886d148299a305c91884f4b93, role_id=a7098e166fd141af92593a49d905b3e9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:02.001131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:02.009130 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3325/6701] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:01 2022] PUT /identity/v3/projects/5a6938631c3d4a1ba5102e12d808fa5f/users/c3723cf0930c4c25a23d38df6f16e081/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:02.013637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:02.095367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562844d-6595-472b-bee0-13d33ac206eb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:02.101692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:02.102394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:02.102673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:02.102944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:02.103845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:02.106187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:02.125278 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3326/6702] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:02 2022] GET /identity/v3/roles => generated 1651 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:02.126367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:02.139824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e383818-9c83-4c37-9c0d-9a796ac0e9b0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:02.144136 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3377/6703] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:01 2022] PUT /identity/v3/projects/78ddc893f35f43e9b7ca437bbe87ad1e/users/9198a80886d148299a305c91884f4b93/roles/a7098e166fd141af92593a49d905b3e9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:02.148255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:02.263704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d80108-02bf-4bb9-9a5e-b043ffca638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:02.263704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d80108-02bf-4bb9-9a5e-b043ffca638e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:02.263704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d80108-02bf-4bb9-9a5e-b043ffca638e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:02.263704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d80108-02bf-4bb9-9a5e-b043ffca638e admin admin] PATH_INFO: `/v3/projects/5a6938631c3d4a1ba5102e12d808fa5f/users/c3723cf0930c4c25a23d38df6f16e081/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:02.264167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d80108-02bf-4bb9-9a5e-b043ffca638e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6938631c3d4a1ba5102e12d808fa5f, user_id=c3723cf0930c4c25a23d38df6f16e081, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:02.264167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d80108-02bf-4bb9-9a5e-b043ffca638e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:02.264524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d5359-3bbc-4ab1-bd92-2d0d47d6e24a tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:02.271331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39919ee-d0d3-44ae-b200-4bbada8754e0 tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9198a80886d148299a305c91884f4b93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78ddc893f35f43e9b7ca437bbe87ad1e', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1522153095', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:02.272219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39919ee-d0d3-44ae-b200-4bbada8754e0 tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:02.272617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39919ee-d0d3-44ae-b200-4bbada8754e0 tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:02.273266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39919ee-d0d3-44ae-b200-4bbada8754e0 tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] PATH_INFO: `/v3/users/9198a80886d148299a305c91884f4b93/application_credentials` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:02.274236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39919ee-d0d3-44ae-b200-4bbada8754e0 tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] RBAC: Authorizing `identity:create_application_credential(user_id=9198a80886d148299a305c91884f4b93)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:02.276267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39919ee-d0d3-44ae-b200-4bbada8754e0 tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:02.277986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3327/6704] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:02 2022] PUT /identity/v3/projects/5a6938631c3d4a1ba5102e12d808fa5f/users/c3723cf0930c4c25a23d38df6f16e081/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:02.296066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:02.296735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:02.297106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:02.348468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] MFA Rules not processed for user `c3723cf0930c4c25a23d38df6f16e081`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:02.350109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:02.480086 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3328/6705] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:02.494435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:02.496494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:02.546638 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3378/6706] 10.222.0.59 () {60 vars in 1315 bytes} [Sun Aug 28 01:44:02 2022] POST /identity/v3/users/9198a80886d148299a305c91884f4b93/application_credentials => generated 660 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:02.548659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22078e1a-7380-4068-a5aa-83b5f0389d59 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:02.548659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22078e1a-7380-4068-a5aa-83b5f0389d59 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:02.548899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22078e1a-7380-4068-a5aa-83b5f0389d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:02.569592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6d04-caf8-47a5-8497-2dd50ec81ed5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:02.575009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:02.576171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:02.576553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:02.576923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:02.583983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-22078e1a-7380-4068-a5aa-83b5f0389d59 None None] MFA Rules not processed for user `9198a80886d148299a305c91884f4b93`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:02.585493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-22078e1a-7380-4068-a5aa-83b5f0389d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:02.660379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:02.667091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:02.674460 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3329/6707] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:02.681361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:02.683413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:02.786630 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3379/6708] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 28 01:44:02.790676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22078e1a-7380-4068-a5aa-83b5f0389d59 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:02.820536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679531d-2a93-46e9-9aaf-7a0195881878 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:02.839771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:02.840432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:02.840776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:02.841061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:02.843611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:02.873334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:02.875036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:02.881424 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:02.892927 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3330/6709] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:03.104721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22078e1a-7380-4068-a5aa-83b5f0389d59 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:03.125224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9198a80886d148299a305c91884f4b93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78ddc893f35f43e9b7ca437bbe87ad1e', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1522153095', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:03.126061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:03.126352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:03.126631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] PATH_INFO: `/v3/users/9198a80886d148299a305c91884f4b93/application_credentials/0cb98def9fc24050bcc51ec2934a096c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:03.128588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9198a80886d148299a305c91884f4b93, application_credential_id=0cb98def9fc24050bcc51ec2934a096c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:03.130615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:03.248128 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:03.324417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3380/6710] 10.222.0.59 () {58 vars in 1395 bytes} [Sun Aug 28 01:44:02 2022] DELETE /identity/v3/users/9198a80886d148299a305c91884f4b93/application_credentials/0cb98def9fc24050bcc51ec2934a096c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:03.328276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:03.509769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d00b1-13ad-46ef-bb97-e3f0c8c92018 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:03.515413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340c5c8fb70548ee9a076e3379769f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21bd567881ec4ba59c68a2c0bd867138', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:03.520067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:03.520765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:03.522237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] PATH_INFO: `/v3/roles/a7098e166fd141af92593a49d905b3e9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:03.525255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a7098e166fd141af92593a49d905b3e9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:03.529202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:03.870934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] Invalidating the token cache because role a7098e166fd141af92593a49d905b3e9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:03.871325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:03.872121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a6002f0-184f-4630-8b6e-315f2024af96 tempest-ApplicationCredentialsV3AdminTest-1949169689 tempest-ApplicationCredentialsV3AdminTest-1949169689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:03.875012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3331/6711] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:03 2022] DELETE /identity/v3/roles/a7098e166fd141af92593a49d905b3e9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:03.880458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:03.883456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:03.971249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42201-4e8b-4e6c-869c-912831c533be tempest-ApplicationCredentialsV3AdminTest-238981273 tempest-ApplicationCredentialsV3AdminTest-238981273-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:04.059809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:04.062382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:04.062382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:04.062382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] PATH_INFO: `/v3/users/9198a80886d148299a305c91884f4b93` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:04.062657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9198a80886d148299a305c91884f4b93)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:04.066398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:04.398596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9198a80886d148299a305c91884f4b93'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:04.402633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9198a80886d148299a305c91884f4b93'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:04.536805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9198a80886d148299a305c91884f4b93'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:04.566484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9198a80886d148299a305c91884f4b93'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:04.567620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9198a80886d148299a305c91884f4b93'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:04.596733 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3381/6712] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:03 2022] DELETE /identity/v3/users/9198a80886d148299a305c91884f4b93 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:04.600883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:04.601398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:04.601500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:04.655170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:04.656694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:04.657302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:04.662380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:04.791363 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3332/6713] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:04.816140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444a419-1651-4e15-bc9f-b38ed8c2be30 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:04.847236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:04.847236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:04.850270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:04.851218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:04.851682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:04.852117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:04.854378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:04.979694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e9c-7b77-4312-bba0-727dd7af25fe None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:04.988469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:04.989600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:04.992525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:04.992921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:05.014289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:05.016608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:05.035207 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3333/6714] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:44:05.080740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:05.082265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:05.117331 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3382/6715] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:44:05.487935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:05.489878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:05.508954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3edcea-5db6-448a-ace7-b9a90bd2b041 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:05.520757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:05.521802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:05.522615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:05.523169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:05.526761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:05.559037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:05.561415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:05.581518 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3334/6716] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:44:05.901886 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:05.916894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:05.939988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd5492-7c55-44da-8c94-e6851e051dbc service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:05.952827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:05.954053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:05.954550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:05.955071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:05.967937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:06.016521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:06.019244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:06.045474 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3383/6717] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:06.517451 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:07.092747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:07.094711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:07.140501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5373-e0d2-427b-83ed-1c06f87609c6 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:07.163357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:07.164327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:07.165130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:07.165566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] PATH_INFO: `/v3/projects/78ddc893f35f43e9b7ca437bbe87ad1e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:07.167536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ddc893f35f43e9b7ca437bbe87ad1e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:07.173481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:07.392164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ddc893f35f43e9b7ca437bbe87ad1e', 'request_id': 'req-90e9b948-afed-43e8-a620-f05254f0cd99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:07.414232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ddc893f35f43e9b7ca437bbe87ad1e', 'request_id': 'req-90e9b948-afed-43e8-a620-f05254f0cd99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:07.531741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ddc893f35f43e9b7ca437bbe87ad1e', 'request_id': 'req-90e9b948-afed-43e8-a620-f05254f0cd99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:07.572136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] The token cache is being invalidate because project 78ddc893f35f43e9b7ca437bbe87ad1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:07.576076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:07.576922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:07.583618 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3335/6718] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:07 2022] DELETE /identity/v3/projects/78ddc893f35f43e9b7ca437bbe87ad1e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:07.584940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:07.622340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e774032-315e-4739-8e85-e1ec0c03d36e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:07.845635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:07.847179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:07.847693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:07.848315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] PATH_INFO: `/v3/users/340c5c8fb70548ee9a076e3379769f3e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:07.849959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340c5c8fb70548ee9a076e3379769f3e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:07.856233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:08.270579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340c5c8fb70548ee9a076e3379769f3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:08.271355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340c5c8fb70548ee9a076e3379769f3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:08.345049 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:08.433938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340c5c8fb70548ee9a076e3379769f3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:08.444424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340c5c8fb70548ee9a076e3379769f3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:08.445864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340c5c8fb70548ee9a076e3379769f3e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:08.474685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3384/6719] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:07 2022] DELETE /identity/v3/users/340c5c8fb70548ee9a076e3379769f3e => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:09.392900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:09.402034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:09.443957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9b948-afed-43e8-a620-f05254f0cd99 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:09.582640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:09.583518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:09.583982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:09.584570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] PATH_INFO: `/v3/users/c1a23debe3c447bbb33b63c6e925bc98` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:09.585798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a23debe3c447bbb33b63c6e925bc98)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:09.588438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:09.833139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:09.839218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:09.871765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e257c-d6db-4d2c-930a-1037045fe9e6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:09.896593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:09.897270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:09.897560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:09.897865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] PATH_INFO: `/v3/projects/21bd567881ec4ba59c68a2c0bd867138` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:09.900068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bd567881ec4ba59c68a2c0bd867138)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:09.902753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:09.938640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a23debe3c447bbb33b63c6e925bc98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:09.973111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a23debe3c447bbb33b63c6e925bc98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:09.988107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a23debe3c447bbb33b63c6e925bc98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:09.991858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a23debe3c447bbb33b63c6e925bc98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:10.100514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bd567881ec4ba59c68a2c0bd867138', 'request_id': 'req-d48c8c46-4eed-46f6-8c40-5231aa28947d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:10.111982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c7db0c3f-18b0-4015-8629-0207b29f7710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a23debe3c447bbb33b63c6e925bc98'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:10.115947 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:10.120716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bd567881ec4ba59c68a2c0bd867138', 'request_id': 'req-d48c8c46-4eed-46f6-8c40-5231aa28947d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:10.130273 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3336/6720] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:09 2022] DELETE /identity/v3/users/c1a23debe3c447bbb33b63c6e925bc98 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:10.136539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:10.141705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:10.141705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:10.189363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:10.191594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:10.226476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bd567881ec4ba59c68a2c0bd867138', 'request_id': 'req-d48c8c46-4eed-46f6-8c40-5231aa28947d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:10.245135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] The token cache is being invalidate because project 21bd567881ec4ba59c68a2c0bd867138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:10.245715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:10.248502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d48c8c46-4eed-46f6-8c40-5231aa28947d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:10.262885 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3385/6721] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:09 2022] DELETE /identity/v3/projects/21bd567881ec4ba59c68a2c0bd867138 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:10.264739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ad23-41ef-40e7-b96a-df5fa6218578 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:10.265209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ad23-41ef-40e7-b96a-df5fa6218578 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:10.265660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ad23-41ef-40e7-b96a-df5fa6218578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:10.311488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5d96ad23-41ef-40e7-b96a-df5fa6218578 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:10.313558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d96ad23-41ef-40e7-b96a-df5fa6218578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:10.374475 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3337/6722] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:10.396390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:10.398154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:10.479162 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3386/6723] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:10.488898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc0e6-0089-4fc1-8383-ef4ecdfd7c77 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:10.489261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc0e6-0089-4fc1-8383-ef4ecdfd7c77 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:10.489538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc0e6-0089-4fc1-8383-ef4ecdfd7c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:10.523674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dd1cc0e6-0089-4fc1-8383-ef4ecdfd7c77 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:10.526138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dd1cc0e6-0089-4fc1-8383-ef4ecdfd7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:10.538408 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3387/6724] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:10.550234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cc0e6-0089-4fc1-8383-ef4ecdfd7c77 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:10.572787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cc0e6-0089-4fc1-8383-ef4ecdfd7c77 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:10.591150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def66aab-6561-410d-9c15-a5e097bdf6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:10.594717 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:10.595656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66aab-6561-410d-9c15-a5e097bdf6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:10.596146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66aab-6561-410d-9c15-a5e097bdf6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:10.596790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66aab-6561-410d-9c15-a5e097bdf6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:10.597725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def66aab-6561-410d-9c15-a5e097bdf6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:10.598962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4087-1473-499c-8470-dcef9d1afb35 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:10.600111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def66aab-6561-410d-9c15-a5e097bdf6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:10.603826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def66aab-6561-410d-9c15-a5e097bdf6c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:10.606292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:10.607764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:10.608381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:10.608902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:10.627253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:10.633095 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3388/6725] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:10.633095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:10.633095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:10.633095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:10.636432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:10.689864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3338/6726] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:44:10.689864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:10.708156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be35f1-51b7-4c22-a3f3-cebc1ef22697 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:10.722771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:10.725339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:10.725728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:10.725993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:10.726707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:10.730299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:10.849995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:10.857142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:11.004319 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3339/6727] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:10 2022] POST /identity/v3/projects => generated 377 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:11.005287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:11.048491 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3389/6728] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:11.072842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:11.075368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:11.169852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3434-1882-426e-91b8-71ac901d286f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:11.183922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:11.184563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:11.184846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:11.185732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:11.186481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:11.195968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:11.262137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cb30b-6f3a-4654-a183-71ca779f26f7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:11.336348 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:11.347416 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3340/6729] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:11 2022] POST /identity/v3/users => generated 289 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:11.351147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:11.392705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984158b-15e5-409e-83b4-d2079e317c71 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:11.409027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:11.412318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:11.413669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:11.414042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:11.416559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:11.422451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:11.458312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3341/6730] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:11.462022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99877d76-ed45-403a-a09f-b9745101bc96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:11.464476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:11.466036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877d76-ed45-403a-a09f-b9745101bc96 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:11.468205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877d76-ed45-403a-a09f-b9745101bc96 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:11.468668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877d76-ed45-403a-a09f-b9745101bc96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:11.479774 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:11.499928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b0e38-7231-411d-87e3-0891660c3836 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:11.508955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:11.510223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:11.511206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:11.511589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:11.513042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:11.515614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:11.542944 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3342/6731] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:11.554256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:11.567502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dda1be-db17-45ff-9a32-0185cf269b2a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:11.575465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:11.576302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:11.576689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:11.577069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] PATH_INFO: `/v3/projects/5a675c88d641422d8cca5844218f95ed/users/996a7b5cf02243eb99919c3ed91cc3e5/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:11.604262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a675c88d641422d8cca5844218f95ed, user_id=996a7b5cf02243eb99919c3ed91cc3e5, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:11.604627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99877d76-ed45-403a-a09f-b9745101bc96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:11.607535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99877d76-ed45-403a-a09f-b9745101bc96 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:11.608009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:11.659575 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3390/6732] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:44:11.703417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3343/6733] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:11 2022] PUT /identity/v3/projects/5a675c88d641422d8cca5844218f95ed/users/996a7b5cf02243eb99919c3ed91cc3e5/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:11.714996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c431-bfb9-422c-b00d-c46ce8d49b65 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:11.717160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c431-bfb9-422c-b00d-c46ce8d49b65 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:11.717160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c431-bfb9-422c-b00d-c46ce8d49b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:11.792574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6045c431-bfb9-422c-b00d-c46ce8d49b65 None None] MFA Rules not processed for user `996a7b5cf02243eb99919c3ed91cc3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:11.794744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6045c431-bfb9-422c-b00d-c46ce8d49b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:11.877737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:11.882458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:11.889156 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3391/6734] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:11.893512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c431-bfb9-422c-b00d-c46ce8d49b65 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:12.043510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc2bc0-cfd4-4abb-900f-272a445245d8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:12.059612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:12.060739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:12.064653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:12.064959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] PATH_INFO: `/v3/projects/55e4177cb6b940178dce821be2e19702` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:12.067410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e4177cb6b940178dce821be2e19702)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:12.074737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:12.088863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c431-bfb9-422c-b00d-c46ce8d49b65 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:12.098994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:12.101958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:12.102424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:12.102740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:12.104243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:12.106422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:12.295593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e4177cb6b940178dce821be2e19702', 'request_id': 'req-5f9af142-1505-40a6-b48a-328cb464fe88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:12.302960 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3392/6735] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:11 2022] POST /identity/v3/projects => generated 373 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:12.309040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:12.325429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e4177cb6b940178dce821be2e19702', 'request_id': 'req-5f9af142-1505-40a6-b48a-328cb464fe88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:12.411689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e4177cb6b940178dce821be2e19702', 'request_id': 'req-5f9af142-1505-40a6-b48a-328cb464fe88'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:12.429160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] The token cache is being invalidate because project 55e4177cb6b940178dce821be2e19702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:12.429460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:12.437010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:12.440011 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3344/6736] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:11 2022] DELETE /identity/v3/projects/55e4177cb6b940178dce821be2e19702 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:12.458570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:12.465459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:12.584624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421ef31-03b1-4641-8d5e-7bc78e32ec23 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:12.610457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:12.614217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:12.614510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:12.614789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:12.615459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:12.617452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:12.648503 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:12.716373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9af142-1505-40a6-b48a-328cb464fe88 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:12.741272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:12.741983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:12.742273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:12.745301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] PATH_INFO: `/v3/users/2cc5d21b8c6a4fba969477e67ad95cc3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:12.750283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc5d21b8c6a4fba969477e67ad95cc3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:12.758914 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:12.766709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3393/6737] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:12 2022] POST /identity/v3/users => generated 293 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:12.770668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:12.778112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:12.779479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:12.835412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb78e8d-9ee6-412d-8268-7914e0d36809 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:12.866819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:12.868202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:12.868202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:12.868202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:12.878917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:12.886757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:12.927623 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3394/6738] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:12.930321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:12.964438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00556698-e487-451f-a3c9-fa422e281124 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:12.967519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:12.968261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:12.968793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:12.969292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] PATH_INFO: `/v3/projects/dccf0f5e186749a2ad97e4062631ae89/users/ab939184c1a541f9b8b8f3a2c0cdf36d/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:13.046273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccf0f5e186749a2ad97e4062631ae89, user_id=ab939184c1a541f9b8b8f3a2c0cdf36d, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:13.050511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:13.101066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc5d21b8c6a4fba969477e67ad95cc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:13.146748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc5d21b8c6a4fba969477e67ad95cc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:13.167299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc5d21b8c6a4fba969477e67ad95cc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:13.168324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc5d21b8c6a4fba969477e67ad95cc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:13.220187 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3395/6739] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:12 2022] PUT /identity/v3/projects/dccf0f5e186749a2ad97e4062631ae89/users/ab939184c1a541f9b8b8f3a2c0cdf36d/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:13.225099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:13.227281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:13.365744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc5d21b8c6a4fba969477e67ad95cc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:13.389649 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3345/6740] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:12 2022] DELETE /identity/v3/users/2cc5d21b8c6a4fba969477e67ad95cc3 => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:13.437927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6525d3-2d4f-4bfe-97d7-432ee9fa2a32 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:13.652229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e36170-575d-4c3f-aedf-f1eea86ecaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:13.655621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e36170-575d-4c3f-aedf-f1eea86ecaca admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:13.655975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e36170-575d-4c3f-aedf-f1eea86ecaca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:13.656356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e36170-575d-4c3f-aedf-f1eea86ecaca admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:13.657050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e36170-575d-4c3f-aedf-f1eea86ecaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:13.670152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e36170-575d-4c3f-aedf-f1eea86ecaca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:13.706393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:13.720626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d341c8-da60-4ed7-90cd-8c4904818df8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:13.721550 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3396/6741] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:13.748160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:13.749072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:13.749352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:13.749606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] PATH_INFO: `/v3/projects/dccf0f5e186749a2ad97e4062631ae89/users/ab939184c1a541f9b8b8f3a2c0cdf36d/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:13.754685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccf0f5e186749a2ad97e4062631ae89, user_id=ab939184c1a541f9b8b8f3a2c0cdf36d, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:13.772832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:13.798836 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3346/6742] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:13 2022] PUT /identity/v3/projects/dccf0f5e186749a2ad97e4062631ae89/users/ab939184c1a541f9b8b8f3a2c0cdf36d/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:13.814101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc28855-c501-4ad8-9d14-2abcb7dbcb4c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:13.814397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc28855-c501-4ad8-9d14-2abcb7dbcb4c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:13.814679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc28855-c501-4ad8-9d14-2abcb7dbcb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:13.913160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7dc28855-c501-4ad8-9d14-2abcb7dbcb4c None None] MFA Rules not processed for user `ab939184c1a541f9b8b8f3a2c0cdf36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:13.915336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7dc28855-c501-4ad8-9d14-2abcb7dbcb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:14.106977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3397/6743] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:14.116988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:14.134104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38d5f-257b-4dde-9175-38f49560774f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:14.145378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:14.146602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:14.147059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:14.147830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:14.150124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:14.155239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:14.268916 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3347/6744] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:14 2022] POST /identity/v3/projects => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:14.271475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc28855-c501-4ad8-9d14-2abcb7dbcb4c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:14.290080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc28855-c501-4ad8-9d14-2abcb7dbcb4c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:14.449519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:14.450761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:14.451152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:14.451537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:14.455124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:14.457387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:14.526362 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:14.645365 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3398/6745] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:44:14 2022] POST /identity/v3/projects => generated 332 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:14.649954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:14.671044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6f02-2a30-4fe0-b0e3-2f7be5a37a06 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:14.857055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:14.858084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:14.858084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:14.858395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:14.859121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:14.861512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:14.935774 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:15.088633 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3348/6746] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:14 2022] POST /identity/v3/projects => generated 357 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:15.090290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:15.132639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9352-cd95-48ec-a67b-009fabfb3982 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:15.308401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:15.313081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:15.507865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:15.514698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:15.516264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:15.516550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:15.517256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:15.518556 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:44:15.518556 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:44:15.518556 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:44:15.519693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:15.590000 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3399/6747] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:44:15 2022] GET /identity/v3/projects => generated 7232 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:15.592435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:15.616011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d72f-ab55-4b6d-906e-be09d3675b20 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:15.627710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c6934-8a83-4393-8361-c5454232939f tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:15.633897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:15.635322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:15.635619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:15.635939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:15.636627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:15.636937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:15.638923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:15.649643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:15.651254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:15.651723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:15.652421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] PATH_INFO: `/v3/projects/a089ec3a7fb64722a81f2c3a445f78db` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:15.655922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a089ec3a7fb64722a81f2c3a445f78db)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:15.663091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:15.714434 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3400/6748] 10.222.0.59 () {58 vars in 1158 bytes} [Sun Aug 28 01:44:15 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:44:15.720362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:15.745669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3705b3e-6869-4c5a-895f-1ddbfbfd8e28 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:15.762443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:15.763361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:15.763848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:15.764428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:15.765307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Adding query filter params (parent_id=3dd9fd6a21764c73808a227f88abb948) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:15.765839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:15.767981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:15.805958 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3401/6749] 10.222.0.59 () {58 vars in 1216 bytes} [Sun Aug 28 01:44:15 2022] GET /identity/v3/projects?parent_id=3dd9fd6a21764c73808a227f88abb948 => generated 497 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:15.811865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:15.837740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aff06-8a8c-4c38-b3aa-5126f1ed461b tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:15.856600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:15.857265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:15.857553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:15.857851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects/27dd1c93ee8a403ea8c34435a2591f92` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:15.861617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27dd1c93ee8a403ea8c34435a2591f92)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:15.865635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:15.922816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a089ec3a7fb64722a81f2c3a445f78db', 'request_id': 'req-12cd422f-8875-4958-8546-93a7a6571332'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:15.934691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a089ec3a7fb64722a81f2c3a445f78db', 'request_id': 'req-12cd422f-8875-4958-8546-93a7a6571332'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:15.997981 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:16.088421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27dd1c93ee8a403ea8c34435a2591f92', 'request_id': 'req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.104730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27dd1c93ee8a403ea8c34435a2591f92', 'request_id': 'req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.128112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a089ec3a7fb64722a81f2c3a445f78db', 'request_id': 'req-12cd422f-8875-4958-8546-93a7a6571332'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.173411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] The token cache is being invalidate because project a089ec3a7fb64722a81f2c3a445f78db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:16.174280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.175878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-12cd422f-8875-4958-8546-93a7a6571332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.179303 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3349/6750] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:15 2022] DELETE /identity/v3/projects/a089ec3a7fb64722a81f2c3a445f78db => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:16.184938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd8a2-8d20-4a99-8ee7-b19590a48af3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:16.189174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd8a2-8d20-4a99-8ee7-b19590a48af3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:16.189174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd8a2-8d20-4a99-8ee7-b19590a48af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:16.252129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ccafd8a2-8d20-4a99-8ee7-b19590a48af3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:16.261765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ccafd8a2-8d20-4a99-8ee7-b19590a48af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:16.280794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27dd1c93ee8a403ea8c34435a2591f92', 'request_id': 'req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.300201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] The token cache is being invalidate because project 27dd1c93ee8a403ea8c34435a2591f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:16.301170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.303777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.306605 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3402/6751] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:15 2022] DELETE /identity/v3/projects/27dd1c93ee8a403ea8c34435a2591f92 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:16.325098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:16.330028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:16.428275 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3350/6752] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:16.436160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405b10-ee42-40f4-8b2c-0e01eea2b689 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:16.436449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405b10-ee42-40f4-8b2c-0e01eea2b689 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:16.436719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405b10-ee42-40f4-8b2c-0e01eea2b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:16.475430 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:16.481179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bb405b10-ee42-40f4-8b2c-0e01eea2b689 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:16.487992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb405b10-ee42-40f4-8b2c-0e01eea2b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:16.511960 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3351/6753] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:16.519872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405b10-ee42-40f4-8b2c-0e01eea2b689 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:16.545880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405b10-ee42-40f4-8b2c-0e01eea2b689 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:16.561941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:16.562589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:16.562888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:16.563170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:16.563834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:16.564194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:16.570163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:16.605496 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3352/6754] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:16.606075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:16.655252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ac33b-3685-4a32-8a9c-31c269c4a23f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:16.661511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:16.663434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:16.663889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:16.664442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:16.665307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:16.668561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:16.693183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1393c5-6f5c-4ae2-8947-f04d349d9c26 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:16.704578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:16.707077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:16.707077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:16.707077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects/3dd9fd6a21764c73808a227f88abb948` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:16.707796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3dd9fd6a21764c73808a227f88abb948)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:16.710064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:16.857115 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3353/6755] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:16 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:16.877003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:16.912549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd9fd6a21764c73808a227f88abb948', 'request_id': 'req-44fb9741-0f6c-4d57-b807-e35ddd70150d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:16.932760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd9fd6a21764c73808a227f88abb948', 'request_id': 'req-44fb9741-0f6c-4d57-b807-e35ddd70150d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.079473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd9fd6a21764c73808a227f88abb948', 'request_id': 'req-44fb9741-0f6c-4d57-b807-e35ddd70150d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.096847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] The token cache is being invalidate because project 3dd9fd6a21764c73808a227f88abb948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:17.097285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.098652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.100289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d690d-9194-4018-9562-a5d7b3540e62 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:17.101150 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3403/6756] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:16 2022] DELETE /identity/v3/projects/3dd9fd6a21764c73808a227f88abb948 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:17.106325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:17.109401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:17.300538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:17.301388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:17.302060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:17.302626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:17.303824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:17.306467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:17.360005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9741-0f6c-4d57-b807-e35ddd70150d tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:17.365242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab939184c1a541f9b8b8f3a2c0cdf36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dccf0f5e186749a2ad97e4062631ae89', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:17.366260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:17.366707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:17.367160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] PATH_INFO: `/v3/projects/a8c72202d0994ab4844b42f006dca9a7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:17.368637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8c72202d0994ab4844b42f006dca9a7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:17.371005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:17.517613 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3354/6757] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:16 2022] POST /identity/v3/users => generated 290 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:17.518979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:17.525008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:17.639618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50e357-73d0-4ec5-aa93-0ffaac955ce6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:17.652040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c72202d0994ab4844b42f006dca9a7', 'request_id': 'req-62939a22-f45f-4ca0-8f06-c9eac6ce5606'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.677050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c72202d0994ab4844b42f006dca9a7', 'request_id': 'req-62939a22-f45f-4ca0-8f06-c9eac6ce5606'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.711448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:17.712057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:17.712334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:17.716487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:17.716487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:17.767771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c72202d0994ab4844b42f006dca9a7', 'request_id': 'req-62939a22-f45f-4ca0-8f06-c9eac6ce5606'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.785245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] The token cache is being invalidate because project a8c72202d0994ab4844b42f006dca9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:17.788000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.790213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62939a22-f45f-4ca0-8f06-c9eac6ce5606 tempest-ListProjectsTestJSON-56363702 tempest-ListProjectsTestJSON-56363702-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:17.802869 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3404/6758] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:17 2022] DELETE /identity/v3/projects/a8c72202d0994ab4844b42f006dca9a7 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:17.804520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:17.808909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:17.809426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:17.860930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:17.862724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:17.883096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3355/6759] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:17.883984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:17.886981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:17.909957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] MFA Rules not processed for user `3150fe59bbbe496bb40fbb9eacaa0637`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:17.914212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:18.054426 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3405/6760] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:18.055381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:18.057036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:18.074542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af8c2-aa62-428e-b16e-bb04e3c6ad95 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:18.083028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:18.083772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:18.084060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:18.084777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] PATH_INFO: `/v3/users/996a7b5cf02243eb99919c3ed91cc3e5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:18.087013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=996a7b5cf02243eb99919c3ed91cc3e5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:18.090272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:18.107240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaefb2f-ddca-4bf3-a493-35b96f67e62a service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:18.130343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:18.133710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:18.141369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:18.141690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:18.142519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:18.144269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:18.168015 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3356/6761] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:18.169407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:18.183558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:18.210839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c204e-a3ce-4a49-8d64-28438633612e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:18.236230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:18.237206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:18.237669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:18.238164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:18.238986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:18.240759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:18.282231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3357/6762] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:18.283562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:18.320078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc5ca-bbe3-4283-adb4-6d5ffda59b22 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:18.329258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e821f81-3759-4dcf-979d-11adf9b2f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:18.330285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e821f81-3759-4dcf-979d-11adf9b2f688 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:18.330735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e821f81-3759-4dcf-979d-11adf9b2f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:18.332335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e821f81-3759-4dcf-979d-11adf9b2f688 admin admin] PATH_INFO: `/v3/projects/641d3f758162407db73e06f1deb7dabb/users/abdedb0c1dc7416f92296f33b88aafe4/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:18.371293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e821f81-3759-4dcf-979d-11adf9b2f688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641d3f758162407db73e06f1deb7dabb, user_id=abdedb0c1dc7416f92296f33b88aafe4, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:18.374759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e821f81-3759-4dcf-979d-11adf9b2f688 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:18.401841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996a7b5cf02243eb99919c3ed91cc3e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:18.403291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996a7b5cf02243eb99919c3ed91cc3e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:18.499731 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3358/6763] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:18 2022] PUT /identity/v3/projects/641d3f758162407db73e06f1deb7dabb/users/abdedb0c1dc7416f92296f33b88aafe4/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:18.519977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996a7b5cf02243eb99919c3ed91cc3e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:18.566289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996a7b5cf02243eb99919c3ed91cc3e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:18.567063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f32db36-54f0-435d-ae54-8cad7b39db8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996a7b5cf02243eb99919c3ed91cc3e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:18.655450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:18.655750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:18.656014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:18.669952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3406/6764] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:18 2022] DELETE /identity/v3/users/996a7b5cf02243eb99919c3ed91cc3e5 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:18.678943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:18.679428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:18.679791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:18.699491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] MFA Rules not processed for user `abdedb0c1dc7416f92296f33b88aafe4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:18.703273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:18.722243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:18.723597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:18.807821 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3359/6765] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:18.814852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:18.816888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:18.909469 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3407/6766] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:18.917596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:18.919697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:19.028167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330c832-6981-46a5-9961-a30b4ea7f044 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:19.033848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:19.034059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:19.034315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:19.034594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:19.037433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:19.037433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:19.066367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654610c-98b3-440f-9975-213c9aeb3dbb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:19.079976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:19.080791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:19.081191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:19.081589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:19.102915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:19.105717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:19.123619 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:19.141921 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3408/6767] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:19.257995 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3360/6768] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:18 2022] POST /identity/v3/projects => generated 383 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:19.266615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:19.285001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23961445-51a7-4625-b4b4-7e652a2fb936 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:19.468786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:19.469522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:19.469903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:19.472875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:19.472875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:19.473095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:19.515245 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:19.624673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3409/6769] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:19 2022] POST /identity/v3/users => generated 298 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:19.628687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:19.657701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe240b30-03fa-45f6-ab4f-f2ae91a11c64 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:19.676296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:19.677160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:19.680928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:19.680928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:19.680928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:19.688966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:19.730954 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3361/6770] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:19.731762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:19.751637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835a66a-d82b-4b2a-982c-bf9a0731d966 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:19.769859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:19.772638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:19.773038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:19.773333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] PATH_INFO: `/v3/projects/4a38935820c74ec69e703bd1ff94293f/users/f07a2d44e2a94411b93a9faec9a2389e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:19.812021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a38935820c74ec69e703bd1ff94293f, user_id=f07a2d44e2a94411b93a9faec9a2389e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:19.818728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:19.925057 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3410/6771] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:19 2022] PUT /identity/v3/projects/4a38935820c74ec69e703bd1ff94293f/users/f07a2d44e2a94411b93a9faec9a2389e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:19.929552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:19.961590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddbea-e845-4fbb-b4a0-6bcdece7e27d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:20.220526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e061f-fb8a-49e4-8c2e-9dc59406a653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:20.223828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e061f-fb8a-49e4-8c2e-9dc59406a653 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:20.224111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e061f-fb8a-49e4-8c2e-9dc59406a653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:20.228264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e061f-fb8a-49e4-8c2e-9dc59406a653 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:20.228646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e061f-fb8a-49e4-8c2e-9dc59406a653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:20.233742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e061f-fb8a-49e4-8c2e-9dc59406a653 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:20.306965 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3362/6772] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:20.308174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:20.320030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec707-ae37-4b74-b854-abf00ddc24bd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:20.324923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:20.325903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:20.326373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:20.326646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] PATH_INFO: `/v3/projects/4a38935820c74ec69e703bd1ff94293f/users/f07a2d44e2a94411b93a9faec9a2389e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:20.328631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a38935820c74ec69e703bd1ff94293f, user_id=f07a2d44e2a94411b93a9faec9a2389e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:20.331393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:20.394558 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3411/6773] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:20 2022] PUT /identity/v3/projects/4a38935820c74ec69e703bd1ff94293f/users/f07a2d44e2a94411b93a9faec9a2389e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:20.411650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:20.411650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:20.411650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:20.462365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:20.464401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:20.482594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] MFA Rules not processed for user `f07a2d44e2a94411b93a9faec9a2389e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:20.483906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:20.627152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bc7c2-f3d8-4df4-bca6-56776192bcf2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:20.644807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:20.647354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:20.648722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:20.651206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] PATH_INFO: `/v3/projects/5a675c88d641422d8cca5844218f95ed` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:20.653665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a675c88d641422d8cca5844218f95ed)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:20.668161 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3363/6774] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:20.674827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:20.683567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:20.686667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:20.787332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24ab8-a5d8-4681-97ca-0670cd94b5f9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:20.792365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:20.792997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:20.793283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:20.798507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:20.920239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a675c88d641422d8cca5844218f95ed', 'request_id': 'req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:20.970736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a675c88d641422d8cca5844218f95ed', 'request_id': 'req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.036136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:21.052879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:21.059006 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3364/6775] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:44:21.079344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a675c88d641422d8cca5844218f95ed', 'request_id': 'req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.137715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] The token cache is being invalidate because project 5a675c88d641422d8cca5844218f95ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:21.138050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.141805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.154485 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3412/6776] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:20 2022] DELETE /identity/v3/projects/5a675c88d641422d8cca5844218f95ed => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:21.155774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:21.174304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847f450-7877-48ed-a138-f87925b3c025 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:21.339973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:21.340849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:21.341079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:21.341599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] PATH_INFO: `/v3/users/ab939184c1a541f9b8b8f3a2c0cdf36d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:21.342663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab939184c1a541f9b8b8f3a2c0cdf36d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:21.350609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:21.624154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab939184c1a541f9b8b8f3a2c0cdf36d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.649803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab939184c1a541f9b8b8f3a2c0cdf36d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.674981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab939184c1a541f9b8b8f3a2c0cdf36d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.675958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab939184c1a541f9b8b8f3a2c0cdf36d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.884948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-898ef410-dece-4114-92b8-ab4fd318b4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab939184c1a541f9b8b8f3a2c0cdf36d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:21.898473 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3365/6777] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:21 2022] DELETE /identity/v3/users/ab939184c1a541f9b8b8f3a2c0cdf36d => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:22.656353 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:22.864993 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:23.197682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:23.199534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:23.230326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd7ac-0ab7-43df-bf5a-ff0a18074761 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:23.402457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:23.403253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:23.403543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:23.403828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] PATH_INFO: `/v3/projects/dccf0f5e186749a2ad97e4062631ae89` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:23.410510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccf0f5e186749a2ad97e4062631ae89)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:23.419374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:23.713135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccf0f5e186749a2ad97e4062631ae89', 'request_id': 'req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:23.720892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccf0f5e186749a2ad97e4062631ae89', 'request_id': 'req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:23.811017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccf0f5e186749a2ad97e4062631ae89', 'request_id': 'req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:23.832217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] The token cache is being invalidate because project dccf0f5e186749a2ad97e4062631ae89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:23.840379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:23.843867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-58a1e086-3ef0-4454-b5ea-e754a0d50bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:23.858280 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3413/6778] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:23 2022] DELETE /identity/v3/projects/dccf0f5e186749a2ad97e4062631ae89 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:23.862970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc8a47-8df8-4986-a602-96286d922838 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:23.865967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc8a47-8df8-4986-a602-96286d922838 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:23.865967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc8a47-8df8-4986-a602-96286d922838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:23.946002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-eddc8a47-8df8-4986-a602-96286d922838 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:23.947470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-eddc8a47-8df8-4986-a602-96286d922838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:24.208089 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3366/6779] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:24.209694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44972ab-1ad1-4dd4-8ab1-70d39b26bf13 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:24.210014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44972ab-1ad1-4dd4-8ab1-70d39b26bf13 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:24.210300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44972ab-1ad1-4dd4-8ab1-70d39b26bf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:24.271020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b44972ab-1ad1-4dd4-8ab1-70d39b26bf13 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:24.283454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b44972ab-1ad1-4dd4-8ab1-70d39b26bf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:24.309597 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3414/6780] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:24.324970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc8a47-8df8-4986-a602-96286d922838 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:24.349880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc8a47-8df8-4986-a602-96286d922838 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:24.369361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:24.370315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:24.372840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:24.372840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:24.372840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:24.372840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:24.386916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:24.452068 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3367/6781] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:24.455592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44972ab-1ad1-4dd4-8ab1-70d39b26bf13 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:24.480809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44972ab-1ad1-4dd4-8ab1-70d39b26bf13 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:24.494485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:24.495108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:24.495397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:24.495674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:24.496326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:24.511142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:24.659875 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:24.666852 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3415/6782] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:24 2022] POST /identity/v3/projects => generated 395 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:24.668421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:24.723442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac874-ba10-421b-a244-72ad6832808b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:24.745262 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:24.972955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:24.973945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:24.974398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:24.974815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:24.978264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:24.985197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:25.015741 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:25.138050 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3368/6783] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:24 2022] POST /identity/v3/users => generated 304 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:25.139302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:25.152372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddb89b-09c8-4140-b9b3-43bfd4632b63 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:25.158445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:25.159264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:25.159427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:25.159711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:25.160468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:25.162282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:25.178476 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3416/6784] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:25.179622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:25.197843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ba2e0-acbd-4cec-a604-0b2454f60718 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:25.211257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:25.211951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:25.212227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:25.212531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] PATH_INFO: `/v3/projects/19c001c9cbb84632974a4d9007e5babf/users/90e9b8940a57454283bf3e775654eead/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:25.219299 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:25.249632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c001c9cbb84632974a4d9007e5babf, user_id=90e9b8940a57454283bf3e775654eead, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:25.262734 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:25.267762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:25.381663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3369/6785] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:25 2022] PUT /identity/v3/projects/19c001c9cbb84632974a4d9007e5babf/users/90e9b8940a57454283bf3e775654eead/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:25.382486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:25.412411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf4a1-9aae-46ad-ad2f-c30f286bfc74 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:25.556218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae581c0-46ea-494a-a7f7-7bd10c5c5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:25.557481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae581c0-46ea-494a-a7f7-7bd10c5c5be9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:25.558005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae581c0-46ea-494a-a7f7-7bd10c5c5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:25.558427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae581c0-46ea-494a-a7f7-7bd10c5c5be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:25.559193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae581c0-46ea-494a-a7f7-7bd10c5c5be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:25.561199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae581c0-46ea-494a-a7f7-7bd10c5c5be9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:25.603282 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3417/6786] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:25.604553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:25.631801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63346c-b83e-4463-a75e-9273d24d5ce7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:25.638290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:25.638966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:25.639254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:25.639501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] PATH_INFO: `/v3/projects/19c001c9cbb84632974a4d9007e5babf/users/90e9b8940a57454283bf3e775654eead/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:25.646104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c001c9cbb84632974a4d9007e5babf, user_id=90e9b8940a57454283bf3e775654eead, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:25.648402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:25.686739 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3370/6787] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:25 2022] PUT /identity/v3/projects/19c001c9cbb84632974a4d9007e5babf/users/90e9b8940a57454283bf3e775654eead/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:25.696026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3707b0-fe40-401e-991e-2851e4600e33 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:25.696319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3707b0-fe40-401e-991e-2851e4600e33 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:25.696599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3707b0-fe40-401e-991e-2851e4600e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:25.765117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ab3707b0-fe40-401e-991e-2851e4600e33 None None] MFA Rules not processed for user `90e9b8940a57454283bf3e775654eead`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:25.769256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab3707b0-fe40-401e-991e-2851e4600e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:25.922651 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:25.989205 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3418/6788] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:25.994493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:26.109347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689315b1-0142-4f85-ad92-b8c0de7debfc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:26.125266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:26.135964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:26.135964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:26.135964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:26.135964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:26.135964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:26.278838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3371/6789] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:25 2022] POST /identity/v3/projects => generated 395 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:26.292688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3707b0-fe40-401e-991e-2851e4600e33 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:26.321028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3707b0-fe40-401e-991e-2851e4600e33 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:26.392828 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:26.478852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:26.488331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:26.488331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:26.488331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:26.488331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:26.488331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:26.612198 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3419/6790] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:26 2022] POST /identity/v3/users => generated 298 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:26.615762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:26.627452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25515-ddfd-46af-86e2-40a076faac00 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:26.650726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:26.651704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:26.652152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:26.652627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:26.653448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:26.655255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:26.676269 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3372/6791] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:26.680478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:26.698949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aaefe-fd92-49cb-a9eb-732c66a07f11 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:26.722719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d770d-e61d-422f-b8fa-c4a01eaa9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:26.724612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d770d-e61d-422f-b8fa-c4a01eaa9351 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:26.725060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d770d-e61d-422f-b8fa-c4a01eaa9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:26.725510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d770d-e61d-422f-b8fa-c4a01eaa9351 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:26.726409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d770d-e61d-422f-b8fa-c4a01eaa9351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:26.728236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d770d-e61d-422f-b8fa-c4a01eaa9351 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:26.762856 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3420/6792] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:26.770578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:26.781572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa5732-8ac3-4017-9ee8-694d2e0a700c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:26.828222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:26.829144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:26.829580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:26.830044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] PATH_INFO: `/v3/projects/5e769f2486c5488a9a8d22bd2ff6b9d7/users/2dd380b42db140d19821b259a9cebdd9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:26.864410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e769f2486c5488a9a8d22bd2ff6b9d7, user_id=2dd380b42db140d19821b259a9cebdd9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:26.867645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:26.976676 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3373/6793] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:26 2022] PUT /identity/v3/projects/5e769f2486c5488a9a8d22bd2ff6b9d7/users/2dd380b42db140d19821b259a9cebdd9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:27.096758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:27.099554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:27.099833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:27.154267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] MFA Rules not processed for user `2dd380b42db140d19821b259a9cebdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:27.160159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:27.402163 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3421/6794] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:27.444535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:27.444535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:27.654350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3e170-f6a6-4825-a6ee-35ef55afd2ba admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:27.654350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:27.654350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:27.654350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:27.655225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:27.700903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:27.703691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:27.721697 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3374/6795] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:28.187216 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:29.742631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:29.744975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:29.789270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:29.805078 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:30.057218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91949d27-6ee3-4303-936a-197a7cc4a01d service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:30.061145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ebcb-e5c4-48f0-b434-1ae06eaa349e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:30.077597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:30.078291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:30.090335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:30.094204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:30.094547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:30.097694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:30.097694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] PATH_INFO: `/v3/users/90e9b8940a57454283bf3e775654eead` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:30.098128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] PATH_INFO: `/v3/users/3150fe59bbbe496bb40fbb9eacaa0637` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:30.101142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3150fe59bbbe496bb40fbb9eacaa0637)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:30.103747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e9b8940a57454283bf3e775654eead)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:30.105725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:30.109480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:30.460080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3150fe59bbbe496bb40fbb9eacaa0637'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.460867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e9b8940a57454283bf3e775654eead'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.462235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3150fe59bbbe496bb40fbb9eacaa0637'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.492243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e9b8940a57454283bf3e775654eead'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.510826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e9b8940a57454283bf3e775654eead'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.513499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e9b8940a57454283bf3e775654eead'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.619442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3150fe59bbbe496bb40fbb9eacaa0637'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.627740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3150fe59bbbe496bb40fbb9eacaa0637'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.628460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e8533543-423c-49a0-a2e3-ba253c468f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3150fe59bbbe496bb40fbb9eacaa0637'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.673293 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3422/6796] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:29 2022] DELETE /identity/v3/users/3150fe59bbbe496bb40fbb9eacaa0637 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:30.727586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e9b8940a57454283bf3e775654eead'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:30.735231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3375/6797] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:29 2022] DELETE /identity/v3/users/90e9b8940a57454283bf3e775654eead => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:30.739471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:30.739762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:30.740097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:30.774148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:30.775974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:30.944897 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3423/6798] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:30.988901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:30.991776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:31.103468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58923a-f08b-425b-9b14-405240494626 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:31.111204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f9d28-b390-47ec-85ff-88a20040d85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:31.113679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9d28-b390-47ec-85ff-88a20040d85b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:31.114193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9d28-b390-47ec-85ff-88a20040d85b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:31.114660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f9d28-b390-47ec-85ff-88a20040d85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:31.139379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f9d28-b390-47ec-85ff-88a20040d85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:31.142781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f9d28-b390-47ec-85ff-88a20040d85b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:31.177350 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3376/6799] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:31.281675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:31.283246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:31.307721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330570d2-9e73-4bca-b0bc-333e97e9631a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:31.320311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:31.329566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:31.329566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:31.329566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] PATH_INFO: `/v3/projects/e6ff032c58b646a9b52bc87b23851f55` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:31.329566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ff032c58b646a9b52bc87b23851f55)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:31.330682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:31.441805 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:31.580296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ff032c58b646a9b52bc87b23851f55', 'request_id': 'req-d82ea936-afbf-4a06-8883-08804b7f18da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:31.597083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ff032c58b646a9b52bc87b23851f55', 'request_id': 'req-d82ea936-afbf-4a06-8883-08804b7f18da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:31.697425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ff032c58b646a9b52bc87b23851f55', 'request_id': 'req-d82ea936-afbf-4a06-8883-08804b7f18da'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:31.710422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] The token cache is being invalidate because project e6ff032c58b646a9b52bc87b23851f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:31.711128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:31.712037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d82ea936-afbf-4a06-8883-08804b7f18da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:31.714425 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3424/6800] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:31 2022] DELETE /identity/v3/projects/e6ff032c58b646a9b52bc87b23851f55 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:31.720474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3771f6-89c2-45f5-9330-28a29ce54b65 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:31.721056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3771f6-89c2-45f5-9330-28a29ce54b65 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:31.721655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3771f6-89c2-45f5-9330-28a29ce54b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:31.762949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8d3771f6-89c2-45f5-9330-28a29ce54b65 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:31.765895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8d3771f6-89c2-45f5-9330-28a29ce54b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:31.857282 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3377/6801] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:31.865263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74e67-9d7e-416a-bbe8-880b29c51ef1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:31.869781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74e67-9d7e-416a-bbe8-880b29c51ef1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:31.869781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74e67-9d7e-416a-bbe8-880b29c51ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:31.920072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-edf74e67-9d7e-416a-bbe8-880b29c51ef1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:31.923991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-edf74e67-9d7e-416a-bbe8-880b29c51ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:31.945795 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3425/6802] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:31.952726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3771f6-89c2-45f5-9330-28a29ce54b65 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:31.973586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3771f6-89c2-45f5-9330-28a29ce54b65 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:32.009680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:32.016443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:32.016867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:32.017252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:32.018523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:32.018957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:32.024569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:32.054486 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3378/6803] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:32.058890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf74e67-9d7e-416a-bbe8-880b29c51ef1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:32.072273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf74e67-9d7e-416a-bbe8-880b29c51ef1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:32.106922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:32.109518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:32.109518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:32.109518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:32.113942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:32.123754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:32.283861 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3426/6804] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:32 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:32.285402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:32.299651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e87cbc-b39d-45d0-a83e-c7bfbbe7dbb7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:32.310652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:32.312585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:32.501966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:32.502602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:32.502884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:32.503163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:32.503816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:32.519981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:32.551086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3920f4-2a94-4ed4-9825-69940ff4e7fa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:32.567494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:32.568940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:32.569465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:32.570051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] PATH_INFO: `/v3/projects/19c001c9cbb84632974a4d9007e5babf` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:32.571686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c001c9cbb84632974a4d9007e5babf)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:32.574321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:32.692429 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3379/6805] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:32 2022] POST /identity/v3/users => generated 284 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:32.693929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:32.732931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241022c-085d-4111-b6d2-325d443088fb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:32.750901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c001c9cbb84632974a4d9007e5babf', 'request_id': 'req-b9092ed8-6208-4996-9c10-81cc8f655ea4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:32.761352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c001c9cbb84632974a4d9007e5babf', 'request_id': 'req-b9092ed8-6208-4996-9c10-81cc8f655ea4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:32.874202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c001c9cbb84632974a4d9007e5babf', 'request_id': 'req-b9092ed8-6208-4996-9c10-81cc8f655ea4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:32.906020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] The token cache is being invalidate because project 19c001c9cbb84632974a4d9007e5babf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:32.907725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:32.908362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:32.908607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:32.908732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:32.908908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:32.909459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:32.909703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:32.911566 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3427/6806] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:32 2022] DELETE /identity/v3/projects/19c001c9cbb84632974a4d9007e5babf => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:32.911703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:32.919638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:32.921150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:32.935020 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3380/6807] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:32.937980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092ed8-6208-4996-9c10-81cc8f655ea4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:32.943742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:32.948456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:32.948955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:32.949335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:32.949634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:32.950008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] PATH_INFO: `/v3/users/2dd380b42db140d19821b259a9cebdd9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:32.951330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd380b42db140d19821b259a9cebdd9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:32.953442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:32.971616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791fad2-d960-4344-bf42-364eac664016 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:32.979018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:32.980074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:32.980583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:32.981121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:32.982404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:32.984796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:33.001936 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3381/6808] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:33.006229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:33.019019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553b2c6-0359-4109-8110-e2032cbf3160 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:33.024168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f23780-add9-43a4-b198-9de66f7e03b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:33.025601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23780-add9-43a4-b198-9de66f7e03b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:33.025977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23780-add9-43a4-b198-9de66f7e03b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:33.026258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23780-add9-43a4-b198-9de66f7e03b5 admin admin] PATH_INFO: `/v3/projects/cf5928a2cecb4f26996f966d76a7dc1f/users/ec01c1b001894358988049435dcf9127/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:33.042387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f23780-add9-43a4-b198-9de66f7e03b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5928a2cecb4f26996f966d76a7dc1f, user_id=ec01c1b001894358988049435dcf9127, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:33.045356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f23780-add9-43a4-b198-9de66f7e03b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:33.172748 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3382/6809] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:33 2022] PUT /identity/v3/projects/cf5928a2cecb4f26996f966d76a7dc1f/users/ec01c1b001894358988049435dcf9127/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:33.185518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9d9e-f576-4c3f-b2c7-6fa1fce5ea92 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:33.185859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9d9e-f576-4c3f-b2c7-6fa1fce5ea92 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:33.186683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9d9e-f576-4c3f-b2c7-6fa1fce5ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:33.251935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f9fb9d9e-f576-4c3f-b2c7-6fa1fce5ea92 None None] MFA Rules not processed for user `ec01c1b001894358988049435dcf9127`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:33.267091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9fb9d9e-f576-4c3f-b2c7-6fa1fce5ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:33.273486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd380b42db140d19821b259a9cebdd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:33.276375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd380b42db140d19821b259a9cebdd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:33.282747 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:33.396560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd380b42db140d19821b259a9cebdd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:33.397436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3383/6810] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:33.398619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb9d9e-f576-4c3f-b2c7-6fa1fce5ea92 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:33.405653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd380b42db140d19821b259a9cebdd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:33.407785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd380b42db140d19821b259a9cebdd9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:33.455240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3428/6811] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:32 2022] DELETE /identity/v3/users/2dd380b42db140d19821b259a9cebdd9 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:33.549966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb9d9e-f576-4c3f-b2c7-6fa1fce5ea92 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:33.669378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:33.670492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:33.671637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:33.672232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:33.673161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:33.675499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:33.839026 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3384/6812] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:33 2022] POST /identity/v3/projects => generated 367 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:33.854933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:33.856520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:33.879396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334deb-40c5-404d-96dd-d62349478a20 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:34.028921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:34.029893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.030360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.030801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.031634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:34.033771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:34.036593 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:34.188769 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3429/6813] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:33 2022] POST /identity/v3/users => generated 290 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:34.192722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:34.214963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb320194-477d-4cb1-9aa0-da54c15b222d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:34.238380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:34.239333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.240637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.241027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.241844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:34.244169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:34.260894 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3385/6814] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:34.262147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:34.277894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d480a5-c07c-4b5e-b8ae-bb8c895191e3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:34.290706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:34.291397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.291675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.291951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] PATH_INFO: `/v3/projects/fc9fefb5eb954c989b872f380dd0f212/users/812e2d5c23004fc3b22dc0644e1da4fe/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.317077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:34.322459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:34.356930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9fefb5eb954c989b872f380dd0f212, user_id=812e2d5c23004fc3b22dc0644e1da4fe, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:34.363259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8f72e-b2ec-4ed3-b1c8-2f1c9fb78d15 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:34.365022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:34.373837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:34.374962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.375306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.375607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] PATH_INFO: `/v3/projects/5e769f2486c5488a9a8d22bd2ff6b9d7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.378346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e769f2486c5488a9a8d22bd2ff6b9d7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:34.380440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:34.523244 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3430/6815] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:34 2022] PUT /identity/v3/projects/fc9fefb5eb954c989b872f380dd0f212/users/812e2d5c23004fc3b22dc0644e1da4fe/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:34.527555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:34.553512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e769f2486c5488a9a8d22bd2ff6b9d7', 'request_id': 'req-d468cb62-4aec-4fd2-acc5-3e3f1784155d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:34.565075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e769f2486c5488a9a8d22bd2ff6b9d7', 'request_id': 'req-d468cb62-4aec-4fd2-acc5-3e3f1784155d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:34.623005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ccdc8-2957-456a-895c-107f4625b4eb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:34.689791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:34.690792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.691237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.691744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.692546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:34.694699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:34.702997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e769f2486c5488a9a8d22bd2ff6b9d7', 'request_id': 'req-d468cb62-4aec-4fd2-acc5-3e3f1784155d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:34.710557 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3431/6816] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:34.719993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:34.726588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] The token cache is being invalidate because project 5e769f2486c5488a9a8d22bd2ff6b9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:34.726907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:34.728371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d468cb62-4aec-4fd2-acc5-3e3f1784155d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:34.735150 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3386/6817] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:34 2022] DELETE /identity/v3/projects/5e769f2486c5488a9a8d22bd2ff6b9d7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:34.736672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779694d-965c-44de-860f-910641308672 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.737037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779694d-965c-44de-860f-910641308672 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.737663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779694d-965c-44de-860f-910641308672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.755881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d2e91-00b0-44d5-868e-058c21b174fb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:34.767015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3779694d-965c-44de-860f-910641308672 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:34.768574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3779694d-965c-44de-860f-910641308672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:34.770273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fe22c-6cb7-4b4b-b679-b0449fc750b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:34.770958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe22c-6cb7-4b4b-b679-b0449fc750b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.771242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe22c-6cb7-4b4b-b679-b0449fc750b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.771558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe22c-6cb7-4b4b-b679-b0449fc750b6 admin admin] PATH_INFO: `/v3/projects/fc9fefb5eb954c989b872f380dd0f212/users/812e2d5c23004fc3b22dc0644e1da4fe/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.773552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fe22c-6cb7-4b4b-b679-b0449fc750b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9fefb5eb954c989b872f380dd0f212, user_id=812e2d5c23004fc3b22dc0644e1da4fe, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:34.776277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fe22c-6cb7-4b4b-b679-b0449fc750b6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:34.801323 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3432/6818] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:34 2022] PUT /identity/v3/projects/fc9fefb5eb954c989b872f380dd0f212/users/812e2d5c23004fc3b22dc0644e1da4fe/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:34.806576 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3387/6819] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:34.816380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55ec1-5e5f-4ea4-af21-84ea305c785b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.817607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55ec1-5e5f-4ea4-af21-84ea305c785b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.817607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55ec1-5e5f-4ea4-af21-84ea305c785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.819865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19592314-ff1d-4d1c-961b-13709d20fd96 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.820449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19592314-ff1d-4d1c-961b-13709d20fd96 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.820997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19592314-ff1d-4d1c-961b-13709d20fd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.856201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5eb55ec1-5e5f-4ea4-af21-84ea305c785b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:34.857381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5eb55ec1-5e5f-4ea4-af21-84ea305c785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:34.893949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-19592314-ff1d-4d1c-961b-13709d20fd96 None None] MFA Rules not processed for user `812e2d5c23004fc3b22dc0644e1da4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:34.895680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-19592314-ff1d-4d1c-961b-13709d20fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:34.949522 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3433/6820] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:34.953773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb55ec1-5e5f-4ea4-af21-84ea305c785b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:34.965707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb55ec1-5e5f-4ea4-af21-84ea305c785b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:34.970823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:34.971907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:34.972359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:34.972792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:34.973593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:34.974073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:34.976227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:34.997371 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3434/6821] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:44:34.998552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:35.014659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fcc44-3b1a-40c9-9cc3-000165ff43f1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:35.020432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:35.021315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:35.021755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:35.022478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:35.023318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:35.026435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:35.050830 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3388/6822] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:35.056069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19592314-ff1d-4d1c-961b-13709d20fd96 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:35.068188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19592314-ff1d-4d1c-961b-13709d20fd96 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:35.082637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:35.082637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:35.082637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:35.083556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:35.084264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:35.088207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:35.166357 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3435/6823] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:34 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:35.171732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:35.271238 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3389/6824] 10.222.0.59 () {60 vars in 1150 bytes} [Sun Aug 28 01:44:35 2022] POST /identity/v3/domains => generated 277 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:35.276021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:35.333386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569aa93-9668-45fe-b085-4d10915e3a99 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:35.454933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c6b29-7432-4ae5-8f8c-af47ec54e5e4 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:35.465054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:35.465691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:35.465983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:35.466267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:35.466955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:35.468582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:35.508261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:35.510094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:35.511605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:35.512193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:35.514333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:35.519705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:35.628718 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3436/6825] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:35 2022] POST /identity/v3/users => generated 300 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:35.634524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:35.636266 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3390/6826] 10.222.0.59 () {60 vars in 1150 bytes} [Sun Aug 28 01:44:35 2022] POST /identity/v3/domains => generated 276 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:35.640089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:35.658338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8ff6-dac5-4a37-889c-331f30ac3d81 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:35.775522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e3478-6275-449f-bdd0-732e5383af32 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:35.791012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:35.791659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:35.791948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:35.792241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:35.792912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:35.794863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:35.803210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:35.804095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:35.804555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:35.805089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:35.806552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:35.808555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:35.823109 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3437/6827] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:35.827051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:35.841561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2b708-1472-4f4f-8e79-1af180db57fd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:35.848089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:35.851434 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:35.856155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:35.856155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:35.856155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] PATH_INFO: `/v3/projects/4438571ff32247f596355e83373aeb82/users/7de0b8cd72e84529b9001c0a7bed2c6e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:35.910806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4438571ff32247f596355e83373aeb82, user_id=7de0b8cd72e84529b9001c0a7bed2c6e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:35.918446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:35.922259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3391/6828] 10.222.0.59 () {60 vars in 1150 bytes} [Sun Aug 28 01:44:35 2022] POST /identity/v3/domains => generated 278 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:35.932656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:36.060082 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3438/6829] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:35 2022] PUT /identity/v3/projects/4438571ff32247f596355e83373aeb82/users/7de0b8cd72e84529b9001c0a7bed2c6e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:36.066378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:36.069025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb7a2-c869-4148-8bea-6a5b52dc46d6 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:36.146807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:36.147726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:36.148195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:36.148641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:36.149476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:36.151917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:36.294832 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:36.308408 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3392/6830] 10.222.0.59 () {60 vars in 1150 bytes} [Sun Aug 28 01:44:35 2022] POST /identity/v3/domains => generated 279 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:36.316799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:36.351440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0d33-1fed-4553-90f2-5d12376da01c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:36.468589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ed816-5f3a-4ceb-9e73-67ffe283240a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:36.492079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:36.493904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:36.494452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:36.497370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/e04476aebeb64139b1cae5f4bbac5c99` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:36.513719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e04476aebeb64139b1cae5f4bbac5c99)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:36.519147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:36.524615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:36.526086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:36.526575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:36.527018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:36.527802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:36.531561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:36.566344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3439/6831] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:36.568701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:36.587657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.593227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.605965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ae17-5246-48b6-bac6-330375614720 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:36.619592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd95a8-a559-4ba0-b984-40fcea39360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:36.620674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd95a8-a559-4ba0-b984-40fcea39360c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:36.621141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd95a8-a559-4ba0-b984-40fcea39360c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:36.621657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd95a8-a559-4ba0-b984-40fcea39360c admin admin] PATH_INFO: `/v3/projects/4438571ff32247f596355e83373aeb82/users/7de0b8cd72e84529b9001c0a7bed2c6e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:36.627631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd95a8-a559-4ba0-b984-40fcea39360c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4438571ff32247f596355e83373aeb82, user_id=7de0b8cd72e84529b9001c0a7bed2c6e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:36.635449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd95a8-a559-4ba0-b984-40fcea39360c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:36.667365 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3440/6832] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:36 2022] PUT /identity/v3/projects/4438571ff32247f596355e83373aeb82/users/7de0b8cd72e84529b9001c0a7bed2c6e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:36.685118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4ad0f-fa61-480b-a6a3-978f96827f30 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:36.685562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4ad0f-fa61-480b-a6a3-978f96827f30 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:36.686001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4ad0f-fa61-480b-a6a3-978f96827f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:36.738811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f2f4ad0f-fa61-480b-a6a3-978f96827f30 None None] MFA Rules not processed for user `7de0b8cd72e84529b9001c0a7bed2c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:36.745987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f2f4ad0f-fa61-480b-a6a3-978f96827f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:36.765524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99', 'request_id': 'req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.779227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99', 'request_id': 'req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.878718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99', 'request_id': 'req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.902396 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3441/6833] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:36.903650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] The token cache is being invalidate because project e04476aebeb64139b1cae5f4bbac5c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:36.904136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.905657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.907326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4ad0f-fa61-480b-a6a3-978f96827f30 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:36.928719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99', 'request_id': 'req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.931743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99', 'request_id': 'req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.934043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e04476aebeb64139b1cae5f4bbac5c99', 'request_id': 'req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:36.960542 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3393/6834] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:44:36 2022] DELETE /identity/v3/domains/e04476aebeb64139b1cae5f4bbac5c99 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:36.966701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:36.968420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:37.112898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4ad0f-fa61-480b-a6a3-978f96827f30 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:37.130511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15653-9168-4dfe-b6eb-2d1a69307ac1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:37.132722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:37.133489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:37.134912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:37.135299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:37.138728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:37.139697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:37.140167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:37.140622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:37.141443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:37.142088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:37.144135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:37.144270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:37.304746 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3394/6835] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:44:36 2022] POST /identity/v3/domains => generated 247 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:37.308664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:37.367796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3442/6836] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:36 2022] POST /identity/v3/projects => generated 385 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:37.376459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:37.379951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:37.459944 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:37.533587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb674d3-32f2-4e83-8ad7-f1754abff572 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:37.572610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842eb92-4370-4623-86e1-31d4e8bdcf1c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:37.578637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:37.579749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:37.580285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:37.580773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:37.597047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:37.621096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:37.722437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:37.723022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:37.723308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:37.723587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/02168bc6d14f43739fe4fc36b5e59dc3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:37.759177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3443/6837] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:37 2022] POST /identity/v3/users => generated 293 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:37.763768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:37.764933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=02168bc6d14f43739fe4fc36b5e59dc3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:37.767634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:37.787471 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:37.789757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bd7f9-ef37-4c09-89e2-2a5a83fc0a68 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:37.811306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:37.812325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:37.812987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:37.813361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:37.814149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:37.815957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:37.842333 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3444/6838] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:37.846074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:37.853307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:37.853307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:37.873457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061339-48a1-4581-a7d9-5b77b769bf54 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:37.988084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:37.988787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:37.995602 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3395/6839] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:37 2022] PATCH /identity/v3/domains/02168bc6d14f43739fe4fc36b5e59dc3 => generated 248 bytes in 687 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:37.999072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:37.999968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:38.000704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:38.001531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:38.001949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:38.002966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:38.004798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:38.011145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:38.021640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3445/6840] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:38.023065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:38.025490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:38.041842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546240cd-3b72-460a-b901-55a1d7a20141 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:38.048530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578ee8-bfd4-4712-b5fc-2979a9c5323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:38.052703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578ee8-bfd4-4712-b5fc-2979a9c5323c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:38.052703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578ee8-bfd4-4712-b5fc-2979a9c5323c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:38.052703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578ee8-bfd4-4712-b5fc-2979a9c5323c admin admin] PATH_INFO: `/v3/projects/2ef14480a7b040f687a056509c7d21ef/users/f78622d9ed21465380b49390d3c3c9d0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:38.074316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab578ee8-bfd4-4712-b5fc-2979a9c5323c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef14480a7b040f687a056509c7d21ef, user_id=f78622d9ed21465380b49390d3c3c9d0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:38.076729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab578ee8-bfd4-4712-b5fc-2979a9c5323c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:38.128740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7535c4a-0cc4-47d9-a66c-e1b6a47d8a22 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:38.146717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:38.152653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:38.154576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:38.163045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/02168bc6d14f43739fe4fc36b5e59dc3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:38.192407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=02168bc6d14f43739fe4fc36b5e59dc3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:38.194175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:38.214160 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3446/6841] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:38 2022] PUT /identity/v3/projects/2ef14480a7b040f687a056509c7d21ef/users/f78622d9ed21465380b49390d3c3c9d0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:38.228527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:38.229572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:38.230178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:38.246811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.269077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.307834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] MFA Rules not processed for user `f78622d9ed21465380b49390d3c3c9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:38.315814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:38.463298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3', 'request_id': 'req-9cd67211-838d-43ca-9374-364652ec96ee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.475598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3', 'request_id': 'req-9cd67211-838d-43ca-9374-364652ec96ee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.504832 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3447/6842] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:38.523281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:38.524407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:38.567238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3', 'request_id': 'req-9cd67211-838d-43ca-9374-364652ec96ee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.592740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] The token cache is being invalidate because project 02168bc6d14f43739fe4fc36b5e59dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:38.593341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.594710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.627614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3', 'request_id': 'req-9cd67211-838d-43ca-9374-364652ec96ee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.629085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3', 'request_id': 'req-9cd67211-838d-43ca-9374-364652ec96ee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.630879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '02168bc6d14f43739fe4fc36b5e59dc3', 'request_id': 'req-9cd67211-838d-43ca-9374-364652ec96ee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:38.650140 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3396/6843] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:44:37 2022] DELETE /identity/v3/domains/02168bc6d14f43739fe4fc36b5e59dc3 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:38.655849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:38.659410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:38.676525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b904-c41d-458c-b870-d95ee64492cd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:38.774315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:38.777051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:38.777051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:38.777051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:38.779012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:38.850336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd67211-838d-43ca-9374-364652ec96ee tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:38.875948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a3547-8010-41f1-ab2a-2a01891f78a5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:38.876597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a3547-8010-41f1-ab2a-2a01891f78a5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:38.876885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a3547-8010-41f1-ab2a-2a01891f78a5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:38.886215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a3547-8010-41f1-ab2a-2a01891f78a5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:38.887101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a3547-8010-41f1-ab2a-2a01891f78a5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:38.892780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a3547-8010-41f1-ab2a-2a01891f78a5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:38.930028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:38.944031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:38.972344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3448/6844] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:39.079912 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:39.083309 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3397/6845] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:44:38 2022] POST /identity/v3/domains => generated 278 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:39.105269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:39.144804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9d11-e579-4c47-95f4-5b1535b3506c service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:39.156300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:39.157572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:39.158055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:39.199009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:39.200699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:39.339886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3398/6846] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:39.346389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:39.347008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:39.347008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:39.347378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/6caa8031ac9b404eba43b875612ac336` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:39.367026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6caa8031ac9b404eba43b875612ac336)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:39.369099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:39.371077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:39.385856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:39.462779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6caa8031ac9b404eba43b875612ac336'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:39.464889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6caa8031ac9b404eba43b875612ac336'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:39.531549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240054fe-dad4-4492-9d08-a14fe8a903ad None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:39.603859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6caa8031ac9b404eba43b875612ac336'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:39.604589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6caa8031ac9b404eba43b875612ac336'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:39.607556 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3449/6847] 10.222.0.59 () {60 vars in 1250 bytes} [Sun Aug 28 01:44:39 2022] PATCH /identity/v3/domains/6caa8031ac9b404eba43b875612ac336 => generated 279 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:39.611654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:39.613122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:39.617662 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:39.643269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:39.643915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:39.644198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:39.644472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:39.654944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:39.862861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:39.865270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:39.879606 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3399/6848] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:44:39.880891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:39.883512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:40.010116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c29a-8f89-473b-9deb-55e584f32d44 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:40.022697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:40.023710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:40.024207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:40.025464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] PATH_INFO: `/v3/users/7de0b8cd72e84529b9001c0a7bed2c6e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:40.030356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de0b8cd72e84529b9001c0a7bed2c6e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:40.030961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d26d3-8fe5-4749-9f5e-9ab8f6addb0b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:40.033088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:40.044457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:40.047831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:40.048811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:40.049531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/6caa8031ac9b404eba43b875612ac336` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:40.075570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=6caa8031ac9b404eba43b875612ac336)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:40.077712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:40.080059 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3450/6849] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:44:39 2022] GET /identity/v3/domains/6caa8031ac9b404eba43b875612ac336 => generated 279 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:40.085585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:40.097673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1d109-2ba9-4fd0-b408-2e1385235c9e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:40.109103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:40.109892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:40.110317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:40.112174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/6caa8031ac9b404eba43b875612ac336` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:40.113769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6caa8031ac9b404eba43b875612ac336)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:40.115809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:40.184510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6caa8031ac9b404eba43b875612ac336'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.194462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6caa8031ac9b404eba43b875612ac336'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.326879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de0b8cd72e84529b9001c0a7bed2c6e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.346069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de0b8cd72e84529b9001c0a7bed2c6e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.351372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caa8031ac9b404eba43b875612ac336', 'request_id': 'req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.361454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caa8031ac9b404eba43b875612ac336', 'request_id': 'req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.387030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de0b8cd72e84529b9001c0a7bed2c6e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.388322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de0b8cd72e84529b9001c0a7bed2c6e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.465561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caa8031ac9b404eba43b875612ac336', 'request_id': 'req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.484354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] The token cache is being invalidate because project 6caa8031ac9b404eba43b875612ac336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:40.484784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.487456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.508202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6caa8031ac9b404eba43b875612ac336', 'request_id': 'req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.509877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6caa8031ac9b404eba43b875612ac336', 'request_id': 'req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.515909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6caa8031ac9b404eba43b875612ac336', 'request_id': 'req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.540049 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3451/6850] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:44:40 2022] DELETE /identity/v3/domains/6caa8031ac9b404eba43b875612ac336 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:40.544253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:40.545779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:40.600461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-253c3f3d-4d63-4213-8bd1-4d75b5f227fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de0b8cd72e84529b9001c0a7bed2c6e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:40.626952 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3400/6851] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:39 2022] DELETE /identity/v3/users/7de0b8cd72e84529b9001c0a7bed2c6e => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:40.641215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:40.642283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:40.643290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:40.659828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ab80f-1a3b-40d6-b911-76df2ca96e1b tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:40.670753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:40.672478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:40.783312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:40.784254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:40.784845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:40.785281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:40.786175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:40.788051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:40.818131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3452/6852] 10.222.0.59 () {58 vars in 1128 bytes} [Sun Aug 28 01:44:40 2022] GET /identity/v3/domains => generated 1349 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:40.823051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:40.844153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a770c04-7e9e-4cfc-86f6-a4c54198e1df tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:40.856489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:40.857410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:40.857999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:40.858671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/6caa8031ac9b404eba43b875612ac336` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:40.875299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:44:40.879220 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3401/6853] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:40.898895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find domain: 6caa8031ac9b404eba43b875612ac336.: keystone.exception.DomainNotFound: Could not find domain: 6caa8031ac9b404eba43b875612ac336. Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6caa8031ac9b404eba43b875612ac336. Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:40.901206 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:40.906366 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6caa8031ac9b404eba43b875612ac336. Aug 28 01:44:40.907831 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:44:40.910103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:40.915284 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3453/6854] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:40 2022] PATCH /identity/v3/domains/6caa8031ac9b404eba43b875612ac336 => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:44:40.916413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:40.939554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15422b86-d19e-46e4-b679-709eafb5426a tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:40.955204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:40.956126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:40.956573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:40.957018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:40.957872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:40.959675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:41.055457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ec88-5b37-4f04-a6cc-2779b42713d3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:41.064723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:41.069218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:41.069513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:41.069796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:41.084998 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3454/6855] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:44:40 2022] POST /identity/v3/domains => generated 276 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:41.087346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:41.095623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:41.097388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:41.120113 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3402/6856] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:41.131456 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:41.193386 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:41.228091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:41.229667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:41.262500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe70d4-951d-4733-9a52-8b114844cf08 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:41.277143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ccf20-035b-4490-92ea-b66afba64b86 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:41.287254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:41.289672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:41.291123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:41.292839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:41.294684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:41.297884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:41.414713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:41.415438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:41.415671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:41.415944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] PATH_INFO: `/v3/users/f873c2a9178840cebd3f564fd68759a1` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:41.421879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f873c2a9178840cebd3f564fd68759a1)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:41.425080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:41.467510 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3455/6857] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:41 2022] POST /identity/v3/users => generated 346 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:41.468663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:41.501144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba2d6b-8352-4837-aed0-6b9c6285b7ca tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:41.518410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:41.519054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:41.521245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:41.521548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/groups` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:41.524494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:41.526669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:41.716933 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3456/6858] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:44:41 2022] POST /identity/v3/groups => generated 324 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:41.721202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:41.748363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129856ad-6cd5-4392-bd54-550a0067296e tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:41.753654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:41.754430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:41.754894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:41.755182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/8283d65d3fd1417b84248fdca09db90c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:41.761588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8283d65d3fd1417b84248fdca09db90c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:41.767422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:41.809905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f873c2a9178840cebd3f564fd68759a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:41.854493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f873c2a9178840cebd3f564fd68759a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:41.867665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8283d65d3fd1417b84248fdca09db90c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:41.870938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8283d65d3fd1417b84248fdca09db90c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:41.877473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f873c2a9178840cebd3f564fd68759a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:41.882239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f873c2a9178840cebd3f564fd68759a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:41.968682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0b355d0a-1162-4a78-8da7-3847fe8786dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f873c2a9178840cebd3f564fd68759a1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:41.988034 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3403/6859] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:41 2022] DELETE /identity/v3/users/f873c2a9178840cebd3f564fd68759a1 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:41.992494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:41.993075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:41.993480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:42.004431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8283d65d3fd1417b84248fdca09db90c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.005390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8283d65d3fd1417b84248fdca09db90c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.009876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3457/6860] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:41 2022] PATCH /identity/v3/domains/8283d65d3fd1417b84248fdca09db90c => generated 277 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:42.012918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:42.014793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:42.025556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:42.027321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:42.111167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63965f04-d215-4305-ae8f-e54f0da3b3f1 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:42.112627 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3404/6861] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:42.138993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:42.142677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:42.241141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:42.243259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:42.244267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:42.245305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/8283d65d3fd1417b84248fdca09db90c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:42.272270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8283d65d3fd1417b84248fdca09db90c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:42.276314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:42.316846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8283d65d3fd1417b84248fdca09db90c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.320966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8283d65d3fd1417b84248fdca09db90c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.329094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1f6e1-ed18-42be-bbd2-68feea025c1b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:42.336163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:42.338686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:42.339205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:42.339881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:42.363619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:42.366262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:42.393964 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3405/6862] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:42.396181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:42.398543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:42.598567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447c12-aacd-4570-920c-d28457e324c5 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:42.720378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:42.721571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:42.721978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:42.722346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:42.724399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:42.823872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce33d9b704634541a154f2d975a1a37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.825949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce33d9b704634541a154f2d975a1a37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.852253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:42.856292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:42.874987 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3406/6863] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:44:42.968043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce33d9b704634541a154f2d975a1a37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.976486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce33d9b704634541a154f2d975a1a37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:42.977303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce33d9b704634541a154f2d975a1a37b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.142626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:43.144162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:43.206413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8283d65d3fd1417b84248fdca09db90c', 'request_id': 'req-1e9d1f83-4707-45df-b478-7c68ec28a778'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.216080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8283d65d3fd1417b84248fdca09db90c', 'request_id': 'req-1e9d1f83-4707-45df-b478-7c68ec28a778'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.273685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c2999-2155-4455-bdaf-dd4cc9d0c727 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:43.367850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8283d65d3fd1417b84248fdca09db90c', 'request_id': 'req-1e9d1f83-4707-45df-b478-7c68ec28a778'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.374327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:43.375481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:43.375943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:43.376699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] PATH_INFO: `/v3/projects/4438571ff32247f596355e83373aeb82` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:43.378706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4438571ff32247f596355e83373aeb82)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:43.382899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] The token cache is being invalidate because project 8283d65d3fd1417b84248fdca09db90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:43.383304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.384012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.389691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:43.395287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8283d65d3fd1417b84248fdca09db90c', 'request_id': 'req-1e9d1f83-4707-45df-b478-7c68ec28a778'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.396017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8283d65d3fd1417b84248fdca09db90c', 'request_id': 'req-1e9d1f83-4707-45df-b478-7c68ec28a778'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.396641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8283d65d3fd1417b84248fdca09db90c', 'request_id': 'req-1e9d1f83-4707-45df-b478-7c68ec28a778'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.425125 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3458/6864] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:44:42 2022] DELETE /identity/v3/domains/8283d65d3fd1417b84248fdca09db90c => generated 0 bytes in 1405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:43.425125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:43.425125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:43.465552 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:43.505049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d1f83-4707-45df-b478-7c68ec28a778 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:43.515912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:43.516791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:43.517304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:43.517681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/8283d65d3fd1417b84248fdca09db90c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:43.527041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=8283d65d3fd1417b84248fdca09db90c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:43.529832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:43.532216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4438571ff32247f596355e83373aeb82', 'request_id': 'req-26369f48-d90c-475e-8277-b38abb09748f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.537167 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:43.561503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4438571ff32247f596355e83373aeb82', 'request_id': 'req-26369f48-d90c-475e-8277-b38abb09748f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find domain: 8283d65d3fd1417b84248fdca09db90c.: keystone.exception.DomainNotFound: Could not find domain: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:43.567349 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:43.577933 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:44:43.583231 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3459/6865] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:44:43 2022] GET /identity/v3/domains/8283d65d3fd1417b84248fdca09db90c => generated 112 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:44:43.584596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:43.584596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:43.607227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ab70b-3a81-4edf-97aa-1ee485d828de tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:43.699358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4438571ff32247f596355e83373aeb82', 'request_id': 'req-26369f48-d90c-475e-8277-b38abb09748f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.719974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] The token cache is being invalidate because project 4438571ff32247f596355e83373aeb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:43.720271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.721266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:43.721960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:43.722239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:43.722508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] PATH_INFO: `/v3/projects/5bd526ba0b704f16a489a484bd346d65` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:43.723296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.726459 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3407/6866] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:43 2022] DELETE /identity/v3/projects/4438571ff32247f596355e83373aeb82 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:43.730059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd526ba0b704f16a489a484bd346d65)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:43.730059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:43.730387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:43.732532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:43.890665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369f48-d90c-475e-8277-b38abb09748f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:43.905344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:43.905943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:43.906223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:43.906495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/users/ce33d9b704634541a154f2d975a1a37b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:43.934279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:get_user(user_id=ce33d9b704634541a154f2d975a1a37b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:43.936419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:43.947391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd526ba0b704f16a489a484bd346d65', 'request_id': 'req-cf1efaed-bca8-4c5b-970c-0756e909b3ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.971254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd526ba0b704f16a489a484bd346d65', 'request_id': 'req-cf1efaed-bca8-4c5b-970c-0756e909b3ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find user: ce33d9b704634541a154f2d975a1a37b.: keystone.exception.UserNotFound: Could not find user: ce33d9b704634541a154f2d975a1a37b. Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 01:44:43.993564 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:43.995113 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ce33d9b704634541a154f2d975a1a37b. Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:43.996161 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3408/6867] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:44:43 2022] GET /identity/v3/users/ce33d9b704634541a154f2d975a1a37b => generated 110 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:44:43.996981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:44.003514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:44.032440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab199b-ea12-48c7-9373-28f889fbea6c tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:44.082410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd526ba0b704f16a489a484bd346d65', 'request_id': 'req-cf1efaed-bca8-4c5b-970c-0756e909b3ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.095951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] The token cache is being invalidate because project 5bd526ba0b704f16a489a484bd346d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:44.097248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.098063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.122240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3460/6868] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:43 2022] DELETE /identity/v3/projects/5bd526ba0b704f16a489a484bd346d65 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:44.123346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:44.130357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:44.176693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:44.177951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:44.178524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:44.179027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] PATH_INFO: `/v3/users/f78622d9ed21465380b49390d3c3c9d0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:44.181793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78622d9ed21465380b49390d3c3c9d0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:44.187915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:44.285121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1efaed-bca8-4c5b-970c-0756e909b3ab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:44.306646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:44.311076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:44.312053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:44.312342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/groups/55dbc505ca114a01afbe89e8f90d08b3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:44.329279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:get_group(group_id=55dbc505ca114a01afbe89e8f90d08b3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:44.339255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find group: 55dbc505ca114a01afbe89e8f90d08b3.: keystone.exception.GroupNotFound: Could not find group: 55dbc505ca114a01afbe89e8f90d08b3. Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 28 01:44:44.367008 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:44.368796 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 55dbc505ca114a01afbe89e8f90d08b3. Aug 28 01:44:44.369978 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:44:44.373030 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3461/6869] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:44 2022] GET /identity/v3/groups/55dbc505ca114a01afbe89e8f90d08b3 => generated 111 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:44:44.374083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:44.375907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:44.378899 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:44.407228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98dd64-7378-4477-8ecb-d7b9cd7992b5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:44.424374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:44.425035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:44.425229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:44.425644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] PATH_INFO: `/v3/users/c3723cf0930c4c25a23d38df6f16e081` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:44.434473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3723cf0930c4c25a23d38df6f16e081)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:44.436723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:44.535768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78622d9ed21465380b49390d3c3c9d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.554922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78622d9ed21465380b49390d3c3c9d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.563948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78622d9ed21465380b49390d3c3c9d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.567516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78622d9ed21465380b49390d3c3c9d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.667859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78622d9ed21465380b49390d3c3c9d0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.675553 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3409/6870] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:43 2022] DELETE /identity/v3/users/f78622d9ed21465380b49390d3c3c9d0 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:44.679328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:44.681896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:44.808215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3723cf0930c4c25a23d38df6f16e081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.809260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3723cf0930c4c25a23d38df6f16e081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.824002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5ac7d-d601-4e94-9a88-11f8c2a434ea admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:44.835962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:44.839523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:44.839894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:44.841505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/groups/55dbc505ca114a01afbe89e8f90d08b3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:44.856352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find group: 55dbc505ca114a01afbe89e8f90d08b3.: keystone.exception.GroupNotFound: Could not find group: 55dbc505ca114a01afbe89e8f90d08b3. Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 28 01:44:44.870476 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:44.871542 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 55dbc505ca114a01afbe89e8f90d08b3. Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:44.872590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3410/6871] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:44:44 2022] DELETE /identity/v3/groups/55dbc505ca114a01afbe89e8f90d08b3 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:44:44.877188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:44.885279 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:44.892342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c44b-b551-4ea1-aff4-9e57790dfbf5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:44.923219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:44.923219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:44.923219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:44.923949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/users/ce33d9b704634541a154f2d975a1a37b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:44.934377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ce33d9b704634541a154f2d975a1a37b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:44.936604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:44.942112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3723cf0930c4c25a23d38df6f16e081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.952135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3723cf0930c4c25a23d38df6f16e081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.957248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3723cf0930c4c25a23d38df6f16e081'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find user: ce33d9b704634541a154f2d975a1a37b.: keystone.exception.UserNotFound: Could not find user: ce33d9b704634541a154f2d975a1a37b. Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 28 01:44:44.968763 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:44.969862 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ce33d9b704634541a154f2d975a1a37b. Aug 28 01:44:44.971034 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:44.975415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3411/6872] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:44 2022] DELETE /identity/v3/users/ce33d9b704634541a154f2d975a1a37b => generated 110 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:44:44.985503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:44.988095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:45.007418 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3462/6873] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:44 2022] DELETE /identity/v3/users/c3723cf0930c4c25a23d38df6f16e081 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:45.020506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010ef0-506a-47ca-86ea-26c109fa1a97 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.111969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:45.112612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:45.112895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:45.113169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/8283d65d3fd1417b84248fdca09db90c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:45.125872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find domain: 8283d65d3fd1417b84248fdca09db90c.: keystone.exception.DomainNotFound: Could not find domain: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:45.134433 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:45.135856 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:45.137029 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:45.142110 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3412/6874] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:44 2022] PATCH /identity/v3/domains/8283d65d3fd1417b84248fdca09db90c => generated 112 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:44:45.143235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:45.158759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227baa3a-7a04-41f4-99ac-2d87c0865a0a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.164294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:45.166099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:45.166780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:45.167277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:45.168124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:45.170443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:45.219666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:45.225322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3463/6875] 10.222.0.59 () {58 vars in 1128 bytes} [Sun Aug 28 01:44:45 2022] GET /identity/v3/domains => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:45.235090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e91fa-1b51-4a39-bf4f-d8ebd4a1548d tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.241204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:45.242082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:45.243225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:45.243856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:45.244742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:45.245561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:45.251741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:45.282645 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3413/6876] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:45 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:45.282796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:45.294922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed4c5-d508-4697-a7bc-606698eb39e0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.301366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:45.302940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:45.302940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:45.303357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:45.304196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-2079863602) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:45.304716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:45.307540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:45.327634 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3464/6877] 10.222.0.59 () {58 vars in 1199 bytes} [Sun Aug 28 01:44:45 2022] GET /identity/v3/domains?name=tempest-test_domain-2079863602 => generated 409 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:45.331837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:45.354840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a809c-51d3-405e-a8c1-d19d3ad28734 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.369249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:45.370005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:45.370305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:45.370586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/8283d65d3fd1417b84248fdca09db90c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:45.384041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Could not find domain: 8283d65d3fd1417b84248fdca09db90c.: keystone.exception.DomainNotFound: Could not find domain: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:44:45.392204 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:44:45.393274 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application with Lock( Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._enter() Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.creator() Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application created_value = creator( Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8283d65d3fd1417b84248fdca09db90c. Aug 28 01:44:45.394620 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:44:45.395724 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3414/6878] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:45 2022] PATCH /identity/v3/domains/8283d65d3fd1417b84248fdca09db90c => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:44:45.399837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:45.415887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344251-c56f-42e1-bec8-092f20c5ba46 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.427288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:45.430622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:45.430924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:45.431209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/48a45147f8684facb52d35c4f3e09b25` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:45.477975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=48a45147f8684facb52d35c4f3e09b25)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:45.479978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:45.542656 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3465/6879] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:45 2022] PATCH /identity/v3/domains/48a45147f8684facb52d35c4f3e09b25 => generated 278 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:45.554533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:45.558951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e23b8-09ff-4091-9171-4eff723995ce tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.564179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:45.565013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:45.565467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:45.565991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/48a45147f8684facb52d35c4f3e09b25` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:45.585130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=48a45147f8684facb52d35c4f3e09b25)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:45.587164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:45.629468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '48a45147f8684facb52d35c4f3e09b25'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:45.635361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '48a45147f8684facb52d35c4f3e09b25'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:45.808213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:45.811615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:45.819324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a45147f8684facb52d35c4f3e09b25', 'request_id': 'req-0c96c09a-ec62-4650-bafa-158509858bf0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:45.833626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a45147f8684facb52d35c4f3e09b25', 'request_id': 'req-0c96c09a-ec62-4650-bafa-158509858bf0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:45.941476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfee28-847f-4f86-9ad2-804aa79bf8d5 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:45.972827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a45147f8684facb52d35c4f3e09b25', 'request_id': 'req-0c96c09a-ec62-4650-bafa-158509858bf0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:45.999433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] The token cache is being invalidate because project 48a45147f8684facb52d35c4f3e09b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:45.999732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.000914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.026722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '48a45147f8684facb52d35c4f3e09b25', 'request_id': 'req-0c96c09a-ec62-4650-bafa-158509858bf0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.027662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '48a45147f8684facb52d35c4f3e09b25', 'request_id': 'req-0c96c09a-ec62-4650-bafa-158509858bf0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.029189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '48a45147f8684facb52d35c4f3e09b25', 'request_id': 'req-0c96c09a-ec62-4650-bafa-158509858bf0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.051930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3415/6880] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:44:45 2022] DELETE /identity/v3/domains/48a45147f8684facb52d35c4f3e09b25 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:46.059199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:46.063049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:46.136256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:46.137797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:46.141342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:46.141342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] PATH_INFO: `/v3/projects/2ef14480a7b040f687a056509c7d21ef` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:46.141342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef14480a7b040f687a056509c7d21ef)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:46.141968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:46.188570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c09a-ec62-4650-bafa-158509858bf0 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:46.209980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:46.209980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:46.209980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:46.210505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/d7752cf1bac54d649797c92f73e20480` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:46.212158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d7752cf1bac54d649797c92f73e20480)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:46.213901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:46.240882 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:46.250518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd7752cf1bac54d649797c92f73e20480'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.251279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd7752cf1bac54d649797c92f73e20480'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.303233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef14480a7b040f687a056509c7d21ef', 'request_id': 'req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.313410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef14480a7b040f687a056509c7d21ef', 'request_id': 'req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.373438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd7752cf1bac54d649797c92f73e20480'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.374352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd7752cf1bac54d649797c92f73e20480'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.377037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3416/6881] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:46 2022] PATCH /identity/v3/domains/d7752cf1bac54d649797c92f73e20480 => generated 277 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:46.378771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:46.392923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:46.486584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef14480a7b040f687a056509c7d21ef', 'request_id': 'req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.511102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] The token cache is being invalidate because project 2ef14480a7b040f687a056509c7d21ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:46.511749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.513530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.515593 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3466/6882] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:45 2022] DELETE /identity/v3/projects/2ef14480a7b040f687a056509c7d21ef => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:46.516601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:46.519716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:46.525183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c33ffd-1a1d-4f04-a1cd-f063c7fff5b8 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:46.654669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff297c-1b08-4f5f-a261-2cc8ae638dbe admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:46.656239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:46.656917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:46.657205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:46.657484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] PATH_INFO: `/v3/projects/5a6938631c3d4a1ba5102e12d808fa5f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:46.660374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6938631c3d4a1ba5102e12d808fa5f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:46.661259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:46.662237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:46.662623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:46.662748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:46.663225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/d7752cf1bac54d649797c92f73e20480` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:46.679179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d7752cf1bac54d649797c92f73e20480)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:46.692083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:46.725953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd7752cf1bac54d649797c92f73e20480'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.730473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd7752cf1bac54d649797c92f73e20480'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.805402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6938631c3d4a1ba5102e12d808fa5f', 'request_id': 'req-1bf3a741-0143-4857-a76d-7690df2e4b72'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.812264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6938631c3d4a1ba5102e12d808fa5f', 'request_id': 'req-1bf3a741-0143-4857-a76d-7690df2e4b72'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.887388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6938631c3d4a1ba5102e12d808fa5f', 'request_id': 'req-1bf3a741-0143-4857-a76d-7690df2e4b72'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.903967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] The token cache is being invalidate because project 5a6938631c3d4a1ba5102e12d808fa5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:46.904272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.904990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1bf3a741-0143-4857-a76d-7690df2e4b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.913643 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3417/6883] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:46 2022] DELETE /identity/v3/projects/5a6938631c3d4a1ba5102e12d808fa5f => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:46.915874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748225d-3ddc-411f-b76c-08fbd97ef48e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:46.916122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748225d-3ddc-411f-b76c-08fbd97ef48e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:46.919041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748225d-3ddc-411f-b76c-08fbd97ef48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:46.932383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7752cf1bac54d649797c92f73e20480', 'request_id': 'req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.939745 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:46.962344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7752cf1bac54d649797c92f73e20480', 'request_id': 'req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:46.989691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a748225d-3ddc-411f-b76c-08fbd97ef48e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:46.992854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a748225d-3ddc-411f-b76c-08fbd97ef48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.054989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7752cf1bac54d649797c92f73e20480', 'request_id': 'req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.073255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] The token cache is being invalidate because project d7752cf1bac54d649797c92f73e20480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:47.073556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.077916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.088635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd7752cf1bac54d649797c92f73e20480', 'request_id': 'req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.090349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd7752cf1bac54d649797c92f73e20480', 'request_id': 'req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.093603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd7752cf1bac54d649797c92f73e20480', 'request_id': 'req-62bf43f1-d015-46e8-bae4-fcceaf0bc5fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.104465 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3467/6884] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:44:46 2022] DELETE /identity/v3/domains/d7752cf1bac54d649797c92f73e20480 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:47.108785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.108785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.108785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.131851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:47.133452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.144919 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3468/6885] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:47.145722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:47.147068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.153314 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3418/6886] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:47.154485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533bd46-f6e5-42b7-83df-4699dbea5b29 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.154775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533bd46-f6e5-42b7-83df-4699dbea5b29 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.155048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533bd46-f6e5-42b7-83df-4699dbea5b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.187968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0533bd46-f6e5-42b7-83df-4699dbea5b29 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:47.189916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0533bd46-f6e5-42b7-83df-4699dbea5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.202175 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3419/6887] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:47.204032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a658e-ec2a-41c6-8218-280e29fdb47b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.204691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a658e-ec2a-41c6-8218-280e29fdb47b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.205275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a658e-ec2a-41c6-8218-280e29fdb47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.250939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9a9a658e-ec2a-41c6-8218-280e29fdb47b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:47.255826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a9a658e-ec2a-41c6-8218-280e29fdb47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.269884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dbb2d-fadc-4589-8323-aff5c2c44929 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:47.276696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:47.277590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.282624 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3420/6888] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:47.282624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a658e-ec2a-41c6-8218-280e29fdb47b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:47.284339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.286939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/d6385a5b9457478193c90fc7cac82dd6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.303435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a658e-ec2a-41c6-8218-280e29fdb47b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:47.306371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d6385a5b9457478193c90fc7cac82dd6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:47.311757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:47.311899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:47.311899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.312265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.312609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.313367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:47.313756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:47.315682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:47.335107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.343612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.343857 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3421/6889] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:47.343857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:47.343857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.353962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0369-76f8-4d74-862c-a7d42984dac4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:47.429742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:47.432395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.432757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.433308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.434249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:47.435830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:47.446944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:47.457790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.459736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.467212 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3469/6890] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:44:47 2022] PATCH /identity/v3/domains/d6385a5b9457478193c90fc7cac82dd6 => generated 278 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:47.469120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:47.470393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3422/6891] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:47.471897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:47.474009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.474825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.505268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff852-8489-4871-8061-7d10a0b21119 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:47.511769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:47.512700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.513182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.513612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.514490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:47.517259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:47.596048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a732f68-9dd2-420e-bff4-0dc6b51b1cc4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:47.601551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '812e2d5c23004fc3b22dc0644e1da4fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc9fefb5eb954c989b872f380dd0f212', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:47.602264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.603192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.603518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] PATH_INFO: `/v3/domains/d6385a5b9457478193c90fc7cac82dd6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.622860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d6385a5b9457478193c90fc7cac82dd6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:47.624482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:47.652882 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3470/6892] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:47 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:47.659263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:47.661643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:47.734587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.747048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.753259 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:47.773624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752aef-0deb-4e3d-9e9e-2bede4896404 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:47.779173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:47.779809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:47.780098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:47.781462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:47.782282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:47.784516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:47.929905 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3471/6893] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:47 2022] POST /identity/v3/projects => generated 371 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:47.929905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:47.987524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6', 'request_id': 'req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:47.992387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188f06-409b-4019-9c93-5e1767270f92 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:47.997117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6', 'request_id': 'req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.064460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:48.065575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.066185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.066656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.067534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:48.072324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:48.094403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6', 'request_id': 'req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.136834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] The token cache is being invalidate because project d6385a5b9457478193c90fc7cac82dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:48.137149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.141694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.175333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6', 'request_id': 'req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.181197 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3472/6894] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:47 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:48.181197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:48.181892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6', 'request_id': 'req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.181892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd6385a5b9457478193c90fc7cac82dd6', 'request_id': 'req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.188133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:48.213780 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3423/6895] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:44:47 2022] DELETE /identity/v3/domains/d6385a5b9457478193c90fc7cac82dd6 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:48.220790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:48.226755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:48.255333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf168b-c5e7-4031-bfe7-5b6a6baa4015 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:48.263199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc701ba-bf0d-44f7-a2d6-3e41e663e261 tempest-DomainsTestJSON-1938373280 tempest-DomainsTestJSON-1938373280-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:48.271314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:48.272789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:48.273431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.273734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.274231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.280683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:48.280683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:48.282272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.283435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.284256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.288176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:48.291372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:48.297658 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3424/6896] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:48.298880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:48.301536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:48.320261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccf243-1bd3-4c6d-8ec9-66894454af70 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:48.334772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:48.334772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.334772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.335608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] PATH_INFO: `/v3/users/ec01c1b001894358988049435dcf9127` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.336942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec01c1b001894358988049435dcf9127)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:48.339432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:48.347706 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:48.488208 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3473/6897] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:48 2022] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:48.488893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:48.514857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e548a8a-64e3-476e-b666-c8fccf3c7656 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:48.531194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:48.533287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.533640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.534019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.534763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:48.536508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:48.553273 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3474/6898] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:48.554309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:48.567885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e51c1-f13b-4505-9f83-032b0fa9a6e5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:48.578511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:48.579152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.579452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.579706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.580475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:48.582326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:48.603469 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3475/6899] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:48.604378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:48.629378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b60284-3000-4ad6-9bc3-9a24b470597a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:48.638214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:48.641438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.641438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.641438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] PATH_INFO: `/v3/projects/857b5bc8698c447897f197c9598b9d0c/users/7a8befd3ed7e4f8ba180cc7053a0375e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.675422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=857b5bc8698c447897f197c9598b9d0c, user_id=7a8befd3ed7e4f8ba180cc7053a0375e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:48.687631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:48.727771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec01c1b001894358988049435dcf9127'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.739299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec01c1b001894358988049435dcf9127'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.748538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec01c1b001894358988049435dcf9127'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.749543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec01c1b001894358988049435dcf9127'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.890356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d1af34cd-b0b0-4d51-a4dc-3ad7eee50a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec01c1b001894358988049435dcf9127'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:48.907714 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3476/6900] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:48 2022] PUT /identity/v3/projects/857b5bc8698c447897f197c9598b9d0c/users/7a8befd3ed7e4f8ba180cc7053a0375e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:48.913777 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3425/6901] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:48 2022] DELETE /identity/v3/users/ec01c1b001894358988049435dcf9127 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:48.916783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:48.918985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace312-8e5b-47a6-9c4a-56d1acd05625 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:48.919475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace312-8e5b-47a6-9c4a-56d1acd05625 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:48.922328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace312-8e5b-47a6-9c4a-56d1acd05625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:48.923065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:49.005671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7bace312-8e5b-47a6-9c4a-56d1acd05625 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:49.006932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7bace312-8e5b-47a6-9c4a-56d1acd05625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:49.083660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4f7e-8b27-44aa-895c-0de3b8e91b8a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:49.124268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3426/6902] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:49.125705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac241-6c14-4621-839f-937c58670de1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:49.126012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac241-6c14-4621-839f-937c58670de1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:49.126319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac241-6c14-4621-839f-937c58670de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:49.176779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-753ac241-6c14-4621-839f-937c58670de1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:49.178494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-753ac241-6c14-4621-839f-937c58670de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:49.191089 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3427/6903] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:49.192246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac241-6c14-4621-839f-937c58670de1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:49.193910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-753ac241-6c14-4621-839f-937c58670de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:49.244796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:49.246066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:49.246655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:49.247764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:49.248612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:49.250823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:49.265524 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3477/6904] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:49.266920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:49.282435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac241-6c14-4621-839f-937c58670de1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:49.283165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b5d9-363b-4faf-95c5-63df6badf739 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:49.288699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8076556-7f44-4531-8863-271e1e80245e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:49.291019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8076556-7f44-4531-8863-271e1e80245e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:49.291483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8076556-7f44-4531-8863-271e1e80245e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:49.292037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8076556-7f44-4531-8863-271e1e80245e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:49.297997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:49.299010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:49.299449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:49.299874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:49.310300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8076556-7f44-4531-8863-271e1e80245e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:49.313575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8076556-7f44-4531-8863-271e1e80245e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:49.315845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:49.317545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:49.335265 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3428/6905] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:49.335413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:49.342756 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3478/6906] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:49.349732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249bd9-a012-477f-af32-937aa662b59b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:49.355308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:49.355991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:49.357158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:49.357158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] PATH_INFO: `/v3/projects/ff09d3f23861416187e3c6a68ef0ee78/users/76617e609cfc412fbdd75da8757a36e9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:49.375135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff09d3f23861416187e3c6a68ef0ee78, user_id=76617e609cfc412fbdd75da8757a36e9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:49.386118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:49.430587 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:49.514211 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3429/6907] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:49 2022] PUT /identity/v3/projects/ff09d3f23861416187e3c6a68ef0ee78/users/76617e609cfc412fbdd75da8757a36e9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:49.522447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:49.522735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:49.523014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:49.562987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] MFA Rules not processed for user `76617e609cfc412fbdd75da8757a36e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:49.564639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:49.673640 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3479/6908] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:49.688545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:49.690624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:49.767712 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:49.790885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaf7d8-e8b2-415b-a9ca-37ed5ef75069 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:49.795506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da451042-ae27-48bd-a97b-b078ed4b5c74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:49.796791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da451042-ae27-48bd-a97b-b078ed4b5c74 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:49.797142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da451042-ae27-48bd-a97b-b078ed4b5c74 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:49.797477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da451042-ae27-48bd-a97b-b078ed4b5c74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:49.823344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da451042-ae27-48bd-a97b-b078ed4b5c74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:49.825004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da451042-ae27-48bd-a97b-b078ed4b5c74 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:49.854686 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3430/6909] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:44:50.244661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:50.246252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:50.403318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04110893-45bc-4863-930c-0a78810cd0b9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:50.417583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:50.418299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:50.418844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:50.419117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] PATH_INFO: `/v3/projects/cf5928a2cecb4f26996f966d76a7dc1f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:50.420268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5928a2cecb4f26996f966d76a7dc1f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:50.422245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:50.616571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5928a2cecb4f26996f966d76a7dc1f', 'request_id': 'req-5d6d2f11-b13a-4078-9628-8766bb2b7c34'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:50.619738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:50.620588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:50.621025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:50.647014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5928a2cecb4f26996f966d76a7dc1f', 'request_id': 'req-5d6d2f11-b13a-4078-9628-8766bb2b7c34'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:50.656389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:50.657624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:50.739337 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3431/6910] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:50.753914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:50.755046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:50.776047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5928a2cecb4f26996f966d76a7dc1f', 'request_id': 'req-5d6d2f11-b13a-4078-9628-8766bb2b7c34'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:50.806728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] The token cache is being invalidate because project cf5928a2cecb4f26996f966d76a7dc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:50.807022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:50.814234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:50.816345 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3480/6911] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:50 2022] DELETE /identity/v3/projects/cf5928a2cecb4f26996f966d76a7dc1f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:50.820502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:50.823714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:50.906396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf11e4-8181-4ba4-8f80-fa26606bc847 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:50.919696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0d8fa-fb23-45a2-bbf0-33c6a9df93f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:50.920629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d8fa-fb23-45a2-bbf0-33c6a9df93f0 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:50.920921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d8fa-fb23-45a2-bbf0-33c6a9df93f0 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:50.921917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d8fa-fb23-45a2-bbf0-33c6a9df93f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:50.926607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-88a0d8fa-fb23-45a2-bbf0-33c6a9df93f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:50.936592 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:50.957969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0d8fa-fb23-45a2-bbf0-33c6a9df93f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:50.959122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0d8fa-fb23-45a2-bbf0-33c6a9df93f0 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:50.971596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2f11-b13a-4078-9628-8766bb2b7c34 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:50.978766 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3432/6912] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:44:50.983052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:50.983356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:50.983699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:50.984010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] PATH_INFO: `/v3/users/812e2d5c23004fc3b22dc0644e1da4fe` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:50.985207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=812e2d5c23004fc3b22dc0644e1da4fe)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:50.987929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:51.296539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812e2d5c23004fc3b22dc0644e1da4fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:51.298065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812e2d5c23004fc3b22dc0644e1da4fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:51.378662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812e2d5c23004fc3b22dc0644e1da4fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:51.399000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812e2d5c23004fc3b22dc0644e1da4fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:51.411761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812e2d5c23004fc3b22dc0644e1da4fe'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:51.455484 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3481/6913] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:50 2022] DELETE /identity/v3/users/812e2d5c23004fc3b22dc0644e1da4fe => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:44:51.674525 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:52.349939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:52.350472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:52.351555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:52.387040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:52.388334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:52.548508 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3433/6914] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:44:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:52.571869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:52.572352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:52.573876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:52.574308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:52.749592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316d3f6-4e02-4965-aa8f-1e409dcc725e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:52.763235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:52.764549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:52.766300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:52.766669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c18d4-f4e7-432d-9c08-209c81eb5fd4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:52.767115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] PATH_INFO: `/v3/projects/fc9fefb5eb954c989b872f380dd0f212` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:52.771121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9fefb5eb954c989b872f380dd0f212)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:52.775986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:52.797000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74303de5-bcd2-4ec9-953e-f20e0aa83971 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:52.797000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74303de5-bcd2-4ec9-953e-f20e0aa83971 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:52.797000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74303de5-bcd2-4ec9-953e-f20e0aa83971 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:52.797000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74303de5-bcd2-4ec9-953e-f20e0aa83971 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:52.808123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74303de5-bcd2-4ec9-953e-f20e0aa83971 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:52.814029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74303de5-bcd2-4ec9-953e-f20e0aa83971 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:52.836471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3482/6915] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:44:52.870794 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:53.048018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9fefb5eb954c989b872f380dd0f212', 'request_id': 'req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:53.056173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9fefb5eb954c989b872f380dd0f212', 'request_id': 'req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:53.150899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9fefb5eb954c989b872f380dd0f212', 'request_id': 'req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:53.193767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] The token cache is being invalidate because project fc9fefb5eb954c989b872f380dd0f212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:53.195442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:53.197992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d9a5a89f-6f5a-45d6-81fd-fb35708112f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:53.202774 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3434/6916] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:44:52 2022] DELETE /identity/v3/projects/fc9fefb5eb954c989b872f380dd0f212 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:53.208339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65a3d-6e53-44cd-8064-dee67804a4b2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:53.208635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65a3d-6e53-44cd-8064-dee67804a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:53.208917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec65a3d-6e53-44cd-8064-dee67804a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:53.243603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4ec65a3d-6e53-44cd-8064-dee67804a4b2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:53.244937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4ec65a3d-6e53-44cd-8064-dee67804a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:53.372797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3483/6917] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:53.373868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c94ae-1579-4e2b-826d-bde338e10744 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:53.373868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c94ae-1579-4e2b-826d-bde338e10744 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:53.373868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c94ae-1579-4e2b-826d-bde338e10744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:53.411342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-295c94ae-1579-4e2b-826d-bde338e10744 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:53.412786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-295c94ae-1579-4e2b-826d-bde338e10744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:53.474178 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3435/6918] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:53.476608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65a3d-6e53-44cd-8064-dee67804a4b2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:53.512457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec65a3d-6e53-44cd-8064-dee67804a4b2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:53.537090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:53.537720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:53.538031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:53.538307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:53.542365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:44:53.550027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:53.552722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:53.596074 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3484/6919] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:44:53.596755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c94ae-1579-4e2b-826d-bde338e10744 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:53.608436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c94ae-1579-4e2b-826d-bde338e10744 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:53.635001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175915a7-46e6-432f-a81d-dda2b9e06dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:53.639288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175915a7-46e6-432f-a81d-dda2b9e06dca admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:53.639778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175915a7-46e6-432f-a81d-dda2b9e06dca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:53.640227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175915a7-46e6-432f-a81d-dda2b9e06dca admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:53.641056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175915a7-46e6-432f-a81d-dda2b9e06dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:53.643494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175915a7-46e6-432f-a81d-dda2b9e06dca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:53.791154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3436/6920] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:53 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:53.795961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:53.839583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ed44c-c3bf-41d9-a40a-c9e005131c85 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:54.065681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:54.066475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:54.066757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:54.067238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:54.068050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:54.074876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:54.110459 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:54.268337 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3485/6921] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:53 2022] POST /identity/v3/users => generated 287 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:54.272328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:54.272887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:54.273462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:54.282371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:54.317525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abb47-55ad-4c11-8a1a-41b9b15c9d62 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:54.339119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:54.340348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:54.341915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:54.342541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:54.342821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:54.343089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:54.343730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:54.349139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:54.406629 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3486/6922] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:54.414045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:54.438366 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:54.461706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb904-e714-441a-a0fd-4f7f661cd745 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:54.479325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:54.479944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:54.480221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:54.480621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:54.481207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:54.482761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:54.523742 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3487/6923] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:44:54.524867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:54.526904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3437/6924] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:54.553700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:54.556828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:54.566101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1be8-959c-427f-b914-a80184ede593 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:54.583725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083aeb-6007-4bfe-99fc-c852c65517bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:54.584523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083aeb-6007-4bfe-99fc-c852c65517bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:54.584926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083aeb-6007-4bfe-99fc-c852c65517bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:54.585405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083aeb-6007-4bfe-99fc-c852c65517bf admin admin] PATH_INFO: `/v3/projects/2354548148484e1da5fb697276d373a9/users/31f45e24d8b34551a5ad05d575550c89/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:54.632681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083aeb-6007-4bfe-99fc-c852c65517bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2354548148484e1da5fb697276d373a9, user_id=31f45e24d8b34551a5ad05d575550c89, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:54.634564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083aeb-6007-4bfe-99fc-c852c65517bf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:54.745914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3488/6925] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:54 2022] PUT /identity/v3/projects/2354548148484e1da5fb697276d373a9/users/31f45e24d8b34551a5ad05d575550c89/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:54.754716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36414f-855c-43de-920c-2fa113dc6de0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:54.755179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36414f-855c-43de-920c-2fa113dc6de0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:54.755465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36414f-855c-43de-920c-2fa113dc6de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:54.766850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6159d-47af-4476-80db-7d2d764a7878 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:54.807128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0b36414f-855c-43de-920c-2fa113dc6de0 None None] MFA Rules not processed for user `31f45e24d8b34551a5ad05d575550c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:54.809371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0b36414f-855c-43de-920c-2fa113dc6de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:54.932782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:54.936583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:54.944712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:54.944712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:54.954056 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3489/6926] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:54.981713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36414f-855c-43de-920c-2fa113dc6de0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:55.073993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:55.078999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:55.117314 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3438/6927] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:44:55.120231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36414f-855c-43de-920c-2fa113dc6de0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:55.126308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:55.127266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:55.127872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:55.128410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:55.129348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:55.132043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:55.272510 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3490/6928] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:54 2022] POST /identity/v3/projects => generated 369 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:55.275848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:55.301275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e424209-4ddf-44dd-a49c-851a42266ecf service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:55.389532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:55.390655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:55.391289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:55.391747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:55.392560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:55.394707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:55.557047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:55.557400 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3439/6929] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:55 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:55.575741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8cf90-7609-45d7-a026-6d69c4fa5a0a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:55.612721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:55.614320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:55.616317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:55.616941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:55.622309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:55.624339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:55.693672 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3491/6930] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:55.700082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:55.730618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706e41-11bf-4e87-b465-5d1254329cb6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:55.761652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:55.766666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:55.767706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:55.768962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] PATH_INFO: `/v3/projects/8c24451bbde341e1b545039831958b29/users/1aa0f92342f14935813222454d37283d/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:55.840473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c24451bbde341e1b545039831958b29, user_id=1aa0f92342f14935813222454d37283d, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:55.847609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:55.911416 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:56.009119 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3440/6931] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:55 2022] PUT /identity/v3/projects/8c24451bbde341e1b545039831958b29/users/1aa0f92342f14935813222454d37283d/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:56.013370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:56.027687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0a99f-056f-4d57-9299-818a1992549d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:56.169774 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:56.232338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f47f5b-3c69-47e0-8d02-1a25e99917ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:56.233443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f47f5b-3c69-47e0-8d02-1a25e99917ff admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:56.234024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f47f5b-3c69-47e0-8d02-1a25e99917ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:56.234524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f47f5b-3c69-47e0-8d02-1a25e99917ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:56.235958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f47f5b-3c69-47e0-8d02-1a25e99917ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:56.239053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f47f5b-3c69-47e0-8d02-1a25e99917ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:56.254048 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3492/6932] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:44:56.258867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:56.280329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf8c69-07fe-4c5b-a133-a5f1bfbdee7f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:56.294791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ac806-1b31-48ad-8e8b-62242108470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:56.295641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ac806-1b31-48ad-8e8b-62242108470c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:56.295824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ac806-1b31-48ad-8e8b-62242108470c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:56.296286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ac806-1b31-48ad-8e8b-62242108470c admin admin] PATH_INFO: `/v3/projects/8c24451bbde341e1b545039831958b29/users/1aa0f92342f14935813222454d37283d/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:56.298959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ac806-1b31-48ad-8e8b-62242108470c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c24451bbde341e1b545039831958b29, user_id=1aa0f92342f14935813222454d37283d, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:56.332627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ac806-1b31-48ad-8e8b-62242108470c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:56.368643 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3441/6933] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:44:56 2022] PUT /identity/v3/projects/8c24451bbde341e1b545039831958b29/users/1aa0f92342f14935813222454d37283d/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:56.382335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e58a7-7c3e-46a0-a7e3-bd699350eeaa None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:56.383068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e58a7-7c3e-46a0-a7e3-bd699350eeaa None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:56.384401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e58a7-7c3e-46a0-a7e3-bd699350eeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:56.491223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b10e58a7-7c3e-46a0-a7e3-bd699350eeaa None None] MFA Rules not processed for user `1aa0f92342f14935813222454d37283d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:56.517938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b10e58a7-7c3e-46a0-a7e3-bd699350eeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:56.544248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338689d-e93b-4957-bdc1-798240fd95df None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:56.544540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338689d-e93b-4957-bdc1-798240fd95df None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:56.544821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338689d-e93b-4957-bdc1-798240fd95df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:56.603839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3338689d-e93b-4957-bdc1-798240fd95df None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:56.605576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3338689d-e93b-4957-bdc1-798240fd95df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:56.651156 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3493/6934] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:44:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:56.657179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e58a7-7c3e-46a0-a7e3-bd699350eeaa None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:56.680097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e58a7-7c3e-46a0-a7e3-bd699350eeaa None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:56.714140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:56.715783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:56.716243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:56.716737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:56.718130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:56.733995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:56.761514 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3442/6935] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:44:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:44:56.778807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338689d-e93b-4957-bdc1-798240fd95df None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:56.834541 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3494/6936] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:44:56 2022] POST /identity/v3/domains => generated 276 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:56.841005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:56.904037 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:56.935326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338689d-e93b-4957-bdc1-798240fd95df None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:57.002943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66f1f-4c00-4931-b32d-41ce74ead461 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:57.012661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:57.013869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:57.014324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:57.024676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:57.024676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:57.024676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:57.181270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:57.182241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:57.182549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:57.182827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:57.227021 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3495/6937] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:44:56 2022] POST /identity/v3/projects => generated 401 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:57.231604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:57.312989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:57.315325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:57.332718 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3443/6938] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:44:57.428653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda613a4-7247-4e0b-b881-34e903294e1c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:57.443852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:57.444498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:57.444786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:57.445067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/groups` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:57.445736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:57.449086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:57.566812 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3496/6939] 10.222.0.59 () {60 vars in 1147 bytes} [Sun Aug 28 01:44:57 2022] POST /identity/v3/groups => generated 302 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:57.570639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:57.595068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c0f63-5400-4a8a-9ea1-77f6386fa257 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:57.607943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:57.608667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:57.609153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:57.609593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:57.610451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:57.620075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:57.780913 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3444/6940] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:44:57 2022] POST /identity/v3/users => generated 445 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:57.781983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:57.795838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31f2b-8108-4cd5-a038-60e32ab8ed76 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:57.811200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:57.813385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:57.813827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:57.814519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:57.817552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:57.821804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:57.927683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3497/6941] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:44:57 2022] POST /identity/v3/roles => generated 240 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:44:57.932542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:57.950679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54251-ac2c-4ff5-94a5-18113d3dc6f2 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:57.971889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:57.973004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:57.973465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:57.973944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/groups/d355896f920a4dce94abfb86f6e54602/roles/4bc9df8f01674796bdeeca99a1cfe104/inherited_to_projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:57.998342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, group_id=d355896f920a4dce94abfb86f6e54602, role_id=4bc9df8f01674796bdeeca99a1cfe104)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:58.001504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:58.084424 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3445/6942] 10.222.0.59 () {60 vars in 1585 bytes} [Sun Aug 28 01:44:57 2022] PUT /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/groups/d355896f920a4dce94abfb86f6e54602/roles/4bc9df8f01674796bdeeca99a1cfe104/inherited_to_projects => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:58.089845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:58.109209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81779a-dff8-4005-a07c-57790ba0b6fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:58.231421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:58.232780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:58.233383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:58.233891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/groups/d355896f920a4dce94abfb86f6e54602/roles/4bc9df8f01674796bdeeca99a1cfe104/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:58.239245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, group_id=d355896f920a4dce94abfb86f6e54602, role_id=4bc9df8f01674796bdeeca99a1cfe104)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:58.250671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:58.281054 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3498/6943] 10.222.0.59 () {58 vars in 1567 bytes} [Sun Aug 28 01:44:58 2022] HEAD /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/groups/d355896f920a4dce94abfb86f6e54602/roles/4bc9df8f01674796bdeeca99a1cfe104/inherited_to_projects => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:58.291876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:58.308340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211344a-2d6d-4ad9-af3d-9fc399dd7e36 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:58.337270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:58.337270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:58.337270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:58.342078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/groups/d355896f920a4dce94abfb86f6e54602/roles/4bc9df8f01674796bdeeca99a1cfe104/inherited_to_projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:58.355187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, group_id=d355896f920a4dce94abfb86f6e54602, role_id=4bc9df8f01674796bdeeca99a1cfe104)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:58.363268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:58.395911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 4bc9df8f01674796bdeeca99a1cfe104 was removed from group d355896f920a4dce94abfb86f6e54602 on project b76bb1fa8ac64da6a1ed6016b291dd00. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:58.396892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:58.406425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6e78dafb-9504-4156-a434-3c960d2b4f43 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:58.435128 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:58.500297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3446/6944] 10.222.0.59 () {58 vars in 1569 bytes} [Sun Aug 28 01:44:58 2022] DELETE /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/groups/d355896f920a4dce94abfb86f6e54602/roles/4bc9df8f01674796bdeeca99a1cfe104/inherited_to_projects => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:58.505980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:58.520717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:58.584309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb642775-6957-4a28-a1bc-7cda8f127be3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:58.605057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:58.605057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:58.605057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:58.655757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:44:58.658456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:58.665576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:58.666650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:58.666650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:58.666966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles/4bc9df8f01674796bdeeca99a1cfe104` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:58.670750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4bc9df8f01674796bdeeca99a1cfe104)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:58.672548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:58.788312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3447/6945] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:44:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:44:58.797737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 4bc9df8f01674796bdeeca99a1cfe104 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:58.798687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:58.800859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:58.801429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:58.802416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:58.806195 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3499/6946] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:58 2022] DELETE /identity/v3/roles/4bc9df8f01674796bdeeca99a1cfe104 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:58.811517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:58.813149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:58.965949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503f722-9ac4-438c-b5d9-fa45216cbed4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:58.992556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86cee-bf2c-4d9a-9dd6-4bd0cabe15bc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:59.000483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:59.001529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:59.002138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:59.002627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:59.003561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:59.006628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:59.050681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:59.058359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:59.058359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:59.058359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:59.058359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:59.167638 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3500/6947] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:44:58 2022] POST /identity/v3/roles => generated 240 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:44:59.172218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:59.179768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:59.184492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:59.195544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d94e-67b2-45eb-9736-5b8929c8c345 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:59.211541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:59.212999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:59.220632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:59.220632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/3c837c5f7def4c2ba5259024105354c4/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:59.221023 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3448/6948] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:44:59.272258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=3c837c5f7def4c2ba5259024105354c4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:59.278496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:59.379241 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3501/6949] 10.222.0.59 () {60 vars in 1582 bytes} [Sun Aug 28 01:44:59 2022] PUT /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/3c837c5f7def4c2ba5259024105354c4/inherited_to_projects => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:59.383153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:59.394417 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:59.400950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dafc6-b0fc-41cc-98cf-294a6c2ee7de service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:59.563225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:59.563936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:59.569082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:59.569082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/3c837c5f7def4c2ba5259024105354c4/inherited_to_projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:59.574152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=3c837c5f7def4c2ba5259024105354c4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:59.577496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:59.595603 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3449/6950] 10.222.0.59 () {58 vars in 1564 bytes} [Sun Aug 28 01:44:59 2022] HEAD /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/3c837c5f7def4c2ba5259024105354c4/inherited_to_projects => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:59.601406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:59.631460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe7ed-2feb-4098-b6f2-53237b5261f9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:59.641452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:59.642555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:59.645167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:59.645167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/3c837c5f7def4c2ba5259024105354c4/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:59.647756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=3c837c5f7def4c2ba5259024105354c4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:59.652219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:59.659994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 3c837c5f7def4c2ba5259024105354c4 was removed from user 767e98ffdb3847b1b2afd93ea379823e on project b76bb1fa8ac64da6a1ed6016b291dd00. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:44:59.660588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:59.661515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:44:59.801106 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3502/6951] 10.222.0.59 () {58 vars in 1566 bytes} [Sun Aug 28 01:44:59 2022] DELETE /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/3c837c5f7def4c2ba5259024105354c4/inherited_to_projects => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:44:59.802349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:59.804198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:59.838062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d98977-2be0-4e62-a874-ca80b09e3b53 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:59.983535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:59.984204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:59.984488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:59.984768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles/3c837c5f7def4c2ba5259024105354c4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:59.989196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c837c5f7def4c2ba5259024105354c4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:59.994834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:00.184582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 3c837c5f7def4c2ba5259024105354c4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:00.184889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:00.185731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a046d87-6e0b-4953-b46d-5ac603612651 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:00.193127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:00.193659 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3450/6952] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:44:59 2022] DELETE /identity/v3/roles/3c837c5f7def4c2ba5259024105354c4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:00.211514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a65c8-3dae-4ce7-8518-bf5c1eeb2239 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:00.447811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:00.463102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:00.463102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:00.463398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:00.463929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:00.472595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:00.492370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:00.493356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:00.494136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:00.520953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:00.523033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:00.578909 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:00.588441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3503/6953] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:45:00 2022] POST /identity/v3/roles => generated 239 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:00.590228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:00.593096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:00.616682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26de8-e978-480d-bb9e-d738f172f2fc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:00.624675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:00.625960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:00.626471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:00.627059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/0e6aa4e70b2d404ca083021a3e61accc/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:00.636694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, group_id=d355896f920a4dce94abfb86f6e54602, role_id=0e6aa4e70b2d404ca083021a3e61accc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:00.641136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:00.721334 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3504/6954] 10.222.0.59 () {60 vars in 1582 bytes} [Sun Aug 28 01:45:00 2022] PUT /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/0e6aa4e70b2d404ca083021a3e61accc/inherited_to_projects => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:00.723545 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3451/6955] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:45:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:00.734592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:00.737782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:00.739274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:00.927224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460d59-5d36-48f3-8eca-2fcea3ba6f6f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:00.935022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caaa5d-46a8-4a46-9fc7-1da61a910700 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:00.942409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:00.943503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:00.944021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:00.944573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:00.947265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, group_id=d355896f920a4dce94abfb86f6e54602)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:00.951333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:00.972390 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3505/6956] 10.222.0.59 () {58 vars in 1464 bytes} [Sun Aug 28 01:45:00 2022] GET /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/inherited_to_projects => generated 447 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:00.973778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:00.985994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4eca0-55c2-4666-8a9c-68965fac3613 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:00.997444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:00.998559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:01.001504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:01.002638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/0e6aa4e70b2d404ca083021a3e61accc/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:01.008047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, group_id=d355896f920a4dce94abfb86f6e54602, role_id=0e6aa4e70b2d404ca083021a3e61accc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:01.015411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:01.030342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:01.030962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:01.031240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:01.031515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:01.035250 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3506/6957] 10.222.0.59 () {58 vars in 1564 bytes} [Sun Aug 28 01:45:00 2022] HEAD /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/0e6aa4e70b2d404ca083021a3e61accc/inherited_to_projects => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:01.037626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:01.063536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b102504-2807-4cda-bb23-67e599e53777 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:01.089194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:01.089194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:01.089194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:01.089902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/0e6aa4e70b2d404ca083021a3e61accc/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:01.089902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, group_id=d355896f920a4dce94abfb86f6e54602, role_id=0e6aa4e70b2d404ca083021a3e61accc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:01.091174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:01.105868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 0e6aa4e70b2d404ca083021a3e61accc was removed from group d355896f920a4dce94abfb86f6e54602 on domain e93f0e9f84e74050bbfd8e48ebcaa9ea. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:01.106341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:01.107729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:01.118173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:01.119924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:01.132706 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3452/6958] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:45:01.204723 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3507/6959] 10.222.0.59 () {58 vars in 1566 bytes} [Sun Aug 28 01:45:01 2022] DELETE /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/groups/d355896f920a4dce94abfb86f6e54602/roles/0e6aa4e70b2d404ca083021a3e61accc/inherited_to_projects => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:01.208714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:01.225964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915e6d-07fb-4e0a-9855-a1f7cd3ca9b5 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:01.261409 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:01.391659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:01.392667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:01.393158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:01.393659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles/0e6aa4e70b2d404ca083021a3e61accc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:01.396930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0e6aa4e70b2d404ca083021a3e61accc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:01.399386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:01.622702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 0e6aa4e70b2d404ca083021a3e61accc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:01.622702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:01.623988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:01.627453 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3453/6960] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:01 2022] DELETE /identity/v3/roles/0e6aa4e70b2d404ca083021a3e61accc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:01.635000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:01.637068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:01.687165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eb325-3a8b-4cdb-815a-f6389bde18cc tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:01.910343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:01.911268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:01.911731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:01.913663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:01.915237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:01.921799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:02.026446 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3508/6961] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:45:01 2022] POST /identity/v3/roles => generated 240 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:02.033215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:02.034798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:02.063447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a8594-7d0f-44e8-ab5f-3f3e52f122ae tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:02.101427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8727-1198-4fc9-adca-73a2c8aca7ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:02.102698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8727-1198-4fc9-adca-73a2c8aca7ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:02.103285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8727-1198-4fc9-adca-73a2c8aca7ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:02.103820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8727-1198-4fc9-adca-73a2c8aca7ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/3ec533304ff44a448e1aa6d6b0643a74/inherited_to_projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:02.111685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8727-1198-4fc9-adca-73a2c8aca7ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=3ec533304ff44a448e1aa6d6b0643a74)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:02.115030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8727-1198-4fc9-adca-73a2c8aca7ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:02.199763 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3454/6962] 10.222.0.59 () {60 vars in 1579 bytes} [Sun Aug 28 01:45:02 2022] PUT /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/3ec533304ff44a448e1aa6d6b0643a74/inherited_to_projects => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:02.202106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:02.221083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a3038-cc1c-427f-b525-3945b682e6d9 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:02.279664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:02.280339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:02.281356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:02.304135 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:02.372096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] MFA Rules not processed for user `7a8befd3ed7e4f8ba180cc7053a0375e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:02.379158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:02.508322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:02.509420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:02.509715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:02.510033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:02.512302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, user_id=767e98ffdb3847b1b2afd93ea379823e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:02.514958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:02.570929 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3509/6963] 10.222.0.59 () {58 vars in 1461 bytes} [Sun Aug 28 01:45:02 2022] GET /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/inherited_to_projects => generated 447 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:02.576986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:02.618290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fcc27-36c3-4a89-8acb-5564b19f7295 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:02.629867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:02.630571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:02.630861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:02.631149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/3ec533304ff44a448e1aa6d6b0643a74/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:02.644829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=3ec533304ff44a448e1aa6d6b0643a74)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:02.647751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:02.653557 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3455/6964] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:02.655004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:02.658029 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3510/6965] 10.222.0.59 () {58 vars in 1561 bytes} [Sun Aug 28 01:45:02 2022] HEAD /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/3ec533304ff44a448e1aa6d6b0643a74/inherited_to_projects => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:02.661911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:02.663175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:02.682753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0788b1-ecd3-4f96-a195-a0bc9f3cc9ac tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:02.702845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:02.703914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:02.704238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:02.704680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/3ec533304ff44a448e1aa6d6b0643a74/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:02.710637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=3ec533304ff44a448e1aa6d6b0643a74)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:02.728338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:02.741555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 3ec533304ff44a448e1aa6d6b0643a74 was removed from user 767e98ffdb3847b1b2afd93ea379823e on domain e93f0e9f84e74050bbfd8e48ebcaa9ea. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:02.743452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:02.744432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:02.824278 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3511/6966] 10.222.0.59 () {58 vars in 1563 bytes} [Sun Aug 28 01:45:02 2022] DELETE /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/3ec533304ff44a448e1aa6d6b0643a74/inherited_to_projects => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:02.837110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:02.841159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:02.880911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75950cc8-cd6d-4b50-8d8a-da104b0d8c10 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:02.915879 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:03.033033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06997c1-35e1-4202-b93e-01fb2a38896e tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:03.049115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:03.050186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:03.050643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:03.052197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles/3ec533304ff44a448e1aa6d6b0643a74` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:03.054800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3ec533304ff44a448e1aa6d6b0643a74)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:03.059758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:03.126755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:03.127717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:03.128618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:03.130380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:03.131283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:03.134673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:03.225178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 3ec533304ff44a448e1aa6d6b0643a74 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:03.225485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:03.226193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:03.228230 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3512/6967] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:02 2022] DELETE /identity/v3/roles/3ec533304ff44a448e1aa6d6b0643a74 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:03.233403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:03.242109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:03.345620 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3456/6968] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:02 2022] POST /identity/v3/projects => generated 381 bytes in 691 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:03.349206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:03.362067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:03.458484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f28ae1-73c6-4e95-9d5c-7600a51c2438 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:03.574144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:03.574918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:03.575212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:03.575544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:03.576374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:03.577660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa72f-9e21-469f-9c90-7a28921abd37 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:03.578106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:03.593171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:03.593171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:03.593171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:03.593171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:03.593662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:03.595633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:03.622672 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:03.670668 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3513/6969] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:45:03 2022] POST /identity/v3/roles => generated 239 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:03.674475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:03.691339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a747-b214-49c9-b65d-8ed85e1df26a tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:03.703515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23815694-e627-4aaf-8997-ba46203cbb6f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:03.710939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815694-e627-4aaf-8997-ba46203cbb6f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:03.711314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815694-e627-4aaf-8997-ba46203cbb6f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:03.711604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815694-e627-4aaf-8997-ba46203cbb6f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:03.712406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23815694-e627-4aaf-8997-ba46203cbb6f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:03.712596 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3457/6970] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:03 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:03.714280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23815694-e627-4aaf-8997-ba46203cbb6f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:03.718954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:03.751594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e602-eeb5-4632-bc4e-cf801a0abc0b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:03.778459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:03.779757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:03.779757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:03.779757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:03.780826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:03.782775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:03.822825 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3458/6971] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:03 2022] GET /identity/v3/roles => generated 1650 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:45:03.823772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:03.870820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d528941-2dbf-4ab9-8eb0-67f8428cd06f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:03.885491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:03.886373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:03.886756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:03.887161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] PATH_INFO: `/v3/projects/105cdce91b65435ea514b2e0ef75a925/users/273829d42f4c4f10a5748365b2ad9412/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:03.944477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105cdce91b65435ea514b2e0ef75a925, user_id=273829d42f4c4f10a5748365b2ad9412, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:03.947280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:04.051773 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3514/6972] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:03 2022] POST /identity/v3/projects => generated 408 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:04.051773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933ded2-aec7-4304-9e88-8cfaa3874e75 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:04.051773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933ded2-aec7-4304-9e88-8cfaa3874e75 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:04.051773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933ded2-aec7-4304-9e88-8cfaa3874e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:04.092254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a933ded2-aec7-4304-9e88-8cfaa3874e75 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:04.094244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a933ded2-aec7-4304-9e88-8cfaa3874e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:04.104516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3459/6973] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:03 2022] PUT /identity/v3/projects/105cdce91b65435ea514b2e0ef75a925/users/273829d42f4c4f10a5748365b2ad9412/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:04.106269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:04.191027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86b57a-a257-43bb-b2e0-fc882bd14137 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:04.196761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:04.197517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:04.198643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:04.198957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/5c5a60eae4ee48a7874e4b1137e65cf6/inherited_to_projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:04.203975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=5c5a60eae4ee48a7874e4b1137e65cf6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:04.207085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:04.237790 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3515/6974] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:04.239015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933ded2-aec7-4304-9e88-8cfaa3874e75 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:04.338838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3460/6975] 10.222.0.59 () {60 vars in 1579 bytes} [Sun Aug 28 01:45:04 2022] PUT /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/5c5a60eae4ee48a7874e4b1137e65cf6/inherited_to_projects => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:04.338838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:04.338838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:04.369018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933ded2-aec7-4304-9e88-8cfaa3874e75 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:04.530765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:04.531873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:04.532325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:04.532767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:04.533789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:04.535649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:04.557841 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3516/6976] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:04 2022] GET /identity/v3/roles => generated 1650 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:04.557841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:04.601598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417318f-ab4c-4b37-803e-ae8a55a6e9c3 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:04.611838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:04.612472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:04.612753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:04.613027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:04.649938 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:04.737289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98beacc-8cba-42c8-88cf-659c3accda8b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:04.754294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:04.754950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:04.755236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:04.755518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:04.756381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Adding query filter params (scope.project.id=b76bb1fa8ac64da6a1ed6016b291dd00, user.id=767e98ffdb3847b1b2afd93ea379823e) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:04.756672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:04.759364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:04.787500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:04.789713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:04.813628 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3461/6977] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:45:04.815031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:04.846895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86134280-4705-4b83-9854-0f7324af95e0 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:04.858231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:04.863214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:04.863214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:04.863214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] PATH_INFO: `/v3/projects/105cdce91b65435ea514b2e0ef75a925/users/273829d42f4c4f10a5748365b2ad9412/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:04.869678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105cdce91b65435ea514b2e0ef75a925, user_id=273829d42f4c4f10a5748365b2ad9412, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:04.876931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:04.894785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3517/6978] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:45:04 2022] GET /identity/v3/role_assignments?scope.project.id=b76bb1fa8ac64da6a1ed6016b291dd00&user.id=767e98ffdb3847b1b2afd93ea379823e&effective => generated 648 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:04.897360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:04.902909 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3462/6979] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:04 2022] PUT /identity/v3/projects/105cdce91b65435ea514b2e0ef75a925/users/273829d42f4c4f10a5748365b2ad9412/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:04.940234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042aa62-ac01-4a33-81fd-6810126ee8e8 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:05.071622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:05.073029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:05.073469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:05.074008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:05.074929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Adding query filter params (scope.project.id=44466c1396214fd6875617fe974ce0e2, user.id=767e98ffdb3847b1b2afd93ea379823e) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:05.076836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:05.078986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:05.219254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:05.224357 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3518/6980] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:45:04 2022] GET /identity/v3/role_assignments?scope.project.id=44466c1396214fd6875617fe974ce0e2&user.id=767e98ffdb3847b1b2afd93ea379823e&effective => generated 648 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:05.239589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f31ae-e0d8-4ece-8588-907c96ad6000 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:05.254086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:05.255202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:05.257364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:05.259044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/5c5a60eae4ee48a7874e4b1137e65cf6/inherited_to_projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:05.266317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=5c5a60eae4ee48a7874e4b1137e65cf6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:05.276675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:05.291564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 5c5a60eae4ee48a7874e4b1137e65cf6 was removed from user 767e98ffdb3847b1b2afd93ea379823e on domain e93f0e9f84e74050bbfd8e48ebcaa9ea. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:05.292875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:05.295959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:05.543621 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3463/6981] 10.222.0.59 () {58 vars in 1563 bytes} [Sun Aug 28 01:45:05 2022] DELETE /identity/v3/OS-INHERIT/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea/users/767e98ffdb3847b1b2afd93ea379823e/roles/5c5a60eae4ee48a7874e4b1137e65cf6/inherited_to_projects => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:05.548949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:05.553131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:05.595732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc857-cd26-4acd-ad62-cbfbc036825f tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:05.692858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befeb30-947e-445d-8ffa-074f1fe880cd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:05.693607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befeb30-947e-445d-8ffa-074f1fe880cd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:05.694007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befeb30-947e-445d-8ffa-074f1fe880cd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:05.694357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befeb30-947e-445d-8ffa-074f1fe880cd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:05.695189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befeb30-947e-445d-8ffa-074f1fe880cd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Adding query filter params (scope.project.id=b76bb1fa8ac64da6a1ed6016b291dd00, user.id=767e98ffdb3847b1b2afd93ea379823e) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:05.696408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befeb30-947e-445d-8ffa-074f1fe880cd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:05.699399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befeb30-947e-445d-8ffa-074f1fe880cd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:05.808620 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3519/6982] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:45:05 2022] GET /identity/v3/role_assignments?scope.project.id=b76bb1fa8ac64da6a1ed6016b291dd00&user.id=767e98ffdb3847b1b2afd93ea379823e&effective => generated 228 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:05.811125 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:05.815593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:05.842042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938405f-1797-4b78-a36d-cd7ffe3415bd tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:05.849604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:05.850254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:05.850962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:05.856501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:05.857136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:05.857425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:05.857903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:05.858656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Adding query filter params (scope.project.id=44466c1396214fd6875617fe974ce0e2, user.id=767e98ffdb3847b1b2afd93ea379823e) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:05.858973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:05.860961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:05.906908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:05.921768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:06.056867 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3464/6983] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:45:05 2022] GET /identity/v3/role_assignments?scope.project.id=44466c1396214fd6875617fe974ce0e2&user.id=767e98ffdb3847b1b2afd93ea379823e&effective => generated 228 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:06.062876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:06.073422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3520/6984] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:45:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:06.089275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:06.092664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:06.114239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777a8c-4419-42b9-83c1-31ffa2b51a24 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:06.128604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:06.133923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:06.134478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:06.134879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/projects/44466c1396214fd6875617fe974ce0e2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:06.139635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=44466c1396214fd6875617fe974ce0e2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:06.141608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:06.376567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44466c1396214fd6875617fe974ce0e2', 'request_id': 'req-75da3c10-8f39-4520-b11e-9f46700696ba'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:06.393855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782578b9-a6c0-4db2-9f20-f4421fc44f6f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:06.406492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44466c1396214fd6875617fe974ce0e2', 'request_id': 'req-75da3c10-8f39-4520-b11e-9f46700696ba'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:06.505899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44466c1396214fd6875617fe974ce0e2', 'request_id': 'req-75da3c10-8f39-4520-b11e-9f46700696ba'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:06.538916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] The token cache is being invalidate because project 44466c1396214fd6875617fe974ce0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:06.540921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:06.545314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:06.551713 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3465/6985] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:06 2022] DELETE /identity/v3/projects/44466c1396214fd6875617fe974ce0e2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:06.556046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:06.561284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:06.664826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:06.667797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:06.668888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:06.675502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:06.681242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:06.804864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da3c10-8f39-4520-b11e-9f46700696ba tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:06.817862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:06.823357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:06.824098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:06.824623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles/5c5a60eae4ee48a7874e4b1137e65cf6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:06.826780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5c5a60eae4ee48a7874e4b1137e65cf6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:06.832066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:06.900966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:06.902787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:06.928649 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3521/6986] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:45:07.022209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 5c5a60eae4ee48a7874e4b1137e65cf6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:07.022541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:07.025544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:07.029886 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3466/6987] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:06 2022] DELETE /identity/v3/roles/5c5a60eae4ee48a7874e4b1137e65cf6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:07.034851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:07.051920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee80c80-ae3d-49fb-a726-78e1cf01c218 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:07.204498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:07.205746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:07.207283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:07.207576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:07.209438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:07.221689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:07.419944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3522/6988] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:45:07 2022] POST /identity/v3/roles => generated 240 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:45:07.421524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:07.424301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:07.451397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31768de-c48f-4e7e-b0ed-4721b42b8136 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:07.466250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d435617-b702-4265-b3ae-3264a425a15d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:07.468190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435617-b702-4265-b3ae-3264a425a15d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:07.468756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435617-b702-4265-b3ae-3264a425a15d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:07.470584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d435617-b702-4265-b3ae-3264a425a15d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:07.472787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d435617-b702-4265-b3ae-3264a425a15d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:07.478642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d435617-b702-4265-b3ae-3264a425a15d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:07.677252 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3467/6989] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:07 2022] POST /identity/v3/projects => generated 409 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:07.680832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:07.700641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8be94-58d3-4603-8a10-52f1801c4202 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:07.734421 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:07.857567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:07.858224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:07.858326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:07.875295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:07.875994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:07.876286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:07.876569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/4b5e04481e3c4228b07b48ccba6b879f/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:07.882034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:07.883151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=4b5e04481e3c4228b07b48ccba6b879f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:07.883694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:07.885908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:07.996573 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3523/6990] 10.222.0.59 () {60 vars in 1582 bytes} [Sun Aug 28 01:45:07 2022] PUT /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/4b5e04481e3c4228b07b48ccba6b879f/inherited_to_projects => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:08.005403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:08.021936 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:08.039335 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3468/6991] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:08.049135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:08.060431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:08.230969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccea4b-5a9a-4589-a443-a95b6a483e29 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:08.248882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:08.249557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:08.249869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:08.250154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:08.252154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Adding query filter params (scope.project.id=9924ab9a3cf843b3af9504e297bc66a3, user.id=767e98ffdb3847b1b2afd93ea379823e) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:08.253601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:08.260467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:08.323461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b868e0e-2061-4624-9913-e4f8aac4e74f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:08.403785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3524/6992] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:45:08 2022] GET /identity/v3/role_assignments?scope.project.id=9924ab9a3cf843b3af9504e297bc66a3&user.id=767e98ffdb3847b1b2afd93ea379823e&effective => generated 649 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:45:08.414831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:08.452619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e92c7-cd89-4ab6-ad72-7185654a3947 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:08.475757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:08.476738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:08.477036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:08.477377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/4b5e04481e3c4228b07b48ccba6b879f/inherited_to_projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:08.489560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b76bb1fa8ac64da6a1ed6016b291dd00, user_id=767e98ffdb3847b1b2afd93ea379823e, role_id=4b5e04481e3c4228b07b48ccba6b879f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:08.492417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:08.516849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 4b5e04481e3c4228b07b48ccba6b879f was removed from user 767e98ffdb3847b1b2afd93ea379823e on project b76bb1fa8ac64da6a1ed6016b291dd00. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:08.517139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:08.518193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:08.542934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:08.544121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:08.544262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:08.544444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:08.557465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:08.668486 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3525/6993] 10.222.0.59 () {58 vars in 1566 bytes} [Sun Aug 28 01:45:08 2022] DELETE /identity/v3/OS-INHERIT/projects/b76bb1fa8ac64da6a1ed6016b291dd00/users/767e98ffdb3847b1b2afd93ea379823e/roles/4b5e04481e3c4228b07b48ccba6b879f/inherited_to_projects => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:08.674080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:08.677454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:08.758949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:08.766378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:08.795896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3469/6994] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:45:08.848037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18b33e-5386-4c22-a18f-73fa8244ad3d tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:08.859684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:08.860744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:08.861247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:08.861736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:08.862734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Adding query filter params (scope.project.id=9924ab9a3cf843b3af9504e297bc66a3, user.id=767e98ffdb3847b1b2afd93ea379823e) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:08.863405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:08.865513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:09.024525 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3526/6995] 10.222.0.59 () {58 vars in 1356 bytes} [Sun Aug 28 01:45:08 2022] GET /identity/v3/role_assignments?scope.project.id=9924ab9a3cf843b3af9504e297bc66a3&user.id=767e98ffdb3847b1b2afd93ea379823e&effective => generated 228 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:45:09.026088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:09.043443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692cd1a-6269-4669-be45-08fe786595e4 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:09.056476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:09.057153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:09.058896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:09.059203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/projects/9924ab9a3cf843b3af9504e297bc66a3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:09.062128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9924ab9a3cf843b3af9504e297bc66a3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:09.069150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:09.333793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9924ab9a3cf843b3af9504e297bc66a3', 'request_id': 'req-299aca04-cd77-46ae-8dd2-d2ed814c636b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:09.346473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9924ab9a3cf843b3af9504e297bc66a3', 'request_id': 'req-299aca04-cd77-46ae-8dd2-d2ed814c636b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:09.450131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9924ab9a3cf843b3af9504e297bc66a3', 'request_id': 'req-299aca04-cd77-46ae-8dd2-d2ed814c636b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:09.474009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] The token cache is being invalidate because project 9924ab9a3cf843b3af9504e297bc66a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:09.474856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:09.477212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-299aca04-cd77-46ae-8dd2-d2ed814c636b tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:09.487916 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3470/6996] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:09 2022] DELETE /identity/v3/projects/9924ab9a3cf843b3af9504e297bc66a3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:09.488808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:09.490623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:09.507703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:09.510333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:09.510925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:09.521265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69e4f-349c-4877-be4e-c2a0482d3531 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:09.540752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:09.542819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:09.686450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:09.687114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:09.687401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:09.687679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/roles/4b5e04481e3c4228b07b48ccba6b879f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:09.689395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4b5e04481e3c4228b07b48ccba6b879f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:09.691120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:09.691420 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:09.776371 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3471/6997] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:09.778021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:09.782226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:09.843143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invalidating the token cache because role 4b5e04481e3c4228b07b48ccba6b879f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:09.843497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:09.845028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:09.848765 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3527/6998] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:09 2022] DELETE /identity/v3/roles/4b5e04481e3c4228b07b48ccba6b879f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:09.854370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:09.856146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:09.900615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cff66-ea8e-4b90-99ee-1f982cd2c267 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:09.971817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:09.972802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:09.973190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:09.973572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:09.975665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:10.073417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61a42-c903-433b-8407-197a7c590223 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:10.081768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:10.083814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:10.092322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:10.093002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:10.093436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:10.093720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/users/767e98ffdb3847b1b2afd93ea379823e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:10.095817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_user(user_id=767e98ffdb3847b1b2afd93ea379823e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:10.097774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:10.098679 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3472/6999] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:45:10.140636 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:10.396289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767e98ffdb3847b1b2afd93ea379823e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:10.397160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767e98ffdb3847b1b2afd93ea379823e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:10.498889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767e98ffdb3847b1b2afd93ea379823e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:10.514220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767e98ffdb3847b1b2afd93ea379823e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:10.519201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bdc7b0c4-e990-4b23-b16a-3a495d0931be tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767e98ffdb3847b1b2afd93ea379823e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:10.577201 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3528/7000] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:09 2022] DELETE /identity/v3/users/767e98ffdb3847b1b2afd93ea379823e => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:10.583460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:10.611339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955774d-e1a6-4a36-b8c0-2f9fdf8df9c0 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:10.861751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:10.866247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:10.866773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:10.872432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/groups/d355896f920a4dce94abfb86f6e54602` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:10.876905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d355896f920a4dce94abfb86f6e54602)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:10.891315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:10.937043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:10.937198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:10.937406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:10.980395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:10.982165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:11.112517 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3473/7001] 10.222.0.59 () {58 vars in 1227 bytes} [Sun Aug 28 01:45:10 2022] DELETE /identity/v3/groups/d355896f920a4dce94abfb86f6e54602 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:11.114377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:11.137415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:11.199801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3529/7002] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:11.204138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:11.209032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:11.359252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e811b9-0464-4339-b25d-30b9212721f6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:11.383101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a269e0-5ad9-4fa9-8f41-f595cae47adb tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:11.392742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:11.393586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:11.406624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:11.411638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/projects/b76bb1fa8ac64da6a1ed6016b291dd00` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:11.411638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b76bb1fa8ac64da6a1ed6016b291dd00)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:11.413315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:11.462986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:11.463827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:11.464917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:11.465400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:11.637166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:11.639024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:11.685963 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3530/7003] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:45:11.689272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76bb1fa8ac64da6a1ed6016b291dd00', 'request_id': 'req-e52cbbf9-1b96-4691-b846-57d1c458bad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:11.718305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76bb1fa8ac64da6a1ed6016b291dd00', 'request_id': 'req-e52cbbf9-1b96-4691-b846-57d1c458bad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:11.811782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76bb1fa8ac64da6a1ed6016b291dd00', 'request_id': 'req-e52cbbf9-1b96-4691-b846-57d1c458bad1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:11.839685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] The token cache is being invalidate because project b76bb1fa8ac64da6a1ed6016b291dd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:11.840267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:11.841542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:11.844046 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3474/7004] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:11 2022] DELETE /identity/v3/projects/b76bb1fa8ac64da6a1ed6016b291dd00 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:11.857947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:11.909842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90bae-481d-456a-a1c2-5470fd1b9d95 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:11.998117 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:12.112626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:12.113488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:12.113780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:12.114388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:12.115682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:12.119546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:12.218738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:12.219691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:12.361551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:12.362213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ab666136-4d9a-4604-984f-8e285fd0a33c tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:12.364912 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3531/7005] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:45:11 2022] PATCH /identity/v3/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea => generated 277 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:12.369634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:12.371906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:12.423408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:12.423408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:12.423777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:12.431596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbbf9-1b96-4691-b846-57d1c458bad1 tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:12.469178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:12.470457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:12.568214 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3532/7006] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:45:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:12.590508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:12.594263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:12.616811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aa0f92342f14935813222454d37283d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c24451bbde341e1b545039831958b29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:12.620135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:12.620496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:12.620771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] PATH_INFO: `/v3/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:12.664934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e93f0e9f84e74050bbfd8e48ebcaa9ea)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:12.667476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:12.707381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:12.717160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:12.812699 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:12.826617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be4e19-402f-4ac1-9ff0-23c571882b19 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:12.839770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:12.840457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:12.840848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:12.841854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:12.852121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:12.854118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:12.866935 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3533/7007] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:45:12.940285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea', 'request_id': 'req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:12.955142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea', 'request_id': 'req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.061216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea', 'request_id': 'req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.094062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] The token cache is being invalidate because project e93f0e9f84e74050bbfd8e48ebcaa9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:13.095817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.096731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.117149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea', 'request_id': 'req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.121353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea', 'request_id': 'req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.122432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e93f0e9f84e74050bbfd8e48ebcaa9ea', 'request_id': 'req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.143870 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3475/7008] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:45:12 2022] DELETE /identity/v3/domains/e93f0e9f84e74050bbfd8e48ebcaa9ea => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:13.147948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:13.150350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:13.334331 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:13.347318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae79f5-4bcb-4f3e-830c-bbea0d8beed1 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:13.486875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:13.488661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:13.489172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:13.489700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] PATH_INFO: `/v3/users/31f45e24d8b34551a5ad05d575550c89` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:13.491472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f45e24d8b34551a5ad05d575550c89)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:13.496412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:13.498582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:13.508742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:13.565470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd46c-1918-43dc-8661-8a4dbb2488ab tempest-InheritsV3TestJSON-11187109 tempest-InheritsV3TestJSON-11187109-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:13.590807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:13.591475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:13.591758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:13.592037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] PATH_INFO: `/v3/users/76617e609cfc412fbdd75da8757a36e9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:13.593902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] RBAC: Authorizing `identity:delete_user(user_id=76617e609cfc412fbdd75da8757a36e9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:13.600875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:13.841944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f45e24d8b34551a5ad05d575550c89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.841944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f45e24d8b34551a5ad05d575550c89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.924276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76617e609cfc412fbdd75da8757a36e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.929362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f45e24d8b34551a5ad05d575550c89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.960264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76617e609cfc412fbdd75da8757a36e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.969572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76617e609cfc412fbdd75da8757a36e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.970635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76617e609cfc412fbdd75da8757a36e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.986595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f45e24d8b34551a5ad05d575550c89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:13.987389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d80ce000-9804-4e2a-b513-e202f29079df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f45e24d8b34551a5ad05d575550c89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:14.035579 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3534/7009] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:13 2022] DELETE /identity/v3/users/31f45e24d8b34551a5ad05d575550c89 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:14.041776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:14.042073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:14.042361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:14.078039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:14.078750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:14.112089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cca550ba-d907-4735-99fe-0c359466553f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76617e609cfc412fbdd75da8757a36e9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:14.121636 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3476/7010] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:13 2022] DELETE /identity/v3/users/76617e609cfc412fbdd75da8757a36e9 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:14.126231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:14.126646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:14.128137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:14.172700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:14.175702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:14.213477 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3535/7011] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:14.278790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:14.281400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:14.320324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3477/7012] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:14.346293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:14.347809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:14.439955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb935fb0-efbc-4663-bac6-357fadba2bbc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:14.495043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc530-3531-44ec-8da5-cb40aabba4d3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:14.503092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:14.503778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:14.503994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:14.504268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:14.519335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:14.521098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:14.535104 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3478/7013] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:45:14.558866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:14.559522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:14.559952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:14.560284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:14.579785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:14.583985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:14.601318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3536/7014] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:14.759619 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:14.801024 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:15.363780 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:15.960429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:15.964132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:15.968176 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:16.002213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e74b61-6b88-484b-97ea-c8d1837a5c39 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:16.011306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:16.012572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:16.013018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:16.013455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] PATH_INFO: `/v3/projects/2354548148484e1da5fb697276d373a9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:16.016138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2354548148484e1da5fb697276d373a9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:16.018369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:16.208028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2354548148484e1da5fb697276d373a9', 'request_id': 'req-9ffd381b-c000-4e0a-a259-b0e7facd4a93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:16.217314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2354548148484e1da5fb697276d373a9', 'request_id': 'req-9ffd381b-c000-4e0a-a259-b0e7facd4a93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:16.338443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2354548148484e1da5fb697276d373a9', 'request_id': 'req-9ffd381b-c000-4e0a-a259-b0e7facd4a93'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:16.355210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] The token cache is being invalidate because project 2354548148484e1da5fb697276d373a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:16.355935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:16.358658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:16.361010 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3479/7015] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:15 2022] DELETE /identity/v3/projects/2354548148484e1da5fb697276d373a9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:16.367011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:16.383863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a4a25-13fe-4d10-892f-ea7e5e1c53be service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:16.540619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:16.542142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:16.544575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:16.545023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] PATH_INFO: `/v3/users/1aa0f92342f14935813222454d37283d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:16.547972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa0f92342f14935813222454d37283d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:16.552605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:16.723353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:16.725280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:16.780426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd381b-c000-4e0a-a259-b0e7facd4a93 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:16.796413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:16.797190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:16.797923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:16.797923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] PATH_INFO: `/v3/projects/ff09d3f23861416187e3c6a68ef0ee78` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:16.799411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff09d3f23861416187e3c6a68ef0ee78)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:16.805665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:16.876333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa0f92342f14935813222454d37283d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:16.877881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa0f92342f14935813222454d37283d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.052289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff09d3f23861416187e3c6a68ef0ee78', 'request_id': 'req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.081901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff09d3f23861416187e3c6a68ef0ee78', 'request_id': 'req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.119358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa0f92342f14935813222454d37283d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.134884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa0f92342f14935813222454d37283d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.135909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2559443-a772-4b68-b429-7ac7c2deab7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa0f92342f14935813222454d37283d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.198026 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3537/7016] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:16 2022] DELETE /identity/v3/users/1aa0f92342f14935813222454d37283d => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:17.296017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff09d3f23861416187e3c6a68ef0ee78', 'request_id': 'req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.339756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] The token cache is being invalidate because project ff09d3f23861416187e3c6a68ef0ee78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:17.340061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.341540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2cbc2af5-9a2e-42c2-8c72-cceab39fa673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:17.348217 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3480/7017] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:16 2022] DELETE /identity/v3/projects/ff09d3f23861416187e3c6a68ef0ee78 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:17.356357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061817-b1a0-4bfc-ab9b-2084644332a0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:17.356357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061817-b1a0-4bfc-ab9b-2084644332a0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:17.356357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061817-b1a0-4bfc-ab9b-2084644332a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:17.402839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-62061817-b1a0-4bfc-ab9b-2084644332a0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:17.408457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-62061817-b1a0-4bfc-ab9b-2084644332a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:17.568796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3538/7018] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:17.579694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89153770-f3e7-4e3f-8f44-1954ed8aa6bd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:17.585089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89153770-f3e7-4e3f-8f44-1954ed8aa6bd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:17.585089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89153770-f3e7-4e3f-8f44-1954ed8aa6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:17.622473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-89153770-f3e7-4e3f-8f44-1954ed8aa6bd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:17.624302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-89153770-f3e7-4e3f-8f44-1954ed8aa6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:17.639699 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3481/7019] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:17.643639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061817-b1a0-4bfc-ab9b-2084644332a0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:17.656454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061817-b1a0-4bfc-ab9b-2084644332a0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:17.662354 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:17.677761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34939f-9ce3-4a23-bbe5-bc3daf09ffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:17.678367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34939f-9ce3-4a23-bbe5-bc3daf09ffab admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:17.683532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34939f-9ce3-4a23-bbe5-bc3daf09ffab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:17.684172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34939f-9ce3-4a23-bbe5-bc3daf09ffab admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:17.685079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34939f-9ce3-4a23-bbe5-bc3daf09ffab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:17.686330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34939f-9ce3-4a23-bbe5-bc3daf09ffab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:17.694365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34939f-9ce3-4a23-bbe5-bc3daf09ffab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:17.719622 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:17.723202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3539/7020] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:17.729318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89153770-f3e7-4e3f-8f44-1954ed8aa6bd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:17.749997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89153770-f3e7-4e3f-8f44-1954ed8aa6bd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:17.752575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:17.752575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:17.753463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:17.754256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:17.755407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:17.758957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:18.004333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.004333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.004333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.021033 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3482/7021] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:17 2022] POST /identity/v3/projects => generated 379 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:18.024342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:18.116916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] MFA Rules not processed for user `273829d42f4c4f10a5748365b2ad9412`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:18.120905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:18.187065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c622f8-f2d9-4471-8169-7c93de49340a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:18.202065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:18.202773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.203194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.203483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.204638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:18.208011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:18.258754 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3540/7022] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:18.271692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:18.274027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:18.433921 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3483/7023] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:18 2022] POST /identity/v3/users => generated 290 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:18.439071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:18.451113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade348d8-4357-4ab0-ab83-2bbd613fb20e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:18.475125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dc84c-50ab-4ad7-973f-81584e6f874c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:18.482401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:18.485708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.485708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.485708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.489953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:18.490537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.490822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.491100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.491758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:18.500240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:18.505254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:18.506919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:18.522549 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3484/7024] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:18.527742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:18.535021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:18.548069 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3541/7025] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:18.550829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:18.573503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fa9d1-0db0-4da7-8396-3f5a887be1a1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:18.577475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee985490-ae43-4aa7-98f4-73aeac7e77b7 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:18.584345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:18.586027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.586509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.586962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] PATH_INFO: `/v3/projects/8c24451bbde341e1b545039831958b29` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.588777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:18.589396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.589894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.590348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.591168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:18.601314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:18.602110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c24451bbde341e1b545039831958b29)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:18.604626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:18.627123 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3542/7026] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:18.636543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:18.661066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3bc1-77f8-4db5-ac6b-aa1269fe1b0e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:18.671078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01338f5-c830-4c31-b231-7f6188ec16df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:18.672032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01338f5-c830-4c31-b231-7f6188ec16df admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.672668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01338f5-c830-4c31-b231-7f6188ec16df admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.673163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01338f5-c830-4c31-b231-7f6188ec16df admin admin] PATH_INFO: `/v3/projects/ff84a0e831bc4c53afaac9fc1e65be99/users/84864fbd9ab742369bf1b798be6e05c5/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.704962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01338f5-c830-4c31-b231-7f6188ec16df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff84a0e831bc4c53afaac9fc1e65be99, user_id=84864fbd9ab742369bf1b798be6e05c5, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:18.708635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01338f5-c830-4c31-b231-7f6188ec16df admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:18.775443 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:18.879918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3543/7027] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:18 2022] PUT /identity/v3/projects/ff84a0e831bc4c53afaac9fc1e65be99/users/84864fbd9ab742369bf1b798be6e05c5/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:18.890268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:18.890782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:18.891221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:18.917553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c24451bbde341e1b545039831958b29', 'request_id': 'req-2c5c01c0-7f77-4b01-bf95-06d22bc49834'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:18.938332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c24451bbde341e1b545039831958b29', 'request_id': 'req-2c5c01c0-7f77-4b01-bf95-06d22bc49834'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:19.014300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] MFA Rules not processed for user `84864fbd9ab742369bf1b798be6e05c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:19.015577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:19.030256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c24451bbde341e1b545039831958b29', 'request_id': 'req-2c5c01c0-7f77-4b01-bf95-06d22bc49834'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:19.074859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] The token cache is being invalidate because project 8c24451bbde341e1b545039831958b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:19.078228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:19.082740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2c5c01c0-7f77-4b01-bf95-06d22bc49834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:19.091864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3485/7028] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:18 2022] DELETE /identity/v3/projects/8c24451bbde341e1b545039831958b29 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:19.100951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471805-a97d-45d8-9588-e18925b19842 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:19.103784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471805-a97d-45d8-9588-e18925b19842 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:19.104338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9471805-a97d-45d8-9588-e18925b19842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:19.176024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f9471805-a97d-45d8-9588-e18925b19842 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:19.177735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9471805-a97d-45d8-9588-e18925b19842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:19.278039 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3544/7029] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:19.290601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:19.293081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:19.354728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3486/7030] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:19.363380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44119-f408-4bcd-9eef-58b4988a6ffb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:19.364257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44119-f408-4bcd-9eef-58b4988a6ffb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:19.364693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe44119-f408-4bcd-9eef-58b4988a6ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:19.429039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cbe44119-f408-4bcd-9eef-58b4988a6ffb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:19.431817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cbe44119-f408-4bcd-9eef-58b4988a6ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:19.438002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a20104-77bc-4337-b051-dac9a8ffaf17 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:19.450582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3487/7031] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:19.467624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe44119-f408-4bcd-9eef-58b4988a6ffb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:19.475987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:19.480490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:19.486734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:19.486734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:19.486997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe44119-f408-4bcd-9eef-58b4988a6ffb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:19.503702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:19.504790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:19.504906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:19.505178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:19.505876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:19.506190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:19.512431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:19.512431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:19.514281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:19.538021 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:19.561475 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3545/7032] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:45:19.566622 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3488/7033] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:19.568849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:19.591910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85e3a8-b7d2-42d9-9ab7-23c523b67f52 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:19.598397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:19.620482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:19.621089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:19.621558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:19.622553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:19.624815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:19.634275 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:19.811391 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3546/7034] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:19 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:19.815468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:19.841412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcce56-c409-4337-b204-ed57569fd5a5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:19.941015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:19.941698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:19.942241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:19.942467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:19.943427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:19.951391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:20.064632 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:20.170224 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3489/7035] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:19 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:20.175943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:20.199751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340ae0a-ea09-454a-b2ec-547855d33e8b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:20.231737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:20.232466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:20.232757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:20.233087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:20.233835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:20.240613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:20.334147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:20.341955 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3547/7036] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:20.354944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8816f-81b7-4b0c-85cf-6816acd2a67b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:20.380698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:20.382513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:20.400411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:20.401794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:20.401794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:20.407933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:20.408960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:20.413796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:20.468112 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3490/7037] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:20.477433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:20.487409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:20.539592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2faf5a-4200-4439-96c2-3365e2c194ce admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:20.553892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:20.555245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:20.556080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:20.556656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] PATH_INFO: `/v3/users/84864fbd9ab742369bf1b798be6e05c5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:20.558897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84864fbd9ab742369bf1b798be6e05c5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:20.561330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:20.624181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299c9e-10e9-44f8-880c-17d9ea04ce85 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:20.647746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:20.649176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:20.651755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:20.652075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:20.654132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:20.699223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:20.699223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:20.729499 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3548/7038] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:20.732083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:20.764137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9446ff-eb55-4d52-bb56-8b4c29971748 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:20.777597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c40cbf-ec9f-4014-9dbd-0e4eed708e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:20.778590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40cbf-ec9f-4014-9dbd-0e4eed708e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:20.779046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40cbf-ec9f-4014-9dbd-0e4eed708e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:20.779490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c40cbf-ec9f-4014-9dbd-0e4eed708e2c admin admin] PATH_INFO: `/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d/users/5f62432a3bb94fe796c1f282d1a4b81f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:20.825977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c40cbf-ec9f-4014-9dbd-0e4eed708e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf37ecc76ce4cfabfdb0b790206917d, user_id=5f62432a3bb94fe796c1f282d1a4b81f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:20.837059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c40cbf-ec9f-4014-9dbd-0e4eed708e2c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:20.976027 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3549/7039] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:20 2022] PUT /identity/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d/users/5f62432a3bb94fe796c1f282d1a4b81f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:20.986630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:20.989407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:20.989881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:20.990868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84864fbd9ab742369bf1b798be6e05c5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:21.027900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84864fbd9ab742369bf1b798be6e05c5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:21.071303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84864fbd9ab742369bf1b798be6e05c5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:21.076936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84864fbd9ab742369bf1b798be6e05c5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:21.093898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] MFA Rules not processed for user `5f62432a3bb94fe796c1f282d1a4b81f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:21.096079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:21.111029 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:21.186001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ebb00ef3-b161-43f2-95a8-b4dec4d17908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84864fbd9ab742369bf1b798be6e05c5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:21.200917 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3491/7040] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:20 2022] DELETE /identity/v3/users/84864fbd9ab742369bf1b798be6e05c5 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:21.205874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:21.206404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:21.208056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:21.285735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:21.287368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:21.323386 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3550/7041] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:21.324500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:21.326925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:21.452725 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3492/7042] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:21.473432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:21.474941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:21.487294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11991efb-1650-4e40-9467-d56a94473d62 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:21.494401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:21.495414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:21.495764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:21.496114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:21.498193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:21.501143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:21.633481 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3551/7043] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:21 2022] POST /identity/v3/projects => generated 387 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:21.637100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:21.638752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e383-ffd6-4396-8ddf-4371c079cf35 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:21.737171 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:21.797147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:21.797147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:21.799715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:21.804261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:21.827571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:21.829384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:21.848485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd72213-319c-4f96-9285-ddea1b96b9b7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:21.864145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:21.864776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:21.865060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:21.865337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:21.866019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:21.868505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:21.868715 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3493/7044] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:21.869791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:21.874694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:22.023094 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3552/7045] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:21 2022] POST /identity/v3/users => generated 300 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:22.026874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:22.074666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188517f-e05e-4347-b043-ff7435103b43 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:22.085265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d603d3-5bef-49ce-acf6-a7f6b78e1db9 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:22.090756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:22.091488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.097981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.097981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.097981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:22.098789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:22.108696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:22.109340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.109621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.110003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.112531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:22.121239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3553/7046] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:22.125941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:22.145073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:22.145494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b7c98-3c3b-485d-8155-cb16c2e9941f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:22.150258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:22.155467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:22.156155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.156439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.156717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] PATH_INFO: `/v3/projects/07dd2c51123a47409df1431d0a867343/users/39c8c4c7367349afaaa3bde4aaa83006/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.189922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3494/7047] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:22.207588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dd2c51123a47409df1431d0a867343, user_id=39c8c4c7367349afaaa3bde4aaa83006, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:22.207588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:22.366033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3554/7048] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:22 2022] PUT /identity/v3/projects/07dd2c51123a47409df1431d0a867343/users/39c8c4c7367349afaaa3bde4aaa83006/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:22.368835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:22.391858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11b0a8-a6e4-4e7a-891b-a2520620b51e service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:22.561713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558baae-b8e0-4144-95c6-e21899f01b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:22.562455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558baae-b8e0-4144-95c6-e21899f01b28 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.562744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558baae-b8e0-4144-95c6-e21899f01b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.562906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558baae-b8e0-4144-95c6-e21899f01b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.563740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558baae-b8e0-4144-95c6-e21899f01b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:22.569341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558baae-b8e0-4144-95c6-e21899f01b28 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:22.589529 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3495/7049] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:22.594763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:22.609735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c90fa8-7453-48c4-a1fa-c06e4aa711ba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:22.617318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:22.618383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.618676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.619131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] PATH_INFO: `/v3/projects/07dd2c51123a47409df1431d0a867343/users/39c8c4c7367349afaaa3bde4aaa83006/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.621463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dd2c51123a47409df1431d0a867343, user_id=39c8c4c7367349afaaa3bde4aaa83006, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:22.624511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:22.645920 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3555/7050] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:22 2022] PUT /identity/v3/projects/07dd2c51123a47409df1431d0a867343/users/39c8c4c7367349afaaa3bde4aaa83006/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:22.661178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d257de5-80e0-4214-987f-f4356ac24337 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.661178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d257de5-80e0-4214-987f-f4356ac24337 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.661633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d257de5-80e0-4214-987f-f4356ac24337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.732012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5d257de5-80e0-4214-987f-f4356ac24337 None None] MFA Rules not processed for user `39c8c4c7367349afaaa3bde4aaa83006`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:22.733564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5d257de5-80e0-4214-987f-f4356ac24337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:22.846783 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3496/7051] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:22.851039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:22.876536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45d6f4-5dbc-4463-95cb-1056eb30fd82 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:22.891444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:22.892193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.892544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.892901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.894697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:get_project(project_id=bdf37ecc76ce4cfabfdb0b790206917d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:22.896906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:22.906667 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3556/7052] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:45:22 2022] GET /identity/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d => generated 387 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:22.911040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d257de5-80e0-4214-987f-f4356ac24337 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:22.935855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d257de5-80e0-4214-987f-f4356ac24337 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:22.948846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:22.949440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:22.949868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:22.952645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:22.953464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:22.957042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.006227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.009133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:23.125797 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3497/7053] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:45:22 2022] POST /identity/v3/projects => generated 339 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:23.128453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.185305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22257189-e065-48af-90b8-7745e3a21f1a tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.264625 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:23.345028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.346028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.346548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.347061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] PATH_INFO: `/v3/projects/ff84a0e831bc4c53afaac9fc1e65be99` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.353499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff84a0e831bc4c53afaac9fc1e65be99)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:23.355852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.359036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa142286-68c6-42c1-bcab-b5724d778f4c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.389944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.390990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.391509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.392456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.393407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:23.400262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.451782 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3498/7054] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:45:23 2022] GET /identity/v3/projects => generated 6937 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:23.452990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.468680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f22e4-ddf8-4c97-83b2-c30afdc27ffe tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.489264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.489982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.490271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.490559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.491953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:get_project(project_id=bdf37ecc76ce4cfabfdb0b790206917d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:23.495406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.502075 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3499/7055] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:45:23 2022] GET /identity/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d => generated 387 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:23.503039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.515349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead34c-3d27-4641-8435-d680c9385708 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.521357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.522409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.522859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.523667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects/09de484b32364164b9eed656f6511489` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.525745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:get_project(project_id=09de484b32364164b9eed656f6511489)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:23.549128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.562951 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3500/7056] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:45:23 2022] GET /identity/v3/projects/09de484b32364164b9eed656f6511489 => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:23.565645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.582552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21cdd4-269a-4ab5-b887-c3c9dd4caed9 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.610321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff84a0e831bc4c53afaac9fc1e65be99', 'request_id': 'req-9a880243-d66e-4929-bc75-21f659a644b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:23.628953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff84a0e831bc4c53afaac9fc1e65be99', 'request_id': 'req-9a880243-d66e-4929-bc75-21f659a644b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:23.699114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.700069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.701298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.702266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.703185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:23.705399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.738579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3501/7057] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:45:23 2022] GET /identity/v3/projects => generated 6570 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:23.738579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.755294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b70fe6-609e-4c73-9a4e-5c2fb7547d70 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.772616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.774310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.774527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.774792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.775500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:23.775815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:23.779235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.843245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3502/7058] 10.222.0.59 () {58 vars in 1166 bytes} [Sun Aug 28 01:45:23 2022] GET /identity/v3/projects?domain_id=default => generated 6239 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:23.857534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.870062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc59e15-b5ee-4239-beeb-feab93f606cd tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.875373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff84a0e831bc4c53afaac9fc1e65be99', 'request_id': 'req-9a880243-d66e-4929-bc75-21f659a644b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:23.877715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.878625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.884305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.884305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.884305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:23.884305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:23.891985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] The token cache is being invalidate because project ff84a0e831bc4c53afaac9fc1e65be99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:23.893240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:23.894184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9a880243-d66e-4929-bc75-21f659a644b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:23.903396 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3557/7059] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:23 2022] DELETE /identity/v3/projects/ff84a0e831bc4c53afaac9fc1e65be99 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:23.906719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b0f79-1ae3-4be8-a7d3-7a3bdf339d5f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.907284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b0f79-1ae3-4be8-a7d3-7a3bdf339d5f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.908535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b0f79-1ae3-4be8-a7d3-7a3bdf339d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.943956 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3503/7060] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:45:23 2022] GET /identity/v3/projects => generated 6570 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:23.950513 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:23.952252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:23.958681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:23.966080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-357b0f79-1ae3-4be8-a7d3-7a3bdf339d5f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:23.968683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-357b0f79-1ae3-4be8-a7d3-7a3bdf339d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:23.982025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfce375-d853-4d21-a886-5656fd9fcdf3 tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:23.997755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:23.998514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:23.998809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:23.999540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:23.999803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:24.000102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.002015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:24.057039 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3504/7061] 10.222.0.59 () {58 vars in 1166 bytes} [Sun Aug 28 01:45:23 2022] GET /identity/v3/projects?domain_id=default => generated 6239 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:45:24.058859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.083972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81e483-9025-4daf-8087-70895e73b0ec tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:24.097524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:24.099517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.101438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.103092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.103092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.110735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:24.143194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3558/7062] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:24.151165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b6e00-168a-4da9-bfbb-61a5a6f06de8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.151522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b6e00-168a-4da9-bfbb-61a5a6f06de8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.151803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b6e00-168a-4da9-bfbb-61a5a6f06de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.198357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3505/7063] 10.222.0.59 () {58 vars in 1131 bytes} [Sun Aug 28 01:45:24 2022] GET /identity/v3/projects => generated 6570 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:45:24.204712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.211651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-061b6e00-168a-4da9-bfbb-61a5a6f06de8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:24.213193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-061b6e00-168a-4da9-bfbb-61a5a6f06de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:24.228359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2cc05-f50d-457e-95ab-c74ae017aa4d tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:24.232931 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3559/7064] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:24.237951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b6e00-168a-4da9-bfbb-61a5a6f06de8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.249230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:24.250248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.250694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.251687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.252562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-916021950) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:24.253038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.256497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:24.260641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b6e00-168a-4da9-bfbb-61a5a6f06de8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:24.277262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:24.278186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.278698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.279268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.280084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:24.280578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.282392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:24.303801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3506/7065] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:45:24 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-916021950 => generated 534 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:24.307941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.326270 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3560/7066] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:24.328978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.339787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30c5f-453c-4758-9cd9-023d7ff378bf tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:24.346367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c8c4c7367349afaaa3bde4aaa83006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07dd2c51123a47409df1431d0a867343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:24.347307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.348231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.348801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] PATH_INFO: `/v3/projects/09de484b32364164b9eed656f6511489` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.351452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09de484b32364164b9eed656f6511489)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.354043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253a2f-c0af-416e-b9ae-0d535e477feb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:24.355207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:24.370340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:24.370882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.371163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.371437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.372675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.376529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:24.780578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09de484b32364164b9eed656f6511489', 'request_id': 'req-3bcd6905-0c61-4f73-b03f-3355d412134c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:24.795573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09de484b32364164b9eed656f6511489', 'request_id': 'req-3bcd6905-0c61-4f73-b03f-3355d412134c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:24.846125 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3561/7067] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:24 2022] POST /identity/v3/projects => generated 359 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:24.847764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.926766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09de484b32364164b9eed656f6511489', 'request_id': 'req-3bcd6905-0c61-4f73-b03f-3355d412134c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:24.946454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710fdc4-b3e1-40bb-83f3-032f65e9bb92 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:24.952173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] The token cache is being invalidate because project 09de484b32364164b9eed656f6511489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:24.952633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:24.958178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:24.965865 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3507/7068] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:24 2022] DELETE /identity/v3/projects/09de484b32364164b9eed656f6511489 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:24.967613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.971378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:24.976397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:24.977401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.978381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.979087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.980018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.982669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:25.085616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd6905-0c61-4f73-b03f-3355d412134c tempest-ListProjectsStaticTestJSON-688893211 tempest-ListProjectsStaticTestJSON-688893211-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:25.091864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:25.092531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:25.092867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:25.093150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] PATH_INFO: `/v3/users/5f62432a3bb94fe796c1f282d1a4b81f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:25.094430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f62432a3bb94fe796c1f282d1a4b81f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:25.099306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:25.130851 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3562/7069] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:24 2022] POST /identity/v3/users => generated 280 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:25.136366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:25.138771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:25.158467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f65b27-c5e6-4a3a-b6de-d18d9065b475 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:25.167036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:25.167036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:25.167036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:25.167036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:25.167400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:25.168294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:25.207508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3563/7070] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:45:25.207508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:25.232358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f3690-4349-4607-a43c-bb65a8b9892a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:25.253628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:25.255404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:25.272633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:25.272633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:25.272633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:25.274658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:25.311096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3564/7071] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:25.323197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:25.334728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4df8-0df6-42a3-8621-f42241f318ab admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:25.341768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db24d4-1c2c-4bf8-b8fc-95166808404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:25.342847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db24d4-1c2c-4bf8-b8fc-95166808404e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:25.343344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db24d4-1c2c-4bf8-b8fc-95166808404e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:25.343824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db24d4-1c2c-4bf8-b8fc-95166808404e admin admin] PATH_INFO: `/v3/projects/9062a1ffbf4d41a694f4a43909a49992/users/bf768ecbba9a47438606b23aeeba575d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:25.365567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db24d4-1c2c-4bf8-b8fc-95166808404e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9062a1ffbf4d41a694f4a43909a49992, user_id=bf768ecbba9a47438606b23aeeba575d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:25.372991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db24d4-1c2c-4bf8-b8fc-95166808404e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:25.437844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f62432a3bb94fe796c1f282d1a4b81f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:25.468294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f62432a3bb94fe796c1f282d1a4b81f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:25.484732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f62432a3bb94fe796c1f282d1a4b81f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:25.487015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f62432a3bb94fe796c1f282d1a4b81f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:25.525062 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3565/7072] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:25 2022] PUT /identity/v3/projects/9062a1ffbf4d41a694f4a43909a49992/users/bf768ecbba9a47438606b23aeeba575d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:25.540403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:25.540740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:25.541593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:25.604494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] MFA Rules not processed for user `bf768ecbba9a47438606b23aeeba575d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:25.605765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:25.637715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-442caa8b-fff9-4f90-ab2e-f05535252db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f62432a3bb94fe796c1f282d1a4b81f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:25.644511 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3508/7073] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:24 2022] DELETE /identity/v3/users/5f62432a3bb94fe796c1f282d1a4b81f => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:25.653409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:25.653688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:25.654005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:25.717041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:25.718778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:25.784457 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:25.787212 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3566/7074] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:25.800482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:25.806240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:25.925192 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:25.965630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779bc9-88a3-4898-93c3-bbe41d82a924 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:25.972339 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3509/7075] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:25.980471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:25.981199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:25.981545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:25.981923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] PATH_INFO: `/v3/users/bf768ecbba9a47438606b23aeeba575d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:25.984522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf768ecbba9a47438606b23aeeba575d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:25.989201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:26.008692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:26.012272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:26.184584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c022-820b-496d-a553-98dddfad0e47 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:26.211205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85ba5c-3221-4b58-b4af-dc7e537641d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:26.211205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85ba5c-3221-4b58-b4af-dc7e537641d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:26.211205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85ba5c-3221-4b58-b4af-dc7e537641d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:26.211205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85ba5c-3221-4b58-b4af-dc7e537641d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:26.215552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85ba5c-3221-4b58-b4af-dc7e537641d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:26.217018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85ba5c-3221-4b58-b4af-dc7e537641d4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:26.282283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3510/7076] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:45:26.380601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf768ecbba9a47438606b23aeeba575d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:26.386883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf768ecbba9a47438606b23aeeba575d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:26.521200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf768ecbba9a47438606b23aeeba575d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:26.533451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf768ecbba9a47438606b23aeeba575d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:26.536071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf768ecbba9a47438606b23aeeba575d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:26.616720 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3567/7077] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:25 2022] DELETE /identity/v3/users/bf768ecbba9a47438606b23aeeba575d => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:26.621903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:26.626654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:26.626654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:26.656915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:26.660367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:26.844678 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3511/7078] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:26.864943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:26.867530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:27.011794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c000-1813-4395-b0d0-0d63c8904b77 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:27.020862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:27.021586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:27.021990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:27.022428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:27.055819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:27.061441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:27.078755 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3568/7079] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:27.601254 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:28.620272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:28.622347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:28.652213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a27dc6-dde5-4789-91b2-819d09145469 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:28.669234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:28.670127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:28.670424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:28.670709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] PATH_INFO: `/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:28.671561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:28.674672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:28.676187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf37ecc76ce4cfabfdb0b790206917d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:28.678975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:28.697301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e469d74-412c-448e-b917-35c4b70ea166 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:28.711889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:28.712909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:28.713406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:28.714391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] PATH_INFO: `/v3/projects/9062a1ffbf4d41a694f4a43909a49992` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:28.722315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9062a1ffbf4d41a694f4a43909a49992)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:28.725669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:28.786170 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:28.955039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf37ecc76ce4cfabfdb0b790206917d', 'request_id': 'req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:28.971313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf37ecc76ce4cfabfdb0b790206917d', 'request_id': 'req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:28.980727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9062a1ffbf4d41a694f4a43909a49992', 'request_id': 'req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:28.998952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9062a1ffbf4d41a694f4a43909a49992', 'request_id': 'req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.087171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf37ecc76ce4cfabfdb0b790206917d', 'request_id': 'req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.135942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] The token cache is being invalidate because project bdf37ecc76ce4cfabfdb0b790206917d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:29.139742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.141568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.157879 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3512/7080] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:28 2022] DELETE /identity/v3/projects/bdf37ecc76ce4cfabfdb0b790206917d => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:29.164560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:29.176102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:29.222902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9062a1ffbf4d41a694f4a43909a49992', 'request_id': 'req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.245157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] The token cache is being invalidate because project 9062a1ffbf4d41a694f4a43909a49992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:29.247141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.249304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.262071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3569/7081] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:28 2022] DELETE /identity/v3/projects/9062a1ffbf4d41a694f4a43909a49992 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:29.262071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:29.264226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:29.358769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaa876-dc77-4345-9f9d-bfbbc7bed715 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:29.495869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce571f-6a41-45d8-a3cc-9d9db1f889a4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:29.501436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:29.502421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:29.504699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:29.510498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:29.510663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] PATH_INFO: `/v3/users/8f6bde87323c40bb8c9d289d7d38d8be` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:29.510771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:29.510771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:29.510771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] PATH_INFO: `/v3/users/39c8c4c7367349afaaa3bde4aaa83006` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:29.511039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6bde87323c40bb8c9d289d7d38d8be)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:29.511136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c8c4c7367349afaaa3bde4aaa83006)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:29.511218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:29.514768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:29.776418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c8c4c7367349afaaa3bde4aaa83006'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.777111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c8c4c7367349afaaa3bde4aaa83006'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.940258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c8c4c7367349afaaa3bde4aaa83006'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.950385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c8c4c7367349afaaa3bde4aaa83006'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.964111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7f9011d7-daf1-409d-ba45-a54c8aac1e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c8c4c7367349afaaa3bde4aaa83006'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:29.979591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6bde87323c40bb8c9d289d7d38d8be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:30.034542 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3570/7082] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:29 2022] DELETE /identity/v3/users/39c8c4c7367349afaaa3bde4aaa83006 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:30.037876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116d9ab-f400-4d88-9983-00e42f13d840 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:30.037876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116d9ab-f400-4d88-9983-00e42f13d840 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:30.037876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116d9ab-f400-4d88-9983-00e42f13d840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:30.064935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6bde87323c40bb8c9d289d7d38d8be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:30.094269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6bde87323c40bb8c9d289d7d38d8be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:30.102588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6bde87323c40bb8c9d289d7d38d8be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:30.141243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2116d9ab-f400-4d88-9983-00e42f13d840 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:30.143735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2116d9ab-f400-4d88-9983-00e42f13d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:30.270356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aec6c6e0-e509-47e1-9ee3-4ffef2fe4eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6bde87323c40bb8c9d289d7d38d8be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:30.283265 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3513/7083] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:29 2022] DELETE /identity/v3/users/8f6bde87323c40bb8c9d289d7d38d8be => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:30.336228 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3571/7084] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:30.344001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6aaf2-916d-4afb-82e6-69d195e87415 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:30.344580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6aaf2-916d-4afb-82e6-69d195e87415 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:30.345065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6aaf2-916d-4afb-82e6-69d195e87415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:30.404671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4bb6aaf2-916d-4afb-82e6-69d195e87415 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:30.411082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4bb6aaf2-916d-4afb-82e6-69d195e87415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:30.570318 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:30.574797 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3514/7085] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:30.579619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116d9ab-f400-4d88-9983-00e42f13d840 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:30.593482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116d9ab-f400-4d88-9983-00e42f13d840 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:30.623367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:30.624501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:30.625062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:30.627264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:30.628891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:30.629758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:30.635610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:30.659339 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3572/7086] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:30.665257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6aaf2-916d-4afb-82e6-69d195e87415 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:30.682644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6aaf2-916d-4afb-82e6-69d195e87415 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:30.704861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:30.705515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:30.707298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:30.707595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:30.710342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:30.715504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:30.786145 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:30.896181 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3515/7087] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:30 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:30.902021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:30.917464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3be8b-426c-43f7-959d-a2eb8c3855c6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:31.043302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:31.044990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.045549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.049654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.050939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:31.053092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:31.195875 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3573/7088] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:30 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:45:31.197329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:31.214234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267047-09c8-4854-be6f-b2f9fa2cc1bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:31.229372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:31.231567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.236873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.236873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.236873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:31.237332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:31.268358 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3516/7089] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:31.276728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:31.288000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf8f76-1f26-4173-8303-7fabc1f41542 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:31.311994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:31.312641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.312928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.313203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.313887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:31.315554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:31.350340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:31.350647 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3574/7090] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:31.360869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa902f0-bcc1-408c-af91-a46701e0fd0a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:31.366516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc792c1-1e20-4ead-ae7e-b16c03bb1bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:31.369049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc792c1-1e20-4ead-ae7e-b16c03bb1bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.369570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc792c1-1e20-4ead-ae7e-b16c03bb1bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.370203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc792c1-1e20-4ead-ae7e-b16c03bb1bd8 admin admin] PATH_INFO: `/v3/projects/00805ee214df42698f3e34f9f9955290/users/b95de2f415d245168e50bb8fcbd9a29a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.381608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:31.383923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:31.406624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30de128-96cd-42df-847c-41363aff3fef admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:31.411153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc792c1-1e20-4ead-ae7e-b16c03bb1bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00805ee214df42698f3e34f9f9955290, user_id=b95de2f415d245168e50bb8fcbd9a29a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:31.414946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc792c1-1e20-4ead-ae7e-b16c03bb1bd8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:31.428734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:31.429950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.430398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.430853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] PATH_INFO: `/v3/projects/07dd2c51123a47409df1431d0a867343` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.432403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07dd2c51123a47409df1431d0a867343)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:31.435028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:31.569920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3517/7091] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:31 2022] PUT /identity/v3/projects/00805ee214df42698f3e34f9f9955290/users/b95de2f415d245168e50bb8fcbd9a29a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:31.581560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07734cd-6162-4246-84bc-69200f55b139 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.581758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07734cd-6162-4246-84bc-69200f55b139 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.582971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07734cd-6162-4246-84bc-69200f55b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.611173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07dd2c51123a47409df1431d0a867343', 'request_id': 'req-261ead82-a481-40ac-b596-2c0c17272bc2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:31.636798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b07734cd-6162-4246-84bc-69200f55b139 None None] MFA Rules not processed for user `b95de2f415d245168e50bb8fcbd9a29a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:31.638392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b07734cd-6162-4246-84bc-69200f55b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:31.656489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07dd2c51123a47409df1431d0a867343', 'request_id': 'req-261ead82-a481-40ac-b596-2c0c17272bc2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:31.805076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07dd2c51123a47409df1431d0a867343', 'request_id': 'req-261ead82-a481-40ac-b596-2c0c17272bc2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:31.807715 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3518/7092] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:31.812108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07734cd-6162-4246-84bc-69200f55b139 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:31.833740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] The token cache is being invalidate because project 07dd2c51123a47409df1431d0a867343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:31.834123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:31.834975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-261ead82-a481-40ac-b596-2c0c17272bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:31.839384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3575/7093] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:31 2022] DELETE /identity/v3/projects/07dd2c51123a47409df1431d0a867343 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:31.851833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.855865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.856200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.926633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:31.928979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:31.967009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07734cd-6162-4246-84bc-69200f55b139 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:31.979273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcdcb0-6ec2-46d3-8492-96bd7c667f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:31.980049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcdcb0-6ec2-46d3-8492-96bd7c667f6e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:31.980436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcdcb0-6ec2-46d3-8492-96bd7c667f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:31.980805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcdcb0-6ec2-46d3-8492-96bd7c667f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:31.981568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcdcb0-6ec2-46d3-8492-96bd7c667f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:31.983719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcdcb0-6ec2-46d3-8492-96bd7c667f6e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:32.074649 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3576/7094] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:32.076314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:32.078576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:32.091857 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3519/7095] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:31 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:45:32.093489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.093784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.094083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.102176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31950e2-2664-4f2d-9eee-f23ff04e5d78 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:32.151850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:32.153527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:32.191085 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:32.228863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:32.229529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.229968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.230254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] PATH_INFO: `/v3/projects/15e8bf26659a4dfda16c7c817e2bb456` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.231514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e8bf26659a4dfda16c7c817e2bb456)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:32.234971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:32.277869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3520/7096] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:32.278930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:32.280704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:32.294057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e183b2-151e-437d-a150-659dccafd95e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:32.300936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:32.301567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.302088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.302369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.303086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:32.305161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:32.402317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e8bf26659a4dfda16c7c817e2bb456', 'request_id': 'req-5513c148-376c-4d72-9e59-cd2f94853e15'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:32.404518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e8bf26659a4dfda16c7c817e2bb456', 'request_id': 'req-5513c148-376c-4d72-9e59-cd2f94853e15'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:32.485893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3521/7097] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:32 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:32.487118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:32.500732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a74e-bf8e-4747-be94-44126c2d49b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:32.537803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e8bf26659a4dfda16c7c817e2bb456', 'request_id': 'req-5513c148-376c-4d72-9e59-cd2f94853e15'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:32.564712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] The token cache is being invalidate because project 15e8bf26659a4dfda16c7c817e2bb456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:32.565003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:32.565692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:32.574617 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3577/7098] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:32 2022] DELETE /identity/v3/projects/15e8bf26659a4dfda16c7c817e2bb456 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:32.575648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:32.585744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:32.608756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d1f09-5ea3-487e-85b3-f8af43a8ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:32.609408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1f09-5ea3-487e-85b3-f8af43a8ab66 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.613827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1f09-5ea3-487e-85b3-f8af43a8ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.613827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1f09-5ea3-487e-85b3-f8af43a8ab66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.613827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d1f09-5ea3-487e-85b3-f8af43a8ab66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:32.613827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d1f09-5ea3-487e-85b3-f8af43a8ab66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:32.613827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d1f09-5ea3-487e-85b3-f8af43a8ab66 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:32.641189 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3522/7099] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:32.652301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.652797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.653089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.679971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:32.681405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:32.692446 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:32.699736 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3523/7100] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:32.700795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:32.703309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:32.734465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170931-1329-453b-8b23-00e1c25fdda2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:32.745223 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:32.752043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:32.752314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513c148-376c-4d72-9e59-cd2f94853e15 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:32.752930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.753217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.753494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.754839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:32.756786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:32.767256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9048d-b82c-4907-b2b7-7e494f083cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:32.767889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9048d-b82c-4907-b2b7-7e494f083cda admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.768226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9048d-b82c-4907-b2b7-7e494f083cda admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.768447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9048d-b82c-4907-b2b7-7e494f083cda admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.769283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9048d-b82c-4907-b2b7-7e494f083cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:32.770942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9048d-b82c-4907-b2b7-7e494f083cda admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:32.795898 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3578/7101] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:32.797222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34d42d-5d67-48c8-aad3-d34234c4936f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:32.797510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34d42d-5d67-48c8-aad3-d34234c4936f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:32.797788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34d42d-5d67-48c8-aad3-d34234c4936f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:32.833641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-de34d42d-5d67-48c8-aad3-d34234c4936f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:32.834916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-de34d42d-5d67-48c8-aad3-d34234c4936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:32.860566 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3579/7102] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:32.861536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34d42d-5d67-48c8-aad3-d34234c4936f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:32.877646 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3524/7103] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:32 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:32.882111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:32.925773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34d42d-5d67-48c8-aad3-d34234c4936f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.070753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85a14-bf5e-4729-851b-b97c0e1e60df admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.079134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.079508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.079865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.080325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.081467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:33.081894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.085339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.111747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.112709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.113062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.121171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.121171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.121171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.122098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3525/7104] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:33.123146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.137372 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:33.144581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5b590-51b8-4aa0-8f09-53853c36f51c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.151761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790df092-d406-45eb-9002-232269346840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.153408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790df092-d406-45eb-9002-232269346840 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.153842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790df092-d406-45eb-9002-232269346840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.154235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790df092-d406-45eb-9002-232269346840 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.154987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790df092-d406-45eb-9002-232269346840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.155465 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3580/7105] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:33.157022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.158300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790df092-d406-45eb-9002-232269346840 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.176831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f98051-d2fb-4296-aceb-139f9384eb39 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.180939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.182010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.182160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.182342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.183668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.186733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.301804 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3526/7106] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:33 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:33.303512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790df092-d406-45eb-9002-232269346840 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.339489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790df092-d406-45eb-9002-232269346840 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.350236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.351026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.351499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.352327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] PATH_INFO: `/v3/projects/884b92d2a3604550a9f439721ed598fa/users/881285360d52423e8d8898a53d66e2fc/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.381713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=884b92d2a3604550a9f439721ed598fa, user_id=881285360d52423e8d8898a53d66e2fc, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.385302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.422241 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3581/7107] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:33 2022] POST /identity/v3/projects => generated 389 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:33.428463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.550691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d48e3-5d12-449d-b8c9-f64ccc0ed122 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.561452 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3527/7108] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:33 2022] PUT /identity/v3/projects/884b92d2a3604550a9f439721ed598fa/users/881285360d52423e8d8898a53d66e2fc/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:33.562982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.575114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f8b4f-6fe7-4925-867c-57f6639c66bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.575793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8b4f-6fe7-4925-867c-57f6639c66bf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.576077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8b4f-6fe7-4925-867c-57f6639c66bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.576408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f8b4f-6fe7-4925-867c-57f6639c66bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.577061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f8b4f-6fe7-4925-867c-57f6639c66bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.578849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f8b4f-6fe7-4925-867c-57f6639c66bf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.612812 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3582/7109] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:33.615445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba202-86d2-4a67-aeff-418c8bdec68e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.615740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba202-86d2-4a67-aeff-418c8bdec68e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.616021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba202-86d2-4a67-aeff-418c8bdec68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.699073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f3cba202-86d2-4a67-aeff-418c8bdec68e None None] MFA Rules not processed for user `881285360d52423e8d8898a53d66e2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:33.700384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f3cba202-86d2-4a67-aeff-418c8bdec68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:33.733931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da146fc3-e7f2-41bf-aaa4-c273019c88aa admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.754372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.755141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.755419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.755552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.756181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.758928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.859293 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3528/7110] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:33 2022] POST /identity/v3/users => generated 295 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:33.859293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.870189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3583/7111] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:33.874874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba202-86d2-4a67-aeff-418c8bdec68e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.886458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c72e5-4b2e-4a03-95d0-a9b5bc2a9cda admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.902659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba202-86d2-4a67-aeff-418c8bdec68e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.908967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.916017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.916291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.918600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.920094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.921921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.922992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.923278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.923391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.923550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.925535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:33.927244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:33.949058 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3529/7112] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:33.949738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.961147 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3584/7113] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:33.961147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:33.973261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370fe7-c7cf-43fb-9bcf-8a16e3547f89 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.984646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea847d-af14-4f30-8ade-9a7b08aa1875 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:33.990558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.991202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.993064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:33.993751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:33.994201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:33.994501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:33.995179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.002033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.002416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] PATH_INFO: `/v3/projects/f3b84db2582844c0900b9c4db6bb38fc/users/4cb731eea29c46228ea7b41afd20ee4b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.003218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:34.058454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b84db2582844c0900b9c4db6bb38fc, user_id=4cb731eea29c46228ea7b41afd20ee4b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.068750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:34.167417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3530/7114] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:33 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:34.168453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:34.190948 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3585/7115] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:33 2022] PUT /identity/v3/projects/f3b84db2582844c0900b9c4db6bb38fc/users/4cb731eea29c46228ea7b41afd20ee4b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:34.191888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:34.260939 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:34.351172 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:34.376931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8046c54-9ccc-4965-9ec6-7cdd7f668b8f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:34.381188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a86f-f9d9-4394-919e-a99097ddd821 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:34.387621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa064f-44f2-48c7-a52e-e8c835221ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:34.388264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa064f-44f2-48c7-a52e-e8c835221ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:34.388785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa064f-44f2-48c7-a52e-e8c835221ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.388785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa064f-44f2-48c7-a52e-e8c835221ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.389446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa064f-44f2-48c7-a52e-e8c835221ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.392969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa064f-44f2-48c7-a52e-e8c835221ed2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:34.394740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:34.395367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:34.395642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.395916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.398371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.428945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:34.447245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3531/7116] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:34.455254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166581b-d9a6-42fa-9216-0ff0a3fbb03c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:34.455576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166581b-d9a6-42fa-9216-0ff0a3fbb03c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.456138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166581b-d9a6-42fa-9216-0ff0a3fbb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.508932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7166581b-d9a6-42fa-9216-0ff0a3fbb03c None None] MFA Rules not processed for user `4cb731eea29c46228ea7b41afd20ee4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:34.512754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7166581b-d9a6-42fa-9216-0ff0a3fbb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:34.553188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3586/7117] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:34 2022] POST /identity/v3/users => generated 297 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:34.553188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:34.577803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dc234-0efd-429b-812d-aa2259ba842f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:34.608095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:34.616703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:34.616703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.616703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] PATH_INFO: `/v3/projects/cc16736c5a50425d86e1e454146035f3/users/86a886019b814956b33a4858c1d27f41/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.637325 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:34.646157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc16736c5a50425d86e1e454146035f3, user_id=86a886019b814956b33a4858c1d27f41, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.654263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:34.688629 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3532/7118] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:34.689648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166581b-d9a6-42fa-9216-0ff0a3fbb03c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:34.702690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166581b-d9a6-42fa-9216-0ff0a3fbb03c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:34.707875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:34.708390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:34.708669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.708943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.710027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.711906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:34.743684 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3533/7119] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:34.751730 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3587/7120] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:34 2022] PUT /identity/v3/projects/cc16736c5a50425d86e1e454146035f3/users/86a886019b814956b33a4858c1d27f41/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:34.751730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:34.755352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:34.807398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b44a3-f7bc-4838-b236-f6ee57eb2325 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:34.872866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da51e-ff2d-404c-ab3e-92d6e2eefa67 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:34.879843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab669f8-5dfe-481f-bad9-a121dc583605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:34.880661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab669f8-5dfe-481f-bad9-a121dc583605 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:34.880946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab669f8-5dfe-481f-bad9-a121dc583605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.881219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab669f8-5dfe-481f-bad9-a121dc583605 admin admin] PATH_INFO: `/v3/projects/000cb9b9873b42999df34a43797ce892/users/5d81f9fd10254986b91731c2f0065b79/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.910001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab669f8-5dfe-481f-bad9-a121dc583605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000cb9b9873b42999df34a43797ce892, user_id=5d81f9fd10254986b91731c2f0065b79, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.913994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab669f8-5dfe-481f-bad9-a121dc583605 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:34.946867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:34.947961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:34.948248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:34.948527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:34.949523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:34.952053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.002042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3588/7121] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:34 2022] PUT /identity/v3/projects/000cb9b9873b42999df34a43797ce892/users/5d81f9fd10254986b91731c2f0065b79/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:35.003410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d78e6b-7fde-40b7-9160-a9edc83f68b6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.003695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d78e6b-7fde-40b7-9160-a9edc83f68b6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.003969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d78e6b-7fde-40b7-9160-a9edc83f68b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.043710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e2d78e6b-7fde-40b7-9160-a9edc83f68b6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:35.044932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e2d78e6b-7fde-40b7-9160-a9edc83f68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:35.104937 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3534/7122] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:34 2022] POST /identity/v3/projects => generated 381 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:35.104937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.141702 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3589/7123] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:35.142877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d78e6b-7fde-40b7-9160-a9edc83f68b6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.155564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d78e6b-7fde-40b7-9160-a9edc83f68b6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.182263 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:35.233058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d481645-2cfc-4c91-873a-e0a3bb6f20d1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.245739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.246405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.248061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.248864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.249077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:35.252547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.270094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.270887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.271274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.271658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.272974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:35.275968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.283645 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3535/7124] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:35.284438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.291934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:35.376733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2dbd1-45d6-4ce9-bc5c-eb9f5658bcbf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.380575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.381355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.381641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.381945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.392295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:35.393688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.416534 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3590/7125] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:35 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:35.417683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.434266 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3536/7126] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:35.435322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.458103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7cfb0-0302-4e2b-a692-5483aae2f73a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.463367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f34f4-d9aa-47b7-ad1b-ff2f36d92a10 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.470764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c82c-50f2-4cda-a614-0f63a8d18c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.471641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c82c-50f2-4cda-a614-0f63a8d18c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.472021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c82c-50f2-4cda-a614-0f63a8d18c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.472307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c82c-50f2-4cda-a614-0f63a8d18c53 admin admin] PATH_INFO: `/v3/projects/000cb9b9873b42999df34a43797ce892/users/5d81f9fd10254986b91731c2f0065b79/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.474660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c82c-50f2-4cda-a614-0f63a8d18c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000cb9b9873b42999df34a43797ce892, user_id=5d81f9fd10254986b91731c2f0065b79, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:35.478204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c82c-50f2-4cda-a614-0f63a8d18c53 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.492702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.493335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.499601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.499601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.499601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:35.501119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.518180 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3591/7127] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:35 2022] PUT /identity/v3/projects/000cb9b9873b42999df34a43797ce892/users/5d81f9fd10254986b91731c2f0065b79/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:35.526768 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3537/7128] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:35.527039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a66c7-1dbd-49e8-b7ef-f798b3f66b9c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.527039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a66c7-1dbd-49e8-b7ef-f798b3f66b9c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.527039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a66c7-1dbd-49e8-b7ef-f798b3f66b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.532766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.558020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc98617-aaa4-4652-8d26-cb4fbc1d507a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.650741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-df2a66c7-1dbd-49e8-b7ef-f798b3f66b9c None None] MFA Rules not processed for user `5d81f9fd10254986b91731c2f0065b79`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:35.652701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df2a66c7-1dbd-49e8-b7ef-f798b3f66b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:35.797515 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3592/7129] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:35.800161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.801593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.801792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.802201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.802965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:35.805605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.828782 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3538/7130] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:35.835915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a66c7-1dbd-49e8-b7ef-f798b3f66b9c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.843771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:35.869958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641b1b6-cd21-4a3f-bd7a-afb44b138344 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.869958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e222fc-eef1-4867-ab9a-f35c1a301567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.869958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e222fc-eef1-4867-ab9a-f35c1a301567 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.870494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e222fc-eef1-4867-ab9a-f35c1a301567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.870752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e222fc-eef1-4867-ab9a-f35c1a301567 admin admin] PATH_INFO: `/v3/projects/87ca7653e0ee482c9b87494e5887ea64/users/c532e579187c4c21bca98aceeab7b8c2/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.910076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e222fc-eef1-4867-ab9a-f35c1a301567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ca7653e0ee482c9b87494e5887ea64, user_id=c532e579187c4c21bca98aceeab7b8c2, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:35.917877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e222fc-eef1-4867-ab9a-f35c1a301567 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:35.929687 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:35.984014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a66c7-1dbd-49e8-b7ef-f798b3f66b9c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:35.992542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:35.993162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:35.993445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:35.993720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:35.997999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:36.048778 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3539/7131] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:35 2022] PUT /identity/v3/projects/87ca7653e0ee482c9b87494e5887ea64/users/c532e579187c4c21bca98aceeab7b8c2/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:36.063839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cd3d6-48a3-4c27-bdf3-92b50bfc96bf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:36.064335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cd3d6-48a3-4c27-bdf3-92b50bfc96bf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:36.065436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cd3d6-48a3-4c27-bdf3-92b50bfc96bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:36.094581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:36.096572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:36.102721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b53cd3d6-48a3-4c27-bdf3-92b50bfc96bf None None] MFA Rules not processed for user `c532e579187c4c21bca98aceeab7b8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:36.104063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b53cd3d6-48a3-4c27-bdf3-92b50bfc96bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:36.110697 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3593/7132] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:36.264039 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3540/7133] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:36.266639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:36.396045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e5b6-fb0a-4dcd-b769-77e747042a5f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:36.562001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eada0-733c-4658-835f-d0c7e784f52c tempest-IdentityV3ProjectsTest-568281770 tempest-IdentityV3ProjectsTest-568281770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb731eea29c46228ea7b41afd20ee4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3b84db2582844c0900b9c4db6bb38fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:36.563011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eada0-733c-4658-835f-d0c7e784f52c tempest-IdentityV3ProjectsTest-568281770 tempest-IdentityV3ProjectsTest-568281770-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:36.563508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eada0-733c-4658-835f-d0c7e784f52c tempest-IdentityV3ProjectsTest-568281770 tempest-IdentityV3ProjectsTest-568281770-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:36.564019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eada0-733c-4658-835f-d0c7e784f52c tempest-IdentityV3ProjectsTest-568281770 tempest-IdentityV3ProjectsTest-568281770-project] PATH_INFO: `/v3/users/4cb731eea29c46228ea7b41afd20ee4b/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:36.565947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eada0-733c-4658-835f-d0c7e784f52c tempest-IdentityV3ProjectsTest-568281770 tempest-IdentityV3ProjectsTest-568281770-project] RBAC: Authorizing `identity:list_user_projects(user_id=4cb731eea29c46228ea7b41afd20ee4b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:36.571184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eada0-733c-4658-835f-d0c7e784f52c tempest-IdentityV3ProjectsTest-568281770 tempest-IdentityV3ProjectsTest-568281770-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:36.676747 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3594/7134] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:45:36 2022] GET /identity/v3/users/4cb731eea29c46228ea7b41afd20ee4b/projects => generated 515 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:36.681718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be1a7e-654f-4703-b65d-c531f78e34eb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:36.683000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be1a7e-654f-4703-b65d-c531f78e34eb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:36.683528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be1a7e-654f-4703-b65d-c531f78e34eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:36.763265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d5be1a7e-654f-4703-b65d-c531f78e34eb None None] MFA Rules not processed for user `4cb731eea29c46228ea7b41afd20ee4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:36.765362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5be1a7e-654f-4703-b65d-c531f78e34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:36.782741 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3541/7135] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:36.783983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478828-9f91-4906-a195-058fc05f513f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:36.784337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478828-9f91-4906-a195-058fc05f513f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:36.784686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478828-9f91-4906-a195-058fc05f513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:36.834611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6f478828-9f91-4906-a195-058fc05f513f None None] MFA Rules not processed for user `4cb731eea29c46228ea7b41afd20ee4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:36.836523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6f478828-9f91-4906-a195-058fc05f513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:36.934016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.models.token_model [None req-6f478828-9f91-4906-a195-058fc05f513f None None] User 4cb731eea29c46228ea7b41afd20ee4b has no access to project 87ca7653e0ee482c9b87494e5887ea64 {{(pid=82007) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 28 01:45:36.937515 n-d-master-1 devstack@keystone.service[82007]: WARNING keystone.server.flask.application [None req-6f478828-9f91-4906-a195-058fc05f513f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.59: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 01:45:36.941399 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3595/7136] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:36 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 158 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 01:45:36.947342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be1a7e-654f-4703-b65d-c531f78e34eb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:37.102669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be1a7e-654f-4703-b65d-c531f78e34eb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:37.114025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:37.114840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.115225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.115649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] PATH_INFO: `/v3/users/4cb731eea29c46228ea7b41afd20ee4b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.118862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb731eea29c46228ea7b41afd20ee4b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:37.124805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:37.297846 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:37.454517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb731eea29c46228ea7b41afd20ee4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:37.508422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb731eea29c46228ea7b41afd20ee4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:37.521838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb731eea29c46228ea7b41afd20ee4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:37.522803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb731eea29c46228ea7b41afd20ee4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:37.746158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb731eea29c46228ea7b41afd20ee4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:37.768900 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3542/7137] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:36 2022] DELETE /identity/v3/users/4cb731eea29c46228ea7b41afd20ee4b => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:37.779466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.779761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.780039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.814637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:37.816483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:37.950635 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3596/7138] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:37.982533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:37.984576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:38.108451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98971a0-6b1b-47c1-9fe8-5fce2ab69966 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:38.114695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:38.115480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:38.115631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:38.115894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:38.127885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:38.129841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:38.144380 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3543/7139] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:39.006734 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:39.429115 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:40.548166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:40.549638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:40.584873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c241b3-bba3-4cbc-ba0f-109d51014b02 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:40.609977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:40.614402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:40.617268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:40.619310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] PATH_INFO: `/v3/projects/f3b84db2582844c0900b9c4db6bb38fc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:40.629564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b84db2582844c0900b9c4db6bb38fc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:40.631894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:40.950859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b84db2582844c0900b9c4db6bb38fc', 'request_id': 'req-bb7b1194-059c-4896-ae06-266515b301e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:40.965112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b84db2582844c0900b9c4db6bb38fc', 'request_id': 'req-bb7b1194-059c-4896-ae06-266515b301e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.001095 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:41.083669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b84db2582844c0900b9c4db6bb38fc', 'request_id': 'req-bb7b1194-059c-4896-ae06-266515b301e9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.122952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] The token cache is being invalidate because project f3b84db2582844c0900b9c4db6bb38fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:41.123218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.126514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.134843 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3597/7140] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:40 2022] DELETE /identity/v3/projects/f3b84db2582844c0900b9c4db6bb38fc => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:41.145220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:41.156741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1aae-93d0-4cf1-8e9a-6ae6db2b2039 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:41.349282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:41.351462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:41.351948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:41.360428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] PATH_INFO: `/v3/users/c532e579187c4c21bca98aceeab7b8c2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:41.362649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c532e579187c4c21bca98aceeab7b8c2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:41.364992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:41.455127 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:41.629801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c532e579187c4c21bca98aceeab7b8c2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.657144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c532e579187c4c21bca98aceeab7b8c2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.678801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c532e579187c4c21bca98aceeab7b8c2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.694618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c532e579187c4c21bca98aceeab7b8c2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.765960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d97e97f0-9a5d-4a5f-9006-3a6e989c07b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c532e579187c4c21bca98aceeab7b8c2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:41.772833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3544/7141] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:41 2022] DELETE /identity/v3/users/c532e579187c4c21bca98aceeab7b8c2 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:42.826208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:42.827999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:42.859221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b1194-059c-4896-ae06-266515b301e9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:42.992997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:42.994749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:42.995193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:42.995641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] PATH_INFO: `/v3/projects/87ca7653e0ee482c9b87494e5887ea64` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:42.997185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ca7653e0ee482c9b87494e5887ea64)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:42.999384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:43.279752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ca7653e0ee482c9b87494e5887ea64', 'request_id': 'req-6d2718ee-bf23-4c7e-9470-cc695f12a86c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:43.310898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ca7653e0ee482c9b87494e5887ea64', 'request_id': 'req-6d2718ee-bf23-4c7e-9470-cc695f12a86c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:43.422569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ca7653e0ee482c9b87494e5887ea64', 'request_id': 'req-6d2718ee-bf23-4c7e-9470-cc695f12a86c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:43.453036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] The token cache is being invalidate because project 87ca7653e0ee482c9b87494e5887ea64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:43.453036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:43.453036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6d2718ee-bf23-4c7e-9470-cc695f12a86c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:43.456797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3598/7142] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:42 2022] DELETE /identity/v3/projects/87ca7653e0ee482c9b87494e5887ea64 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:43.463462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baedd-bdad-417e-9816-ebd127af39d2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:43.464027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baedd-bdad-417e-9816-ebd127af39d2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:43.464027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baedd-bdad-417e-9816-ebd127af39d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:43.511025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-762baedd-bdad-417e-9816-ebd127af39d2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:43.512342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-762baedd-bdad-417e-9816-ebd127af39d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:43.652344 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:43.704791 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3545/7143] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:43.709804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c1be-e65c-4b90-9acd-9e01cd8c5336 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:43.710694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c1be-e65c-4b90-9acd-9e01cd8c5336 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:43.711336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592c1be-e65c-4b90-9acd-9e01cd8c5336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:43.751149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d592c1be-e65c-4b90-9acd-9e01cd8c5336 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:43.752419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d592c1be-e65c-4b90-9acd-9e01cd8c5336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:43.768588 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3599/7144] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:43.772752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762baedd-bdad-417e-9816-ebd127af39d2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:43.795139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762baedd-bdad-417e-9816-ebd127af39d2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:43.817415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:43.818078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:43.818364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:43.818643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:43.819309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:43.819676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:43.821751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:43.862487 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3546/7145] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:43.867581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592c1be-e65c-4b90-9acd-9e01cd8c5336 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:43.889320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592c1be-e65c-4b90-9acd-9e01cd8c5336 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:43.895030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:43.896868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:43.897476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:43.898721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:43.899652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:43.901996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:43.929405 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:44.084869 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3600/7146] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:43 2022] POST /identity/v3/projects => generated 359 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:44.091637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:44.109021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef3720-363e-4986-bb00-d5ae7a7cac5c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:44.277903 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:44.290162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:44.290868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:44.291176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:44.291666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:44.292648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:44.295818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:44.448152 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3547/7147] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:44 2022] POST /identity/v3/users => generated 280 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:45:44.451943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:44.498595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6160f-5f66-4886-a8e9-53728123af3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:44.515401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:44.516350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:44.516796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:44.517233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:44.518404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:44.520346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:44.534771 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3601/7148] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:44.539391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:44.552843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53762fd0-b3cd-4c54-b986-ea7f231efa5e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:44.559626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dc90e-f19c-413f-a56c-01bd664629b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:44.560562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dc90e-f19c-413f-a56c-01bd664629b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:44.561033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dc90e-f19c-413f-a56c-01bd664629b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:44.561467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dc90e-f19c-413f-a56c-01bd664629b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:44.563188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dc90e-f19c-413f-a56c-01bd664629b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:44.565317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dc90e-f19c-413f-a56c-01bd664629b2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:44.580643 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3548/7149] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:44.584517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:44.600195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77d9f-5fe5-4070-a48d-14ad5dbe5560 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:44.615655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:44.616530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:44.616820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:44.617104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] PATH_INFO: `/v3/projects/de401d987cb747b1a407f2c06df58d79/users/60e0e83e86d94c0e8acfed957b75029c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:44.667940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de401d987cb747b1a407f2c06df58d79, user_id=60e0e83e86d94c0e8acfed957b75029c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:44.687397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:44.800648 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3602/7150] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:44 2022] PUT /identity/v3/projects/de401d987cb747b1a407f2c06df58d79/users/60e0e83e86d94c0e8acfed957b75029c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:44.812107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ba677-c7e6-4aa8-9ad9-da16cbaa1773 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:44.812964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ba677-c7e6-4aa8-9ad9-da16cbaa1773 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:44.820459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ba677-c7e6-4aa8-9ad9-da16cbaa1773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:44.908272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e75ba677-c7e6-4aa8-9ad9-da16cbaa1773 None None] MFA Rules not processed for user `60e0e83e86d94c0e8acfed957b75029c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:44.911959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e75ba677-c7e6-4aa8-9ad9-da16cbaa1773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:44.987476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:44.988610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:45.125193 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3549/7151] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:45.129672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6cab1-79ed-439d-b433-2d54d666c79b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.137496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6cab1-79ed-439d-b433-2d54d666c79b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.164001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6cab1-79ed-439d-b433-2d54d666c79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.207673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc660-a55f-4c09-a47b-c0473665e15e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:45.224610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:45.227327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.242894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-49c6cab1-79ed-439d-b433-2d54d666c79b None None] MFA Rules not processed for user `60e0e83e86d94c0e8acfed957b75029c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:45.244134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-49c6cab1-79ed-439d-b433-2d54d666c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:45.244842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.251000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] PATH_INFO: `/v3/users/7a8befd3ed7e4f8ba180cc7053a0375e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.260924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8befd3ed7e4f8ba180cc7053a0375e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:45.265780 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3550/7152] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:45 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 01:45:45.269888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:45.272290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebdbf6-5e32-4321-b914-240ba6955a4b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.273361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebdbf6-5e32-4321-b914-240ba6955a4b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.274719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebdbf6-5e32-4321-b914-240ba6955a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.356338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-40ebdbf6-5e32-4321-b914-240ba6955a4b None None] MFA Rules not processed for user `60e0e83e86d94c0e8acfed957b75029c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:45.357776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-40ebdbf6-5e32-4321-b914-240ba6955a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:45.373290 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3551/7153] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:45 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:45:45.383699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebdbf6-5e32-4321-b914-240ba6955a4b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:45.425065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebdbf6-5e32-4321-b914-240ba6955a4b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:45.448678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e0e83e86d94c0e8acfed957b75029c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de401d987cb747b1a407f2c06df58d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:45.449628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.449787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.450071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.465859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorizing `identity:check_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:45.467996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:45.484981 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3552/7154] 10.222.0.59 () {56 vars in 1264 bytes} [Sun Aug 28 01:45:45 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 28 01:45:45.486764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:45.496252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9f92a-f3ff-4ca3-9a68-9e282756d853 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:45.508681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e0e83e86d94c0e8acfed957b75029c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de401d987cb747b1a407f2c06df58d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:45.509457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.509739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.510058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.529332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:45.531154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:45.553662 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3553/7155] 10.222.0.59 () {56 vars in 1263 bytes} [Sun Aug 28 01:45:45 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 01:45:45.555543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:45.566677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4ca3-bfcf-4fc0-b46c-da3d99ebaff9 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:45.573965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e0e83e86d94c0e8acfed957b75029c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de401d987cb747b1a407f2c06df58d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:45.574851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.575434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.575931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.589231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:45.591329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:45.688618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8befd3ed7e4f8ba180cc7053a0375e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:45.690412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8befd3ed7e4f8ba180cc7053a0375e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:45.722190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3554/7156] 10.222.0.59 () {56 vars in 1266 bytes} [Sun Aug 28 01:45:45 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:45.723642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:45.740206 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:45.744433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ed9d5-0aef-43d3-828f-7bdd8cac0c33 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:45.763713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76b18-2e39-4f1f-99c1-0934a4641223 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e0e83e86d94c0e8acfed957b75029c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de401d987cb747b1a407f2c06df58d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:45.768632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76b18-2e39-4f1f-99c1-0934a4641223 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.769250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76b18-2e39-4f1f-99c1-0934a4641223 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.769923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76b18-2e39-4f1f-99c1-0934a4641223 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.785932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69a76b18-2e39-4f1f-99c1-0934a4641223 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:45.797074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8befd3ed7e4f8ba180cc7053a0375e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:45.820545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8befd3ed7e4f8ba180cc7053a0375e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-69a76b18-2e39-4f1f-99c1-0934a4641223 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 28 01:45:45.820727 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 01:45:45.828841 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 01:45:45.831646 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:45.831646 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:45.831646 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 01:45:45.831646 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 01:45:45.831646 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 01:45:45.831646 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:45:45.831646 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3555/7157] 10.222.0.59 () {56 vars in 1264 bytes} [Sun Aug 28 01:45:45 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 28 01:45:45.832182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8befd3ed7e4f8ba180cc7053a0375e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:45.835152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd963d28-d60c-447a-afe4-5b26d1c05b7c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:45.835579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd963d28-d60c-447a-afe4-5b26d1c05b7c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:45.835735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd963d28-d60c-447a-afe4-5b26d1c05b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:45.895038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3603/7158] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:44 2022] DELETE /identity/v3/users/7a8befd3ed7e4f8ba180cc7053a0375e => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:45.900480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cd963d28-d60c-447a-afe4-5b26d1c05b7c None None] MFA Rules not processed for user `60e0e83e86d94c0e8acfed957b75029c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:45.906596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cd963d28-d60c-447a-afe4-5b26d1c05b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:45.920296 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3556/7159] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:45 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:45:45.924267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:45.931797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:46.160840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331406f8-dd41-4fa6-8596-923461c6a855 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:46.178176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e0e83e86d94c0e8acfed957b75029c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de401d987cb747b1a407f2c06df58d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:46.178176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:46.178176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:46.178505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:46.190967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:46.196546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:46.217676 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3604/7160] 10.222.0.59 () {56 vars in 1263 bytes} [Sun Aug 28 01:45:45 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 01:45:46.218434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd963d28-d60c-447a-afe4-5b26d1c05b7c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:46.262335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd963d28-d60c-447a-afe4-5b26d1c05b7c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:46.283819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e0e83e86d94c0e8acfed957b75029c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de401d987cb747b1a407f2c06df58d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:46.284472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:46.284754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:46.285031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:46.311208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:46.315225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:46.477710 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3557/7161] 10.222.0.59 () {56 vars in 1266 bytes} [Sun Aug 28 01:45:46 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:46.482438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:46.493915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9350-ff6b-45f6-8954-db42a87712d8 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:46.514078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e0e83e86d94c0e8acfed957b75029c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de401d987cb747b1a407f2c06df58d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:46.519029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:46.519379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:46.519661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:46.524312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 28 01:45:46.545519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 01:45:46.550230 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 01:45:46.551697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:45:46.551697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:45:46.551697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 01:45:46.551697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 01:45:46.551697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 01:45:46.551697 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:45:46.552507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:46.554406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:46.556887 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3605/7162] 10.222.0.59 () {56 vars in 1263 bytes} [Sun Aug 28 01:45:46 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 01:45:46.558439 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:46.716677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277f50-d30c-4dad-93d3-ef39dcc8a5ae tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:46.746448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:46.747557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:46.748041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:46.748483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] PATH_INFO: `/v3/users/60e0e83e86d94c0e8acfed957b75029c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:46.750525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e0e83e86d94c0e8acfed957b75029c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:46.752720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:46.995783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:46.997545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:47.020950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284758-ac54-4697-a54f-08eaabf48342 tempest-TokensV3Test-613124770 tempest-TokensV3Test-613124770-project] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:47.026740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:47.028137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:47.028643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:47.029479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] PATH_INFO: `/v3/projects/857b5bc8698c447897f197c9598b9d0c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:47.031234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=857b5bc8698c447897f197c9598b9d0c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:47.038032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:47.107575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e0e83e86d94c0e8acfed957b75029c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.137986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e0e83e86d94c0e8acfed957b75029c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.197430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e0e83e86d94c0e8acfed957b75029c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.205382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e0e83e86d94c0e8acfed957b75029c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.281702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857b5bc8698c447897f197c9598b9d0c', 'request_id': 'req-6b98add3-bfa6-4299-836e-6f23d2b223ff'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.326916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857b5bc8698c447897f197c9598b9d0c', 'request_id': 'req-6b98add3-bfa6-4299-836e-6f23d2b223ff'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.338151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-38b6e777-de70-4ab9-a52f-70dba74c6df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e0e83e86d94c0e8acfed957b75029c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.363490 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3558/7163] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:46 2022] DELETE /identity/v3/users/60e0e83e86d94c0e8acfed957b75029c => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:47.368718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:47.369024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:47.369282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:47.459037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857b5bc8698c447897f197c9598b9d0c', 'request_id': 'req-6b98add3-bfa6-4299-836e-6f23d2b223ff'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.476791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:47.478175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:47.488719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] The token cache is being invalidate because project 857b5bc8698c447897f197c9598b9d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:47.489234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.495100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:47.498189 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3606/7164] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:46 2022] DELETE /identity/v3/projects/857b5bc8698c447897f197c9598b9d0c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:47.503012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:47.522787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:47.734321 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3559/7165] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:47.780649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98add3-bfa6-4299-836e-6f23d2b223ff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:47.782925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:47.784523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:47.810292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:47.815813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:47.816461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:47.816995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] PATH_INFO: `/v3/users/273829d42f4c4f10a5748365b2ad9412` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:47.818730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=273829d42f4c4f10a5748365b2ad9412)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:47.821227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:47.996974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdc45a-35a9-431e-a13d-a27608c479e7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:48.015274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:48.015925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:48.016268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:48.016545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:48.056277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:48.057762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:48.092275 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3560/7166] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:48.118120 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:48.156266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273829d42f4c4f10a5748365b2ad9412'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:48.159332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273829d42f4c4f10a5748365b2ad9412'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:48.296636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273829d42f4c4f10a5748365b2ad9412'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:48.309715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273829d42f4c4f10a5748365b2ad9412'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:48.311788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273829d42f4c4f10a5748365b2ad9412'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:48.369704 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3607/7167] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:47 2022] DELETE /identity/v3/users/273829d42f4c4f10a5748365b2ad9412 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:48.446370 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:49.332931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:49.354317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6ddd4-f800-409b-817d-62711a7a1af1 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:49.568474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:49.569134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:49.569978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:49.570254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] PATH_INFO: `/v3/projects/105cdce91b65435ea514b2e0ef75a925` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:49.572913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] RBAC: Authorizing `identity:delete_project(project_id=105cdce91b65435ea514b2e0ef75a925)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:49.574490 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:49.574993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:49.656125 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:49.778457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105cdce91b65435ea514b2e0ef75a925', 'request_id': 'req-a4f35ca0-347a-4c03-84ab-765d094b769f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:49.793315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105cdce91b65435ea514b2e0ef75a925', 'request_id': 'req-a4f35ca0-347a-4c03-84ab-765d094b769f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:49.896604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105cdce91b65435ea514b2e0ef75a925', 'request_id': 'req-a4f35ca0-347a-4c03-84ab-765d094b769f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:49.920391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] The token cache is being invalidate because project 105cdce91b65435ea514b2e0ef75a925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:49.925034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:49.925157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a4f35ca0-347a-4c03-84ab-765d094b769f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:49.937879 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3561/7168] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:49 2022] DELETE /identity/v3/projects/105cdce91b65435ea514b2e0ef75a925 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:50.145976 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:50.163512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:50.166173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:50.204412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba5320-9714-48dd-907c-731d2f469eb5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:50.343180 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:50.379300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:50.380396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:50.381000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:50.381458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] PATH_INFO: `/v3/projects/de401d987cb747b1a407f2c06df58d79` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:50.384077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de401d987cb747b1a407f2c06df58d79)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:50.388882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:50.590235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de401d987cb747b1a407f2c06df58d79', 'request_id': 'req-ba2b7149-7104-474a-860c-da6e9435b09b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:50.617633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de401d987cb747b1a407f2c06df58d79', 'request_id': 'req-ba2b7149-7104-474a-860c-da6e9435b09b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:50.743264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de401d987cb747b1a407f2c06df58d79', 'request_id': 'req-ba2b7149-7104-474a-860c-da6e9435b09b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:50.772930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] The token cache is being invalidate because project de401d987cb747b1a407f2c06df58d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:45:50.775980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:50.775980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba2b7149-7104-474a-860c-da6e9435b09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:50.779228 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3608/7169] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:50 2022] DELETE /identity/v3/projects/de401d987cb747b1a407f2c06df58d79 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:50.786052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7912-dbe4-4dda-a469-11b46f5db139 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:50.786567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7912-dbe4-4dda-a469-11b46f5db139 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:50.787066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7912-dbe4-4dda-a469-11b46f5db139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:50.818474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1d7c7912-dbe4-4dda-a469-11b46f5db139 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:50.820371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1d7c7912-dbe4-4dda-a469-11b46f5db139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:50.912295 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:50.949287 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3562/7170] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:50.949996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995eb30-5b98-4166-a5f1-9dca1334ff77 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:50.950295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995eb30-5b98-4166-a5f1-9dca1334ff77 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:50.950574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995eb30-5b98-4166-a5f1-9dca1334ff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:50.992026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5995eb30-5b98-4166-a5f1-9dca1334ff77 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:50.995003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5995eb30-5b98-4166-a5f1-9dca1334ff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:50.997292 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:51.032837 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3609/7171] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:51.037512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c7912-dbe4-4dda-a469-11b46f5db139 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:51.051143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c7912-dbe4-4dda-a469-11b46f5db139 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:51.059967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c328439-2c93-40a9-a9b7-1ad91ca57cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:51.060965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c328439-2c93-40a9-a9b7-1ad91ca57cbe admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:51.061472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c328439-2c93-40a9-a9b7-1ad91ca57cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:51.062154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c328439-2c93-40a9-a9b7-1ad91ca57cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:51.063337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c328439-2c93-40a9-a9b7-1ad91ca57cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:45:51.067140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c328439-2c93-40a9-a9b7-1ad91ca57cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:51.070868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c328439-2c93-40a9-a9b7-1ad91ca57cbe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:51.097862 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3563/7172] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:45:51.101561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995eb30-5b98-4166-a5f1-9dca1334ff77 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:51.129961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995eb30-5b98-4166-a5f1-9dca1334ff77 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:51.138078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:51.140110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:51.141281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:51.141730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:51.142725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:51.146173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:51.237115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:51.237621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:51.238642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:51.302937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] MFA Rules not processed for user `86a886019b814956b33a4858c1d27f41`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:51.309584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:51.310468 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3610/7173] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:51 2022] POST /identity/v3/projects => generated 391 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:51.314571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:51.469634 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:51.478136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ab517-8e29-41f8-8f8c-ebe95a399bad admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:51.501223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:51.501891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:51.502158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:51.504452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:51.505106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:51.514238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:51.524986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3564/7174] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:51.540248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:51.541776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:51.611432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3611/7175] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:51 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:51.615829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:51.651405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8c96-1734-4ec6-88cd-507fbecae823 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:51.664084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:51.665763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:51.666178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:51.666738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:51.667801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:51.672105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:51.688019 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3612/7176] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:51.692030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:51.696630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d087d-2f98-4d13-a446-b90791d554a9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:51.712867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf85c-b5b3-4eb8-a6c7-5f6a72b42b76 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:51.715619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:51.716489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:51.717617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:51.718104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:51.727903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:51.728920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:51.729360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:51.731123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] PATH_INFO: `/v3/projects/e0cd5f3df3044877bfa18fae5beb9b97/users/45cb45ff143e46c5bc322b7d1a16e1db/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:51.738101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:51.743305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:51.770132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cd5f3df3044877bfa18fae5beb9b97, user_id=45cb45ff143e46c5bc322b7d1a16e1db, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:51.770429 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3565/7177] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:45:51.775956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:51.904684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3613/7178] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:51 2022] PUT /identity/v3/projects/e0cd5f3df3044877bfa18fae5beb9b97/users/45cb45ff143e46c5bc322b7d1a16e1db/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:51.906415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:51.922763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc8225-8f33-4675-b661-505b0fff2430 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:52.036965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c419a-6969-4f48-9721-5fffbad0559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:52.037616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c419a-6969-4f48-9721-5fffbad0559d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:52.037978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c419a-6969-4f48-9721-5fffbad0559d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:52.038232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c419a-6969-4f48-9721-5fffbad0559d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:52.039077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c419a-6969-4f48-9721-5fffbad0559d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:52.045138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c419a-6969-4f48-9721-5fffbad0559d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:52.064912 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3566/7179] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:52.066273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:52.077066 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:52.082836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed754372-159d-4d47-925f-3de91e7517d0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:52.088485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:52.089401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:52.089687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:52.090004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] PATH_INFO: `/v3/projects/e0cd5f3df3044877bfa18fae5beb9b97/users/45cb45ff143e46c5bc322b7d1a16e1db/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:52.092575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cd5f3df3044877bfa18fae5beb9b97, user_id=45cb45ff143e46c5bc322b7d1a16e1db, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:52.096065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:52.115832 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3614/7180] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:52 2022] PUT /identity/v3/projects/e0cd5f3df3044877bfa18fae5beb9b97/users/45cb45ff143e46c5bc322b7d1a16e1db/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:45:52.213199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc002e-f5ae-4a4d-8dcf-eada65503061 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:52.213495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc002e-f5ae-4a4d-8dcf-eada65503061 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:52.213745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc002e-f5ae-4a4d-8dcf-eada65503061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:52.280254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2edc002e-f5ae-4a4d-8dcf-eada65503061 None None] MFA Rules not processed for user `45cb45ff143e46c5bc322b7d1a16e1db`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:52.281661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2edc002e-f5ae-4a4d-8dcf-eada65503061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:52.480127 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3567/7181] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:52 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:52.484759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:52.619028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d0bfb-4539-44b9-b7d7-ee84ac8e0f99 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:52.630922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:52.631444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:52.632277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:52.632545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:52.633549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:52.636421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:52.768990 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3615/7182] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:45:52 2022] POST /identity/v3/projects => generated 393 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:52.773347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc002e-f5ae-4a4d-8dcf-eada65503061 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:52.784036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc002e-f5ae-4a4d-8dcf-eada65503061 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:52.903203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:52.903926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:52.904279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:52.904635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:52.905362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:52.908835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:53.029682 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3568/7183] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:45:52 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:45:53.030753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:53.052738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbf22f-47ba-44e5-9c0d-80f0d2aea12a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:53.061670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:53.062992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:53.063517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:53.064083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:53.064973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:53.066900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:53.088913 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3616/7184] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:45:53.092947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:53.108812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44e5c2-ecd9-43ef-9ca0-1fa00f28bc03 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:53.124933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777233f-353c-4878-a489-d8b47ffe4523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:53.125591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777233f-353c-4878-a489-d8b47ffe4523 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:53.125896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777233f-353c-4878-a489-d8b47ffe4523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:53.126179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777233f-353c-4878-a489-d8b47ffe4523 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:53.126845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777233f-353c-4878-a489-d8b47ffe4523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:53.128486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777233f-353c-4878-a489-d8b47ffe4523 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:53.183566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:53.191933 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3569/7185] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:45:53.200259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875af83-15eb-47e3-a5b0-92855d3cbeae admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:53.213520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:53.214243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:53.214589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:53.214871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] PATH_INFO: `/v3/projects/935d5730300545ce9ff664e23b25816c/users/dfaec42ca22d4d21ab9324b3d3d09c83/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:53.245786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935d5730300545ce9ff664e23b25816c, user_id=dfaec42ca22d4d21ab9324b3d3d09c83, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:53.248855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:53.363888 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3617/7186] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:45:53 2022] PUT /identity/v3/projects/935d5730300545ce9ff664e23b25816c/users/dfaec42ca22d4d21ab9324b3d3d09c83/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:53.370603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15fb8-4236-4b9a-8c24-a881f34cfde9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:53.371266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15fb8-4236-4b9a-8c24-a881f34cfde9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:53.371556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15fb8-4236-4b9a-8c24-a881f34cfde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:53.442027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c8b15fb8-4236-4b9a-8c24-a881f34cfde9 None None] MFA Rules not processed for user `dfaec42ca22d4d21ab9324b3d3d09c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:53.443282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c8b15fb8-4236-4b9a-8c24-a881f34cfde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:53.620129 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:53.625534 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3570/7187] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:53.643644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:53.646899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:53.861279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73cd8e-a3ec-401f-bfed-f84115c9ad28 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:53.890797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97a4c1-3be1-4dd8-8f82-1901265f8a4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:53.892035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a4c1-3be1-4dd8-8f82-1901265f8a4b service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:53.892484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a4c1-3be1-4dd8-8f82-1901265f8a4b service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:53.893285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a4c1-3be1-4dd8-8f82-1901265f8a4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:53.951526 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:54.025838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97a4c1-3be1-4dd8-8f82-1901265f8a4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:54.032777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97a4c1-3be1-4dd8-8f82-1901265f8a4b service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:54.067737 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3618/7188] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:45:54.439041 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:55.362821 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:55.766511 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:56.957139 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:57.141707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15fb8-4236-4b9a-8c24-a881f34cfde9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:57.259799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15fb8-4236-4b9a-8c24-a881f34cfde9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:57.265245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:57.266250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:57.266721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:57.267171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] PATH_INFO: `/v3/users/45cb45ff143e46c5bc322b7d1a16e1db` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:57.276340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cb45ff143e46c5bc322b7d1a16e1db)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:57.283263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:57.516704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cb45ff143e46c5bc322b7d1a16e1db'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:57.528419 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:57.556887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cb45ff143e46c5bc322b7d1a16e1db'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:57.581756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cb45ff143e46c5bc322b7d1a16e1db'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:57.583142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cb45ff143e46c5bc322b7d1a16e1db'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:57.662785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a95c52b0-0e40-459b-9d7d-0cbda9fbe68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cb45ff143e46c5bc322b7d1a16e1db'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:57.670914 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3571/7189] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:45:57 2022] DELETE /identity/v3/users/45cb45ff143e46c5bc322b7d1a16e1db => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:45:57.675541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:57.676234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:57.681376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:57.703511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:57.704999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:57.718773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628cc6-0f3d-40eb-9dfa-e8340ffa63c7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:57.719971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628cc6-0f3d-40eb-9dfa-e8340ffa63c7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:57.720260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91628cc6-0f3d-40eb-9dfa-e8340ffa63c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:57.775894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-91628cc6-0f3d-40eb-9dfa-e8340ffa63c7 None None] MFA Rules not processed for user `86a886019b814956b33a4858c1d27f41`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:57.784271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-91628cc6-0f3d-40eb-9dfa-e8340ffa63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:57.854224 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3619/7190] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:57.891526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3572/7191] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:45:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:45:57.899583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:57.902816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:58.023979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff408a-503d-4acb-b063-346dcb262bcb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:58.029225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:58.030258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:58.030780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:58.031265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:58.078529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:58.080232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:58.105104 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3620/7192] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:58.160178 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:58.501130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628cc6-0f3d-40eb-9dfa-e8340ffa63c7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:58.520965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91628cc6-0f3d-40eb-9dfa-e8340ffa63c7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:58.532551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:58.534607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:58.535760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:58.536519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:58.542998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:58.720665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:58.727019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:58.743361 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3573/7193] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:58.891587 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:58.962828 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:59.725128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:59.727021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:59.747963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc9074-46b8-41c6-bee9-2c880dc60985 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:59.760002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:59.761500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:59.762043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:59.762768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] PATH_INFO: `/v3/projects/e0cd5f3df3044877bfa18fae5beb9b97` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:59.764375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cd5f3df3044877bfa18fae5beb9b97)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:59.780195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:59.883078 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:59.938363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cd5f3df3044877bfa18fae5beb9b97', 'request_id': 'req-2edb8727-b15a-4727-be14-87afc7a920a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:45:59.948602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cd5f3df3044877bfa18fae5beb9b97', 'request_id': 'req-2edb8727-b15a-4727-be14-87afc7a920a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.105302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cd5f3df3044877bfa18fae5beb9b97', 'request_id': 'req-2edb8727-b15a-4727-be14-87afc7a920a1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.120880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] The token cache is being invalidate because project e0cd5f3df3044877bfa18fae5beb9b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:00.123114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.125744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.136144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:00.136642 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3621/7194] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:45:59 2022] DELETE /identity/v3/projects/e0cd5f3df3044877bfa18fae5beb9b97 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:00.163487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d1311-3299-4df5-99cd-66ec37bd0c22 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:00.263045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:00.264012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:00.264293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:00.264801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] PATH_INFO: `/v3/users/dfaec42ca22d4d21ab9324b3d3d09c83` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:00.266016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfaec42ca22d4d21ab9324b3d3d09c83)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:00.267949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:00.527712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfaec42ca22d4d21ab9324b3d3d09c83'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.544479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfaec42ca22d4d21ab9324b3d3d09c83'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.552991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfaec42ca22d4d21ab9324b3d3d09c83'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.554405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfaec42ca22d4d21ab9324b3d3d09c83'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.622500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cf4a12aa-f10b-4605-aeb4-459361f54955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfaec42ca22d4d21ab9324b3d3d09c83'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:00.629481 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3574/7195] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:00 2022] DELETE /identity/v3/users/dfaec42ca22d4d21ab9324b3d3d09c83 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:00.755084 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:01.420106 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:01.505028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:01.506673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:01.541585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8727-b15a-4727-be14-87afc7a920a1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:01.628464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:01.629115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:01.629401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:01.629736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] PATH_INFO: `/v3/projects/935d5730300545ce9ff664e23b25816c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:01.631032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935d5730300545ce9ff664e23b25816c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:01.634194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:01.774591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935d5730300545ce9ff664e23b25816c', 'request_id': 'req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:01.785789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935d5730300545ce9ff664e23b25816c', 'request_id': 'req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:01.888456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935d5730300545ce9ff664e23b25816c', 'request_id': 'req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:01.907635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] The token cache is being invalidate because project 935d5730300545ce9ff664e23b25816c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:01.908411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:01.909913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fdfd69ce-ece8-427b-a26b-f1ea6b8d5ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:01.912068 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3622/7196] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:01 2022] DELETE /identity/v3/projects/935d5730300545ce9ff664e23b25816c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:01.917609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c497-034e-426e-bf12-1ec1060980b9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:01.918619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c497-034e-426e-bf12-1ec1060980b9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:01.919175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c497-034e-426e-bf12-1ec1060980b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:01.948632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7a18c497-034e-426e-bf12-1ec1060980b9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:01.950305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a18c497-034e-426e-bf12-1ec1060980b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:02.049190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889352cb-0c58-4159-8f00-047b9457cd63 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.049734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889352cb-0c58-4159-8f00-047b9457cd63 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.050314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889352cb-0c58-4159-8f00-047b9457cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.052293 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3575/7197] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:02.091483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-889352cb-0c58-4159-8f00-047b9457cd63 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:02.105135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-889352cb-0c58-4159-8f00-047b9457cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:02.123783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c497-034e-426e-bf12-1ec1060980b9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:02.124368 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3623/7198] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:02.138650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c497-034e-426e-bf12-1ec1060980b9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:02.145677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:02.156178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.156178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.156178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.156178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:46:02.156178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:02.156178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:02.172563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889352cb-0c58-4159-8f00-047b9457cd63 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:02.180045 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3576/7199] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:46:02.184826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889352cb-0c58-4159-8f00-047b9457cd63 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:02.190103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:02.191917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.191917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.191917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.192797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:02.195959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:02.305307 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3624/7200] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:46:02 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:02.309075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:02.324715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b152d0-9c48-4227-8403-afcdd815f4f9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:02.465980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:02.467236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.467525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.467805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.468960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:02.471428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:02.562699 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:02.574680 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3577/7201] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:46:02 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:46:02.575869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:02.591224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25f0ae-6596-480f-949b-c10a7e69880d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:02.598681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:02.599434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.599775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.600056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.601338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:02.603377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:02.614503 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:02.620186 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3625/7202] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:02.623901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:02.639450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb6d50-45d0-44e1-92f3-0cefb06a9782 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:02.648490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d0f8-1b48-4af8-81ba-8faa3c612224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:02.650103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d0f8-1b48-4af8-81ba-8faa3c612224 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.650491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d0f8-1b48-4af8-81ba-8faa3c612224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.650864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d0f8-1b48-4af8-81ba-8faa3c612224 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.654603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9d0f8-1b48-4af8-81ba-8faa3c612224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:02.657247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9d0f8-1b48-4af8-81ba-8faa3c612224 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:02.674196 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3578/7203] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:02.678070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:02.694898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef159-f34e-422e-abe3-b73c6a2b2d27 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:02.709275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:02.711178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.711689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.712212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] PATH_INFO: `/v3/projects/0d8f5d972e604a088a39ce979ff5a87b/users/00721cc49cfc4a53aba7ce81081e3dc5/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.767477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8f5d972e604a088a39ce979ff5a87b, user_id=00721cc49cfc4a53aba7ce81081e3dc5, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:02.772905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:02.877153 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3626/7204] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:02 2022] PUT /identity/v3/projects/0d8f5d972e604a088a39ce979ff5a87b/users/00721cc49cfc4a53aba7ce81081e3dc5/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:46:02.891287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9af6a-5b84-4766-8afb-4aab434004d5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:02.891608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9af6a-5b84-4766-8afb-4aab434004d5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:02.891983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9af6a-5b84-4766-8afb-4aab434004d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:02.983534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-def9af6a-5b84-4766-8afb-4aab434004d5 None None] MFA Rules not processed for user `00721cc49cfc4a53aba7ce81081e3dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:02.985977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-def9af6a-5b84-4766-8afb-4aab434004d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:03.151168 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:03.156447 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3579/7205] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:03.170364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:03.172297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:03.351365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342f1eb-f161-4cae-8a94-bde1cd663c74 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:03.366273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb850d3-62c1-4cfe-a315-199298878756 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:03.366914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb850d3-62c1-4cfe-a315-199298878756 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:03.367343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb850d3-62c1-4cfe-a315-199298878756 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:03.367622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb850d3-62c1-4cfe-a315-199298878756 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:03.389712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb850d3-62c1-4cfe-a315-199298878756 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:03.389712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb850d3-62c1-4cfe-a315-199298878756 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:03.422344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3627/7206] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:03.662378 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:04.373904 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:04.984976 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:05.917469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9af6a-5b84-4766-8afb-4aab434004d5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:05.918969 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:06.020766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9af6a-5b84-4766-8afb-4aab434004d5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:06.027116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:06.028089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:06.029221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:06.029722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] PATH_INFO: `/v3/users/00721cc49cfc4a53aba7ce81081e3dc5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:06.031200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00721cc49cfc4a53aba7ce81081e3dc5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:06.033588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:06.302798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00721cc49cfc4a53aba7ce81081e3dc5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:06.362422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00721cc49cfc4a53aba7ce81081e3dc5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:06.382593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00721cc49cfc4a53aba7ce81081e3dc5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:06.383801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00721cc49cfc4a53aba7ce81081e3dc5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:06.531153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00721cc49cfc4a53aba7ce81081e3dc5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:06.542727 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3580/7207] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:05 2022] DELETE /identity/v3/users/00721cc49cfc4a53aba7ce81081e3dc5 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:06.544509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09b72-72ca-43e9-a194-07fa8d8fa57f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:06.544867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09b72-72ca-43e9-a194-07fa8d8fa57f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:06.545216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09b72-72ca-43e9-a194-07fa8d8fa57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:06.585078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-37d09b72-72ca-43e9-a194-07fa8d8fa57f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:06.586320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-37d09b72-72ca-43e9-a194-07fa8d8fa57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:06.699672 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3628/7208] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:06.739159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:06.740759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:06.870647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9cad-2d7e-42d5-a613-003134b5079d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:06.874476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:06.875109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:06.875395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:06.875670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:06.886797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:06.888449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:06.905536 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3581/7209] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:07.439484 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:07.458079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:07.459053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:07.460380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:07.483931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:07.485760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:07.588892 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3629/7210] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:46:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:07.683193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:07.687477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:07.703214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce7e29-5153-48f7-ba12-899e2b038761 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:07.722268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:07.723180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:07.723700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:07.724040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] PATH_INFO: `/v3/projects/0d8f5d972e604a088a39ce979ff5a87b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:07.725898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8f5d972e604a088a39ce979ff5a87b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:07.728383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:07.739762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:07.741968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:07.851384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8257da-5fee-4041-b227-198b7e2e3bcd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:07.857168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:07.857670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:07.858061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:07.858419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:07.870157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:07.871870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:07.881962 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3630/7211] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:46:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:46:07.908843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8f5d972e604a088a39ce979ff5a87b', 'request_id': 'req-88563e49-3e9c-4d64-9c8a-828fab470602'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:07.914949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8f5d972e604a088a39ce979ff5a87b', 'request_id': 'req-88563e49-3e9c-4d64-9c8a-828fab470602'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:07.980756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:07.994188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a672ae-faf8-4723-93f7-ba236c0da91a service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.008599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8f5d972e604a088a39ce979ff5a87b', 'request_id': 'req-88563e49-3e9c-4d64-9c8a-828fab470602'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:08.029703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] The token cache is being invalidate because project 0d8f5d972e604a088a39ce979ff5a87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:08.030893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:08.032347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-88563e49-3e9c-4d64-9c8a-828fab470602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:08.038124 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3582/7212] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:07 2022] DELETE /identity/v3/projects/0d8f5d972e604a088a39ce979ff5a87b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:08.046049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913213a-611c-48d0-b57a-e7f3d3a0e04e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.046180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913213a-611c-48d0-b57a-e7f3d3a0e04e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.048632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913213a-611c-48d0-b57a-e7f3d3a0e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.060977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d419ed-7b21-4cd1-9fd8-e79438faad9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.062294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d419ed-7b21-4cd1-9fd8-e79438faad9b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.062294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d419ed-7b21-4cd1-9fd8-e79438faad9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.062882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d419ed-7b21-4cd1-9fd8-e79438faad9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.065631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-23d419ed-7b21-4cd1-9fd8-e79438faad9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:08.078631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7913213a-611c-48d0-b57a-e7f3d3a0e04e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:08.079917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7913213a-611c-48d0-b57a-e7f3d3a0e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:08.160696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d419ed-7b21-4cd1-9fd8-e79438faad9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.162995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d419ed-7b21-4cd1-9fd8-e79438faad9b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:08.175181 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3631/7213] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:46:08.189927 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3583/7214] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:08.198550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99c37e-6c5c-476f-8a04-846f49318fe1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.198842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99c37e-6c5c-476f-8a04-846f49318fe1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.199204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99c37e-6c5c-476f-8a04-846f49318fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.221733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-de99c37e-6c5c-476f-8a04-846f49318fe1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:08.222959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-de99c37e-6c5c-476f-8a04-846f49318fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:08.232380 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3632/7215] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:08.238201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913213a-611c-48d0-b57a-e7f3d3a0e04e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:08.251726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913213a-611c-48d0-b57a-e7f3d3a0e04e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.257518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.258750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.259397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.259901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.261383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:46:08.262107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.264412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:08.279195 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3584/7216] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:46:08.284758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99c37e-6c5c-476f-8a04-846f49318fe1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:08.296548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99c37e-6c5c-476f-8a04-846f49318fe1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.307900 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:08.308509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.310035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.310035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.310467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.311251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.315472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:08.487850 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3633/7217] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:46:08 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:46:08.501535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:08.515196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa68ee-dc4e-4b61-8153-5c0f565aa1a0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.515994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:08.517932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:08.638098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.638972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.639352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.639775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.640612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.643344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:08.644911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7fcc-0fc4-46c5-9f37-7fd82ef94586 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.661453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.662320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.662456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.662783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.667971 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:08.675987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:08.793915 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3585/7218] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:46:08 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:08.798425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:08.823069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8399c1-642f-4163-bea5-9eed7195908d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.823607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.827865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:08.829145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.830069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.830537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.831872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.832708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.834683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:08.848691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3586/7219] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:08.852703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:08.860366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3634/7220] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:46:08.868384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad296a4e-2826-48d8-bdaf-c63024d26e65 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.888140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50a76f-2a94-442f-8893-45aa77b29324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.889207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a76f-2a94-442f-8893-45aa77b29324 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.889741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a76f-2a94-442f-8893-45aa77b29324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.890559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a76f-2a94-442f-8893-45aa77b29324 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.891751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50a76f-2a94-442f-8893-45aa77b29324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.893370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50a76f-2a94-442f-8893-45aa77b29324 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:08.910192 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3587/7221] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:08.911521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:08.929695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaba0c-0a6f-44fd-b7c9-9f198d82a2c8 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:08.940370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:08.941053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:08.941336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:08.941613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] PATH_INFO: `/v3/projects/710d96d9456841939c24b84bd82058e0/users/4a5c09adee1741658d4a5ca1bd80eac7/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:08.958999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710d96d9456841939c24b84bd82058e0, user_id=4a5c09adee1741658d4a5ca1bd80eac7, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:08.962756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:09.050407 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3635/7222] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:08 2022] PUT /identity/v3/projects/710d96d9456841939c24b84bd82058e0/users/4a5c09adee1741658d4a5ca1bd80eac7/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:09.060950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:09.061909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:09.062494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:09.129590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] MFA Rules not processed for user `4a5c09adee1741658d4a5ca1bd80eac7`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:09.131846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:09.238081 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3588/7223] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:09.252298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:09.254571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:09.316180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d5ca-bc68-43f5-9017-572d755f1690 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:09.320066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:09.320776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:09.321116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:09.321461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:09.335485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:09.337078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:09.347110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3636/7224] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:10.088488 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:11.088382 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:12.606630 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:13.259629 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:13.543176 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:14.526065 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:15.393915 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:16.379507 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:17.047614 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:18.110032 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:18.416305 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:18.491674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:18.493848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:18.674546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70caf850-55a6-4de6-9957-9e568d6e8da0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:18.685327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca1d9-0bac-4fa1-8eed-2c22c2ca9bbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:18.686049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca1d9-0bac-4fa1-8eed-2c22c2ca9bbd service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:18.688756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca1d9-0bac-4fa1-8eed-2c22c2ca9bbd service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:18.688756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca1d9-0bac-4fa1-8eed-2c22c2ca9bbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:18.689298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0d7ca1d9-0bac-4fa1-8eed-2c22c2ca9bbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:18.721655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca1d9-0bac-4fa1-8eed-2c22c2ca9bbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:18.726989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca1d9-0bac-4fa1-8eed-2c22c2ca9bbd service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:18.773064 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3589/7225] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:20.854728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:20.857188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:21.054668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df83569-dc6f-4848-a7b4-11ed6dc0ceb9 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:21.062790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:21.063725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:21.064173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:21.064611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] PATH_INFO: `/v3/users/b95de2f415d245168e50bb8fcbd9a29a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:21.072944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95de2f415d245168e50bb8fcbd9a29a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:21.075500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:21.301476 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95de2f415d245168e50bb8fcbd9a29a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:21.302231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95de2f415d245168e50bb8fcbd9a29a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:21.315082 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:21.431948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95de2f415d245168e50bb8fcbd9a29a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:21.443593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95de2f415d245168e50bb8fcbd9a29a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:21.444856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95de2f415d245168e50bb8fcbd9a29a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:21.493544 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3637/7226] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:20 2022] DELETE /identity/v3/users/b95de2f415d245168e50bb8fcbd9a29a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:21.498212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:21.498732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:21.498732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:21.548750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:21.550443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:21.624263 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:21.676552 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3590/7227] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:21.699546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:21.702488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:21.851036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c5390-3a04-4bf2-92a9-b379dfe11563 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:21.857098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:21.859453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:21.859921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:21.860374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:21.875640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:21.877365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:21.902630 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3638/7228] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:22.598393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:22.600027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:22.635438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9ff99-adc4-4aea-86eb-5bee9a46e171 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:22.651819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:22.654281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:22.654281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:22.654281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] PATH_INFO: `/v3/projects/00805ee214df42698f3e34f9f9955290` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:22.655820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=00805ee214df42698f3e34f9f9955290)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:22.660500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:22.867984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00805ee214df42698f3e34f9f9955290', 'request_id': 'req-212650d0-8bae-43ad-a908-e620ca43d74e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:22.877084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00805ee214df42698f3e34f9f9955290', 'request_id': 'req-212650d0-8bae-43ad-a908-e620ca43d74e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:22.984874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00805ee214df42698f3e34f9f9955290', 'request_id': 'req-212650d0-8bae-43ad-a908-e620ca43d74e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.000923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] The token cache is being invalidate because project 00805ee214df42698f3e34f9f9955290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:23.001507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.002425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.004327 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3591/7229] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:22 2022] DELETE /identity/v3/projects/00805ee214df42698f3e34f9f9955290 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:23.009348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:23.024538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1ba88-d59a-412a-af67-47cda1e7a96b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:23.160670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:23.161687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:23.163649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:23.164117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] PATH_INFO: `/v3/users/881285360d52423e8d8898a53d66e2fc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:23.165575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881285360d52423e8d8898a53d66e2fc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:23.171493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:23.638575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881285360d52423e8d8898a53d66e2fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.638575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881285360d52423e8d8898a53d66e2fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.724231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881285360d52423e8d8898a53d66e2fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.736430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881285360d52423e8d8898a53d66e2fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.738022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881285360d52423e8d8898a53d66e2fc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:23.749102 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:23.793195 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3639/7230] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:23 2022] DELETE /identity/v3/users/881285360d52423e8d8898a53d66e2fc => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:24.742208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:24.742208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:24.757251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212650d0-8bae-43ad-a908-e620ca43d74e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:24.929533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:24.932929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:24.938185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:24.938588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] PATH_INFO: `/v3/projects/884b92d2a3604550a9f439721ed598fa` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:24.944688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] RBAC: Authorizing `identity:delete_project(project_id=884b92d2a3604550a9f439721ed598fa)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:24.949967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:25.118727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884b92d2a3604550a9f439721ed598fa', 'request_id': 'req-220771ce-2335-4ced-9f48-aa96166f396f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:25.129463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884b92d2a3604550a9f439721ed598fa', 'request_id': 'req-220771ce-2335-4ced-9f48-aa96166f396f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:25.211739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884b92d2a3604550a9f439721ed598fa', 'request_id': 'req-220771ce-2335-4ced-9f48-aa96166f396f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:25.225627 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:25.248955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] The token cache is being invalidate because project 884b92d2a3604550a9f439721ed598fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:25.249209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:25.250201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:25.255071 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3592/7231] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:24 2022] DELETE /identity/v3/projects/884b92d2a3604550a9f439721ed598fa => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:25.268533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:25.270033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:25.308243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3da3c-db9e-4cec-a3d2-587ddfd9bae4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:25.415013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:25.415995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:25.417753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:25.417753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] PATH_INFO: `/v3/users/5d81f9fd10254986b91731c2f0065b79` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:25.418861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d81f9fd10254986b91731c2f0065b79)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:25.421708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:25.853239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d81f9fd10254986b91731c2f0065b79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:25.859651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d81f9fd10254986b91731c2f0065b79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:26.003590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d81f9fd10254986b91731c2f0065b79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:26.017718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d81f9fd10254986b91731c2f0065b79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:26.018641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e07dae7a-32a7-4506-b922-7970c6aa2682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d81f9fd10254986b91731c2f0065b79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:26.064394 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3640/7232] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:25 2022] DELETE /identity/v3/users/5d81f9fd10254986b91731c2f0065b79 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:27.192189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:27.195213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:27.214733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220771ce-2335-4ced-9f48-aa96166f396f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:27.356263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:27.357975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:27.358507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:27.359316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] PATH_INFO: `/v3/projects/000cb9b9873b42999df34a43797ce892` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:27.367302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000cb9b9873b42999df34a43797ce892)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:27.370172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:27.556477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000cb9b9873b42999df34a43797ce892', 'request_id': 'req-d31a4c03-3dc3-4f34-af6e-de833cffcb99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:27.567066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000cb9b9873b42999df34a43797ce892', 'request_id': 'req-d31a4c03-3dc3-4f34-af6e-de833cffcb99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:27.727011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000cb9b9873b42999df34a43797ce892', 'request_id': 'req-d31a4c03-3dc3-4f34-af6e-de833cffcb99'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:27.741396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] The token cache is being invalidate because project 000cb9b9873b42999df34a43797ce892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:27.741942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:27.742419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d31a4c03-3dc3-4f34-af6e-de833cffcb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:27.753398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b589-2dc6-4cf0-ac16-f9f70e8ec3f3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:27.753398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b589-2dc6-4cf0-ac16-f9f70e8ec3f3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:27.753398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889b589-2dc6-4cf0-ac16-f9f70e8ec3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:27.758259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3593/7233] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:27 2022] DELETE /identity/v3/projects/000cb9b9873b42999df34a43797ce892 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:27.773272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4889b589-2dc6-4cf0-ac16-f9f70e8ec3f3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:27.774703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4889b589-2dc6-4cf0-ac16-f9f70e8ec3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:27.848329 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3641/7234] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:27.858288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe08a-8619-4a8c-af66-71e5a14e28cb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:27.859816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe08a-8619-4a8c-af66-71e5a14e28cb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:27.859816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbe08a-8619-4a8c-af66-71e5a14e28cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:27.886003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-67dbe08a-8619-4a8c-af66-71e5a14e28cb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:27.886003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67dbe08a-8619-4a8c-af66-71e5a14e28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:27.899703 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3594/7235] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:46:27.904529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889b589-2dc6-4cf0-ac16-f9f70e8ec3f3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:27.921455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889b589-2dc6-4cf0-ac16-f9f70e8ec3f3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:27.928753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:27.929331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:27.929579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:27.930344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:27.931808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:46:27.932301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:27.946543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:27.954324 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:27.967482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbe08a-8619-4a8c-af66-71e5a14e28cb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:27.967732 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3642/7236] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:46:27.979425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbe08a-8619-4a8c-af66-71e5a14e28cb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:27.984882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:27.985628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:27.986040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:27.986415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:27.987641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:27.989851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:28.109556 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3595/7237] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:46:27 2022] POST /identity/v3/projects => generated 407 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:46:28.113943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:28.128827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d27a1-eb73-44c7-9c30-a0b0b8f94f56 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:28.203320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:28.203948 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:28.204232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:28.204504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:28.205141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:28.208353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:28.372638 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3643/7238] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:46:28 2022] POST /identity/v3/users => generated 304 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:28.377224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:28.400994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fd828-9d1a-4247-9327-0c7716c7b26e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:28.400994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:28.400994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:28.400994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:28.403325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:28.405193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:28.407162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:28.451566 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3596/7239] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:46:28.459444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:28.477769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a67df-96de-417e-901f-b8f17b83f8e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:28.483908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b91323-903f-4268-b7c5-436245f76d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:28.488367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b91323-903f-4268-b7c5-436245f76d51 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:28.488367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b91323-903f-4268-b7c5-436245f76d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:28.488367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b91323-903f-4268-b7c5-436245f76d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:28.488367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b91323-903f-4268-b7c5-436245f76d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:28.488367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b91323-903f-4268-b7c5-436245f76d51 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:28.506825 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3644/7240] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:28.511372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:28.522077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d47ab-4fa3-4327-a9c7-4642c85082bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:28.536501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:28.540196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:28.540196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:28.540196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] PATH_INFO: `/v3/projects/becdf55ce5a1467087fb9107b98e43bd/users/d2bec496c94f4bd2af5ed12372634e57/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:28.574743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becdf55ce5a1467087fb9107b98e43bd, user_id=d2bec496c94f4bd2af5ed12372634e57, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:28.613940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:28.784543 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3597/7241] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:28 2022] PUT /identity/v3/projects/becdf55ce5a1467087fb9107b98e43bd/users/d2bec496c94f4bd2af5ed12372634e57/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:28.795783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80b6b-7a28-43b7-9ae7-48aca9326773 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:28.796272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80b6b-7a28-43b7-9ae7-48aca9326773 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:28.796378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80b6b-7a28-43b7-9ae7-48aca9326773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:28.841736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e2b80b6b-7a28-43b7-9ae7-48aca9326773 None None] MFA Rules not processed for user `d2bec496c94f4bd2af5ed12372634e57`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:28.843585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e2b80b6b-7a28-43b7-9ae7-48aca9326773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:28.945838 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3645/7242] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:28 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:28.949276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:28.986990 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:29.050513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed4af-3af2-4518-b11d-a0179b90cd37 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:29.057047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:29.057782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:29.058365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:29.058804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:29.059454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:29.062148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:29.277190 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3598/7243] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:46:28 2022] POST /identity/v3/projects => generated 407 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:29.280965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80b6b-7a28-43b7-9ae7-48aca9326773 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:29.301315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80b6b-7a28-43b7-9ae7-48aca9326773 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:29.466290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:29.467178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:29.471211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:29.475858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:29.476583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:29.485368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:29.608388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3646/7244] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:46:29 2022] POST /identity/v3/users => generated 310 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:29.612252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:29.630273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ba18b-1fa5-4215-a612-afe46d4d10e6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:29.636871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:29.637840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:29.638350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:29.638862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:29.639801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:29.642168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:29.661460 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3599/7245] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:46:29.667181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:29.681519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5da85a-48eb-41f3-9eb5-7ed88292a8b4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:29.690818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:29.691224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:29.692391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:29.692795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] PATH_INFO: `/v3/projects/bc97645ee8ca4aa897998b944fdca86e/users/dc175aad823343539a4ff1599b246944/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:29.731752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc97645ee8ca4aa897998b944fdca86e, user_id=dc175aad823343539a4ff1599b246944, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:29.743853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:29.836653 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3647/7246] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:29 2022] PUT /identity/v3/projects/bc97645ee8ca4aa897998b944fdca86e/users/dc175aad823343539a4ff1599b246944/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:29.845970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:29.860527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567649-e303-4bef-a1d0-54cc480b0f9b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:29.992997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a139f5-b844-42d3-8653-dcac6e29f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:29.993288 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:29.994852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a139f5-b844-42d3-8653-dcac6e29f530 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:29.995639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a139f5-b844-42d3-8653-dcac6e29f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:29.996523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a139f5-b844-42d3-8653-dcac6e29f530 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:29.997354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a139f5-b844-42d3-8653-dcac6e29f530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:30.000146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a139f5-b844-42d3-8653-dcac6e29f530 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:30.030126 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3600/7247] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:30.044434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:30.063833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1afc9d-5eda-48f4-bf29-b92be05a1500 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:30.072938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:30.074433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:30.083754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:30.083754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] PATH_INFO: `/v3/projects/bc97645ee8ca4aa897998b944fdca86e/users/dc175aad823343539a4ff1599b246944/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:30.083754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc97645ee8ca4aa897998b944fdca86e, user_id=dc175aad823343539a4ff1599b246944, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:30.083754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:30.093401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3648/7248] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:30 2022] PUT /identity/v3/projects/bc97645ee8ca4aa897998b944fdca86e/users/dc175aad823343539a4ff1599b246944/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:30.105000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:30.105347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:30.105561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:30.161087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] MFA Rules not processed for user `dc175aad823343539a4ff1599b246944`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:30.163324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:30.279485 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3601/7249] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:30 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:30.296911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:30.299469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:30.466101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f64d3-1df6-4c8f-8964-b39da2d461bb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:30.472686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:30.473544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:30.474126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:30.475419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:30.629305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:30.636458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:30.651639 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3649/7250] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:30 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:33.669913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:33.674284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:33.756961 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:33.850132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba725d4e-12c3-4469-a61a-33b64b1584e4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:33.859243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2d623-59b1-4d86-b543-ef39469c44bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:33.859904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2d623-59b1-4d86-b543-ef39469c44bb service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:33.860350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2d623-59b1-4d86-b543-ef39469c44bb service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:33.860475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2d623-59b1-4d86-b543-ef39469c44bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:33.892317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2d623-59b1-4d86-b543-ef39469c44bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:33.893988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2d623-59b1-4d86-b543-ef39469c44bb service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:33.922218 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3602/7251] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:33 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:37.627015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:37.628036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:37.739444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a044fca-ff88-437d-ad92-0d5fa9213743 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:37.744868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:37.745523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:37.745847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:37.746112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] PATH_INFO: `/v3/users/4a5c09adee1741658d4a5ca1bd80eac7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:37.750543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5c09adee1741658d4a5ca1bd80eac7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:37.752746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:37.790411 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:38.028302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5c09adee1741658d4a5ca1bd80eac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:38.030981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5c09adee1741658d4a5ca1bd80eac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:38.101927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5c09adee1741658d4a5ca1bd80eac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:38.110967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5c09adee1741658d4a5ca1bd80eac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:38.112251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5c09adee1741658d4a5ca1bd80eac7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:38.144906 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3650/7252] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:37 2022] DELETE /identity/v3/users/4a5c09adee1741658d4a5ca1bd80eac7 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:38.150182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:38.150767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:38.150767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:38.172832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:38.174356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:38.249155 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3603/7253] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:38.259997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:38.261603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:38.352800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae6da-9e3e-4692-8ac2-da2db6d05328 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:38.359938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e27aa-eff7-45c3-a024-224ee16dd92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:38.360635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e27aa-eff7-45c3-a024-224ee16dd92e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:38.361415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e27aa-eff7-45c3-a024-224ee16dd92e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:38.361961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e27aa-eff7-45c3-a024-224ee16dd92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:38.392068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e27aa-eff7-45c3-a024-224ee16dd92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:38.394621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e27aa-eff7-45c3-a024-224ee16dd92e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:38.438169 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3651/7254] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:46:38.919189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:38.919738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:38.976245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d98e17-7c46-4143-a2eb-53ed4ff809c0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:38.985169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:38.986579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:38.987528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:38.988043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] PATH_INFO: `/v3/projects/710d96d9456841939c24b84bd82058e0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:38.990656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710d96d9456841939c24b84bd82058e0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:38.993323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:39.225010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710d96d9456841939c24b84bd82058e0', 'request_id': 'req-9ddafc67-cc3b-478e-a3ce-388050ecce33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:39.241484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710d96d9456841939c24b84bd82058e0', 'request_id': 'req-9ddafc67-cc3b-478e-a3ce-388050ecce33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:39.415706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710d96d9456841939c24b84bd82058e0', 'request_id': 'req-9ddafc67-cc3b-478e-a3ce-388050ecce33'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:39.480727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] The token cache is being invalidate because project 710d96d9456841939c24b84bd82058e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:39.481876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:39.485410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ddafc67-cc3b-478e-a3ce-388050ecce33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:39.491075 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3604/7255] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:38 2022] DELETE /identity/v3/projects/710d96d9456841939c24b84bd82058e0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:39.496272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ba5f-e302-45d5-938a-cc5555a6b4e2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:39.496835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ba5f-e302-45d5-938a-cc5555a6b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:39.496835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ba5f-e302-45d5-938a-cc5555a6b4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:39.535230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-64d3ba5f-e302-45d5-938a-cc5555a6b4e2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:39.540043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-64d3ba5f-e302-45d5-938a-cc5555a6b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:39.745352 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3652/7256] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:39.753068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2c31-de0f-43ef-b523-b7b654b4ffba None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:39.753352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2c31-de0f-43ef-b523-b7b654b4ffba None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:39.753770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2c31-de0f-43ef-b523-b7b654b4ffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:39.792963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-548e2c31-de0f-43ef-b523-b7b654b4ffba None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:39.794630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-548e2c31-de0f-43ef-b523-b7b654b4ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:39.805143 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3605/7257] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:39.809301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ba5f-e302-45d5-938a-cc5555a6b4e2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:39.827694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ba5f-e302-45d5-938a-cc5555a6b4e2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:39.840764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:39.840764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:39.840764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:39.840764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:39.841373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:46:39.841373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:39.842059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:39.871665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2c31-de0f-43ef-b523-b7b654b4ffba None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:39.893801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3653/7258] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:46:39.894086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2c31-de0f-43ef-b523-b7b654b4ffba None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:39.940080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:39.940655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:39.940932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:39.941211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:39.941884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:39.947627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:40.119370 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:40.127660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3606/7259] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:46:39 2022] POST /identity/v3/projects => generated 361 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:40.131226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:40.142994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837289b-1c24-41e2-9cb2-226f09a8f951 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:40.170201 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:40.243515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:40.248389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:40.248389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:40.248389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:40.248389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:40.248389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:40.382565 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3654/7260] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:46:40 2022] POST /identity/v3/users => generated 281 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:46:40.386491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:40.406047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15ccf9-e902-4fbd-8733-57cd4a40c69d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:40.412713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:40.413355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:40.413634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:40.413939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:40.414943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:40.416863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:40.436888 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3607/7261] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:40.440775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:40.455887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d26b38-507f-494c-9fd4-e3544302e9dc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:40.463861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e7032-682b-4d0a-9e3a-04b2e9976aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:40.464875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7032-682b-4d0a-9e3a-04b2e9976aba admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:40.465330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7032-682b-4d0a-9e3a-04b2e9976aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:40.466026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e7032-682b-4d0a-9e3a-04b2e9976aba admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:40.467325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e7032-682b-4d0a-9e3a-04b2e9976aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:40.469331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e7032-682b-4d0a-9e3a-04b2e9976aba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:40.513417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3655/7262] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:46:40.517496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:40.529629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef922-25a1-4829-903b-b11e69123c56 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:40.558625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:40.560963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:40.561450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:40.562641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] PATH_INFO: `/v3/projects/e98fdec916784651a70a11e78d157066/users/15b2d6f1b9a847a5bb42d7feebf47e4e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:40.611803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98fdec916784651a70a11e78d157066, user_id=15b2d6f1b9a847a5bb42d7feebf47e4e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:40.617491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:40.709195 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3608/7263] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:40 2022] PUT /identity/v3/projects/e98fdec916784651a70a11e78d157066/users/15b2d6f1b9a847a5bb42d7feebf47e4e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:40.719629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:40.720037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:40.721210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:40.779004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] MFA Rules not processed for user `15b2d6f1b9a847a5bb42d7feebf47e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:40.779004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:40.932020 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3656/7264] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:40.949654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:40.951758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:41.084906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309b822-15f6-4e10-b4a3-c37fa1009a16 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:41.104293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f4aaa-5fbf-4e5b-b4f3-36924c6d22be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:41.104293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4aaa-5fbf-4e5b-b4f3-36924c6d22be service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:41.104293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4aaa-5fbf-4e5b-b4f3-36924c6d22be service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:41.104293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f4aaa-5fbf-4e5b-b4f3-36924c6d22be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:41.113191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f4aaa-5fbf-4e5b-b4f3-36924c6d22be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:41.116950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f4aaa-5fbf-4e5b-b4f3-36924c6d22be service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:41.129923 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3609/7265] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:46.450152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:46.452435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:46.570060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd7f55-000d-42f4-a537-3475e5576e2a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:46.582895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:46.583721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:46.584016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:46.584526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] PATH_INFO: `/v3/users/d2bec496c94f4bd2af5ed12372634e57` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:46.585748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bec496c94f4bd2af5ed12372634e57)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:46.588091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:46.868259 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:46.887607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bec496c94f4bd2af5ed12372634e57'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:46.888345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bec496c94f4bd2af5ed12372634e57'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:47.010336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bec496c94f4bd2af5ed12372634e57'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:47.026501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bec496c94f4bd2af5ed12372634e57'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:47.027675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bec496c94f4bd2af5ed12372634e57'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:47.061848 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3657/7266] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:46 2022] DELETE /identity/v3/users/d2bec496c94f4bd2af5ed12372634e57 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:47.068241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:47.068829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:47.068829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:47.097704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:47.099974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:47.191777 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3610/7267] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:47.203373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:47.204852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:47.304245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9787e69-a809-42d7-b1bf-01b95bdb52fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:47.308030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:47.308683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:47.308964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:47.309237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:47.319639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:47.321090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:47.349499 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3658/7268] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:47.828242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:47.830481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:47.851587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0d69b-4e2c-4f7d-bc65-eb24fe7937c0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:47.872652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:47.873413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:47.873738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:47.874136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] PATH_INFO: `/v3/projects/becdf55ce5a1467087fb9107b98e43bd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:47.875359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=becdf55ce5a1467087fb9107b98e43bd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:47.877390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:48.020204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becdf55ce5a1467087fb9107b98e43bd', 'request_id': 'req-2a27aab8-3089-477b-9902-b7888c899004'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.026188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becdf55ce5a1467087fb9107b98e43bd', 'request_id': 'req-2a27aab8-3089-477b-9902-b7888c899004'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.030094 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:48.097713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becdf55ce5a1467087fb9107b98e43bd', 'request_id': 'req-2a27aab8-3089-477b-9902-b7888c899004'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.112786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] The token cache is being invalidate because project becdf55ce5a1467087fb9107b98e43bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:48.113279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.114012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.116531 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3611/7269] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:47 2022] DELETE /identity/v3/projects/becdf55ce5a1467087fb9107b98e43bd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:48.120646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:48.147099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b0f33-d3cc-4cb6-8c3a-ffa2b6726ff1 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:48.241391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:48.242544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:48.242917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:48.243403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] PATH_INFO: `/v3/users/dc175aad823343539a4ff1599b246944` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:48.244589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc175aad823343539a4ff1599b246944)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:48.246617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:48.504236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc175aad823343539a4ff1599b246944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.506575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc175aad823343539a4ff1599b246944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.598119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc175aad823343539a4ff1599b246944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.612028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc175aad823343539a4ff1599b246944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.613284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f2960751-0889-4473-a41f-90e085d1414b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc175aad823343539a4ff1599b246944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:48.665218 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3659/7270] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:46:48 2022] DELETE /identity/v3/users/dc175aad823343539a4ff1599b246944 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:49.029931 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:49.180303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:49.182736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:49.208440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27aab8-3089-477b-9902-b7888c899004 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:49.311661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:49.312461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:49.312803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:49.313223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] PATH_INFO: `/v3/projects/bc97645ee8ca4aa897998b944fdca86e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:49.314727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc97645ee8ca4aa897998b944fdca86e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:49.316759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:49.558161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc97645ee8ca4aa897998b944fdca86e', 'request_id': 'req-5cda552a-b7de-4817-b76f-6a2b174683b6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:49.570335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc97645ee8ca4aa897998b944fdca86e', 'request_id': 'req-5cda552a-b7de-4817-b76f-6a2b174683b6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:49.644165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc97645ee8ca4aa897998b944fdca86e', 'request_id': 'req-5cda552a-b7de-4817-b76f-6a2b174683b6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:49.662037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] The token cache is being invalidate because project bc97645ee8ca4aa897998b944fdca86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:46:49.662751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:49.663695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5cda552a-b7de-4817-b76f-6a2b174683b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:46:49.666117 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3612/7271] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:46:49 2022] DELETE /identity/v3/projects/bc97645ee8ca4aa897998b944fdca86e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:49.671774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf6c03-0a0c-495c-8fab-7471852430b9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:49.671774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf6c03-0a0c-495c-8fab-7471852430b9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:49.671774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf6c03-0a0c-495c-8fab-7471852430b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:49.707605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0aaf6c03-0a0c-495c-8fab-7471852430b9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:49.711351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0aaf6c03-0a0c-495c-8fab-7471852430b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:49.815376 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3660/7272] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:49.824457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067f4b-f702-4d11-a9d1-31dca14166ec None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:49.825441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067f4b-f702-4d11-a9d1-31dca14166ec None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:49.825842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067f4b-f702-4d11-a9d1-31dca14166ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:49.865951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e2067f4b-f702-4d11-a9d1-31dca14166ec None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:49.867764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e2067f4b-f702-4d11-a9d1-31dca14166ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:49.888591 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3613/7273] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:49.892458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf6c03-0a0c-495c-8fab-7471852430b9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:49.911337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf6c03-0a0c-495c-8fab-7471852430b9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:49.926293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:49.927143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:49.927538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:49.928168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:49.928864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:46:49.929236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:49.931144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:49.947410 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3661/7274] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:46:49.953645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2067f4b-f702-4d11-a9d1-31dca14166ec None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:49.967677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2067f4b-f702-4d11-a9d1-31dca14166ec None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:49.974872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:49.975656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:49.976338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:49.976684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:49.977540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:49.979790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:50.095317 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3614/7275] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:46:49 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:50.101075 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:50.112898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa25f-def8-4eaa-98d9-f032ca504c40 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:50.186997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:50.187545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:50.188528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:50.188528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:50.188997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:50.191300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:50.398818 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3662/7276] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:46:50 2022] POST /identity/v3/users => generated 284 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:50.400139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:50.431458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506049c-0560-465d-916a-f0a33095c399 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:50.438621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:50.439254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:50.439536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:50.439813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:50.440467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:50.442254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:50.455602 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3615/7277] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:50.466262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:50.476932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45892a84-86bc-414b-b4a4-4585023dd117 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:50.488657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964598e9-8134-4c5b-a26a-fc3588e3f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:50.489447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964598e9-8134-4c5b-a26a-fc3588e3f7cf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:50.490010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964598e9-8134-4c5b-a26a-fc3588e3f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:50.490373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964598e9-8134-4c5b-a26a-fc3588e3f7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:50.491193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964598e9-8134-4c5b-a26a-fc3588e3f7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:50.492971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964598e9-8134-4c5b-a26a-fc3588e3f7cf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:50.509856 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3663/7278] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:50.512921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:50.550167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90ed92-3282-42c0-ae34-1e98d5f20a3a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:50.563372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:50.564077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:50.564364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:50.564647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] PATH_INFO: `/v3/projects/55a79b6a03bb4bb2a0d295a968f666e8/users/038f64dccd434957b208cd2212a14da2/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:50.600914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a79b6a03bb4bb2a0d295a968f666e8, user_id=038f64dccd434957b208cd2212a14da2, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:50.605091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:50.712106 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3616/7279] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:50 2022] PUT /identity/v3/projects/55a79b6a03bb4bb2a0d295a968f666e8/users/038f64dccd434957b208cd2212a14da2/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:46:50.722168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a969-0f80-41b9-9a5b-7af9f9575603 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:50.722757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a969-0f80-41b9-9a5b-7af9f9575603 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:50.722757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a969-0f80-41b9-9a5b-7af9f9575603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:50.788816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a1f1a969-0f80-41b9-9a5b-7af9f9575603 None None] MFA Rules not processed for user `038f64dccd434957b208cd2212a14da2`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:50.790134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1f1a969-0f80-41b9-9a5b-7af9f9575603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:50.936634 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3664/7280] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:46:50.937822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:50.947427 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:50.977865 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:51.072230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1541c4-3dd7-42c2-b1c5-5058802fc3ec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:51.083793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:51.087750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:51.088943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:51.089331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:51.091496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:51.097342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:51.249457 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3617/7281] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:46:50 2022] POST /identity/v3/projects => generated 367 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:46:51.253170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a969-0f80-41b9-9a5b-7af9f9575603 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:51.271256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a969-0f80-41b9-9a5b-7af9f9575603 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:51.361612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:51.362419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:51.362802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:51.363151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:51.363884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:51.366801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:51.445269 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3665/7282] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:46:51 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:46:51.448320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:51.464806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68739927-2ea2-44a2-85cf-3996d6f2d9d2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:51.486606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:51.487263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:51.487552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:51.487833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:51.488495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:51.490695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:51.529313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:51.529762 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3618/7283] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:51.558024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c3bd-67b5-41ce-9f82-6b81bc289d28 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:51.579939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:51.580643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:51.580927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:51.581253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] PATH_INFO: `/v3/projects/1a119184aac84fbcb6d5b83c40422dc9/users/c469d77567754fd184418fb04eda4a02/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:51.628630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a119184aac84fbcb6d5b83c40422dc9, user_id=c469d77567754fd184418fb04eda4a02, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:51.631562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:51.741924 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3666/7284] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:51 2022] PUT /identity/v3/projects/1a119184aac84fbcb6d5b83c40422dc9/users/c469d77567754fd184418fb04eda4a02/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:46:51.745536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:51.762175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2447a-c10f-4cff-852f-99b64dea37a6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:51.853897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced072b-d26f-4c29-b4a8-66709204d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:51.854808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced072b-d26f-4c29-b4a8-66709204d767 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:51.855256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced072b-d26f-4c29-b4a8-66709204d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:51.855726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced072b-d26f-4c29-b4a8-66709204d767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:51.856603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced072b-d26f-4c29-b4a8-66709204d767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:51.858610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced072b-d26f-4c29-b4a8-66709204d767 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:51.871804 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3619/7285] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:46:51.875945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:51.889678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ea50-87b4-4798-98db-c1841c7a58a8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:51.898507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:51.899553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:51.902114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:51.902114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] PATH_INFO: `/v3/projects/1a119184aac84fbcb6d5b83c40422dc9/users/c469d77567754fd184418fb04eda4a02/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:51.903353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a119184aac84fbcb6d5b83c40422dc9, user_id=c469d77567754fd184418fb04eda4a02, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:51.906354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:51.930406 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3667/7286] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:46:51 2022] PUT /identity/v3/projects/1a119184aac84fbcb6d5b83c40422dc9/users/c469d77567754fd184418fb04eda4a02/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:46:51.936570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8912de-5708-4a6f-8fb8-cef42905d591 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:51.936570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8912de-5708-4a6f-8fb8-cef42905d591 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:51.936570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8912de-5708-4a6f-8fb8-cef42905d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:51.968905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ee8912de-5708-4a6f-8fb8-cef42905d591 None None] MFA Rules not processed for user `c469d77567754fd184418fb04eda4a02`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:51.972800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee8912de-5708-4a6f-8fb8-cef42905d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:52.101120 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3620/7287] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:46:52.111719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:52.113644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:52.266224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bd436-cd95-4200-9065-6c59616c9c6d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:52.286049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:52.286735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:52.287066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:52.287298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:52.310220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:52.310220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:52.310220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:52.313670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:52.315162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:52.332408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:46:52.337339 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3668/7288] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:52.351181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:52.481156 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3621/7289] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:46:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:46:52.653644 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:53.502989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:53.519024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb368e4-179b-4727-bdfd-a94a967b49e9 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:53.533387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:53.534092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:53.534465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:53.534786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:53.546755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:53.586518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:53.588114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:53.621673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3669/7290] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:57.008558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:57.010190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:57.100633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082e504-0751-4d7b-ab24-84b3a7be4386 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:57.106468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:57.107242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:57.107639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:57.107919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:57.110171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:57.125625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:57.130504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:57.141118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3622/7291] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:46:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:46:57.531856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:46:57.533357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:57.551777 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:57.716614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3237a-0b81-42c7-b711-863146bcbe05 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:46:57.724592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:46:57.727902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:46:57.728377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:46:57.728875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:46:57.734343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:46:57.927155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:46:57.935662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:46:57.976470 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3670/7292] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:46:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:47:05.777284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:05.780120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:06.082230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d464a6-6eb1-4e19-a6b2-20e65b4ea108 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:06.159417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:06.165455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:06.168459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:06.168459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:06.173641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:06.260784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:06.260784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:06.328442 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3623/7293] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:08.117012 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=52 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:09.819186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:09.845444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20691da-86c0-4ba8-a302-4b71a9886de0 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:09.888826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c469d77567754fd184418fb04eda4a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a119184aac84fbcb6d5b83c40422dc9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:09.889795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:09.891499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:09.893455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:09.894363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:47:09.894865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:09.896728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:09.915967 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3671/7294] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:47:09.920835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:09.934383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f206c-ebc4-4e8b-9632-676e8b12cccb service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:09.940038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c469d77567754fd184418fb04eda4a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a119184aac84fbcb6d5b83c40422dc9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:09.940739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:09.941113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:09.941467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:09.942522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:09.944748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:10.118629 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3624/7295] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:47:09 2022] POST /identity/v3/projects => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:47:10.119816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:10.131155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf83e7-ac4f-46dc-8920-d5d0302c7b10 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:10.229187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c469d77567754fd184418fb04eda4a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a119184aac84fbcb6d5b83c40422dc9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:10.229516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:10.230029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:10.230409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:10.231176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:47:10.231585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:10.234855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:10.251683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3672/7296] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:47:11.063756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:11.065754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:11.090461 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:11.197011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3471-2a68-453e-9449-69f759869e68 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:11.203853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:11.204723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:11.207568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:11.207568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] PATH_INFO: `/v3/users/0d96a4b20a51415f8cb428c057f84515` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:11.208336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d96a4b20a51415f8cb428c057f84515)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:11.210330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:11.240951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:11.254053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ead04-0217-443a-9ec4-64965c208276 tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:11.258898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c469d77567754fd184418fb04eda4a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a119184aac84fbcb6d5b83c40422dc9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:11.259569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:11.259858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:11.260145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] PATH_INFO: `/v3/projects/9dad30c504aa4b2c960eb13724b4fd62` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:11.261573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9dad30c504aa4b2c960eb13724b4fd62)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:11.264030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:11.509255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d96a4b20a51415f8cb428c057f84515'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.511419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dad30c504aa4b2c960eb13724b4fd62', 'request_id': 'req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.517745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dad30c504aa4b2c960eb13724b4fd62', 'request_id': 'req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.521384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d96a4b20a51415f8cb428c057f84515'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.528399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d96a4b20a51415f8cb428c057f84515'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.529140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d96a4b20a51415f8cb428c057f84515'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.608875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dad30c504aa4b2c960eb13724b4fd62', 'request_id': 'req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.621166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] The token cache is being invalidate because project 9dad30c504aa4b2c960eb13724b4fd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:47:11.621461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.622139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897e0beb-8c7c-4c9f-b1bd-20d5a341e92e tempest-RoutersAdminTest-523395093 tempest-RoutersAdminTest-523395093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.623684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3673/7297] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:47:11 2022] DELETE /identity/v3/projects/9dad30c504aa4b2c960eb13724b4fd62 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:47:11.631495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa4b7-d28f-4413-b5a0-bbb2255a22a8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:11.631881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa4b7-d28f-4413-b5a0-bbb2255a22a8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:11.632255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa4b7-d28f-4413-b5a0-bbb2255a22a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:11.652957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2c3fa4b7-d28f-4413-b5a0-bbb2255a22a8 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:11.654247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c3fa4b7-d28f-4413-b5a0-bbb2255a22a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:11.660222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d96a4b20a51415f8cb428c057f84515'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:11.667926 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3625/7298] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:47:11 2022] DELETE /identity/v3/users/0d96a4b20a51415f8cb428c057f84515 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:47:11.669029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:11.670645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:11.728404 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3674/7299] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:47:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:11.729663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:11.730093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:11.730376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:11.742142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a47434-6e62-4d84-99d7-b62a186bdeb3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:11.746157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:11.747105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:11.747593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:11.748049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:11.750600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:11.751208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:11.752807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:11.759575 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:11.843968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:11.847383 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3675/7300] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:11.847528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:11.857444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:11.859005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:11.866893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3626/7301] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:11.876176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3f1f0-89f3-4e6a-9bc7-1e5916bf5a32 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:11.886040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:11.886040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:11.886271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:11.886551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:11.896731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:11.898358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:11.900941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:11.902844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:11.932109 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3676/7302] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:11.986396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f7a8d-5a68-4013-bf8b-45f4e452cbb2 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:11.992209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee137054-1926-4ee3-aa96-7716a9a8c72e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:11.992823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137054-1926-4ee3-aa96-7716a9a8c72e service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:11.993334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137054-1926-4ee3-aa96-7716a9a8c72e service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:11.993334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137054-1926-4ee3-aa96-7716a9a8c72e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:12.026558 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:12.074186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee137054-1926-4ee3-aa96-7716a9a8c72e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:12.075935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee137054-1926-4ee3-aa96-7716a9a8c72e service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:12.085285 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3627/7303] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:47:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:47:12.356906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:12.358458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:12.379754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85d49-4b9b-44e8-9357-28c4eb50b42b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:12.392168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:12.393031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:12.393492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:12.393969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] PATH_INFO: `/v3/projects/ced2e395e85046afa9dacded5ce03e68` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:12.397927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced2e395e85046afa9dacded5ce03e68)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:12.400273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:12.610024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced2e395e85046afa9dacded5ce03e68', 'request_id': 'req-6f31959c-3639-4454-a702-3129bb4317fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:12.619267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced2e395e85046afa9dacded5ce03e68', 'request_id': 'req-6f31959c-3639-4454-a702-3129bb4317fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:12.732164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced2e395e85046afa9dacded5ce03e68', 'request_id': 'req-6f31959c-3639-4454-a702-3129bb4317fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:12.747907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] The token cache is being invalidate because project ced2e395e85046afa9dacded5ce03e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:47:12.748477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:12.752080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6f31959c-3639-4454-a702-3129bb4317fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:12.752517 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3677/7304] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:47:12 2022] DELETE /identity/v3/projects/ced2e395e85046afa9dacded5ce03e68 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:47:12.758561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e737f-a80e-4540-8d98-2fe210158f2d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:12.759084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e737f-a80e-4540-8d98-2fe210158f2d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:12.759515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e737f-a80e-4540-8d98-2fe210158f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:12.784137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-291e737f-a80e-4540-8d98-2fe210158f2d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:12.785066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-291e737f-a80e-4540-8d98-2fe210158f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:12.909361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9fac-4d5a-44fb-b7a7-9000f4a0a960 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:12.910061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9fac-4d5a-44fb-b7a7-9000f4a0a960 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:12.911085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9fac-4d5a-44fb-b7a7-9000f4a0a960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:12.920246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3628/7305] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:12.962760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-53ce9fac-4d5a-44fb-b7a7-9000f4a0a960 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:12.964662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-53ce9fac-4d5a-44fb-b7a7-9000f4a0a960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:12.977325 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3678/7306] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:12.982807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e737f-a80e-4540-8d98-2fe210158f2d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:12.995577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e737f-a80e-4540-8d98-2fe210158f2d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:13.002215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:13.003363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:13.003880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:13.005169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:13.006136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:47:13.006650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:13.009399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:13.032527 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3629/7307] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:47:13.035797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9fac-4d5a-44fb-b7a7-9000f4a0a960 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:13.060238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9fac-4d5a-44fb-b7a7-9000f4a0a960 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:13.072099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:13.075767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:13.075767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:13.075767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:13.075767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:13.077333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:13.182513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:13.195618 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3679/7308] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:47:13 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:47:13.199961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83db885-463e-4222-b86f-867a4e253b58 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:13.274980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:13.276847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:13.277348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:13.277825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:13.278636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:13.281659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:13.388176 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3630/7309] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:47:13 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:47:13.392573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:13.433951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934bde3-0acd-4750-9347-6cb73bb8bec0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:13.453641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:13.456130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:13.456130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:13.458972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:13.459800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:13.461935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:13.481181 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3680/7310] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:47:13.482382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:13.499630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602652c-4e3e-43fe-92ab-67c7f9be578a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:13.507041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb6e2-4386-4410-9bbb-cd401f08aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:13.508061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb6e2-4386-4410-9bbb-cd401f08aff5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:13.508626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb6e2-4386-4410-9bbb-cd401f08aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:13.509113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb6e2-4386-4410-9bbb-cd401f08aff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:13.510053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb6e2-4386-4410-9bbb-cd401f08aff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:13.511954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb6e2-4386-4410-9bbb-cd401f08aff5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:13.529933 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3631/7311] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:47:13.536264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:13.555366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e566-eca8-4c6e-af4c-0f84daf426f1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:13.583983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:13.584815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:13.585321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:13.585827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] PATH_INFO: `/v3/projects/f0fad388e17f438dbc9783e86d13206d/users/67d82c40cc464a268bc293980b664075/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:13.619730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fad388e17f438dbc9783e86d13206d, user_id=67d82c40cc464a268bc293980b664075, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:13.622932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:13.649382 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:13.714366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3681/7312] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:47:13 2022] PUT /identity/v3/projects/f0fad388e17f438dbc9783e86d13206d/users/67d82c40cc464a268bc293980b664075/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:47:13.731820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae697503-b8c7-45bc-97ea-8a2d9677665b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:13.732220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae697503-b8c7-45bc-97ea-8a2d9677665b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:13.733112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae697503-b8c7-45bc-97ea-8a2d9677665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:13.826805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ae697503-b8c7-45bc-97ea-8a2d9677665b None None] MFA Rules not processed for user `67d82c40cc464a268bc293980b664075`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:13.829178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ae697503-b8c7-45bc-97ea-8a2d9677665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:13.962037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3632/7313] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:14.021911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:14.025392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:14.091664 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:14.190956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d783023-34a9-4cf0-a309-15b756d95f81 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:14.212973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:14.216620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:14.217879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:14.218384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:14.265303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:14.268427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:14.300385 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3682/7314] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:23.966032 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=60,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:25.210909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae697503-b8c7-45bc-97ea-8a2d9677665b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:25.233314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae697503-b8c7-45bc-97ea-8a2d9677665b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:25.240062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:25.240062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:25.240062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:25.240062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:25.240865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:25.328958 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=19 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:25.372809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:25.374445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:25.428439 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3633/7315] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:47:35.427097 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=43 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:36.431187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:36.433144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:36.435438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:36.448308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae749-aef9-4cc5-a6d1-acab16a081a9 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:36.460757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:36.461522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:36.461853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:36.462133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:36.469649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:36.564002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d4ef-65d6-4c80-b6c6-7ea13880c560 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:36.572381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:36.573302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:36.573779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:36.574257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:36.576306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:36.585008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:36.586704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:36.610894 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3634/7316] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:36.613622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:36.615847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:36.650695 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3683/7317] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:41.466240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:41.607818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e786ca-37a3-4865-969a-e9eb74ea7f3a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:41.620595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:41.620595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:41.620595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:41.620595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] PATH_INFO: `/v3/users/67d82c40cc464a268bc293980b664075` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:41.623420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d82c40cc464a268bc293980b664075)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:41.625537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:41.625930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:41.628300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:41.715977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6ed60-5cb3-4984-91c4-171db0116661 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:41.724861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f92ee-4673-4a04-8e10-2e0c2c209c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:41.725505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f92ee-4673-4a04-8e10-2e0c2c209c78 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:41.726044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f92ee-4673-4a04-8e10-2e0c2c209c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:41.726329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f92ee-4673-4a04-8e10-2e0c2c209c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:41.728794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d95f92ee-4673-4a04-8e10-2e0c2c209c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:41.749132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f92ee-4673-4a04-8e10-2e0c2c209c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:41.751071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f92ee-4673-4a04-8e10-2e0c2c209c78 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:41.774149 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3684/7318] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:41.871099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d82c40cc464a268bc293980b664075'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:41.899120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d82c40cc464a268bc293980b664075'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:41.910518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d82c40cc464a268bc293980b664075'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:41.911348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d82c40cc464a268bc293980b664075'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:42.005363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d82c40cc464a268bc293980b664075'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:42.022065 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3635/7319] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:47:41 2022] DELETE /identity/v3/users/67d82c40cc464a268bc293980b664075 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:47:42.026908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:42.027491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:42.027937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:42.063528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:42.065179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:42.192977 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3685/7320] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:42.213067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:42.214759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:42.229037 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:42.356201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef43662-c5d4-425d-a3e7-3f441865698a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:42.364404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc68cf-9c32-41cf-9aa8-731ba10acafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:42.365272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc68cf-9c32-41cf-9aa8-731ba10acafd service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:42.365727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc68cf-9c32-41cf-9aa8-731ba10acafd service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:42.367055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc68cf-9c32-41cf-9aa8-731ba10acafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:42.389627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc68cf-9c32-41cf-9aa8-731ba10acafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:42.391162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc68cf-9c32-41cf-9aa8-731ba10acafd service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:42.404323 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3636/7321] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:42.853398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:42.855788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:42.880668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47357c96-4b52-4dc9-920a-77179ec7534f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:42.895298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:42.895968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:42.896254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:42.896529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] PATH_INFO: `/v3/projects/f0fad388e17f438dbc9783e86d13206d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:42.898460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fad388e17f438dbc9783e86d13206d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:42.903039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:43.089504 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:43.109587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fad388e17f438dbc9783e86d13206d', 'request_id': 'req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:43.117611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fad388e17f438dbc9783e86d13206d', 'request_id': 'req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:43.284504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fad388e17f438dbc9783e86d13206d', 'request_id': 'req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:43.297247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] The token cache is being invalidate because project f0fad388e17f438dbc9783e86d13206d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:47:43.297657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:43.302766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-908a1abd-0702-4ea9-bf5a-b7b67f6f8bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:47:43.305070 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3686/7322] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:47:42 2022] DELETE /identity/v3/projects/f0fad388e17f438dbc9783e86d13206d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:47:43.310474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013079a0-50da-4a04-9749-e01f88d63e52 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:43.310950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013079a0-50da-4a04-9749-e01f88d63e52 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:43.312491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013079a0-50da-4a04-9749-e01f88d63e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:43.340654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-013079a0-50da-4a04-9749-e01f88d63e52 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:43.342274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-013079a0-50da-4a04-9749-e01f88d63e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:43.474700 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3637/7323] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:43.483496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6c1e-fdba-4b43-bd3e-aa0f609bfbff None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:43.483792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6c1e-fdba-4b43-bd3e-aa0f609bfbff None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:43.484076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c6c1e-fdba-4b43-bd3e-aa0f609bfbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:43.517724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fd8c6c1e-fdba-4b43-bd3e-aa0f609bfbff None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:43.520389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fd8c6c1e-fdba-4b43-bd3e-aa0f609bfbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:43.531713 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3687/7324] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:43.536287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013079a0-50da-4a04-9749-e01f88d63e52 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:43.552295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013079a0-50da-4a04-9749-e01f88d63e52 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:43.560451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:43.561334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:43.563143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:43.563436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:43.564285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:47:43.564603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:43.567831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:43.596930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3638/7325] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:47:43.602293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c6c1e-fdba-4b43-bd3e-aa0f609bfbff None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:43.618030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c6c1e-fdba-4b43-bd3e-aa0f609bfbff None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:43.639841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:43.640599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:43.640759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:43.641051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:43.641988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:43.644024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:43.742513 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3688/7326] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:47:43 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:47:43.743923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:43.766346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751aa1-fb02-4b3e-ad25-47f513e20ead admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:43.918108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:43.920298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:43.984420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:43.985121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:43.985470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:43.985847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:43.986535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:43.989190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:44.078877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89a9bd-c317-47fa-be21-c644527091c5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:44.086003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda48ed-2086-4ebd-b0e8-b8effa8f310a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:44.087390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda48ed-2086-4ebd-b0e8-b8effa8f310a service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.087971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda48ed-2086-4ebd-b0e8-b8effa8f310a service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.088525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda48ed-2086-4ebd-b0e8-b8effa8f310a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.112279 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3639/7327] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:47:43 2022] POST /identity/v3/users => generated 290 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:47:44.113164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-acda48ed-2086-4ebd-b0e8-b8effa8f310a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:44.117095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:44.129297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fec194-a9a0-43c6-878c-334fe4271b54 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:44.142059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:44.142855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.143144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.143424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.144559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:44.147446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:44.171549 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3640/7328] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:47:44.178043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:44.196209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4fa3-f499-4bd9-b4e2-73967ca98944 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:44.217749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:44.218421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.218704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.218982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.219633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:44.221419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:44.244786 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3641/7329] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:47:44.256822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda48ed-2086-4ebd-b0e8-b8effa8f310a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:44.258399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda48ed-2086-4ebd-b0e8-b8effa8f310a service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:44.259721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:44.267579 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:44.276605 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3689/7330] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:47:44.276811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42463c2-6785-4c4f-81a8-63bd8c31eec0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:44.286771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:44.287482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.287770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.288584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] PATH_INFO: `/v3/projects/624b70cc490c441fb88bb72877358b4a/users/26f3b38503944cb592aaa11f8e52b944/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.314263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=624b70cc490c441fb88bb72877358b4a, user_id=26f3b38503944cb592aaa11f8e52b944, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:44.318686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:44.445471 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3642/7331] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:47:44 2022] PUT /identity/v3/projects/624b70cc490c441fb88bb72877358b4a/users/26f3b38503944cb592aaa11f8e52b944/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:47:44.463037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.463707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.464013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.518392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] MFA Rules not processed for user `26f3b38503944cb592aaa11f8e52b944`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:44.521038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:44.549097 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:44.574044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:44.575940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:44.687888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c145c-898d-460c-9ac7-dc44b90b4ddf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:44.696853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:44.698077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.698605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.699084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.702006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:44.714619 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3690/7332] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:47:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:44.723178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:44.724976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:44.746458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:44.747963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:44.750676 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3643/7333] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:47:44.768077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7f37f-2de3-48e4-99bd-0c514f8c466d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:44.774884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005c2fa-b4e6-42a2-a763-d8ab2614f1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:44.776214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005c2fa-b4e6-42a2-a763-d8ab2614f1ca service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.776631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005c2fa-b4e6-42a2-a763-d8ab2614f1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.776975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005c2fa-b4e6-42a2-a763-d8ab2614f1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.792317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005c2fa-b4e6-42a2-a763-d8ab2614f1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:44.794377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005c2fa-b4e6-42a2-a763-d8ab2614f1ca service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:44.808678 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3691/7334] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:44.906401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:44.926393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee46bc-cc93-4415-ad1f-7ce1abffd59e service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:44.926393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:44.926393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:44.926393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:44.926955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:44.929563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:45.042234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:45.044020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:45.059349 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3644/7335] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:54.946765 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=25 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:55.053641 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=69,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:58.431776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c9a3-88a5-48e4-8b67-e7f2dc8a78bc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:58.432494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c9a3-88a5-48e4-8b67-e7f2dc8a78bc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:58.432494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c9a3-88a5-48e4-8b67-e7f2dc8a78bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:58.455534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-33b5c9a3-88a5-48e4-8b67-e7f2dc8a78bc None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:58.458573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-33b5c9a3-88a5-48e4-8b67-e7f2dc8a78bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:58.565384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3692/7336] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:47:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:58.578482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:58.579950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:58.680903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398766ce-3eac-48d1-bd8e-03864fbf1389 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:58.686302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:58.693151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:58.693151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:58.693151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:58.697265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:58.698899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:58.707633 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3645/7337] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:47:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:48:04.343996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c9a3-88a5-48e4-8b67-e7f2dc8a78bc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:04.389333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c9a3-88a5-48e4-8b67-e7f2dc8a78bc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:04.422225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03274cf5-786a-42bb-b3f3-910d9e0894ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:04.422225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274cf5-786a-42bb-b3f3-910d9e0894ec service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:04.424552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274cf5-786a-42bb-b3f3-910d9e0894ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:04.425067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03274cf5-786a-42bb-b3f3-910d9e0894ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:04.429251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-03274cf5-786a-42bb-b3f3-910d9e0894ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:04.471111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03274cf5-786a-42bb-b3f3-910d9e0894ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:04.473559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03274cf5-786a-42bb-b3f3-910d9e0894ec service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:04.506219 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3693/7338] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:08.704615 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=32 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:14.499928 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=31 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:14.988306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:14.989455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:15.144457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7118-07d3-4d08-892a-33ae70da300c service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:15.154777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:15.155521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:15.155871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:15.156214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] PATH_INFO: `/v3/users/038f64dccd434957b208cd2212a14da2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:15.157661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038f64dccd434957b208cd2212a14da2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:15.160998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:15.401152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038f64dccd434957b208cd2212a14da2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:15.446481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038f64dccd434957b208cd2212a14da2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:15.456639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038f64dccd434957b208cd2212a14da2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:15.457622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038f64dccd434957b208cd2212a14da2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:15.558688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038f64dccd434957b208cd2212a14da2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:15.570573 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3646/7339] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:48:14 2022] DELETE /identity/v3/users/038f64dccd434957b208cd2212a14da2 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:15.576081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:15.576677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:15.576926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:15.604692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:15.605522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:15.713276 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3694/7340] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:15.725989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:15.727509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:15.810718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e506ef-e459-46be-92a8-b056390fb137 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:15.819139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:15.819139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:15.819139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:15.819942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:15.840053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:15.841510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:15.863011 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3647/7341] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:16.617076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:16.618607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:16.661388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3cb1-9b73-466d-84cb-861a08cdd753 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:16.686376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:16.687771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:16.688236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:16.688743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] PATH_INFO: `/v3/projects/55a79b6a03bb4bb2a0d295a968f666e8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:16.693265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a79b6a03bb4bb2a0d295a968f666e8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:16.696918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:16.864103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a79b6a03bb4bb2a0d295a968f666e8', 'request_id': 'req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:16.877057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a79b6a03bb4bb2a0d295a968f666e8', 'request_id': 'req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:16.963249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a79b6a03bb4bb2a0d295a968f666e8', 'request_id': 'req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:16.980576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] The token cache is being invalidate because project 55a79b6a03bb4bb2a0d295a968f666e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:48:16.980975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:16.982247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:16.984978 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3695/7342] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:48:16 2022] DELETE /identity/v3/projects/55a79b6a03bb4bb2a0d295a968f666e8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:16.989910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:17.007186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4d52f-f71e-465b-b11a-0ead73be3cf6 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:17.030739 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:17.079594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:17.081236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:17.081735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:17.082119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] PATH_INFO: `/v3/users/c469d77567754fd184418fb04eda4a02` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:17.083989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c469d77567754fd184418fb04eda4a02)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:17.086522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:17.403113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c469d77567754fd184418fb04eda4a02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:17.418052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c469d77567754fd184418fb04eda4a02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:17.430808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c469d77567754fd184418fb04eda4a02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:17.431639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c469d77567754fd184418fb04eda4a02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:17.527944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8bba3188-9988-4717-b702-a6f1ebb54cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c469d77567754fd184418fb04eda4a02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:17.535516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3648/7343] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:48:16 2022] DELETE /identity/v3/users/c469d77567754fd184418fb04eda4a02 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:18.062807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:18.064569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:18.103955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2322-1d1e-45d4-87cb-33a466b5a8a8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:18.226644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:18.227468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:18.227749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:18.228357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] PATH_INFO: `/v3/projects/1a119184aac84fbcb6d5b83c40422dc9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:18.230603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a119184aac84fbcb6d5b83c40422dc9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:18.233445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:18.356974 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:18.373691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a119184aac84fbcb6d5b83c40422dc9', 'request_id': 'req-310792e2-708c-40a9-b82a-90a572aa190b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:18.382658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a119184aac84fbcb6d5b83c40422dc9', 'request_id': 'req-310792e2-708c-40a9-b82a-90a572aa190b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:18.592366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a119184aac84fbcb6d5b83c40422dc9', 'request_id': 'req-310792e2-708c-40a9-b82a-90a572aa190b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:18.605190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] The token cache is being invalidate because project 1a119184aac84fbcb6d5b83c40422dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:48:18.616953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:18.618267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-310792e2-708c-40a9-b82a-90a572aa190b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:18.626650 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3696/7344] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:48:18 2022] DELETE /identity/v3/projects/1a119184aac84fbcb6d5b83c40422dc9 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:18.632010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b929ee-53a5-4762-9fef-d52b3dec755f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:18.632605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b929ee-53a5-4762-9fef-d52b3dec755f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:18.632605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b929ee-53a5-4762-9fef-d52b3dec755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:18.665588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-22b929ee-53a5-4762-9fef-d52b3dec755f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:18.666888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-22b929ee-53a5-4762-9fef-d52b3dec755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:18.838707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1309-9a34-45fb-846f-20f7ef8929d8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:18.839405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1309-9a34-45fb-846f-20f7ef8929d8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:18.840042 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3649/7345] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:18.840223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1309-9a34-45fb-846f-20f7ef8929d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:18.887105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-052a1309-9a34-45fb-846f-20f7ef8929d8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:18.892397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-052a1309-9a34-45fb-846f-20f7ef8929d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:18.920068 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3697/7346] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:48:18.927623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b929ee-53a5-4762-9fef-d52b3dec755f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:18.951653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b929ee-53a5-4762-9fef-d52b3dec755f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:18.963925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:18.974410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:18.974410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:18.974410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:18.974410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:48:18.974410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:18.974410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:18.987142 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3650/7347] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:48:19.000522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a1309-9a34-45fb-846f-20f7ef8929d8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:19.010853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a1309-9a34-45fb-846f-20f7ef8929d8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:19.017713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:19.025141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:19.025141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:19.025141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:19.025141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:19.025141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:19.153029 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3698/7348] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:48:18 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:48:19.155522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:19.193693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c9eb9-7909-44d3-944f-2d897756b875 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:19.263214 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:19.316208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:19.330522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:19.331094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:19.334104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:19.335199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:19.337789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:19.438697 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3651/7349] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:48:19 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:48:19.446162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:19.458540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c138274-032c-4be9-8528-0d67e3cd543d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:19.468123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:19.469039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:19.469522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:19.470035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:19.470930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:19.473175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:19.489188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3699/7350] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:48:19.492509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:19.505892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0c7f-ff8f-4d4f-9f2e-2d5cab9bc2c0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:19.532969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44eeea3-8780-468e-9a7f-4ac72c3038ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:19.533651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eeea3-8780-468e-9a7f-4ac72c3038ba admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:19.534026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eeea3-8780-468e-9a7f-4ac72c3038ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:19.534308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eeea3-8780-468e-9a7f-4ac72c3038ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:19.534968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44eeea3-8780-468e-9a7f-4ac72c3038ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:19.536605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44eeea3-8780-468e-9a7f-4ac72c3038ba admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:19.584262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:19.594243 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3652/7351] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:48:19.605711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645357c7-66df-4279-a5b4-b64944dee341 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:19.641548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:19.645458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:19.645458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:19.645458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] PATH_INFO: `/v3/projects/d6c1e0eb0fad48399542c80b67eda32a/users/5b094faaecf54ed09d16d3c495f3e67f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:19.662903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c1e0eb0fad48399542c80b67eda32a, user_id=5b094faaecf54ed09d16d3c495f3e67f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:19.665891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:19.802569 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3700/7352] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:48:19 2022] PUT /identity/v3/projects/d6c1e0eb0fad48399542c80b67eda32a/users/5b094faaecf54ed09d16d3c495f3e67f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:19.820180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b8955-7266-409e-8c2c-ed6ccb8afae8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:19.820781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b8955-7266-409e-8c2c-ed6ccb8afae8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:19.820917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b8955-7266-409e-8c2c-ed6ccb8afae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:19.851727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d04b8955-7266-409e-8c2c-ed6ccb8afae8 None None] MFA Rules not processed for user `5b094faaecf54ed09d16d3c495f3e67f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:19.857878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d04b8955-7266-409e-8c2c-ed6ccb8afae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:19.966858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3653/7353] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:19.978149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:19.980018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:20.161874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f77061-c89e-4975-8d37-b78addc199a6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:20.189035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:20.189035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:20.189035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:20.189035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:20.206415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:20.212647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:20.230885 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3701/7354] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:24.484806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a6d2-76d0-4ba7-8757-6af6b7403ac0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:24.490122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a6d2-76d0-4ba7-8757-6af6b7403ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:24.490122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a6d2-76d0-4ba7-8757-6af6b7403ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:24.522952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3868a6d2-76d0-4ba7-8757-6af6b7403ac0 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:24.523957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3868a6d2-76d0-4ba7-8757-6af6b7403ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:24.616667 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3654/7355] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:24.649468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:24.652213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:24.728053 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:24.761198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a9299-bf71-4459-a6f8-7f1ca794120c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:24.768640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14014-2eef-4b99-9305-2dd8128d2d53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:24.769778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14014-2eef-4b99-9305-2dd8128d2d53 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:24.770294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14014-2eef-4b99-9305-2dd8128d2d53 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:24.772038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14014-2eef-4b99-9305-2dd8128d2d53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:24.791281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14014-2eef-4b99-9305-2dd8128d2d53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:24.793845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14014-2eef-4b99-9305-2dd8128d2d53 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:24.836557 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3702/7356] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:48:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:48:30.656843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a6d2-76d0-4ba7-8757-6af6b7403ac0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:30.756637 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:30.785112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868a6d2-76d0-4ba7-8757-6af6b7403ac0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:30.790725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:30.792660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:30.793144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:30.795028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] PATH_INFO: `/v3/users/5b094faaecf54ed09d16d3c495f3e67f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:30.796500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b094faaecf54ed09d16d3c495f3e67f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:30.798823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:31.096730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b094faaecf54ed09d16d3c495f3e67f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:31.125053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b094faaecf54ed09d16d3c495f3e67f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:31.138552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b094faaecf54ed09d16d3c495f3e67f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:31.139997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b094faaecf54ed09d16d3c495f3e67f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:31.231471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b094faaecf54ed09d16d3c495f3e67f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:31.269993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:31.270615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:31.273291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:31.295644 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3655/7357] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:48:30 2022] DELETE /identity/v3/users/5b094faaecf54ed09d16d3c495f3e67f => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:31.338259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:31.339614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:31.528568 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3703/7358] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:31.541991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:31.545170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:31.627554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:31.629160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:31.631873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165fd8-3baa-4c15-af9d-e42f3aa42e68 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:31.635930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:31.637148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:31.637498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:31.638370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:31.644339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d3612-c0df-4e7f-82a6-32a47c816e01 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:31.650161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:31.650869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:31.651153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:31.651431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] PATH_INFO: `/v3/users/26f3b38503944cb592aaa11f8e52b944` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:31.652578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f3b38503944cb592aaa11f8e52b944)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:31.652832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:31.656163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:31.669482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:31.677555 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3656/7359] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:31.907005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f3b38503944cb592aaa11f8e52b944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:31.907782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f3b38503944cb592aaa11f8e52b944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:31.991833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f3b38503944cb592aaa11f8e52b944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.001310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:32.002821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f3b38503944cb592aaa11f8e52b944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.003607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:32.005730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-deaf338a-975c-46b8-8537-c69df98b8b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f3b38503944cb592aaa11f8e52b944'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.049802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91539452-eeff-4c7d-b758-f48766e29745 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:32.051985 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3704/7360] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:48:31 2022] DELETE /identity/v3/users/26f3b38503944cb592aaa11f8e52b944 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:48:32.066656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:32.067100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:32.067484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:32.090812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:32.092178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:32.209130 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:32.212411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:32.215262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:32.215664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:32.216044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] PATH_INFO: `/v3/projects/d6c1e0eb0fad48399542c80b67eda32a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:32.218619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c1e0eb0fad48399542c80b67eda32a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:32.223564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:32.231815 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3705/7361] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:32.242334 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:32.279657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:32.283968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:32.360418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a30cab-c705-4b6c-9583-efa2312f4799 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:32.365014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7529e-a5df-488d-a198-f676e0556dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:32.366929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7529e-a5df-488d-a198-f676e0556dfd service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:32.366929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7529e-a5df-488d-a198-f676e0556dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:32.366929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7529e-a5df-488d-a198-f676e0556dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:32.379608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7529e-a5df-488d-a198-f676e0556dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:32.381510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7529e-a5df-488d-a198-f676e0556dfd service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:32.395034 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3706/7362] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:32.433896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c1e0eb0fad48399542c80b67eda32a', 'request_id': 'req-0274a299-10dc-45b7-ac35-20996f928933'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.445868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c1e0eb0fad48399542c80b67eda32a', 'request_id': 'req-0274a299-10dc-45b7-ac35-20996f928933'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.528873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c1e0eb0fad48399542c80b67eda32a', 'request_id': 'req-0274a299-10dc-45b7-ac35-20996f928933'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.561230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] The token cache is being invalidate because project d6c1e0eb0fad48399542c80b67eda32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:48:32.561595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.566088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0274a299-10dc-45b7-ac35-20996f928933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:32.567931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3657/7363] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:48:31 2022] DELETE /identity/v3/projects/d6c1e0eb0fad48399542c80b67eda32a => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:32.573463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45b2e-7222-408a-baba-bec83252156b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:32.573647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45b2e-7222-408a-baba-bec83252156b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:32.573921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45b2e-7222-408a-baba-bec83252156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:32.613021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0ce45b2e-7222-408a-baba-bec83252156b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:32.614273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0ce45b2e-7222-408a-baba-bec83252156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:32.715823 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3707/7364] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:32.726028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5f7b-a83e-41d7-845c-6e67d565a9f1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:32.726605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5f7b-a83e-41d7-845c-6e67d565a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:32.726605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d5f7b-a83e-41d7-845c-6e67d565a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:32.748732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-308d5f7b-a83e-41d7-845c-6e67d565a9f1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:32.750144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-308d5f7b-a83e-41d7-845c-6e67d565a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:32.759587 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3658/7365] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:32.764267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce45b2e-7222-408a-baba-bec83252156b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:32.776540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce45b2e-7222-408a-baba-bec83252156b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:32.785028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:32.785587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:32.786078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:32.786946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:32.793873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:48:32.793873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:32.793873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:32.802909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3708/7366] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:48:32.807457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d5f7b-a83e-41d7-845c-6e67d565a9f1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:32.817763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d5f7b-a83e-41d7-845c-6e67d565a9f1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:32.822582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:32.823198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:32.823486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:32.823763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:32.824447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:32.827370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:32.957872 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3659/7367] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:48:32 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:48:32.962517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:32.973646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862775c-2ff7-4297-9704-78cee2168fc9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:32.985506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:32.990654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:33.061670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.062776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.063447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.063931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.066960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.072758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.107371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09e3a2-fc13-48e5-85e5-72faaebb7a4f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.114415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.115107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.115410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.115676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] PATH_INFO: `/v3/projects/624b70cc490c441fb88bb72877358b4a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.116858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624b70cc490c441fb88bb72877358b4a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.118941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.148572 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3709/7368] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:48:32 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:48:33.149507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.161964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaa566-7da6-43e3-96bd-a7461650a634 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.167412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.168019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.168334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.168612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.169264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.170924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.183290 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3710/7369] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:48:33.187400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.199582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707f4ea-c650-4445-8179-3b1cc1114773 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.205541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.206525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.207601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.207601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.207850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.209428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.228470 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3711/7370] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:48:33.233051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.242958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624b70cc490c441fb88bb72877358b4a', 'request_id': 'req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:33.243572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071df9b-a816-450c-9d7c-e98bdc3cf82d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.252928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624b70cc490c441fb88bb72877358b4a', 'request_id': 'req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:33.310508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da3341-69ee-406b-a245-083c265cc784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.311185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da3341-69ee-406b-a245-083c265cc784 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.311498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da3341-69ee-406b-a245-083c265cc784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.311803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da3341-69ee-406b-a245-083c265cc784 admin admin] PATH_INFO: `/v3/projects/9ed00e5ab5a14e97bdb9b739dac9cdb6/users/e6750cd177474f818333b9c4552d6280/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.329888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da3341-69ee-406b-a245-083c265cc784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed00e5ab5a14e97bdb9b739dac9cdb6, user_id=e6750cd177474f818333b9c4552d6280, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.332735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da3341-69ee-406b-a245-083c265cc784 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.335488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624b70cc490c441fb88bb72877358b4a', 'request_id': 'req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:33.351476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] The token cache is being invalidate because project 624b70cc490c441fb88bb72877358b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:48:33.351770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:33.352890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c0e93c4-28e2-4c4f-b4b7-a5bb36d80df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:33.354777 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3660/7371] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:48:32 2022] DELETE /identity/v3/projects/624b70cc490c441fb88bb72877358b4a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:48:33.359744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67aa86-9437-4095-8ec7-d59d4f33d732 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.360145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67aa86-9437-4095-8ec7-d59d4f33d732 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.360482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67aa86-9437-4095-8ec7-d59d4f33d732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.383198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bb67aa86-9437-4095-8ec7-d59d4f33d732 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:33.384569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb67aa86-9437-4095-8ec7-d59d4f33d732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:33.393383 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3661/7372] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:33.400714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca859a7-a59e-4df4-9901-db54dcf527fb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.401014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca859a7-a59e-4df4-9901-db54dcf527fb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.401289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca859a7-a59e-4df4-9901-db54dcf527fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.412491 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3712/7373] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:48:33 2022] PUT /identity/v3/projects/9ed00e5ab5a14e97bdb9b739dac9cdb6/users/e6750cd177474f818333b9c4552d6280/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:33.425196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.425777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.426260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.449353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aca859a7-a59e-4df4-9901-db54dcf527fb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:33.450896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aca859a7-a59e-4df4-9901-db54dcf527fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:33.472339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] MFA Rules not processed for user `e6750cd177474f818333b9c4552d6280`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:33.473684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:33.537581 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3662/7374] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:33.542536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca859a7-a59e-4df4-9901-db54dcf527fb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.553454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca859a7-a59e-4df4-9901-db54dcf527fb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.558327 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3713/7375] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:33.562193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.562891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.563242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.563717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.565312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:48:33.565674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.567760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.568840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.570380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:33.589519 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3663/7376] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:48:33.590828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.608728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058785-3070-42c8-af8a-ce9d7380fc0a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.616766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.617619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.618299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.618707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.620098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.623000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.654308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50459c-fe46-45f8-a1d0-1b1e68f155ca None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.659788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.660679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.661223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.662083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.676291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.678081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.690258 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3714/7377] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:48:33.726141 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3664/7378] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:48:33 2022] POST /identity/v3/projects => generated 361 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:48:33.730409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.744668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cee50a-5395-43e7-87d8-deb63d5dd069 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.747229 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:33.824621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.825564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.825873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.826148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.826882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.829181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.923533 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3715/7379] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:48:33 2022] POST /identity/v3/users => generated 281 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:48:33.926914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.947116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd68994-c179-4dfd-a9bc-74e80f528528 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.952280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.952743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.953030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.953308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.954022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.957173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:33.968775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3665/7380] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:48:33.972841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:33.976807 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:33.983581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b50d0-4433-459b-8bf0-c5cc034056c0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:33.995474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f4140-63cf-48fc-86fb-991816f851c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:33.996109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f4140-63cf-48fc-86fb-991816f851c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:33.996394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f4140-63cf-48fc-86fb-991816f851c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:33.996672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f4140-63cf-48fc-86fb-991816f851c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:33.997332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f4140-63cf-48fc-86fb-991816f851c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:33.999250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f4140-63cf-48fc-86fb-991816f851c3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:34.020058 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3716/7381] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:48:34.024404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:34.037525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d729-d4da-4cdd-8446-dd80ef8a8aa3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:34.043267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:34.050535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:34.050535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:34.050535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] PATH_INFO: `/v3/projects/021fb79c6b394bef9726a169cbd5d2ad/users/775e071c758b4a909482f0951b38cf5b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:34.062415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021fb79c6b394bef9726a169cbd5d2ad, user_id=775e071c758b4a909482f0951b38cf5b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:34.067229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:34.210256 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3666/7382] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:48:34 2022] PUT /identity/v3/projects/021fb79c6b394bef9726a169cbd5d2ad/users/775e071c758b4a909482f0951b38cf5b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:34.212352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:34.212715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:34.213066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:34.251494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] MFA Rules not processed for user `775e071c758b4a909482f0951b38cf5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:34.253766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:34.340028 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3717/7383] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:34.350854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:34.352801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:34.435815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e069e-51a6-4b82-b31c-e5948c00ece1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:34.440919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ef5b-f246-4ab1-95df-6fd7a2ebbaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:34.441656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ef5b-f246-4ab1-95df-6fd7a2ebbaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:34.441992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ef5b-f246-4ab1-95df-6fd7a2ebbaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:34.442406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ef5b-f246-4ab1-95df-6fd7a2ebbaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:34.454650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ef5b-f246-4ab1-95df-6fd7a2ebbaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:34.456645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ef5b-f246-4ab1-95df-6fd7a2ebbaf2 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:34.469394 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3667/7384] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:34.775900 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:43.337713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:43.341022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:43.447660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec114e-05cc-4ee7-9059-afe9432e62cc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:43.475055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:43.475055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:43.475055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:43.475055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] PATH_INFO: `/v3/users/15b2d6f1b9a847a5bb42d7feebf47e4e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:43.475295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b2d6f1b9a847a5bb42d7feebf47e4e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:43.475295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:43.485011 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:43.770701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b2d6f1b9a847a5bb42d7feebf47e4e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:43.771391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b2d6f1b9a847a5bb42d7feebf47e4e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:43.843659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b2d6f1b9a847a5bb42d7feebf47e4e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:43.854557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b2d6f1b9a847a5bb42d7feebf47e4e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:43.856365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b2d6f1b9a847a5bb42d7feebf47e4e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:43.889864 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3718/7385] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:48:43 2022] DELETE /identity/v3/users/15b2d6f1b9a847a5bb42d7feebf47e4e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:43.896982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:43.897502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:43.897502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:43.922722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:43.924909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:43.950689 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:43.997789 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3668/7386] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:44.007902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:44.009352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:44.074506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9be7-a666-4d5d-879e-4d05bdb63fdf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:44.081602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf6ae9-7529-42ab-9326-c1e34441db78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:44.082429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6ae9-7529-42ab-9326-c1e34441db78 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:44.082637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6ae9-7529-42ab-9326-c1e34441db78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:44.082933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6ae9-7529-42ab-9326-c1e34441db78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:44.097626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf6ae9-7529-42ab-9326-c1e34441db78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:44.099543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf6ae9-7529-42ab-9326-c1e34441db78 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:44.111424 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3719/7387] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:44.466403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:44.469084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:44.487839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b82ad5-5782-4dde-a2c7-5e8fef5bec17 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:44.493081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:44.493733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:44.494102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:44.494535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] PATH_INFO: `/v3/projects/e98fdec916784651a70a11e78d157066` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:44.495672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98fdec916784651a70a11e78d157066)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:44.497578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:44.677160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98fdec916784651a70a11e78d157066', 'request_id': 'req-3c027613-17b5-460c-9cd5-145723322738'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:44.683654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98fdec916784651a70a11e78d157066', 'request_id': 'req-3c027613-17b5-460c-9cd5-145723322738'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:44.801309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98fdec916784651a70a11e78d157066', 'request_id': 'req-3c027613-17b5-460c-9cd5-145723322738'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:44.815048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] The token cache is being invalidate because project e98fdec916784651a70a11e78d157066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:48:44.815393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:44.816262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c027613-17b5-460c-9cd5-145723322738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:48:44.817870 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3669/7388] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:48:44 2022] DELETE /identity/v3/projects/e98fdec916784651a70a11e78d157066 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:48:44.823459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fc9a-b940-4f19-b371-6b45b0f21be4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:44.827724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fc9a-b940-4f19-b371-6b45b0f21be4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:44.827724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399fc9a-b940-4f19-b371-6b45b0f21be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:44.854628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4399fc9a-b940-4f19-b371-6b45b0f21be4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:44.855875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4399fc9a-b940-4f19-b371-6b45b0f21be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:44.917778 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3720/7389] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:44.927309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f773cda-4b60-4471-8cf6-91362a30be6c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:44.927882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f773cda-4b60-4471-8cf6-91362a30be6c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:44.927882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f773cda-4b60-4471-8cf6-91362a30be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:44.948989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9f773cda-4b60-4471-8cf6-91362a30be6c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:44.950596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9f773cda-4b60-4471-8cf6-91362a30be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:44.958931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3670/7390] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:44.963269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399fc9a-b940-4f19-b371-6b45b0f21be4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:44.979729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399fc9a-b940-4f19-b371-6b45b0f21be4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:44.985515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:44.986941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:44.987364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:44.987794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:44.988762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:48:44.989208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:44.991025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:45.004903 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3721/7391] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:48:45.012187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f773cda-4b60-4471-8cf6-91362a30be6c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:45.022324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f773cda-4b60-4471-8cf6-91362a30be6c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:45.027326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:45.028011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:45.028362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:45.028701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:45.029404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:45.031511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:45.164987 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3671/7392] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:48:45 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:48:45.169196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:45.179856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98974c8f-70ed-4ab7-9357-39681e606617 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:45.214415 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:45.255468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:45.256551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:45.256755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:45.257277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:45.257837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:45.260006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:45.422936 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3722/7393] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:48:45 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:48:45.428182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:45.443583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954754b-798b-4586-9f27-99f68fc66826 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:45.449284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:45.453934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:45.453934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:45.453934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:45.453934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:45.453934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:45.468856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3672/7394] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:48:45.470846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:45.482916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffad8be-519f-4bc8-be31-295a9e7c7294 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:45.489767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf307c98-f3d5-4a14-b55f-ef5cd116df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:45.490683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf307c98-f3d5-4a14-b55f-ef5cd116df1e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:45.491160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf307c98-f3d5-4a14-b55f-ef5cd116df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:45.491441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf307c98-f3d5-4a14-b55f-ef5cd116df1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:45.492100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf307c98-f3d5-4a14-b55f-ef5cd116df1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:45.508279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf307c98-f3d5-4a14-b55f-ef5cd116df1e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:45.537150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:45.538207 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3723/7395] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:48:45.553174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838300-fbc0-422f-ac2a-63c036157a17 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:45.559095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:45.559971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:45.560422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:45.561107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] PATH_INFO: `/v3/projects/e8b36863fee84e78809c2cbd1b726cd7/users/9f39da5448d74638ba6b2a935350f5b0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:45.594934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b36863fee84e78809c2cbd1b726cd7, user_id=9f39da5448d74638ba6b2a935350f5b0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:45.598689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:45.710512 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3673/7396] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:48:45 2022] PUT /identity/v3/projects/e8b36863fee84e78809c2cbd1b726cd7/users/9f39da5448d74638ba6b2a935350f5b0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:48:45.720870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:45.721388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:45.721689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:45.802764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] MFA Rules not processed for user `9f39da5448d74638ba6b2a935350f5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:48:45.805466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:45.911355 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3724/7397] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:48:45.929263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:45.933234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:45.992452 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:48:46.011032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b07d9-9d56-4ec0-853e-67d4605baf26 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:46.016857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:46.018142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:46.018422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:46.018930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:46.029438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:46.031231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:46.045921 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3674/7398] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:56.611726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:48:56.613055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:56.810073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973938-aa02-4e1e-8065-47c59782fbef None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:48:56.820870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c810b-4f5f-4cc0-8a57-217bb823fb5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:48:56.826295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c810b-4f5f-4cc0-8a57-217bb823fb5b service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:48:56.826804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c810b-4f5f-4cc0-8a57-217bb823fb5b service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:48:56.827090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c810b-4f5f-4cc0-8a57-217bb823fb5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:48:56.829443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-084c810b-4f5f-4cc0-8a57-217bb823fb5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:48:56.870893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c810b-4f5f-4cc0-8a57-217bb823fb5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:48:56.875696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c810b-4f5f-4cc0-8a57-217bb823fb5b service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:48:56.914064 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3725/7399] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:48:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:48:58.909926 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:03.633759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:03.635938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:03.889400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5ce59-8632-423f-8429-b297aca05f1d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:03.899682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:03.900539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:03.906129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:03.907520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] PATH_INFO: `/v3/users/abdedb0c1dc7416f92296f33b88aafe4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:03.909226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abdedb0c1dc7416f92296f33b88aafe4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:03.911339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:04.218607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abdedb0c1dc7416f92296f33b88aafe4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:04.252066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abdedb0c1dc7416f92296f33b88aafe4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:04.268890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abdedb0c1dc7416f92296f33b88aafe4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:04.272417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abdedb0c1dc7416f92296f33b88aafe4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:04.423265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abdedb0c1dc7416f92296f33b88aafe4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:04.432247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3675/7400] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:03 2022] DELETE /identity/v3/users/abdedb0c1dc7416f92296f33b88aafe4 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:04.436684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1beb81-5ac5-485c-9ce4-be883e69ce23 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:04.437572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1beb81-5ac5-485c-9ce4-be883e69ce23 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:04.438108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1beb81-5ac5-485c-9ce4-be883e69ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:04.499860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9b1beb81-5ac5-485c-9ce4-be883e69ce23 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:04.506132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b1beb81-5ac5-485c-9ce4-be883e69ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:04.517331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:04.519535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:04.587257 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:04.719346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3726/7401] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:04.720640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593607-dca2-4460-bd1f-711a427b2db5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:04.735061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:04.736311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:04.736605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:04.736856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:04.739768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:04.746483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1beb81-5ac5-485c-9ce4-be883e69ce23 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:04.770055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1beb81-5ac5-485c-9ce4-be883e69ce23 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:04.780184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:04.780888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:04.781175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:04.781449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:04.802973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:04.806243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:04.811291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:04.812772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:04.838010 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3676/7402] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:49:04.838422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3727/7403] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:06.241756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:06.247902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:06.273239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce973d-998a-44ec-8135-ee9ad6079e0d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:06.280075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:06.285831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:06.287387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:06.289223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] PATH_INFO: `/v3/projects/641d3f758162407db73e06f1deb7dabb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:06.295605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641d3f758162407db73e06f1deb7dabb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:06.298502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:06.338326 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:06.465406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641d3f758162407db73e06f1deb7dabb', 'request_id': 'req-956facee-80f5-4414-9955-50d38592cf44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.474621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641d3f758162407db73e06f1deb7dabb', 'request_id': 'req-956facee-80f5-4414-9955-50d38592cf44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.542602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641d3f758162407db73e06f1deb7dabb', 'request_id': 'req-956facee-80f5-4414-9955-50d38592cf44'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.554749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] The token cache is being invalidate because project 641d3f758162407db73e06f1deb7dabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:06.554931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.555588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.557161 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3677/7404] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:06 2022] DELETE /identity/v3/projects/641d3f758162407db73e06f1deb7dabb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:06.561669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:06.572597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314459a1-74cc-4483-bb94-411e5138d06f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:06.650500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:06.651432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:06.651612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:06.651920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] PATH_INFO: `/v3/users/f07a2d44e2a94411b93a9faec9a2389e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:06.653335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07a2d44e2a94411b93a9faec9a2389e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:06.655893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:06.896530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07a2d44e2a94411b93a9faec9a2389e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.897478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07a2d44e2a94411b93a9faec9a2389e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.963315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07a2d44e2a94411b93a9faec9a2389e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.973241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07a2d44e2a94411b93a9faec9a2389e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:06.974117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b94a305f-3351-49e1-a0f1-ccaac9fea1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07a2d44e2a94411b93a9faec9a2389e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:07.015504 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3728/7405] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:06 2022] DELETE /identity/v3/users/f07a2d44e2a94411b93a9faec9a2389e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:08.076091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:08.079922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:08.109682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956facee-80f5-4414-9955-50d38592cf44 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:08.246206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:08.247136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:08.247692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:08.248201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] PATH_INFO: `/v3/projects/4a38935820c74ec69e703bd1ff94293f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:08.249878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a38935820c74ec69e703bd1ff94293f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:08.252771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:08.546833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a38935820c74ec69e703bd1ff94293f', 'request_id': 'req-e100731b-3160-47ee-a2ed-675448d5101b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:08.555113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a38935820c74ec69e703bd1ff94293f', 'request_id': 'req-e100731b-3160-47ee-a2ed-675448d5101b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:08.658375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a38935820c74ec69e703bd1ff94293f', 'request_id': 'req-e100731b-3160-47ee-a2ed-675448d5101b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:08.679853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] The token cache is being invalidate because project 4a38935820c74ec69e703bd1ff94293f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:08.680681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:08.682412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e100731b-3160-47ee-a2ed-675448d5101b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:08.685920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3678/7406] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:08 2022] DELETE /identity/v3/projects/4a38935820c74ec69e703bd1ff94293f => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:08.692338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eac3e-4f9c-4e0f-9d14-4dd6a4c73e01 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:08.692862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eac3e-4f9c-4e0f-9d14-4dd6a4c73e01 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:08.692982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eac3e-4f9c-4e0f-9d14-4dd6a4c73e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:08.713394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c78eac3e-4f9c-4e0f-9d14-4dd6a4c73e01 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:08.714747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c78eac3e-4f9c-4e0f-9d14-4dd6a4c73e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:08.750148 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:08.794319 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3729/7407] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:49:08.803408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a554fb-6fe4-4823-b90c-f605d883bce5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:08.804021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a554fb-6fe4-4823-b90c-f605d883bce5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:08.804236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a554fb-6fe4-4823-b90c-f605d883bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:08.834112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-02a554fb-6fe4-4823-b90c-f605d883bce5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:08.836299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02a554fb-6fe4-4823-b90c-f605d883bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:08.871472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eac3e-4f9c-4e0f-9d14-4dd6a4c73e01 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:08.888167 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3679/7408] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:08.891388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eac3e-4f9c-4e0f-9d14-4dd6a4c73e01 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:08.896989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:08.897901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:08.898186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:08.898459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:08.900383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:49:08.900873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:08.902920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:08.924686 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3730/7409] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:08.929710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a554fb-6fe4-4823-b90c-f605d883bce5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:08.952012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a554fb-6fe4-4823-b90c-f605d883bce5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:08.958625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:08.960090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:08.960590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:08.961074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:08.962186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:08.967272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:09.092283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3680/7410] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:08 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:49:09.098251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:09.116002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff31d03-6013-42d3-b963-350084323a0c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:09.221053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:09.221676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:09.222007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:09.222288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:09.222985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:09.224930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:09.372711 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3731/7411] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:09 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:09.376087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:09.388103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d89b9-45bc-4d26-8426-23e376eec27d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:09.398931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:09.399801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:09.400270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:09.400917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:09.401731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:09.407570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:09.408929 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:09.426024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:09.426805 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3681/7412] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:09.440076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5919b6c-a853-4c5b-982b-c9fac2c89001 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:09.449037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511aba-8e43-492c-abf6-a4d56298a52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:09.449988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511aba-8e43-492c-abf6-a4d56298a52d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:09.450438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511aba-8e43-492c-abf6-a4d56298a52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:09.450868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511aba-8e43-492c-abf6-a4d56298a52d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:09.452123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511aba-8e43-492c-abf6-a4d56298a52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:09.454672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511aba-8e43-492c-abf6-a4d56298a52d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:09.493664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:09.502240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3732/7413] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:09.504679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505a55c-0f53-4d58-9cde-1ce169fbd16b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:09.511551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:09.512254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:09.512522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:09.513391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] PATH_INFO: `/v3/projects/24cef305df894ba4ad1db5bd2241f0b0/users/3f9f28bc3d784d0693c05f4c15bb3856/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:09.534946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cef305df894ba4ad1db5bd2241f0b0, user_id=3f9f28bc3d784d0693c05f4c15bb3856, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:09.539735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:09.634862 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3682/7414] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:09 2022] PUT /identity/v3/projects/24cef305df894ba4ad1db5bd2241f0b0/users/3f9f28bc3d784d0693c05f4c15bb3856/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:09.648842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc256e-5fbb-42fa-b4c5-bbc04826e6f8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:09.649397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc256e-5fbb-42fa-b4c5-bbc04826e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:09.649988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc256e-5fbb-42fa-b4c5-bbc04826e6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:09.710151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5afc256e-5fbb-42fa-b4c5-bbc04826e6f8 None None] MFA Rules not processed for user `3f9f28bc3d784d0693c05f4c15bb3856`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:09.713891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5afc256e-5fbb-42fa-b4c5-bbc04826e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:09.821471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3733/7415] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:09.822907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:09.926642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86bbf9-16b7-4e6a-9ccb-53ac8507521e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:09.934502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:09.935412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:09.936431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:09.936821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:09.937654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:09.941262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:10.065844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3683/7416] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:09 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:10.069658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc256e-5fbb-42fa-b4c5-bbc04826e6f8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:10.081133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc256e-5fbb-42fa-b4c5-bbc04826e6f8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:10.111715 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:10.158041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:10.159555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:10.159555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:10.159555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:10.160481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:10.163636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:10.260510 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3734/7417] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:10 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:10.266057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:10.276949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a90dfe-4875-4d80-b49d-53b1ed3ffa0c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:10.282371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:10.283253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:10.284004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:10.284458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:10.285342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:10.287263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:10.301965 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3684/7418] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:10.306440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:10.317960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e09014-df94-426a-90d7-f9b16b0f22ff admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:10.326591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:10.334676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:10.334676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:10.334676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] PATH_INFO: `/v3/projects/90ccb2b61b304f9399723847eb950ea0/users/b50b76e14a9c4b2fb3de5f45e880cc26/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:10.352861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ccb2b61b304f9399723847eb950ea0, user_id=b50b76e14a9c4b2fb3de5f45e880cc26, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:10.358363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:10.458133 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3735/7419] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:10 2022] PUT /identity/v3/projects/90ccb2b61b304f9399723847eb950ea0/users/b50b76e14a9c4b2fb3de5f45e880cc26/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:10.461858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:10.473408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640df1-72bb-4853-a9c5-99534599a038 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:10.551469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d1f22-d64c-4bf0-8afe-ec024da72373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:10.552207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1f22-d64c-4bf0-8afe-ec024da72373 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:10.553347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1f22-d64c-4bf0-8afe-ec024da72373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:10.553347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1f22-d64c-4bf0-8afe-ec024da72373 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:10.553589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1f22-d64c-4bf0-8afe-ec024da72373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:10.555303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1f22-d64c-4bf0-8afe-ec024da72373 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:10.603520 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3685/7420] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:10.606053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:10.632559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6262ef-b2e1-4bc7-af51-6db3facf141e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:10.638916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:10.639826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:10.640187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:10.640697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] PATH_INFO: `/v3/projects/90ccb2b61b304f9399723847eb950ea0/users/b50b76e14a9c4b2fb3de5f45e880cc26/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:10.643023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ccb2b61b304f9399723847eb950ea0, user_id=b50b76e14a9c4b2fb3de5f45e880cc26, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:10.647445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:10.661939 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3736/7421] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:10 2022] PUT /identity/v3/projects/90ccb2b61b304f9399723847eb950ea0/users/b50b76e14a9c4b2fb3de5f45e880cc26/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:10.674817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:10.675323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:10.676375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:10.726019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] MFA Rules not processed for user `b50b76e14a9c4b2fb3de5f45e880cc26`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:10.727715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:10.774647 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:10.850740 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3686/7422] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:10.861502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:10.863403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:10.947937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e3f50-e863-4ac4-afce-e811f3cf0275 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:10.952103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:10.952842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:10.953132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:10.953406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:11.029393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:11.032056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:11.045880 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3737/7423] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:11.162055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:11.164333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:11.311100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b60b8-716e-4a2e-a9e1-b3e1e9689519 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:11.327256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762adbc6-1f99-41fa-bc16-f0805f51ad3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:11.328406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adbc6-1f99-41fa-bc16-f0805f51ad3a service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:11.330295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adbc6-1f99-41fa-bc16-f0805f51ad3a service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:11.333128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adbc6-1f99-41fa-bc16-f0805f51ad3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:11.339201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-762adbc6-1f99-41fa-bc16-f0805f51ad3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:11.363461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762adbc6-1f99-41fa-bc16-f0805f51ad3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:11.368656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762adbc6-1f99-41fa-bc16-f0805f51ad3a service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:11.392267 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3687/7424] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:17.884212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:17.983583 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:18.050594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3c96-35a5-4548-8270-2d7daa963800 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:18.057414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:18.058658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:18.059189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:18.059679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] PATH_INFO: `/v3/users/3f9f28bc3d784d0693c05f4c15bb3856` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:18.061315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9f28bc3d784d0693c05f4c15bb3856)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:18.063894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:18.301351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9f28bc3d784d0693c05f4c15bb3856'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:18.302912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9f28bc3d784d0693c05f4c15bb3856'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:18.426225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9f28bc3d784d0693c05f4c15bb3856'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:18.441983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9f28bc3d784d0693c05f4c15bb3856'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:18.443164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9f28bc3d784d0693c05f4c15bb3856'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:18.487770 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3738/7425] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:17 2022] DELETE /identity/v3/users/3f9f28bc3d784d0693c05f4c15bb3856 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:18.492316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:18.493569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:18.494063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:18.535131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:18.536622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:18.702031 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3688/7426] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:18.761955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:18.763005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:18.863797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3a7c4-0ae0-4be5-b1df-9985cadf1f96 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:18.878283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6101128-993f-4fb3-995a-507feb6dded5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:18.880058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6101128-993f-4fb3-995a-507feb6dded5 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:18.880058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6101128-993f-4fb3-995a-507feb6dded5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:18.880058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6101128-993f-4fb3-995a-507feb6dded5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:18.902520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6101128-993f-4fb3-995a-507feb6dded5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:18.904794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6101128-993f-4fb3-995a-507feb6dded5 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:18.926055 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3739/7427] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:20.301085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:20.305185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:20.326485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78fc39-3840-4ad2-95c7-25f4b4104d28 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:20.341401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:20.342099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:20.342638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:20.342919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] PATH_INFO: `/v3/projects/24cef305df894ba4ad1db5bd2241f0b0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:20.344294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cef305df894ba4ad1db5bd2241f0b0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:20.346576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:20.534163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193de0-0c0a-4c85-95b9-aa05b06445c6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:20.534658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193de0-0c0a-4c85-95b9-aa05b06445c6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:20.534746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193de0-0c0a-4c85-95b9-aa05b06445c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:20.555073 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:20.558916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cef305df894ba4ad1db5bd2241f0b0', 'request_id': 'req-305a6c71-de47-4d46-ae13-07a06157252e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:20.564363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-30193de0-0c0a-4c85-95b9-aa05b06445c6 None None] MFA Rules not processed for user `86a886019b814956b33a4858c1d27f41`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:20.565594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-30193de0-0c0a-4c85-95b9-aa05b06445c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:20.576983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cef305df894ba4ad1db5bd2241f0b0', 'request_id': 'req-305a6c71-de47-4d46-ae13-07a06157252e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:20.638221 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:20.645305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cef305df894ba4ad1db5bd2241f0b0', 'request_id': 'req-305a6c71-de47-4d46-ae13-07a06157252e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:20.664356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] The token cache is being invalidate because project 24cef305df894ba4ad1db5bd2241f0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:20.665427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:20.668634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:20.675932 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3740/7429] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:20.675932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193de0-0c0a-4c85-95b9-aa05b06445c6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:20.685607 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3689/7429] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:20 2022] DELETE /identity/v3/projects/24cef305df894ba4ad1db5bd2241f0b0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:20.808205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193de0-0c0a-4c85-95b9-aa05b06445c6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:20.815294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:20.816509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:20.817026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:20.817526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] PATH_INFO: `/v3/users/b50b76e14a9c4b2fb3de5f45e880cc26` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:20.819063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50b76e14a9c4b2fb3de5f45e880cc26)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:20.821776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:21.099231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50b76e14a9c4b2fb3de5f45e880cc26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:21.099986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50b76e14a9c4b2fb3de5f45e880cc26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:21.201660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50b76e14a9c4b2fb3de5f45e880cc26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:21.210360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50b76e14a9c4b2fb3de5f45e880cc26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:21.211224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50b76e14a9c4b2fb3de5f45e880cc26'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:21.234276 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3741/7430] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:20 2022] DELETE /identity/v3/users/b50b76e14a9c4b2fb3de5f45e880cc26 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:49:21.685476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:21.687043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:21.776951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a6c71-de47-4d46-ae13-07a06157252e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:21.882936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:21.883860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:21.884292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:21.884824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:21.887197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:21.904041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:21.906585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:21.925137 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3690/7431] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:22.557119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:22.564372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:22.770770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:22.773411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:22.785852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f0df-6963-4f14-8979-a5348d1c9587 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:22.791517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:22.792175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:22.792463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:22.792743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] PATH_INFO: `/v3/projects/90ccb2b61b304f9399723847eb950ea0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:22.794617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ccb2b61b304f9399723847eb950ea0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:22.802339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:22.849360 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:22.928612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34496053-6910-4d60-89f8-21ea76f15ccd service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:22.946859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ccb2b61b304f9399723847eb950ea0', 'request_id': 'req-df0d43b8-8510-4783-877f-6e1c45d31694'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:22.964764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ccb2b61b304f9399723847eb950ea0', 'request_id': 'req-df0d43b8-8510-4783-877f-6e1c45d31694'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:22.993633 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:23.032007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c983-6000-41e3-803a-f6b4a05dec2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:23.033081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c983-6000-41e3-803a-f6b4a05dec2c service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.034358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c983-6000-41e3-803a-f6b4a05dec2c service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.035178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c983-6000-41e3-803a-f6b4a05dec2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.037426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1982c983-6000-41e3-803a-f6b4a05dec2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:23.062721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c983-6000-41e3-803a-f6b4a05dec2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:23.066915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c983-6000-41e3-803a-f6b4a05dec2c service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:23.088458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ccb2b61b304f9399723847eb950ea0', 'request_id': 'req-df0d43b8-8510-4783-877f-6e1c45d31694'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:23.104861 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3691/7432] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:49:23.116614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] The token cache is being invalidate because project 90ccb2b61b304f9399723847eb950ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:23.117167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:23.118129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df0d43b8-8510-4783-877f-6e1c45d31694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:23.124569 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3742/7433] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:22 2022] DELETE /identity/v3/projects/90ccb2b61b304f9399723847eb950ea0 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:23.131483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf3de2-ef96-48e1-b677-d4c774a47b03 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.131483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf3de2-ef96-48e1-b677-d4c774a47b03 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.131483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf3de2-ef96-48e1-b677-d4c774a47b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.163226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-afdf3de2-ef96-48e1-b677-d4c774a47b03 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:23.167005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-afdf3de2-ef96-48e1-b677-d4c774a47b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:23.258375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3692/7434] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:49:23.266158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01d34-9183-4ef6-9565-e0a06b4455f8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.267721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01d34-9183-4ef6-9565-e0a06b4455f8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.268235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01d34-9183-4ef6-9565-e0a06b4455f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.304197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7de01d34-9183-4ef6-9565-e0a06b4455f8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:23.306031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7de01d34-9183-4ef6-9565-e0a06b4455f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:23.324860 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3743/7435] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:49:23.328435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf3de2-ef96-48e1-b677-d4c774a47b03 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:23.347628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf3de2-ef96-48e1-b677-d4c774a47b03 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:23.359566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:23.360936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.361298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.361710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.362674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:49:23.363092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:23.365162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:23.388363 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3693/7436] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:23.392996 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01d34-9183-4ef6-9565-e0a06b4455f8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:23.407081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01d34-9183-4ef6-9565-e0a06b4455f8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:23.409436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:23.410280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.410555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.410890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.411570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:23.414186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:23.519274 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3744/7437] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:23 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:49:23.523448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:23.560987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942d0ce-658e-41b5-9f92-d6d7a48119e5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:23.651031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:23.651722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.652005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.652296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.652934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:23.654956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:23.769215 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3694/7438] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:23 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:49:23.773099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:23.793553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29287-95da-4c26-88e8-32eedaea7e51 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:23.800623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:23.801853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.802347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.802871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.803850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:23.806055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:23.819792 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3745/7439] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:23.824111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:23.838775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c5e58-572e-4b2e-8d2e-5bc80c9f181c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:23.845416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b538a-87a4-40b0-8a82-c28bae114dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:23.846518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b538a-87a4-40b0-8a82-c28bae114dbd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.852595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b538a-87a4-40b0-8a82-c28bae114dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.852595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b538a-87a4-40b0-8a82-c28bae114dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.852595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b538a-87a4-40b0-8a82-c28bae114dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:23.852595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b538a-87a4-40b0-8a82-c28bae114dbd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:23.869046 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3695/7440] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:49:23.873291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:23.889283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011efc-1500-4460-84e2-c7d76ded4709 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:23.894728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:23.895505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:23.895856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:23.896203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] PATH_INFO: `/v3/projects/0f943692e59644e6aebaae7492fd5f14/users/42914772de6a468f96db9181d02bac5f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:23.917894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f943692e59644e6aebaae7492fd5f14, user_id=42914772de6a468f96db9181d02bac5f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:23.920850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:24.013867 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3746/7441] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:23 2022] PUT /identity/v3/projects/0f943692e59644e6aebaae7492fd5f14/users/42914772de6a468f96db9181d02bac5f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:24.018023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:24.018651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:24.019017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:24.056224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] MFA Rules not processed for user `42914772de6a468f96db9181d02bac5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:24.060163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:24.149235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3696/7442] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:24.150451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:24.155273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:24.232041 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:24.259885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b38a7-09d5-487d-a159-64a5f93fe3d4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:24.265054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e413949-1932-4000-af78-979d8f61141f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:24.265779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e413949-1932-4000-af78-979d8f61141f service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:24.269689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e413949-1932-4000-af78-979d8f61141f service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:24.269689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e413949-1932-4000-af78-979d8f61141f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:24.283009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e413949-1932-4000-af78-979d8f61141f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:24.285860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e413949-1932-4000-af78-979d8f61141f service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:24.314201 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3747/7443] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:29.034538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:29.037563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:29.199315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724381-ac09-4061-9768-b5c5ac62d0f1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:29.218067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:29.219323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:29.219636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:29.222222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] PATH_INFO: `/v3/users/e6750cd177474f818333b9c4552d6280` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:29.223703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6750cd177474f818333b9c4552d6280)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:29.228630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:29.508030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6750cd177474f818333b9c4552d6280'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:29.533797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6750cd177474f818333b9c4552d6280'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:29.552354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6750cd177474f818333b9c4552d6280'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:29.553119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6750cd177474f818333b9c4552d6280'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:29.613443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6750cd177474f818333b9c4552d6280'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:29.620636 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3697/7444] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:29 2022] DELETE /identity/v3/users/e6750cd177474f818333b9c4552d6280 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:49:29.625291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:29.625952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:29.625952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:29.661766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:29.663305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:29.779120 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:29.815799 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3748/7445] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:29.835837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:29.837190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:29.944523 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:29.971430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcb94b-d358-4566-9dbb-ba1bac5cdf3a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:29.981859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d65771-cf99-4a39-86ca-21691de33e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:29.982779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65771-cf99-4a39-86ca-21691de33e2a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:29.983209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65771-cf99-4a39-86ca-21691de33e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:29.983631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65771-cf99-4a39-86ca-21691de33e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:30.009718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d65771-cf99-4a39-86ca-21691de33e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:30.020438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d65771-cf99-4a39-86ca-21691de33e2a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:30.039526 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3698/7446] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:30.755061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:30.756696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:30.806978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca04de-e712-4016-a391-98a21e7cb673 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:30.820334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:30.821407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:30.821695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:30.824712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] PATH_INFO: `/v3/projects/9ed00e5ab5a14e97bdb9b739dac9cdb6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:30.826279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed00e5ab5a14e97bdb9b739dac9cdb6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:30.828483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:31.025146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed00e5ab5a14e97bdb9b739dac9cdb6', 'request_id': 'req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:31.036348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed00e5ab5a14e97bdb9b739dac9cdb6', 'request_id': 'req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:31.118383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed00e5ab5a14e97bdb9b739dac9cdb6', 'request_id': 'req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:31.146800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] The token cache is being invalidate because project 9ed00e5ab5a14e97bdb9b739dac9cdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:31.147411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:31.151197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4802acc1-8ddd-4a8a-91bc-bc3b1a609ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:31.156119 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3749/7447] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:30 2022] DELETE /identity/v3/projects/9ed00e5ab5a14e97bdb9b739dac9cdb6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:49:31.161670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f010-df9f-4113-8af0-c0775b81e5f4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.163231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f010-df9f-4113-8af0-c0775b81e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.163661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40f010-df9f-4113-8af0-c0775b81e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.200937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9e40f010-df9f-4113-8af0-c0775b81e5f4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:31.202429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9e40f010-df9f-4113-8af0-c0775b81e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:31.370269 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3699/7448] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:31.378774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14516c-d2e2-4ad9-85ea-9ed767d3bf56 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.379073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14516c-d2e2-4ad9-85ea-9ed767d3bf56 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.379324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14516c-d2e2-4ad9-85ea-9ed767d3bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.410563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cd14516c-d2e2-4ad9-85ea-9ed767d3bf56 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:31.412556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cd14516c-d2e2-4ad9-85ea-9ed767d3bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:31.426054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40f010-df9f-4113-8af0-c0775b81e5f4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:31.432926 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3750/7449] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:31.451656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40f010-df9f-4113-8af0-c0775b81e5f4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:31.460929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:31.465783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.466143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.466408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.467090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:49:31.467470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:31.469210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:31.490370 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3700/7450] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:31.493136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14516c-d2e2-4ad9-85ea-9ed767d3bf56 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:31.504842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14516c-d2e2-4ad9-85ea-9ed767d3bf56 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:31.512756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:31.513528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.513946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.514337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.515066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:31.522027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:31.618877 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3751/7451] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:31 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:31.623273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:31.649128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ada186-3c11-4e65-80eb-61ac4eac39c3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:31.731625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:31.732418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.732805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.733277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.734055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:31.737486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:31.829390 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3701/7452] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:31 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:31.833471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:31.848215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae26be-7d47-4d1e-bae3-e179536469e5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:31.854396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:31.855827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.856880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.857301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.860158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:31.862606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:31.876569 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3752/7453] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:31.882266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:31.895199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d446-801a-424e-9e97-eee5bf6d2bfa admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:31.900123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2f144-eee7-4c87-828f-9e0fa4478db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:31.900846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2f144-eee7-4c87-828f-9e0fa4478db5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.901193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2f144-eee7-4c87-828f-9e0fa4478db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.901540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2f144-eee7-4c87-828f-9e0fa4478db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.902283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2f144-eee7-4c87-828f-9e0fa4478db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:31.904583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2f144-eee7-4c87-828f-9e0fa4478db5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:31.919963 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3702/7454] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:31.927011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:31.939354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8736b-78ef-4312-b77e-ab3486f5cb75 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:31.945354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:31.946394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:31.946991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:31.947403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] PATH_INFO: `/v3/projects/6d03b52d14b54577aa0818001b0d6e26/users/e12d8a94860b466dbaf034ff50a87048/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:31.966954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d03b52d14b54577aa0818001b0d6e26, user_id=e12d8a94860b466dbaf034ff50a87048, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:31.970231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:32.103006 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3753/7455] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:31 2022] PUT /identity/v3/projects/6d03b52d14b54577aa0818001b0d6e26/users/e12d8a94860b466dbaf034ff50a87048/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:32.114316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:32.114606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:32.114886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:32.142864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] MFA Rules not processed for user `e12d8a94860b466dbaf034ff50a87048`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:32.144077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:32.187587 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:32.234079 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3703/7456] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:32.252140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:32.254802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:32.361396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31de7-171a-4e9b-9aa3-691a8bd307c4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:32.367582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:32.368824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:32.369222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:32.369605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:32.382276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:32.386002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:32.409869 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3754/7457] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:32.415481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:32.416912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:32.452724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:32.478999 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:32.617772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35cf9-c1fc-4cf6-bc98-529103cff5ee service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:32.635579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:32.636724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:32.637221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:32.637516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] PATH_INFO: `/v3/users/e12d8a94860b466dbaf034ff50a87048` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:32.645001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12d8a94860b466dbaf034ff50a87048)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:32.646342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64944a-2c84-4bb8-9b54-76a1dfd2915b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:32.651492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:32.653194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:32.654132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:32.656352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:32.656831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] PATH_INFO: `/v3/users/42914772de6a468f96db9181d02bac5f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:32.658472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42914772de6a468f96db9181d02bac5f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:32.661087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:32.933911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42914772de6a468f96db9181d02bac5f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:32.949750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42914772de6a468f96db9181d02bac5f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:32.959528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42914772de6a468f96db9181d02bac5f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:32.960278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42914772de6a468f96db9181d02bac5f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:32.989688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12d8a94860b466dbaf034ff50a87048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:32.990995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12d8a94860b466dbaf034ff50a87048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:33.056465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-27d146bd-a879-4bba-9118-73bea5eee937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42914772de6a468f96db9181d02bac5f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:33.064346 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3704/7458] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:32 2022] DELETE /identity/v3/users/42914772de6a468f96db9181d02bac5f => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:33.072094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:33.072094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:33.072094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:33.097840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:33.099531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:33.142170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12d8a94860b466dbaf034ff50a87048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:33.153747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12d8a94860b466dbaf034ff50a87048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:33.160267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0ed2685a-45fd-474e-9fc3-ff804acd7183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12d8a94860b466dbaf034ff50a87048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:33.210752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3755/7459] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:32 2022] DELETE /identity/v3/users/e12d8a94860b466dbaf034ff50a87048 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:33.223588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2b36-2666-4e53-a97e-5f80e92948c2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:33.224010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2b36-2666-4e53-a97e-5f80e92948c2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:33.224382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2b36-2666-4e53-a97e-5f80e92948c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:33.245626 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:33.257313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-118d2b36-2666-4e53-a97e-5f80e92948c2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:33.259421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-118d2b36-2666-4e53-a97e-5f80e92948c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:33.275500 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3705/7460] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:33.286845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:33.288867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:33.392085 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3756/7461] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:33.401099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2b36-2666-4e53-a97e-5f80e92948c2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:33.416799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5a46b-4714-432b-a31a-ab9fe0c37095 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:33.498619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2b36-2666-4e53-a97e-5f80e92948c2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:33.504573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:33.505362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:33.505745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:33.506496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:33.520344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:33.522109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:33.522284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:33.524974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:33.524974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:33.524974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:33.538384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3757/7462] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:33.542097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:33.544709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:33.561955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3706/7463] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:33.802204 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:34.228385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:34.233176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:34.309180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:34.311148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:34.327378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833da87f-9b66-47ef-b084-25de64f08a53 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:34.332929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c90107-8907-49dd-9545-0f2b4de9405f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:34.336268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:34.337201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.337484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.338010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] PATH_INFO: `/v3/projects/0f943692e59644e6aebaae7492fd5f14` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.339475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f943692e59644e6aebaae7492fd5f14)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:34.341557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:34.348858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:34.349510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.349798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.350102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] PATH_INFO: `/v3/projects/6d03b52d14b54577aa0818001b0d6e26` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.354599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d03b52d14b54577aa0818001b0d6e26)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:34.356588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:34.487331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f943692e59644e6aebaae7492fd5f14', 'request_id': 'req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.488148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d03b52d14b54577aa0818001b0d6e26', 'request_id': 'req-61875c67-8e6f-4054-a203-375f9686e1af'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.495429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d03b52d14b54577aa0818001b0d6e26', 'request_id': 'req-61875c67-8e6f-4054-a203-375f9686e1af'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.497263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f943692e59644e6aebaae7492fd5f14', 'request_id': 'req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.593354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d03b52d14b54577aa0818001b0d6e26', 'request_id': 'req-61875c67-8e6f-4054-a203-375f9686e1af'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.607305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] The token cache is being invalidate because project 6d03b52d14b54577aa0818001b0d6e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:34.607744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.608530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-61875c67-8e6f-4054-a203-375f9686e1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.610219 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3707/7464] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:34 2022] DELETE /identity/v3/projects/6d03b52d14b54577aa0818001b0d6e26 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:49:34.615348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96801-213a-4d33-bf53-17a9f8c6d65b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.616016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96801-213a-4d33-bf53-17a9f8c6d65b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.621871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e96801-213a-4d33-bf53-17a9f8c6d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.647262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-83e96801-213a-4d33-bf53-17a9f8c6d65b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:34.648549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-83e96801-213a-4d33-bf53-17a9f8c6d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:34.653037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f943692e59644e6aebaae7492fd5f14', 'request_id': 'req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.677675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] The token cache is being invalidate because project 0f943692e59644e6aebaae7492fd5f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:34.679556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.680995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-330d1035-f1f4-4811-9ef5-73ebc4a7bf19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:34.685230 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3758/7465] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:34 2022] DELETE /identity/v3/projects/0f943692e59644e6aebaae7492fd5f14 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:34.691592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d91d-4ba2-462e-ab48-c9abbf0da30b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.692110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d91d-4ba2-462e-ab48-c9abbf0da30b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.693128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d91d-4ba2-462e-ab48-c9abbf0da30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.744818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0c60d91d-4ba2-462e-ab48-c9abbf0da30b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:34.746286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0c60d91d-4ba2-462e-ab48-c9abbf0da30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:34.759079 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:34.811681 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3708/7466] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:34.824384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137d48b-37c3-479a-a1e4-7886734c6de0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.824384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137d48b-37c3-479a-a1e4-7886734c6de0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.824384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137d48b-37c3-479a-a1e4-7886734c6de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.850045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0137d48b-37c3-479a-a1e4-7886734c6de0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:34.851579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0137d48b-37c3-479a-a1e4-7886734c6de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:34.864254 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3759/7467] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:34.868919 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3709/7468] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:34.869199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60d91d-4ba2-462e-ab48-c9abbf0da30b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:34.872121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e05a-b859-4915-ad3d-2c5704d0e949 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.872418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e05a-b859-4915-ad3d-2c5704d0e949 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.872703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3e05a-b859-4915-ad3d-2c5704d0e949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.880628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60d91d-4ba2-462e-ab48-c9abbf0da30b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:34.887180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:34.887797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.888105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.888338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.888992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:49:34.889298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:34.891333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:34.905231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d5b3e05a-b859-4915-ad3d-2c5704d0e949 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:34.907286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d5b3e05a-b859-4915-ad3d-2c5704d0e949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:34.918899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3760/7469] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:49:34.919841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:34.919955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3710/7470] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:34.921059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e05a-b859-4915-ad3d-2c5704d0e949 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:34.922317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:34.934941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3e05a-b859-4915-ad3d-2c5704d0e949 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:34.942658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:34.943293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:34.943581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:34.943863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:34.944910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:34.948386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.056146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cd55-c1cf-4592-8c04-44de8cf3ab81 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.064112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.064742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.065026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.065285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.069923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:35.088803 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3711/7471] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:34 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:35.091394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.102713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.104667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.120999 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3761/7472] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:35.121701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.133974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed201b-ba5a-42e2-981c-2c91562cfb92 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.209836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2a98-5752-4513-9ccf-99716d0b2977 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.218358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.220009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.220475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.220860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.221998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:49:35.222597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.224163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.239106 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3712/7473] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:35.242934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.256137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc24ae-f701-4128-843d-9ec3e9ea8356 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.258734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.259855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.260585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.260585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.263585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.263891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.264686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.267386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.267774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.268233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.268945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.271052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.372823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3713/7474] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:35 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:35.381077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.381864 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3762/7475] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:35 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:35.389006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.418393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322feaa-9dfa-4d92-a570-6dcdca866c51 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.486027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4107a4-487d-44dd-b643-8ffd5c0b382f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.491001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.491697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.492065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.492408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.493051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.495034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.510532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.515197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.515197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.515197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.515197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.515197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.526024 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3763/7476] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:35.529958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.543021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e260-77fd-4a21-903b-6b36da8e6d66 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.548869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.549484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.553053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.553053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.553053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.553053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.567845 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3764/7477] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:35.578866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.588911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed7b0-a26d-499a-9bf8-882f22f0ed56 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.593887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820f7e1-edb0-4a0a-9202-91ee70d62808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.594537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820f7e1-edb0-4a0a-9202-91ee70d62808 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.594982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820f7e1-edb0-4a0a-9202-91ee70d62808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.595130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820f7e1-edb0-4a0a-9202-91ee70d62808 admin admin] PATH_INFO: `/v3/projects/215da5b4d1d54be89662d3ea8c3c4be4/users/e4b519b895b04673951fcf55c2f3e4de/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.603157 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3714/7478] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:35 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:35.604223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.611655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820f7e1-edb0-4a0a-9202-91ee70d62808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215da5b4d1d54be89662d3ea8c3c4be4, user_id=e4b519b895b04673951fcf55c2f3e4de, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.614574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820f7e1-edb0-4a0a-9202-91ee70d62808 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.617077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547daf2-a31e-4510-85e8-891ca6680251 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.624342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.626006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.626391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.626819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.627686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.629608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.648214 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3715/7479] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:35.651108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.664129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa75c0-2c55-4e6b-bb45-3e137b2ff42f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.669476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.670155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.670447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.670715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.671357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.673642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.690349 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3716/7480] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:35.695204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.706656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763406-878a-4006-8293-e8f6efe8b9ee admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.715757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1ae98-6bbb-44b6-aec0-0f69c58347d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:35.716524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ae98-6bbb-44b6-aec0-0f69c58347d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.717070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ae98-6bbb-44b6-aec0-0f69c58347d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.717356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ae98-6bbb-44b6-aec0-0f69c58347d9 admin admin] PATH_INFO: `/v3/projects/cc9c1b49b881438ca12e11df300ca582/users/3441c16c2b8e4c9ea63d3d273344c37f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.722008 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3765/7481] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:35 2022] PUT /identity/v3/projects/215da5b4d1d54be89662d3ea8c3c4be4/users/e4b519b895b04673951fcf55c2f3e4de/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:35.738208 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:35.738208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.738208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.738208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.740982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1ae98-6bbb-44b6-aec0-0f69c58347d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9c1b49b881438ca12e11df300ca582, user_id=3441c16c2b8e4c9ea63d3d273344c37f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:35.743982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1ae98-6bbb-44b6-aec0-0f69c58347d9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:35.773333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] MFA Rules not processed for user `e4b519b895b04673951fcf55c2f3e4de`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:35.774818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:35.835587 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3717/7482] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:35 2022] PUT /identity/v3/projects/cc9c1b49b881438ca12e11df300ca582/users/3441c16c2b8e4c9ea63d3d273344c37f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:35.846430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aba19-a6ec-4e59-86f4-1b7a99a46b04 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:35.846844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aba19-a6ec-4e59-86f4-1b7a99a46b04 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:35.847213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aba19-a6ec-4e59-86f4-1b7a99a46b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:35.877479 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3766/7483] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:35.890243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:35.893425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:35.903336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d74aba19-a6ec-4e59-86f4-1b7a99a46b04 None None] MFA Rules not processed for user `3441c16c2b8e4c9ea63d3d273344c37f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:35.904705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d74aba19-a6ec-4e59-86f4-1b7a99a46b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:35.959531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485d47b-af32-4127-aad1-f93227e9a342 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:35.992039 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3718/7484] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:49:35.996734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aba19-a6ec-4e59-86f4-1b7a99a46b04 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:36.024868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:36.026429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:36.026883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:36.027161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:36.098113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aba19-a6ec-4e59-86f4-1b7a99a46b04 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:36.111487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:36.112684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:36.113106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:36.113680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:36.114434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:36.114568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:36.116767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:36.116885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:36.130871 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3767/7485] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:49:36.255676 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3719/7486] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:35 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:36.259807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:36.272953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99422-c5e3-43a9-bf48-f365d2948051 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:36.343306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:36.344212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:36.344496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:36.344893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:36.345739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:36.347957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:36.496983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3768/7487] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:36 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:49:36.498989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:36.513857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef331d-4d78-41fe-be90-c164d430626b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:36.520310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60660-fc71-4729-83f0-0454f3c91625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:36.521143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60660-fc71-4729-83f0-0454f3c91625 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:36.521549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60660-fc71-4729-83f0-0454f3c91625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:36.521982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60660-fc71-4729-83f0-0454f3c91625 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:36.522789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60660-fc71-4729-83f0-0454f3c91625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:36.524840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60660-fc71-4729-83f0-0454f3c91625 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:36.543062 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3720/7488] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:36.548597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:36.563530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5adca-0b4c-4a8d-961e-6bae7e3a17e9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:36.569849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:36.570801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:36.570801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:36.571160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] PATH_INFO: `/v3/projects/c33060cdfd4243619307fe585c3da49f/users/6d748fda5bac4fac8e7edb453fbfa091/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:36.599523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33060cdfd4243619307fe585c3da49f, user_id=6d748fda5bac4fac8e7edb453fbfa091, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:36.605472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:36.696581 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3769/7489] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:36 2022] PUT /identity/v3/projects/c33060cdfd4243619307fe585c3da49f/users/6d748fda5bac4fac8e7edb453fbfa091/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:49:36.708881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:36.709177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:36.709465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:36.747680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] MFA Rules not processed for user `6d748fda5bac4fac8e7edb453fbfa091`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:36.750709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:36.865778 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3721/7490] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:36 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:36.895658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:36.897631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:37.021130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f4633-0b7d-4a87-b6c8-1fa0d060c8ed admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:37.026449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62089-8c08-4ae4-bc3d-317f5d8d8b78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:37.027078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62089-8c08-4ae4-bc3d-317f5d8d8b78 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:37.027340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62089-8c08-4ae4-bc3d-317f5d8d8b78 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:37.027609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62089-8c08-4ae4-bc3d-317f5d8d8b78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:37.036482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62089-8c08-4ae4-bc3d-317f5d8d8b78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:37.038440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62089-8c08-4ae4-bc3d-317f5d8d8b78 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:37.055431 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3770/7491] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:49:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:49:37.125754 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:37.698468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:37.707884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:37.775488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f465b-fe2e-4dc2-8c52-f63a7a49a82a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:37.788083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:37.788590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:37.788990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:37.789596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] PATH_INFO: `/v3/users/775e071c758b4a909482f0951b38cf5b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:37.791280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=775e071c758b4a909482f0951b38cf5b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:37.793669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:37.982616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775e071c758b4a909482f0951b38cf5b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:37.995680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775e071c758b4a909482f0951b38cf5b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:38.003103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775e071c758b4a909482f0951b38cf5b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:38.003836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775e071c758b4a909482f0951b38cf5b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:38.044533 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:38.067578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775e071c758b4a909482f0951b38cf5b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:38.074267 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3722/7492] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:37 2022] DELETE /identity/v3/users/775e071c758b4a909482f0951b38cf5b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:38.079660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:38.080068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:38.080270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:38.100899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:38.102156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:38.170873 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:38.177587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3771/7493] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:38.184808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:38.186688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:38.252741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925aa5-669e-4cfb-956c-0566d42c38ec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:38.256511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec47419-7ce3-43b0-b1f5-0756a3b76118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:38.257127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47419-7ce3-43b0-b1f5-0756a3b76118 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:38.257427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47419-7ce3-43b0-b1f5-0756a3b76118 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:38.257695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec47419-7ce3-43b0-b1f5-0756a3b76118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:38.268000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec47419-7ce3-43b0-b1f5-0756a3b76118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:38.269668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec47419-7ce3-43b0-b1f5-0756a3b76118 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:38.292897 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3723/7494] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:38.725355 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:38.840570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:38.844963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:38.858506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099f96-0659-4306-960b-b9b9b08ee360 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:38.864919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:38.866217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:38.866665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:38.867317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] PATH_INFO: `/v3/projects/021fb79c6b394bef9726a169cbd5d2ad` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:38.868668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] RBAC: Authorizing `identity:delete_project(project_id=021fb79c6b394bef9726a169cbd5d2ad)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:38.870974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:38.993085 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:39.013257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021fb79c6b394bef9726a169cbd5d2ad', 'request_id': 'req-c348ceb1-6f79-4f45-9c6c-eff92409711d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:39.023186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021fb79c6b394bef9726a169cbd5d2ad', 'request_id': 'req-c348ceb1-6f79-4f45-9c6c-eff92409711d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:39.135939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021fb79c6b394bef9726a169cbd5d2ad', 'request_id': 'req-c348ceb1-6f79-4f45-9c6c-eff92409711d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:39.149872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] The token cache is being invalidate because project 021fb79c6b394bef9726a169cbd5d2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:39.150431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:39.151128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c348ceb1-6f79-4f45-9c6c-eff92409711d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:39.156846 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3772/7495] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:38 2022] DELETE /identity/v3/projects/021fb79c6b394bef9726a169cbd5d2ad => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:39.159811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8b52-fca6-4ed3-b70f-1c89571e09ee None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:39.160103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8b52-fca6-4ed3-b70f-1c89571e09ee None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:39.160380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b8b52-fca6-4ed3-b70f-1c89571e09ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:39.185622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b97b8b52-fca6-4ed3-b70f-1c89571e09ee None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:39.186986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b97b8b52-fca6-4ed3-b70f-1c89571e09ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:39.242368 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:39.291837 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3724/7496] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:39.301662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853974c-3b65-497e-a18e-db08f6e941d3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:39.302223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853974c-3b65-497e-a18e-db08f6e941d3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:39.302504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853974c-3b65-497e-a18e-db08f6e941d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:39.324126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5853974c-3b65-497e-a18e-db08f6e941d3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:39.325262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5853974c-3b65-497e-a18e-db08f6e941d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:39.334254 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3773/7497] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:39.338804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8b52-fca6-4ed3-b70f-1c89571e09ee None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:39.349918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b8b52-fca6-4ed3-b70f-1c89571e09ee None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:39.355478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:39.356383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:39.356383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:39.356669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:39.357294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:49:39.358009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:39.360016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:39.375315 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3725/7498] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:39.380358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853974c-3b65-497e-a18e-db08f6e941d3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:39.395845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853974c-3b65-497e-a18e-db08f6e941d3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:39.414678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:39.415997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:39.416199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:39.416502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:39.417176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:39.420507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:39.726725 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3774/7499] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:39 2022] POST /identity/v3/projects => generated 361 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:39.731092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:39.747244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd523af-e6bd-492e-9ef1-056067e49541 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:39.836358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:39.837047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:39.837340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:39.837625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:39.838574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:39.840913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:39.935406 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3726/7500] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:39 2022] POST /identity/v3/users => generated 281 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:39.938085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:39.955070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f56dd-b45d-4410-8f40-7c939b541cba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:39.964049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:39.964744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:39.965068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:39.965551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:39.966528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:39.969986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:39.987079 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3775/7501] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:49:39.992341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:40.004919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc9dd-b436-46a9-b3f7-dab5ae63e9ed admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:40.009974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76aace-d1ad-4e34-a2ff-a57a41bede64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:40.010900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76aace-d1ad-4e34-a2ff-a57a41bede64 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:40.011237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76aace-d1ad-4e34-a2ff-a57a41bede64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:40.011519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76aace-d1ad-4e34-a2ff-a57a41bede64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:40.012254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76aace-d1ad-4e34-a2ff-a57a41bede64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:40.014290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76aace-d1ad-4e34-a2ff-a57a41bede64 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:40.027662 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3727/7502] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:40.033331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:40.043865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e9260-86c7-43f6-adb8-cc382ae91867 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:40.050345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:40.051296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:40.051749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:40.052025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] PATH_INFO: `/v3/projects/fbce5b1d431f421d891b78248c4ffd03/users/b9c5a4643a7c4040bb08b4ad6a9ff678/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:40.081698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbce5b1d431f421d891b78248c4ffd03, user_id=b9c5a4643a7c4040bb08b4ad6a9ff678, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:40.085306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:40.199037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3776/7503] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:40 2022] PUT /identity/v3/projects/fbce5b1d431f421d891b78248c4ffd03/users/b9c5a4643a7c4040bb08b4ad6a9ff678/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:40.209436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:40.209724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:40.213201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:40.266124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] MFA Rules not processed for user `b9c5a4643a7c4040bb08b4ad6a9ff678`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:40.267675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:40.410083 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3728/7504] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:40.430344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:40.446369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:40.479998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:40.481611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:40.553632 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:40.557440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946d06-2e9f-4a3f-8216-ab76587141d8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:40.564329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b07dbd-b98c-4f03-8159-e970008f1aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:40.565328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07dbd-b98c-4f03-8159-e970008f1aec service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:40.565863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07dbd-b98c-4f03-8159-e970008f1aec service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:40.566404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07dbd-b98c-4f03-8159-e970008f1aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:40.579190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b07dbd-b98c-4f03-8159-e970008f1aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:40.581430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b07dbd-b98c-4f03-8159-e970008f1aec service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:40.600443 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3777/7505] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:40.625421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c566a-5d0c-428b-aa7a-da6f3d97196c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:40.632593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:40.633359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:40.633775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:40.634175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] PATH_INFO: `/v3/users/3441c16c2b8e4c9ea63d3d273344c37f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:40.635555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3441c16c2b8e4c9ea63d3d273344c37f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:40.638150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:40.885856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3441c16c2b8e4c9ea63d3d273344c37f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:40.911899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3441c16c2b8e4c9ea63d3d273344c37f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:40.932430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3441c16c2b8e4c9ea63d3d273344c37f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:40.934237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3441c16c2b8e4c9ea63d3d273344c37f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:41.027635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3441c16c2b8e4c9ea63d3d273344c37f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:41.041860 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3729/7506] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:40 2022] DELETE /identity/v3/users/3441c16c2b8e4c9ea63d3d273344c37f => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:41.046195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:41.047385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:41.047926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:41.070652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:41.071906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:41.107026 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:41.137287 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3778/7507] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:41.161304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:41.162546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:41.244979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719210ad-a6b0-4123-8318-a5e11104a61c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:41.250517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:41.251238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:41.251238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:41.251238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:41.263320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:41.264840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:41.279337 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3730/7508] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:41.738115 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:42.201492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:42.203768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:42.229009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755398-3c44-4092-9c0b-6b7213d351e9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:42.239977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:42.240700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:42.241798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:42.242290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] PATH_INFO: `/v3/projects/cc9c1b49b881438ca12e11df300ca582` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:42.244214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9c1b49b881438ca12e11df300ca582)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:42.254503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:42.452319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9c1b49b881438ca12e11df300ca582', 'request_id': 'req-083cee02-36c6-4f19-b4c8-dfe0dc03346d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.460627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9c1b49b881438ca12e11df300ca582', 'request_id': 'req-083cee02-36c6-4f19-b4c8-dfe0dc03346d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.547246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9c1b49b881438ca12e11df300ca582', 'request_id': 'req-083cee02-36c6-4f19-b4c8-dfe0dc03346d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.560555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] The token cache is being invalidate because project cc9c1b49b881438ca12e11df300ca582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:42.560850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.561730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.563992 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3779/7509] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:42 2022] DELETE /identity/v3/projects/cc9c1b49b881438ca12e11df300ca582 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:42.567769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:42.583074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf024e-0056-4f41-a24b-cb595a95826a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:42.656727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:42.657490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:42.657768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:42.658278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] PATH_INFO: `/v3/users/6d748fda5bac4fac8e7edb453fbfa091` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:42.659643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d748fda5bac4fac8e7edb453fbfa091)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:42.671681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:42.881248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d748fda5bac4fac8e7edb453fbfa091'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.911085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d748fda5bac4fac8e7edb453fbfa091'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.919641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d748fda5bac4fac8e7edb453fbfa091'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.922290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d748fda5bac4fac8e7edb453fbfa091'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.987005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3d212849-a55b-48af-ab0a-7b21b78be307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d748fda5bac4fac8e7edb453fbfa091'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:42.995648 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3731/7510] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:49:42 2022] DELETE /identity/v3/users/6d748fda5bac4fac8e7edb453fbfa091 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:43.634500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:43.636889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:43.658883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cee02-36c6-4f19-b4c8-dfe0dc03346d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:43.784733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:43.785655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:43.786192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:43.786654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] PATH_INFO: `/v3/projects/c33060cdfd4243619307fe585c3da49f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:43.788098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33060cdfd4243619307fe585c3da49f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:43.790177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:43.914880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33060cdfd4243619307fe585c3da49f', 'request_id': 'req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:43.923175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33060cdfd4243619307fe585c3da49f', 'request_id': 'req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:43.992816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33060cdfd4243619307fe585c3da49f', 'request_id': 'req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:44.002623 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:44.014149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] The token cache is being invalidate because project c33060cdfd4243619307fe585c3da49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:49:44.014726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:44.016923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-69bd78da-c2e5-4b8a-a644-1bb515ffb36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:49:44.019490 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3780/7511] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:49:43 2022] DELETE /identity/v3/projects/c33060cdfd4243619307fe585c3da49f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:44.024131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe49334-2a06-4e25-93eb-5d2be0ecb7ac None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.024969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe49334-2a06-4e25-93eb-5d2be0ecb7ac None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.025394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe49334-2a06-4e25-93eb-5d2be0ecb7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.047665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1fe49334-2a06-4e25-93eb-5d2be0ecb7ac None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:44.049312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1fe49334-2a06-4e25-93eb-5d2be0ecb7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:44.143092 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3732/7512] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:44.151136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebd41-61e2-47d8-b882-5a3fe9e2c79d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.151423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebd41-61e2-47d8-b882-5a3fe9e2c79d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.155697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ebd41-61e2-47d8-b882-5a3fe9e2c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.180040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e15ebd41-61e2-47d8-b882-5a3fe9e2c79d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:44.181462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e15ebd41-61e2-47d8-b882-5a3fe9e2c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:44.191460 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3781/7513] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:44.195758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe49334-2a06-4e25-93eb-5d2be0ecb7ac None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:44.211606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe49334-2a06-4e25-93eb-5d2be0ecb7ac None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:44.222154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:44.223088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.223546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.223970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.224845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:49:44.225509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:44.227612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:44.245544 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3733/7514] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:44.250267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ebd41-61e2-47d8-b882-5a3fe9e2c79d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:44.265051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ebd41-61e2-47d8-b882-5a3fe9e2c79d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:44.278416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:44.279220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.279785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.280239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.281270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:44.287634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:44.431222 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3782/7515] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:49:44 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:49:44.434137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:44.441246 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:44.449509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13180fbe-2450-47fa-87b9-3c362854ac30 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:44.567858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:44.569993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.571724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.572167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.573037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:44.580834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:44.690584 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3734/7516] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:44 2022] POST /identity/v3/users => generated 282 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:49:44.691858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:44.703814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea28f6-8d45-4bc8-a779-a0ec114f71b9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:44.710544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:44.711729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.712108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.712500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.713281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:44.715281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:44.730749 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3783/7517] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:44.734487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:44.748602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91031055-0c21-4598-8abd-bdced87a8815 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:44.756600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a668688-e702-45ed-8996-94e9e4e6dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:44.757618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668688-e702-45ed-8996-94e9e4e6dc52 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.758151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668688-e702-45ed-8996-94e9e4e6dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.758620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668688-e702-45ed-8996-94e9e4e6dc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.760408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a668688-e702-45ed-8996-94e9e4e6dc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:44.763267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a668688-e702-45ed-8996-94e9e4e6dc52 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:44.791806 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3735/7518] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:49:44.801327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:44.821364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768fbf-ea4d-4b89-b167-5f6cf5a66240 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:44.835876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:44.843333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.843333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.843333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] PATH_INFO: `/v3/projects/8be21147c8d44351a1c8e5d0669df6b3/users/3573a8df7f9946b292c7dd945cd47a28/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.861965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be21147c8d44351a1c8e5d0669df6b3, user_id=3573a8df7f9946b292c7dd945cd47a28, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:44.866854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:44.958960 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3784/7519] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:49:44 2022] PUT /identity/v3/projects/8be21147c8d44351a1c8e5d0669df6b3/users/3573a8df7f9946b292c7dd945cd47a28/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:44.963944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874ad6-63f2-4c85-aea5-de54000401f2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:44.964234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874ad6-63f2-4c85-aea5-de54000401f2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:44.964585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74874ad6-63f2-4c85-aea5-de54000401f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:44.987328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-74874ad6-63f2-4c85-aea5-de54000401f2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:44.988637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-74874ad6-63f2-4c85-aea5-de54000401f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:45.067092 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3736/7520] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:45.078014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:45.080151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:45.178953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25de6a-43ef-46ae-8204-f191941a62ee admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:45.184074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:45.185017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:45.185493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:45.185995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:45.200373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:45.202688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:45.219436 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3785/7521] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:54.809200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6455e2-5611-4a54-bb32-df759e59c742 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:54.810589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6455e2-5611-4a54-bb32-df759e59c742 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:54.812329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6455e2-5611-4a54-bb32-df759e59c742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:54.943867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5c6455e2-5611-4a54-bb32-df759e59c742 None None] MFA Rules not processed for user `3573a8df7f9946b292c7dd945cd47a28`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:54.945048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5c6455e2-5611-4a54-bb32-df759e59c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:55.064095 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3737/7522] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:55.068808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:55.081718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b6b2-2c53-489c-bb43-141f840ba474 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:55.087765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:55.088934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:55.089547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:55.090263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:55.091378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:55.095545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:55.263708 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3786/7523] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:49:55 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:49:55.269928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6455e2-5611-4a54-bb32-df759e59c742 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:55.281572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6455e2-5611-4a54-bb32-df759e59c742 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:55.287121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f86ca-f628-4809-904c-4e70597d8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:55.287388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f86ca-f628-4809-904c-4e70597d8366 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:55.287674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f86ca-f628-4809-904c-4e70597d8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:55.287948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f86ca-f628-4809-904c-4e70597d8366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:55.288594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f86ca-f628-4809-904c-4e70597d8366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:55.290229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f86ca-f628-4809-904c-4e70597d8366 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:55.295863 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:55.302002 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3738/7524] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:55.306086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:55.317138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51a2f8-9f4d-4aff-979c-846039eadfc2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:55.321753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:55.322452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:55.322738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:55.323017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] PATH_INFO: `/v3/system/users/ab7e9cce2a9e454dbc4de8e5bfa3a1a0/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:55.337604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ab7e9cce2a9e454dbc4de8e5bfa3a1a0, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:55.339274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:55.479383 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3787/7525] 10.222.0.59 () {60 vars in 1378 bytes} [Sun Aug 28 01:49:55 2022] PUT /identity/v3/system/users/ab7e9cce2a9e454dbc4de8e5bfa3a1a0/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:49:55.493379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e0a8-0c10-4459-982e-ff6c426e97d4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:55.493692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e0a8-0c10-4459-982e-ff6c426e97d4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:55.493989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87e0a8-0c10-4459-982e-ff6c426e97d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:55.532800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bc87e0a8-0c10-4459-982e-ff6c426e97d4 None None] MFA Rules not processed for user `ab7e9cce2a9e454dbc4de8e5bfa3a1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:55.535129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bc87e0a8-0c10-4459-982e-ff6c426e97d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:55.644235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3739/7526] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:49:55 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 01:49:55.646864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:55.717394 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=1,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:55.779806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c977d85-f3c2-4312-b668-f095e6116b3d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:55.860403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:55.861579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:55.862132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:55.862893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] PATH_INFO: `/v3/services` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:55.863747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:55.865627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:55.882092 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3788/7527] 10.222.0.59 () {58 vars in 1110 bytes} [Sun Aug 28 01:49:55 2022] GET /identity/v3/services => generated 2191 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:49:55.882672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87e0a8-0c10-4459-982e-ff6c426e97d4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:56.130663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87e0a8-0c10-4459-982e-ff6c426e97d4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:56.228048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:56.231545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:56.232153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:56.233323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] PATH_INFO: `/v3/limits` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:56.234798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:56.240913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:56.288049 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 28 01:49:56.338540 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 01:49:56.339553 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:49:56.341211 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3740/7528] 10.222.0.59 () {60 vars in 1126 bytes} [Sun Aug 28 01:49:55 2022] POST /identity/v3/limits => generated 124 bytes in 459 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:49:56.353096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:56.578466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847d0d8-1e57-4169-beb6-f7aab47168ff None tempest-ImageQuotaTest-1127207577-system-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:56.687638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:56.692854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:56.693122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:56.694726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:56.695387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:56.705688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:56.752670 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3789/7529] 10.222.0.59 () {58 vars in 1137 bytes} [Sun Aug 28 01:49:56 2022] GET /identity/v3/registered_limits => generated 129 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:56.759052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:56.980285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c8f6-be04-451b-9628-a0cbceba33d9 None tempest-ImageQuotaTest-1127207577-system-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:57.019249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:57.019889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:57.020171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:57.020450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:57.021077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:57.022263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:57.028877 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3741/7530] 10.222.0.59 () {58 vars in 1137 bytes} [Sun Aug 28 01:49:56 2022] GET /identity/v3/registered_limits => generated 129 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:49:57.129690 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:03.525112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:03.528622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:03.667331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b162e07-21cf-46f0-a6dc-f392906fcdab None tempest-ImageQuotaTest-1127207577-system-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:03.675820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:03.676451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:03.676741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:03.677026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:03.678946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:03.749663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:03.753752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:03.810502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91ef9-944d-493b-ac7e-86af5d80db51 None tempest-ImageQuotaTest-1127207577-system-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:03.826269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:03.827784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:03.828265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:03.828753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] PATH_INFO: `/v3/users/e4b519b895b04673951fcf55c2f3e4de` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:03.830161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b519b895b04673951fcf55c2f3e4de)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:03.833920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:03.837314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:03.840169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:03.855508 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3790/7531] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:03.856458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:03.879069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7dbf3-417b-4032-8130-8c059cdc3c48 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:03.885426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:03.887933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:03.887933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:03.887933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] PATH_INFO: `/v3/users/3573a8df7f9946b292c7dd945cd47a28` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:03.888410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3573a8df7f9946b292c7dd945cd47a28)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:03.891875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:04.150766 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:04.159553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b519b895b04673951fcf55c2f3e4de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.183161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b519b895b04673951fcf55c2f3e4de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.193078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b519b895b04673951fcf55c2f3e4de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.199928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b519b895b04673951fcf55c2f3e4de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.215350 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:04.217326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3573a8df7f9946b292c7dd945cd47a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.218087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3573a8df7f9946b292c7dd945cd47a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.315720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-14433325-cadf-4ed9-b7a6-65357b322424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b519b895b04673951fcf55c2f3e4de'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.326307 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3742/7532] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:03 2022] DELETE /identity/v3/users/e4b519b895b04673951fcf55c2f3e4de => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:04.328117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:04.328437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:04.328718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:04.353445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:04.354720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:04.423132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3573a8df7f9946b292c7dd945cd47a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.432707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3573a8df7f9946b292c7dd945cd47a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.434970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3573a8df7f9946b292c7dd945cd47a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:04.492233 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3791/7533] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:03 2022] DELETE /identity/v3/users/3573a8df7f9946b292c7dd945cd47a28 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:04.541193 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3743/7534] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:50:04.593105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:04.596872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:04.723135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887a383-df8f-43c9-a0c7-5314903783cc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:04.731043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:04.731928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:04.732249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:04.732715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:04.849860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:04.852067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:04.866221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3792/7535] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:05.202390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:05.204411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:05.217200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209b296-5198-43fd-96f5-42083cd7fba4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:05.223352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:05.224194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:05.224625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:05.225079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] PATH_INFO: `/v3/projects/8be21147c8d44351a1c8e5d0669df6b3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:05.226453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be21147c8d44351a1c8e5d0669df6b3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:05.229268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:05.409403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be21147c8d44351a1c8e5d0669df6b3', 'request_id': 'req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.421202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be21147c8d44351a1c8e5d0669df6b3', 'request_id': 'req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.496209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be21147c8d44351a1c8e5d0669df6b3', 'request_id': 'req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.513752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] The token cache is being invalidate because project 8be21147c8d44351a1c8e5d0669df6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:05.515620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.516836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.519084 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3744/7536] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:05 2022] DELETE /identity/v3/projects/8be21147c8d44351a1c8e5d0669df6b3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:05.522847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:05.534264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc06a18-f8e4-4980-a50f-f715893ac0f7 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:05.611640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:05.612349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:05.612659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:05.613006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] PATH_INFO: `/v3/users/ab7e9cce2a9e454dbc4de8e5bfa3a1a0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:05.615006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7e9cce2a9e454dbc4de8e5bfa3a1a0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:05.617118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:05.751470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:05.753345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:05.780420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e03a2e-a00e-4c7d-a534-21a110fd1e6d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:05.793245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:05.798286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:05.799810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:05.800450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] PATH_INFO: `/v3/projects/215da5b4d1d54be89662d3ea8c3c4be4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:05.803130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=215da5b4d1d54be89662d3ea8c3c4be4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:05.806277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:05.841205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.842481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.884156 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:05.907058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.915086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.915814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-db9744e8-6e0a-4690-9373-4ed3df9e91eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7e9cce2a9e454dbc4de8e5bfa3a1a0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.941133 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3793/7537] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:05 2022] DELETE /identity/v3/users/ab7e9cce2a9e454dbc4de8e5bfa3a1a0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:05.941387 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:05.958059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215da5b4d1d54be89662d3ea8c3c4be4', 'request_id': 'req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:05.965342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215da5b4d1d54be89662d3ea8c3c4be4', 'request_id': 'req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.060714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215da5b4d1d54be89662d3ea8c3c4be4', 'request_id': 'req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.082383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] The token cache is being invalidate because project 215da5b4d1d54be89662d3ea8c3c4be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:06.082802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.084844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1fcc5a9d-ba8b-4729-8070-0b4326fab1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.094480 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3745/7538] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:05 2022] DELETE /identity/v3/projects/215da5b4d1d54be89662d3ea8c3c4be4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:06.098094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.098756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.100294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.148688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:06.150663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:06.230683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3794/7539] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:06.241132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508076e7-c8b3-45b6-af7f-b2f7ca53ec06 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.242531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508076e7-c8b3-45b6-af7f-b2f7ca53ec06 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.243081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508076e7-c8b3-45b6-af7f-b2f7ca53ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.265416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-508076e7-c8b3-45b6-af7f-b2f7ca53ec06 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:06.266969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-508076e7-c8b3-45b6-af7f-b2f7ca53ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:06.272859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:06.274445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:06.276884 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3746/7540] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:06.281587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508076e7-c8b3-45b6-af7f-b2f7ca53ec06 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:06.291846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af6537-a5ae-41f3-8188-57008172b8a0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:06.292534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508076e7-c8b3-45b6-af7f-b2f7ca53ec06 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:06.298118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:06.299192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.299594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.300116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] PATH_INFO: `/v3/users/b9c5a4643a7c4040bb08b4ad6a9ff678` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.302030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c5a4643a7c4040bb08b4ad6a9ff678)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:06.303524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:06.304151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.304434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.304707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.305234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:06.306124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:50:06.306436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:06.308887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:06.325854 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3747/7541] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:50:06.332865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:06.369502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36fbee-9614-4f0e-ad96-6b85331bec16 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:06.381305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:06.381969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.382258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.382536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.383182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:06.385115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:06.530151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3748/7542] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:06 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:06.532905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:06.628724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c5a4643a7c4040bb08b4ad6a9ff678'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.630164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c5a4643a7c4040bb08b4ad6a9ff678'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.661192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a227b9c-86cc-416a-9988-77f9fe0aa05a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:06.667851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:06.668618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.669286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.669286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.670006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:06.672131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:06.750425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c5a4643a7c4040bb08b4ad6a9ff678'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.760704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c5a4643a7c4040bb08b4ad6a9ff678'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.763873 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3749/7543] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:06 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:06.763873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:06.766465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c5a4643a7c4040bb08b4ad6a9ff678'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:06.767881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:06.783890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47879-778f-4263-8531-657ebd27d687 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:06.790211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e816db7-fa3c-41e6-aa48-c3c6ba5b9210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:06.790920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816db7-fa3c-41e6-aa48-c3c6ba5b9210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.791203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816db7-fa3c-41e6-aa48-c3c6ba5b9210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.791476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816db7-fa3c-41e6-aa48-c3c6ba5b9210 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.801085 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3795/7544] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:06 2022] DELETE /identity/v3/users/b9c5a4643a7c4040bb08b4ad6a9ff678 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:06.803243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e816db7-fa3c-41e6-aa48-c3c6ba5b9210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:06.803611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:06.805523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:06.822126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e816db7-fa3c-41e6-aa48-c3c6ba5b9210 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-7e816db7-fa3c-41e6-aa48-c3c6ba5b9210 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:50:06.845920 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 01:50:06.847050 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:50:06.848839 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3750/7545] 10.222.0.59 () {58 vars in 1149 bytes} [Sun Aug 28 01:50:06 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 01:50:06.851419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.851875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.852830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.896213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:06.899578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:06.961759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa001-cff9-4fa6-bf7e-8937acd6708e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:06.970494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:06.971977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:06.972272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:06.972554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:06.973237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:06.979909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:07.004108 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3796/7546] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:07.005468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:07.028283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28aa10-5f0f-4fea-902b-c29af6253a85 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:07.034323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:07.036165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:07.037104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:07.037547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:07.038442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:07.040523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:07.058357 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3797/7547] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:07.059566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:07.079588 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3751/7548] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:07.089648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc22cd-e042-4130-b025-ffc5a777bc4f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:07.094681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:07.096109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:07.103598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4749a5-9120-476a-b9ec-dc5f9eb1c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:07.104296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4749a5-9120-476a-b9ec-dc5f9eb1c2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:07.104583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4749a5-9120-476a-b9ec-dc5f9eb1c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:07.104862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4749a5-9120-476a-b9ec-dc5f9eb1c2e7 admin admin] PATH_INFO: `/v3/projects/057bb706695f4bf29435f8c7407ee81d/users/8516f61993f645a8af0cdb61b34ed333/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:07.133202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4749a5-9120-476a-b9ec-dc5f9eb1c2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=057bb706695f4bf29435f8c7407ee81d, user_id=8516f61993f645a8af0cdb61b34ed333, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:07.137062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4749a5-9120-476a-b9ec-dc5f9eb1c2e7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:07.209656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7b3ae-df8c-42cb-b6a9-00d066a662c8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:07.218734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:07.219735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:07.220175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:07.220606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:07.251647 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3798/7549] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:07 2022] PUT /identity/v3/projects/057bb706695f4bf29435f8c7407ee81d/users/8516f61993f645a8af0cdb61b34ed333/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:07.257031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:07.257640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:07.258585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:07.262553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:07.267488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:07.357740 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3752/7550] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:50:07.413289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] MFA Rules not processed for user `8516f61993f645a8af0cdb61b34ed333`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:07.414586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:07.547936 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3799/7551] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:07.552179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:07.569521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a7394-2110-44c8-be73-b569c846d95b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:07.694479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:07.695118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:07.695403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:07.695682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:07.696659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:07.698841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:07.780664 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:07.835239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:07.835868 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:07.836871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:07.856271 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3753/7552] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:07 2022] POST /identity/v3/projects => generated 379 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:07.857614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:07.863941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28bf5-0bcd-4aab-a7fa-2d240f46c326 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:07.965983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:07.966653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:07.966942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:07.967220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] PATH_INFO: `/v3/projects/fbce5b1d431f421d891b78248c4ffd03` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:07.971913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbce5b1d431f421d891b78248c4ffd03)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:07.971913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:07.972275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3649f8-41a7-4d80-9c47-4fedb10069be admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:07.984916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:07.985569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:07.987514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:07.987514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:07.987514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:07.988702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.111856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3754/7553] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:07 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:50:08.118684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.133436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbce5b1d431f421d891b78248c4ffd03', 'request_id': 'req-2384877f-e96f-4645-8878-9f9217b77508'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:08.136208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e53446-d9c4-4c04-8b22-0e22bc52e379 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.142826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbce5b1d431f421d891b78248c4ffd03', 'request_id': 'req-2384877f-e96f-4645-8878-9f9217b77508'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:08.243988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbce5b1d431f421d891b78248c4ffd03', 'request_id': 'req-2384877f-e96f-4645-8878-9f9217b77508'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:08.256102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.257074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.257512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.258136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.259093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.260923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.261425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] The token cache is being invalidate because project fbce5b1d431f421d891b78248c4ffd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:08.261719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:08.262512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2384877f-e96f-4645-8878-9f9217b77508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:08.264026 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3800/7554] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:07 2022] DELETE /identity/v3/projects/fbce5b1d431f421d891b78248c4ffd03 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:08.270377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ee4e-f957-4587-95ba-d3292eee43f3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.270478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ee4e-f957-4587-95ba-d3292eee43f3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.270809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ee4e-f957-4587-95ba-d3292eee43f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.290008 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3755/7555] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:08.294127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.297664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:08.310349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-00c7ee4e-f957-4587-95ba-d3292eee43f3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:08.310349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-00c7ee4e-f957-4587-95ba-d3292eee43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:08.314245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42744504-37f6-40cf-b8f5-a681aa8300ed admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.320172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.321263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.321757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.324612 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3801/7556] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:08.328385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] PATH_INFO: `/v3/projects/1b0a6f82cb3547eabf6253de6d2e5583/users/b0b76eece1f44a3999843229958f8711/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.333159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe2f4-007d-4624-87d3-0fd557202a67 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.333568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe2f4-007d-4624-87d3-0fd557202a67 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.334008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfe2f4-007d-4624-87d3-0fd557202a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.359853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0a6f82cb3547eabf6253de6d2e5583, user_id=b0b76eece1f44a3999843229958f8711, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.360837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-84cfe2f4-007d-4624-87d3-0fd557202a67 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:08.362466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-84cfe2f4-007d-4624-87d3-0fd557202a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:08.365306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.396057 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3802/7557] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:08.399835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfe2f4-007d-4624-87d3-0fd557202a67 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.418354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfe2f4-007d-4624-87d3-0fd557202a67 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.427479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.428514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.428864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.429214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.430008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:50:08.430386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.432470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.451722 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3756/7558] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:08 2022] PUT /identity/v3/projects/1b0a6f82cb3547eabf6253de6d2e5583/users/b0b76eece1f44a3999843229958f8711/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:08.456451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.468139 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3803/7559] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:50:08.473992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.494819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a2f1-81a5-41a4-89f1-9d7ca5c21d15 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.561265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b9d0-3179-46b0-8569-551ff3430ec5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.570400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.571076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.571347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.571634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.572398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.573968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.574388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.575198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.575705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.575991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.577518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.588921 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3757/7560] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:50:08.590401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.594752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.614250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f0f8a-d170-4c32-941c-1f1db728f059 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.626651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a06b90-26d0-4b01-9cd4-8b5eb8efe7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.628202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06b90-26d0-4b01-9cd4-8b5eb8efe7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.628605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06b90-26d0-4b01-9cd4-8b5eb8efe7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.629075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06b90-26d0-4b01-9cd4-8b5eb8efe7d7 admin admin] PATH_INFO: `/v3/projects/1b0a6f82cb3547eabf6253de6d2e5583/users/b0b76eece1f44a3999843229958f8711/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.633374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a06b90-26d0-4b01-9cd4-8b5eb8efe7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0a6f82cb3547eabf6253de6d2e5583, user_id=b0b76eece1f44a3999843229958f8711, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.637692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a06b90-26d0-4b01-9cd4-8b5eb8efe7d7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.656414 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3758/7561] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:08 2022] PUT /identity/v3/projects/1b0a6f82cb3547eabf6253de6d2e5583/users/b0b76eece1f44a3999843229958f8711/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:08.668318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.668706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.669018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.696312 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3804/7562] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:08 2022] POST /identity/v3/projects => generated 353 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:08.701000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.716532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] MFA Rules not processed for user `b0b76eece1f44a3999843229958f8711`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:08.719306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:08.830941 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3759/7563] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:08.843258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.844726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:08.847356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7e758-e904-4150-9bd2-689e942aabd1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.852539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.853339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.853633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.853949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.855367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.857359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.928518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172e797-4baf-49b1-8d33-76cd021c5875 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:08.932683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:08.933490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:08.934283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:08.934283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:08.946425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:08.947963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:08.961391 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3760/7564] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:08.981541 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3805/7565] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:08 2022] POST /identity/v3/users => generated 277 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:08.982646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:08.995325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df55e-292a-46be-ba77-bcec4c9b6c81 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:09.001842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:09.002440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:09.002733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:09.007414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:09.007414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:09.007414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:09.018527 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3761/7566] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:09.022267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:09.035534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ace2d-f327-445d-8a80-58966bf3027f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:09.042565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa610-be95-4252-a9d6-5e2ad70c990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:09.043397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa610-be95-4252-a9d6-5e2ad70c990b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:09.043682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa610-be95-4252-a9d6-5e2ad70c990b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:09.044000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa610-be95-4252-a9d6-5e2ad70c990b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:09.044658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa610-be95-4252-a9d6-5e2ad70c990b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:09.047012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa610-be95-4252-a9d6-5e2ad70c990b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:09.063298 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3806/7567] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:09.067246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:09.080507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb2796-497b-43b7-804e-ea1b41b93f41 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:09.096199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:09.097258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:09.097747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:09.098289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] PATH_INFO: `/v3/projects/b9a61cbdac8a4d4782e14da700bb6ee7/users/6ebd90045a3f49cdaf6c4fb370641b0e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:09.149635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a61cbdac8a4d4782e14da700bb6ee7, user_id=6ebd90045a3f49cdaf6c4fb370641b0e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:09.151025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:09.263728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3762/7568] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:09 2022] PUT /identity/v3/projects/b9a61cbdac8a4d4782e14da700bb6ee7/users/6ebd90045a3f49cdaf6c4fb370641b0e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:09.274911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:09.275210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:09.275477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:09.321553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:09.355397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] MFA Rules not processed for user `6ebd90045a3f49cdaf6c4fb370641b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:09.357701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:09.442212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848a65e-a312-4e7c-8e5a-66234bd05f48 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:09.463510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:09.464429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:09.464903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:09.465184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:09.468488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:09.521299 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3807/7569] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:09.539107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:09.543901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:09.599330 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:09.631091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:09.635717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:09.659143 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3763/7570] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:09.669235 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:09.701471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252d254-c58a-489b-86d5-8d8615e29289 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:09.721331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e429ee-e798-49d0-a6a2-630169016112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:09.722012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e429ee-e798-49d0-a6a2-630169016112 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:09.722302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e429ee-e798-49d0-a6a2-630169016112 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:09.722578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e429ee-e798-49d0-a6a2-630169016112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:09.745354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e429ee-e798-49d0-a6a2-630169016112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:09.746969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e429ee-e798-49d0-a6a2-630169016112 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:09.778281 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3808/7571] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:11.006765 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:11.339560 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:13.414846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:13.465016 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:13.571574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a7f7-e8ac-468f-bf55-012d78aefa57 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:13.589525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:13.590478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:13.590922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:13.591350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] PATH_INFO: `/v3/users/6ebd90045a3f49cdaf6c4fb370641b0e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:13.594553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebd90045a3f49cdaf6c4fb370641b0e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:13.596695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:13.834762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebd90045a3f49cdaf6c4fb370641b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:13.856663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebd90045a3f49cdaf6c4fb370641b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:13.866385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebd90045a3f49cdaf6c4fb370641b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:13.869346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebd90045a3f49cdaf6c4fb370641b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:13.963382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebd90045a3f49cdaf6c4fb370641b0e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:13.976567 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3764/7572] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:13 2022] DELETE /identity/v3/users/6ebd90045a3f49cdaf6c4fb370641b0e => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:13.978032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:13.978446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:13.978601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:14.003374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:14.004823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:14.069588 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:14.095533 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3809/7573] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:14.125253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:14.127505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:14.276474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c8273-2cd9-4ab7-bec1-5295f6d855cf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:14.292231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bdd7-741b-436a-97a2-70a23f05d6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:14.292871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bdd7-741b-436a-97a2-70a23f05d6ee service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:14.293159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bdd7-741b-436a-97a2-70a23f05d6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:14.293436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bdd7-741b-436a-97a2-70a23f05d6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:14.306974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bdd7-741b-436a-97a2-70a23f05d6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:14.308930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bdd7-741b-436a-97a2-70a23f05d6ee service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:14.331175 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3765/7574] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:14.788126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:14.790657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:14.822400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf18ce-6762-4010-abab-49c1710be06e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:14.832119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:14.837610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:14.837610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:14.837610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] PATH_INFO: `/v3/projects/b9a61cbdac8a4d4782e14da700bb6ee7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:14.837610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a61cbdac8a4d4782e14da700bb6ee7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:14.839593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:15.046259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a61cbdac8a4d4782e14da700bb6ee7', 'request_id': 'req-a01fdec7-0559-4324-940b-e18c438f1b12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:15.059453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a61cbdac8a4d4782e14da700bb6ee7', 'request_id': 'req-a01fdec7-0559-4324-940b-e18c438f1b12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:15.134577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a61cbdac8a4d4782e14da700bb6ee7', 'request_id': 'req-a01fdec7-0559-4324-940b-e18c438f1b12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:15.153632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] The token cache is being invalidate because project b9a61cbdac8a4d4782e14da700bb6ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:15.158720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:15.160435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a01fdec7-0559-4324-940b-e18c438f1b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:15.166192 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3810/7575] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:14 2022] DELETE /identity/v3/projects/b9a61cbdac8a4d4782e14da700bb6ee7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:15.171232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2f80f-9b89-4676-b8eb-facd7298c0dc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:15.171715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2f80f-9b89-4676-b8eb-facd7298c0dc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:15.171715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2f80f-9b89-4676-b8eb-facd7298c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:15.216861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2fd2f80f-9b89-4676-b8eb-facd7298c0dc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:15.216861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2fd2f80f-9b89-4676-b8eb-facd7298c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:15.260320 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:15.309398 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3766/7576] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:50:15.318002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4005ea-5af3-4330-91ea-80f437901fa4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:15.318529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4005ea-5af3-4330-91ea-80f437901fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:15.318809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4005ea-5af3-4330-91ea-80f437901fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:15.349685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ce4005ea-5af3-4330-91ea-80f437901fa4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:15.352287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ce4005ea-5af3-4330-91ea-80f437901fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:15.372777 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3811/7577] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:15.375014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2f80f-9b89-4676-b8eb-facd7298c0dc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:15.386588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2f80f-9b89-4676-b8eb-facd7298c0dc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:15.395946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:15.397119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:15.398155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:15.398781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:15.399661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:50:15.400136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:15.402483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:15.422332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3767/7578] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:50:15.426375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4005ea-5af3-4330-91ea-80f437901fa4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:15.440610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4005ea-5af3-4330-91ea-80f437901fa4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:15.446523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:15.447153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:15.447447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:15.447734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:15.448458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:15.450731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:15.689389 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3812/7579] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:15 2022] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:50:15.690550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:15.716956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63fd17-e7de-4225-9f6d-f060bbe8d76f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:15.860493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:15.861055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:15.861342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:15.862388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:15.862388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:15.864291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:16.018833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3768/7580] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:15 2022] POST /identity/v3/users => generated 287 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:50:16.023479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:16.056668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107d62c-25a8-45a8-b98b-d5268e16542c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:16.070357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:16.071490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:16.071705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:16.072139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:16.072796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:16.074444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:16.106260 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3813/7581] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:16.112327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:16.132844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432663-f8bd-4983-bb8e-792b6e429b17 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:16.172071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7459b8-a86b-423d-ac43-f491d66e5294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:16.175158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7459b8-a86b-423d-ac43-f491d66e5294 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:16.175658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7459b8-a86b-423d-ac43-f491d66e5294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:16.175933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7459b8-a86b-423d-ac43-f491d66e5294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:16.176622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7459b8-a86b-423d-ac43-f491d66e5294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:16.178423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7459b8-a86b-423d-ac43-f491d66e5294 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:16.200950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:16.203738 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3769/7582] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:16.214873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b036f-e5e7-4d30-94a7-933c745bacb6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:16.229131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:16.230813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:16.231432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:16.231946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] PATH_INFO: `/v3/projects/6c17acd0f594466bb34c3edc89a9d649/users/40115bcc6318434f9f6ded6203b96661/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:16.257683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c17acd0f594466bb34c3edc89a9d649, user_id=40115bcc6318434f9f6ded6203b96661, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:16.261427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:16.385207 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3814/7583] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:16 2022] PUT /identity/v3/projects/6c17acd0f594466bb34c3edc89a9d649/users/40115bcc6318434f9f6ded6203b96661/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:16.400501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d794b9-f28d-4600-9288-00b99db3f99d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:16.401612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d794b9-f28d-4600-9288-00b99db3f99d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:16.402078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d794b9-f28d-4600-9288-00b99db3f99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:16.501356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-13d794b9-f28d-4600-9288-00b99db3f99d None None] MFA Rules not processed for user `40115bcc6318434f9f6ded6203b96661`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:16.505642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-13d794b9-f28d-4600-9288-00b99db3f99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:16.690443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3770/7584] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:16.704951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:16.707074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:16.856702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f2a5-2aa9-4812-80c0-2150b2cee85f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:16.870248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34b0b-92b2-4395-b783-f766192c1f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:16.871192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34b0b-92b2-4395-b783-f766192c1f18 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:16.878099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34b0b-92b2-4395-b783-f766192c1f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:16.882413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34b0b-92b2-4395-b783-f766192c1f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:16.896533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34b0b-92b2-4395-b783-f766192c1f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:16.898312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34b0b-92b2-4395-b783-f766192c1f18 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:16.922871 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3815/7585] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:16.950435 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d794b9-f28d-4600-9288-00b99db3f99d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:17.028313 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:17.059991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d794b9-f28d-4600-9288-00b99db3f99d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:17.067864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:17.068872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:17.069506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:17.070036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] PATH_INFO: `/v3/users/40115bcc6318434f9f6ded6203b96661` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:17.071514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=40115bcc6318434f9f6ded6203b96661)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:17.074645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:17.331941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40115bcc6318434f9f6ded6203b96661'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:17.347072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40115bcc6318434f9f6ded6203b96661'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:17.355161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40115bcc6318434f9f6ded6203b96661'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:17.356225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40115bcc6318434f9f6ded6203b96661'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:17.523788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f4e79d9f-9ec7-4bd8-92a3-94191a9d0cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40115bcc6318434f9f6ded6203b96661'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:17.544668 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3771/7586] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:16 2022] DELETE /identity/v3/users/40115bcc6318434f9f6ded6203b96661 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:17.549472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:17.550461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:17.550461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:17.586905 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:17.613381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:17.613693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:17.637921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:17.691008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:17.721542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:17.804515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:17.806170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:17.912923 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3772/7587] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:50:17.999586 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3816/7588] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:18.006124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:18.007853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:18.109499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90621-8251-4cec-a010-1cef16d9c3ee None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:18.114606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5289-3a21-44c2-b538-63f50e53a045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:18.115301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5289-3a21-44c2-b538-63f50e53a045 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:18.115585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5289-3a21-44c2-b538-63f50e53a045 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:18.115950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5289-3a21-44c2-b538-63f50e53a045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:18.124659 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:18.128715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5289-3a21-44c2-b538-63f50e53a045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:18.130269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca5289-3a21-44c2-b538-63f50e53a045 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:18.145151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3773/7589] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:50:18.800134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:18.800134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:18.833985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3db4f6-e247-4385-98e0-83a2c085e6ed None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:18.855649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:18.856784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:18.862365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:18.862365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] PATH_INFO: `/v3/projects/6c17acd0f594466bb34c3edc89a9d649` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:18.862365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c17acd0f594466bb34c3edc89a9d649)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:18.862365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:19.030740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c17acd0f594466bb34c3edc89a9d649', 'request_id': 'req-02918d67-344d-4db2-87ff-434c28a45262'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:19.039287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c17acd0f594466bb34c3edc89a9d649', 'request_id': 'req-02918d67-344d-4db2-87ff-434c28a45262'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:19.104389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c17acd0f594466bb34c3edc89a9d649', 'request_id': 'req-02918d67-344d-4db2-87ff-434c28a45262'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:19.117172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] The token cache is being invalidate because project 6c17acd0f594466bb34c3edc89a9d649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:19.117470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:19.118220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-02918d67-344d-4db2-87ff-434c28a45262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:19.119809 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3817/7590] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:18 2022] DELETE /identity/v3/projects/6c17acd0f594466bb34c3edc89a9d649 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:19.126721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215ed6-8f10-4c4f-960c-2a1be07878d5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.132264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215ed6-8f10-4c4f-960c-2a1be07878d5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.132264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215ed6-8f10-4c4f-960c-2a1be07878d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:19.152657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e8215ed6-8f10-4c4f-960c-2a1be07878d5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:19.154024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e8215ed6-8f10-4c4f-960c-2a1be07878d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:19.242468 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3774/7591] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:19.243871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad4c6-16bb-487b-bd01-6a1b53bc170f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.244159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad4c6-16bb-487b-bd01-6a1b53bc170f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.244433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad4c6-16bb-487b-bd01-6a1b53bc170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:19.267880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-20cad4c6-16bb-487b-bd01-6a1b53bc170f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:19.269154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-20cad4c6-16bb-487b-bd01-6a1b53bc170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:19.285132 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3818/7592] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:19.286604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215ed6-8f10-4c4f-960c-2a1be07878d5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:19.298831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215ed6-8f10-4c4f-960c-2a1be07878d5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:19.305018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:19.306076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.306534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.307490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:19.308345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:50:19.308861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:19.310878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:19.333015 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3775/7593] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:50:19.337621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad4c6-16bb-487b-bd01-6a1b53bc170f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:19.350452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad4c6-16bb-487b-bd01-6a1b53bc170f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:19.356231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:19.357040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.357469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.357960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:19.358767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:19.360889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:19.541541 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3819/7594] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:19 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:19.546853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:19.559107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28325c75-dff3-4b6e-86b6-f299345068b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:19.666046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:19.666863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.667238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.667613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:19.668341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:19.670378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:19.775219 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3776/7595] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:19 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:19.782289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:19.805259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea6d5f-cff0-4d93-9376-a8bf60130110 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:19.844915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:19.845716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.846082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.846440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:19.847159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:19.848942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:19.861935 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3820/7596] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:19.867086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:19.882366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ece46-3136-4986-b971-6b3078711673 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:19.895561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e68c0-ec8f-4285-bb9c-895b8e058397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:19.896401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e68c0-ec8f-4285-bb9c-895b8e058397 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.896833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e68c0-ec8f-4285-bb9c-895b8e058397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.898031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e68c0-ec8f-4285-bb9c-895b8e058397 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:19.898722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e68c0-ec8f-4285-bb9c-895b8e058397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:19.900382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e68c0-ec8f-4285-bb9c-895b8e058397 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:19.924445 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3777/7597] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:19.926275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:19.941504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf690698-be50-4aa8-bdba-a80586731a67 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:19.963887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:19.963887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:19.963887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:19.963887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] PATH_INFO: `/v3/projects/6734242aafcb47bbbbd76654b2a0b817/users/ac68300847824286b1ee7045fe089c8f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:20.003012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6734242aafcb47bbbbd76654b2a0b817, user_id=ac68300847824286b1ee7045fe089c8f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:20.005731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:20.176375 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3821/7598] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:19 2022] PUT /identity/v3/projects/6734242aafcb47bbbbd76654b2a0b817/users/ac68300847824286b1ee7045fe089c8f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:20.176939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:20.176939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:20.177522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:20.231338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] MFA Rules not processed for user `ac68300847824286b1ee7045fe089c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:20.232601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:20.336149 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:20.355088 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3778/7599] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:20.366721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:20.368824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:20.446083 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:20.566717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1f49-2d86-4bd7-881a-ffcb9bced78c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:20.571664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0076d02-9181-40ad-8bac-0c28de3357d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:20.572488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076d02-9181-40ad-8bac-0c28de3357d1 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:20.572946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076d02-9181-40ad-8bac-0c28de3357d1 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:20.573612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0076d02-9181-40ad-8bac-0c28de3357d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:20.608818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0076d02-9181-40ad-8bac-0c28de3357d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:20.610365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0076d02-9181-40ad-8bac-0c28de3357d1 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:20.626258 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3822/7600] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:29.146351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:29.147998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:29.355078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39614-3c19-4c55-8e97-d3742e1d6370 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:29.363506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:29.363506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:29.363790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:29.363949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] PATH_INFO: `/v3/users/8516f61993f645a8af0cdb61b34ed333` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:29.372082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8516f61993f645a8af0cdb61b34ed333)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:29.375007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:29.651196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8516f61993f645a8af0cdb61b34ed333'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:29.683964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8516f61993f645a8af0cdb61b34ed333'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:29.704983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8516f61993f645a8af0cdb61b34ed333'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:29.708115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8516f61993f645a8af0cdb61b34ed333'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:29.791743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8516f61993f645a8af0cdb61b34ed333'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:29.803171 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3779/7601] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:29 2022] DELETE /identity/v3/users/8516f61993f645a8af0cdb61b34ed333 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:29.808561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:29.809138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:29.809532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:29.845621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:29.847395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:29.994971 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3823/7602] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:30.005824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:30.008292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:30.175155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5af7f-a4d3-4520-ba28-38b54667fb52 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:30.191007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:30.193095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:30.194039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:30.194039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:30.209392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:30.212097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:30.238493 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3780/7603] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:31.035538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:31.038042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:31.084459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a550d9-ace4-47b0-a0e9-fb15961cc110 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:31.090591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:31.091427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:31.091735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:31.092058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] PATH_INFO: `/v3/projects/057bb706695f4bf29435f8c7407ee81d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:31.094474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057bb706695f4bf29435f8c7407ee81d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:31.096449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:31.293934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057bb706695f4bf29435f8c7407ee81d', 'request_id': 'req-a68a204e-89db-4a92-993b-ab0e05b57a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.308002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057bb706695f4bf29435f8c7407ee81d', 'request_id': 'req-a68a204e-89db-4a92-993b-ab0e05b57a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.368740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057bb706695f4bf29435f8c7407ee81d', 'request_id': 'req-a68a204e-89db-4a92-993b-ab0e05b57a28'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.389006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] The token cache is being invalidate because project 057bb706695f4bf29435f8c7407ee81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:31.389386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.390232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a68a204e-89db-4a92-993b-ab0e05b57a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.395181 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3824/7604] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:31 2022] DELETE /identity/v3/projects/057bb706695f4bf29435f8c7407ee81d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:31.396169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:31.418489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd0bb8-a958-4e3d-be03-24c6effaae59 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:31.434302 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:31.533092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:31.537666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:31.542733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:31.542733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] PATH_INFO: `/v3/users/b0b76eece1f44a3999843229958f8711` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:31.542733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b76eece1f44a3999843229958f8711)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:31.542733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:31.743473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:31.745943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:31.745943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:31.767660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:31.768884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:31.776439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b76eece1f44a3999843229958f8711'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.822330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b76eece1f44a3999843229958f8711'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.836460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b76eece1f44a3999843229958f8711'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.837638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b76eece1f44a3999843229958f8711'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.837750 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:31.872517 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3825/7605] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:50:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:50:31.918512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b76eece1f44a3999843229958f8711'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:31.928812 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3781/7606] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:31 2022] DELETE /identity/v3/users/b0b76eece1f44a3999843229958f8711 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:50:32.087698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:32.089413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:32.188588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0b88e-4e7d-428e-8bc8-bac7e5a8bd22 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:32.286488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a964102-5a61-4682-90e5-d9e6f9752641 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:32.287271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a964102-5a61-4682-90e5-d9e6f9752641 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:32.287554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a964102-5a61-4682-90e5-d9e6f9752641 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:32.287831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a964102-5a61-4682-90e5-d9e6f9752641 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:32.390546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a964102-5a61-4682-90e5-d9e6f9752641 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:32.392679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a964102-5a61-4682-90e5-d9e6f9752641 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:32.410446 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3826/7607] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:50:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:50:32.558789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:32.560107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:32.793452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4aa15-8615-4336-bb15-315a88ee23fb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:32.800262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:32.801656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:32.802237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:32.802749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] PATH_INFO: `/v3/projects/1b0a6f82cb3547eabf6253de6d2e5583` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:32.822325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0a6f82cb3547eabf6253de6d2e5583)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:32.825470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:32.958990 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:32.972183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0a6f82cb3547eabf6253de6d2e5583', 'request_id': 'req-276ea53a-10ce-4f99-a864-3360893acca8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:32.981748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0a6f82cb3547eabf6253de6d2e5583', 'request_id': 'req-276ea53a-10ce-4f99-a864-3360893acca8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:33.066690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0a6f82cb3547eabf6253de6d2e5583', 'request_id': 'req-276ea53a-10ce-4f99-a864-3360893acca8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:33.094390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] The token cache is being invalidate because project 1b0a6f82cb3547eabf6253de6d2e5583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:33.095395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:33.097360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-276ea53a-10ce-4f99-a864-3360893acca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:33.104709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012beb4-9681-47cb-8d2f-7ca046aac981 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:33.105234 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3782/7608] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:32 2022] DELETE /identity/v3/projects/1b0a6f82cb3547eabf6253de6d2e5583 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:33.105775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012beb4-9681-47cb-8d2f-7ca046aac981 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:33.106299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012beb4-9681-47cb-8d2f-7ca046aac981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:33.196048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4012beb4-9681-47cb-8d2f-7ca046aac981 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:33.199119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4012beb4-9681-47cb-8d2f-7ca046aac981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:33.264869 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:33.330844 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3827/7609] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:50:33.332871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627e1c-ca65-4ab3-81dc-a8acafb8b648 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:33.332871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627e1c-ca65-4ab3-81dc-a8acafb8b648 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:33.333062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6627e1c-ca65-4ab3-81dc-a8acafb8b648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:33.375933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d6627e1c-ca65-4ab3-81dc-a8acafb8b648 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:33.379097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d6627e1c-ca65-4ab3-81dc-a8acafb8b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:33.418157 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3783/7610] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:33.429708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012beb4-9681-47cb-8d2f-7ca046aac981 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:33.443640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012beb4-9681-47cb-8d2f-7ca046aac981 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:33.453155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:33.454006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:33.454628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:33.455007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:33.456747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:50:33.457213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:33.458975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:33.483380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627e1c-ca65-4ab3-81dc-a8acafb8b648 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:33.498323 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3828/7611] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:50:33.510770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6627e1c-ca65-4ab3-81dc-a8acafb8b648 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:33.526426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:33.527324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:33.528030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:33.528487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:33.529408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:33.532768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:33.688067 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3784/7612] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:33 2022] POST /identity/v3/projects => generated 357 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:33.692012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:33.707662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277fb26-93cc-4288-9796-76a321c429fd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:33.801636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:33.803351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:33.803836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:33.804125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:33.804765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:33.806783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:33.921890 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3829/7613] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:33 2022] POST /identity/v3/users => generated 279 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:33.926701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:33.958194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c881-8b44-4bb1-af54-b1ae1152ea87 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:33.970092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:33.971035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:33.971678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:33.972103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:33.973112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:33.975026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:34.010708 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3785/7614] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:50:34.012000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:34.024569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870091e5-b263-484d-a25b-f4e028d153cf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:34.043559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299104b-cc11-4e83-ba25-88adf3d814c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:34.044324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299104b-cc11-4e83-ba25-88adf3d814c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:34.044604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299104b-cc11-4e83-ba25-88adf3d814c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:34.044945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299104b-cc11-4e83-ba25-88adf3d814c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:34.045955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299104b-cc11-4e83-ba25-88adf3d814c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:34.052865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299104b-cc11-4e83-ba25-88adf3d814c5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:34.081556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:34.082366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3830/7615] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:34.093231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b35b1-feea-4b71-a28c-144041393684 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:34.098844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:34.099768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:34.100210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:34.100663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] PATH_INFO: `/v3/projects/82a001b8807d45f0b56a394a9ab1adaf/users/518be4dd551c474c97aa3402e078dfc4/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:34.119938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a001b8807d45f0b56a394a9ab1adaf, user_id=518be4dd551c474c97aa3402e078dfc4, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:34.123857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:34.184975 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3786/7616] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:34 2022] PUT /identity/v3/projects/82a001b8807d45f0b56a394a9ab1adaf/users/518be4dd551c474c97aa3402e078dfc4/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:50:34.195324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d779b-7a77-4a54-8dff-13911dc90bf1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:34.195826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d779b-7a77-4a54-8dff-13911dc90bf1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:34.195926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d779b-7a77-4a54-8dff-13911dc90bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:34.247663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-218d779b-7a77-4a54-8dff-13911dc90bf1 None None] MFA Rules not processed for user `518be4dd551c474c97aa3402e078dfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:34.250384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-218d779b-7a77-4a54-8dff-13911dc90bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:34.361669 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3831/7617] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:34.366277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:34.503346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc44a-90c8-40f3-a9f6-81f7f2674622 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:34.513493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:34.515107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:34.515334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:34.515613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:34.516850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:34.523397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:34.672482 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3787/7618] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:34 2022] POST /identity/v3/projects => generated 355 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:50:34.673978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d779b-7a77-4a54-8dff-13911dc90bf1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:34.700637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d779b-7a77-4a54-8dff-13911dc90bf1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:34.775547 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:34.883529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:34.886513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:34.887198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:34.888607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:34.890564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:34.897126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:35.023844 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3832/7619] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:34 2022] POST /identity/v3/users => generated 284 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:50:35.030653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:35.044466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e150127-ac2f-4424-95e1-8681c5e51755 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:35.060036 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:35.061071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:35.061507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:35.062045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:35.063170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:35.065143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:35.086596 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3788/7620] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:50:35.095587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:35.131936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600249f-230a-4e55-8a4e-c0e6198debc9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:35.146298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:35.147289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:35.148558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:35.149111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] PATH_INFO: `/v3/projects/b7f91cb92f244d63b88681f530b7947b/users/7858763fc9274de39ad229f4b8b5e130/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:35.189590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f91cb92f244d63b88681f530b7947b, user_id=7858763fc9274de39ad229f4b8b5e130, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:35.196288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:35.353723 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3833/7621] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:35 2022] PUT /identity/v3/projects/b7f91cb92f244d63b88681f530b7947b/users/7858763fc9274de39ad229f4b8b5e130/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:35.359396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:35.382866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cfa44-fd75-4e87-a82f-49c7779df608 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:35.515742 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:35.588910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31fe45-35ff-4923-8dad-d34fda4e4ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:35.593390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fe45-35ff-4923-8dad-d34fda4e4ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:35.594752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fe45-35ff-4923-8dad-d34fda4e4ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:35.595063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fe45-35ff-4923-8dad-d34fda4e4ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:35.595745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31fe45-35ff-4923-8dad-d34fda4e4ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:35.599142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31fe45-35ff-4923-8dad-d34fda4e4ac6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:35.637518 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3789/7622] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:35.641016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:35.654689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021462d-7865-4478-9b53-d74d1feff87d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:35.834659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:35.834659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:35.834659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:35.834659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] PATH_INFO: `/v3/projects/b7f91cb92f244d63b88681f530b7947b/users/7858763fc9274de39ad229f4b8b5e130/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:35.835352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f91cb92f244d63b88681f530b7947b, user_id=7858763fc9274de39ad229f4b8b5e130, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:35.835352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:35.835352 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3834/7623] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:35 2022] PUT /identity/v3/projects/b7f91cb92f244d63b88681f530b7947b/users/7858763fc9274de39ad229f4b8b5e130/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:35.842869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:35.842869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:35.842869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:35.905593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] MFA Rules not processed for user `7858763fc9274de39ad229f4b8b5e130`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:35.907619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:36.047950 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3790/7624] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:36.063756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:36.066291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:36.164781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044061d-614c-43a1-8fe6-ab90ab73740d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:36.168638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:36.169595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:36.170459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:36.170459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:36.181412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:36.184865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:36.199650 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3835/7625] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:36.520976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:36.522537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:36.557848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6ac77-948e-4ef4-82b5-c71430969aae None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:36.565768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:36.568400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:36.568400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:36.568400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:36.697448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:36.698062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:36.711502 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3791/7626] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:46.192483 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=58,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:46.705487 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=76 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:51.220705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:51.222243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:51.452686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b2e4b-7448-4ab7-8577-f67f06931473 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:51.473621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e24ee-ada8-4adc-a147-25ccdb84fd57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:51.474314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e24ee-ada8-4adc-a147-25ccdb84fd57 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:51.475550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e24ee-ada8-4adc-a147-25ccdb84fd57 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:51.475838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e24ee-ada8-4adc-a147-25ccdb84fd57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:51.487395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a78e24ee-ada8-4adc-a147-25ccdb84fd57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:51.644901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e24ee-ada8-4adc-a147-25ccdb84fd57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:51.651719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e24ee-ada8-4adc-a147-25ccdb84fd57 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:51.694381 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3836/7627] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:50:55.864148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:55.865800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:55.978018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1c5c-8524-4222-a6ce-804a0f21a884 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:55.986592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:55.988005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:55.988656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:55.988784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] PATH_INFO: `/v3/users/9f39da5448d74638ba6b2a935350f5b0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:55.990606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f39da5448d74638ba6b2a935350f5b0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:55.993068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:56.248161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f39da5448d74638ba6b2a935350f5b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:56.274061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f39da5448d74638ba6b2a935350f5b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:56.284259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f39da5448d74638ba6b2a935350f5b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:56.285555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f39da5448d74638ba6b2a935350f5b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:56.382482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f39da5448d74638ba6b2a935350f5b0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:56.392687 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3792/7628] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:50:55 2022] DELETE /identity/v3/users/9f39da5448d74638ba6b2a935350f5b0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:56.397701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:56.398698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:56.399171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:56.430613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:56.431958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:56.500584 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3837/7629] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:56.507471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:56.508954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:56.580914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506cef4-b3be-4443-8ba4-7a5e5e1655b0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:56.584643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63302538-277e-421c-9648-bc537c077a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:56.585248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63302538-277e-421c-9648-bc537c077a93 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:56.585525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63302538-277e-421c-9648-bc537c077a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:56.585794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63302538-277e-421c-9648-bc537c077a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:56.600749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63302538-277e-421c-9648-bc537c077a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:56.600749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63302538-277e-421c-9648-bc537c077a93 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:56.608529 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3793/7630] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:56.900140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:56.905188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:56.930199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25840be5-f9c0-42e3-8832-77ab1eda4850 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:56.943092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:56.943745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:56.944024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:56.944299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] PATH_INFO: `/v3/projects/e8b36863fee84e78809c2cbd1b726cd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:56.945515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b36863fee84e78809c2cbd1b726cd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:56.947608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:57.084791 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:57.121071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b36863fee84e78809c2cbd1b726cd7', 'request_id': 'req-850962d4-e156-411e-9fbc-9a6f0a08570b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:57.129408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b36863fee84e78809c2cbd1b726cd7', 'request_id': 'req-850962d4-e156-411e-9fbc-9a6f0a08570b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:57.217603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b36863fee84e78809c2cbd1b726cd7', 'request_id': 'req-850962d4-e156-411e-9fbc-9a6f0a08570b'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:57.244579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] The token cache is being invalidate because project e8b36863fee84e78809c2cbd1b726cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:50:57.244946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:57.245535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-850962d4-e156-411e-9fbc-9a6f0a08570b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:50:57.253387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3f94-06c9-452d-b2ab-afe2bcf13687 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.254563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3f94-06c9-452d-b2ab-afe2bcf13687 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.254990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3f94-06c9-452d-b2ab-afe2bcf13687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.259356 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3838/7631] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:50:56 2022] DELETE /identity/v3/projects/e8b36863fee84e78809c2cbd1b726cd7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:57.281217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-89fe3f94-06c9-452d-b2ab-afe2bcf13687 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:57.283078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-89fe3f94-06c9-452d-b2ab-afe2bcf13687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:57.304781 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:57.372907 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3794/7632] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:57.380361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4231-a14a-4c79-bd57-641c68cb9b60 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.380646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4231-a14a-4c79-bd57-641c68cb9b60 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.380922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4231-a14a-4c79-bd57-641c68cb9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.410146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-06ee4231-a14a-4c79-bd57-641c68cb9b60 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:57.411694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-06ee4231-a14a-4c79-bd57-641c68cb9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:57.424329 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3839/7633] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:57.425912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe3f94-06c9-452d-b2ab-afe2bcf13687 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:57.440897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe3f94-06c9-452d-b2ab-afe2bcf13687 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:57.444524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:57.445169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.445630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.446344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.447025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:50:57.447330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:57.448955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:57.485390 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3795/7634] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:50:57.490086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4231-a14a-4c79-bd57-641c68cb9b60 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:57.504793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4231-a14a-4c79-bd57-641c68cb9b60 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:57.511225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:57.515263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.515263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.515263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.515263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:57.515629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:57.636322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3840/7635] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:50:57 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:50:57.641132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:57.651708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80657ed3-a5b3-44cc-a90f-aa928fbb2857 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:57.713732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:57.714368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.714651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.714929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.715567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:57.717741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:57.832775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3796/7636] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:50:57 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:50:57.834018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:57.844914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74422de-2ae9-4d7b-a70c-834ad2e7c73a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:57.850068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:57.850666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.850941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.851210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.851880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:57.853455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:57.864227 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3841/7637] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:50:57.868390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:57.881871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a63cb6-b1a3-4eab-8a83-a95c2067eb6a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:57.883992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f6bef-443d-47b6-932d-00fb0530ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:57.884595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6bef-443d-47b6-932d-00fb0530ccdb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.884883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6bef-443d-47b6-932d-00fb0530ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.885161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6bef-443d-47b6-932d-00fb0530ccdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.885848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6bef-443d-47b6-932d-00fb0530ccdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:57.887493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6bef-443d-47b6-932d-00fb0530ccdb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:57.899586 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3797/7638] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:50:57.904465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:57.915372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a974-15bb-4a66-aa0c-2b7c767bf977 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:57.920233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:57.920910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:57.921191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:57.921462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] PATH_INFO: `/v3/projects/7cb5b7d92b6747e2ad77bb50c906e7a5/users/97626b9287be408dbd9486c725536860/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:57.936924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb5b7d92b6747e2ad77bb50c906e7a5, user_id=97626b9287be408dbd9486c725536860, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:57.939607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:58.011194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3842/7639] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:50:57 2022] PUT /identity/v3/projects/7cb5b7d92b6747e2ad77bb50c906e7a5/users/97626b9287be408dbd9486c725536860/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:50:58.022790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:58.023071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:58.023344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:58.050953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] MFA Rules not processed for user `97626b9287be408dbd9486c725536860`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:58.052140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:58.128533 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3798/7640] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:50:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:50:58.141385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:58.143489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:58.219020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6151a-7368-452f-ad16-ac07e18f4feb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:58.223445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:58.224058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:58.224345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:58.224626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:58.234640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:58.236179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:58.248942 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3843/7641] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:00.031685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:00.033458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:00.082029 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:00.145021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4477fd-eaf4-4b36-9b40-429c16571030 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:00.149904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:00.150934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:00.151143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:00.151418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:00.153567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:00.255966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:00.257413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:00.271295 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3799/7642] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:00.577443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:00.604999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17866-63b0-4e40-9df6-a2973412e02b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:00.608957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:00.609565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:00.610049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:00.610478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:00.612196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:00.628634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:00.628634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:00.639082 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3844/7643] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:00.719315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:00.720816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:00.734593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a2d26-339d-4626-be8a-bcd998349c7e service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:00.738319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea06873-1b87-4cb2-9981-532017aafa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:00.738924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea06873-1b87-4cb2-9981-532017aafa02 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:00.739201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea06873-1b87-4cb2-9981-532017aafa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:00.739501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea06873-1b87-4cb2-9981-532017aafa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:00.741669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3ea06873-1b87-4cb2-9981-532017aafa02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:00.760274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea06873-1b87-4cb2-9981-532017aafa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:00.761879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea06873-1b87-4cb2-9981-532017aafa02 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:00.782704 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3800/7644] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:02.163702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:02.167454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:02.228330 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:02.270692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a00a5-dd9b-45dc-acb5-4369fb064d38 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:02.276660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:02.278314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:02.278314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:02.278875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] PATH_INFO: `/v3/users/ac68300847824286b1ee7045fe089c8f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:02.281092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac68300847824286b1ee7045fe089c8f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:02.283746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:02.487953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac68300847824286b1ee7045fe089c8f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:02.489157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac68300847824286b1ee7045fe089c8f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:02.576498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac68300847824286b1ee7045fe089c8f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:02.592367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac68300847824286b1ee7045fe089c8f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:02.593230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac68300847824286b1ee7045fe089c8f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:02.624346 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3845/7645] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:02 2022] DELETE /identity/v3/users/ac68300847824286b1ee7045fe089c8f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:02.626039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238cf61-7100-4d74-9b15-c7233cfd1eff None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:02.626495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238cf61-7100-4d74-9b15-c7233cfd1eff None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:02.626609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238cf61-7100-4d74-9b15-c7233cfd1eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:02.646416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f238cf61-7100-4d74-9b15-c7233cfd1eff None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:02.647901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f238cf61-7100-4d74-9b15-c7233cfd1eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:02.710229 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3801/7646] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:02.722254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:02.723885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:02.790018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431bd8c-3e60-4c2c-a30a-2f8b55b83d02 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:02.794452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:02.795359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:02.795822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:02.796309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:02.815227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:02.817682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:02.830066 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3846/7647] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:03.338034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:03.338327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:03.338603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:03.357100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:03.358869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:03.365170 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:03.377330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:03.377330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:03.384493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73014b25-e22f-4a2e-ba02-771ace0fbfa8 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:03.400403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:03.406250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:03.406250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:03.406250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] PATH_INFO: `/v3/projects/6734242aafcb47bbbbd76654b2a0b817` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:03.406250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=6734242aafcb47bbbbd76654b2a0b817)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:03.412382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:03.488841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3802/7648] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:51:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:03.502159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:03.503606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:03.571681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6734242aafcb47bbbbd76654b2a0b817', 'request_id': 'req-5374a17c-00a3-497c-b177-1ec5c4da5fde'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:03.574844 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:03.583656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6734242aafcb47bbbbd76654b2a0b817', 'request_id': 'req-5374a17c-00a3-497c-b177-1ec5c4da5fde'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:03.587710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e8610-f95d-4381-b31e-55b18102f568 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:03.671677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abd4dd-ce45-433d-91c7-2d02e037d955 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:03.672377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd4dd-ce45-433d-91c7-2d02e037d955 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:03.672673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd4dd-ce45-433d-91c7-2d02e037d955 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:03.672945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abd4dd-ce45-433d-91c7-2d02e037d955 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:03.724535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6734242aafcb47bbbbd76654b2a0b817', 'request_id': 'req-5374a17c-00a3-497c-b177-1ec5c4da5fde'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:03.741064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] The token cache is being invalidate because project 6734242aafcb47bbbbd76654b2a0b817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:03.742099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:03.743657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5374a17c-00a3-497c-b177-1ec5c4da5fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:03.746507 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3847/7649] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:03 2022] DELETE /identity/v3/projects/6734242aafcb47bbbbd76654b2a0b817 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:03.755823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b762c6-d6a9-4e06-91ed-6a68f7ed2cb6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:03.756191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b762c6-d6a9-4e06-91ed-6a68f7ed2cb6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:03.756687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b762c6-d6a9-4e06-91ed-6a68f7ed2cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:03.765198 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:03.771068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abd4dd-ce45-433d-91c7-2d02e037d955 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:03.772737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abd4dd-ce45-433d-91c7-2d02e037d955 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:03.793143 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3803/7650] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:51:03.836736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d6b762c6-d6a9-4e06-91ed-6a68f7ed2cb6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:03.836736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d6b762c6-d6a9-4e06-91ed-6a68f7ed2cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:03.922862 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3848/7651] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:03.924974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1110cb-cb2f-40ab-87b1-20fce155cc4f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:03.925266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1110cb-cb2f-40ab-87b1-20fce155cc4f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:03.925543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1110cb-cb2f-40ab-87b1-20fce155cc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:03.953062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4d1110cb-cb2f-40ab-87b1-20fce155cc4f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:03.954602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d1110cb-cb2f-40ab-87b1-20fce155cc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:03.964641 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3804/7652] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:03.972286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b762c6-d6a9-4e06-91ed-6a68f7ed2cb6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:03.983750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b762c6-d6a9-4e06-91ed-6a68f7ed2cb6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:03.991106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:03.991861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:03.992280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:03.992624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:03.993425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:03.993827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:03.996807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:04.023937 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3849/7653] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:04.036202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1110cb-cb2f-40ab-87b1-20fce155cc4f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:04.053566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1110cb-cb2f-40ab-87b1-20fce155cc4f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:04.079870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:04.080600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:04.082033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:04.082780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:04.083908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:04.087885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:04.233896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3805/7654] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:04 2022] POST /identity/v3/projects => generated 359 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:04.239020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:04.261311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b01d6-940c-4859-b241-87390c974130 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:04.415754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:04.417107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:04.417384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:04.417663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:04.426086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:04.428705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:04.525395 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3850/7655] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:04 2022] POST /identity/v3/users => generated 280 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:04.526645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:04.545885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b79f-75ea-4283-8ac8-90045ead7466 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:04.555890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:04.556628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:04.556970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:04.557297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:04.558256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:04.561718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:04.604482 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3806/7656] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:04.609364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:04.626588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99c30a-11ed-4386-b534-7f5b1e2b8f3f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:04.633783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e4323-7af8-4472-aa8b-60f5c52c5967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:04.634450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e4323-7af8-4472-aa8b-60f5c52c5967 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:04.639309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e4323-7af8-4472-aa8b-60f5c52c5967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:04.639309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e4323-7af8-4472-aa8b-60f5c52c5967 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:04.639309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e4323-7af8-4472-aa8b-60f5c52c5967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:04.639309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e4323-7af8-4472-aa8b-60f5c52c5967 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:04.657365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:04.668149 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3851/7657] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:04.674760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fcac8-fa97-4190-b254-9f86e8cba71c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:04.681084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:04.682194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:04.682796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:04.683386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] PATH_INFO: `/v3/projects/12aa1142fe9941bcb3dd0292055ccc6b/users/895992d87afb46899441c46cbdb3d53a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:04.723350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12aa1142fe9941bcb3dd0292055ccc6b, user_id=895992d87afb46899441c46cbdb3d53a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:04.726820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:04.813251 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3807/7658] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:04 2022] PUT /identity/v3/projects/12aa1142fe9941bcb3dd0292055ccc6b/users/895992d87afb46899441c46cbdb3d53a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:04.818751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4186d2-36f2-491e-84f8-31a45eac995f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:04.819144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4186d2-36f2-491e-84f8-31a45eac995f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:04.819321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4186d2-36f2-491e-84f8-31a45eac995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:04.914532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8f4186d2-36f2-491e-84f8-31a45eac995f None None] MFA Rules not processed for user `895992d87afb46899441c46cbdb3d53a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:04.920329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f4186d2-36f2-491e-84f8-31a45eac995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:04.991191 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:05.091300 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3852/7659] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:05.161040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:05.163094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:05.263290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f6696-0745-4998-9f87-aba1e7f95527 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:05.272489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4edcc6-7cb2-45f6-b064-e1316f048f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:05.283157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4edcc6-7cb2-45f6-b064-e1316f048f94 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:05.284029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4edcc6-7cb2-45f6-b064-e1316f048f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:05.284331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4edcc6-7cb2-45f6-b064-e1316f048f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:05.301515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4edcc6-7cb2-45f6-b064-e1316f048f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:05.303888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4edcc6-7cb2-45f6-b064-e1316f048f94 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:05.317178 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3808/7660] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:05.336654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4186d2-36f2-491e-84f8-31a45eac995f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:05.529412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4186d2-36f2-491e-84f8-31a45eac995f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:05.538747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:05.539752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:05.540390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:05.541509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] PATH_INFO: `/v3/users/895992d87afb46899441c46cbdb3d53a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:05.544560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=895992d87afb46899441c46cbdb3d53a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:05.547623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:05.751228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895992d87afb46899441c46cbdb3d53a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:05.752223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895992d87afb46899441c46cbdb3d53a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:05.812836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895992d87afb46899441c46cbdb3d53a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:05.834144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895992d87afb46899441c46cbdb3d53a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:05.835061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895992d87afb46899441c46cbdb3d53a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:05.860916 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3853/7661] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:05 2022] DELETE /identity/v3/users/895992d87afb46899441c46cbdb3d53a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:05.870426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:05.870961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:05.871248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:05.909678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:05.912403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:06.072574 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3809/7662] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:06.080451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:06.082262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:06.236271 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:06.251509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b83d-dce5-46be-9c51-8f5d722b5f6d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:06.257917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effd69c-049a-4a60-9970-a46725f04c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:06.258914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effd69c-049a-4a60-9970-a46725f04c88 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:06.259236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effd69c-049a-4a60-9970-a46725f04c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:06.260276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effd69c-049a-4a60-9970-a46725f04c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:06.301458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effd69c-049a-4a60-9970-a46725f04c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:06.303139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effd69c-049a-4a60-9970-a46725f04c88 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:06.334564 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3854/7663] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:07.287496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:07.290082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:07.402362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dee9-6a16-43e5-a647-096f88f0347f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:07.413221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:07.413965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:07.414349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:07.414861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] PATH_INFO: `/v3/projects/12aa1142fe9941bcb3dd0292055ccc6b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:07.420795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=12aa1142fe9941bcb3dd0292055ccc6b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:07.423132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:07.454245 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:07.578617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12aa1142fe9941bcb3dd0292055ccc6b', 'request_id': 'req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:07.604173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12aa1142fe9941bcb3dd0292055ccc6b', 'request_id': 'req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:07.701877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12aa1142fe9941bcb3dd0292055ccc6b', 'request_id': 'req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:07.724294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] The token cache is being invalidate because project 12aa1142fe9941bcb3dd0292055ccc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:07.724935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:07.726016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bdd11445-1460-4cf7-a7bd-5ea37a7118fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:07.728104 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3810/7664] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:07 2022] DELETE /identity/v3/projects/12aa1142fe9941bcb3dd0292055ccc6b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:07.736689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3e67-7243-40bd-9cf7-752f34d5dd55 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:07.737342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3e67-7243-40bd-9cf7-752f34d5dd55 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:07.737447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3e67-7243-40bd-9cf7-752f34d5dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:07.826704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ffec3e67-7243-40bd-9cf7-752f34d5dd55 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:07.831851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ffec3e67-7243-40bd-9cf7-752f34d5dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:08.006303 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3855/7665] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:08.008251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f59039-ad11-4097-b280-dabc97526224 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:08.008615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f59039-ad11-4097-b280-dabc97526224 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:08.008932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f59039-ad11-4097-b280-dabc97526224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:08.047015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-46f59039-ad11-4097-b280-dabc97526224 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:08.048887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-46f59039-ad11-4097-b280-dabc97526224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:08.058324 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3811/7666] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:08.063401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec3e67-7243-40bd-9cf7-752f34d5dd55 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:08.075296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec3e67-7243-40bd-9cf7-752f34d5dd55 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:08.094726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:08.094726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:08.094726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:08.094726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:08.095491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:08.095491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:08.095491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:08.133578 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3856/7667] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:08.139740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f59039-ad11-4097-b280-dabc97526224 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:08.152960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f59039-ad11-4097-b280-dabc97526224 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:08.171669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:08.174691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:08.175695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:08.176415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:08.178441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:08.181162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:08.319501 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3812/7668] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:08 2022] POST /identity/v3/projects => generated 397 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:08.321203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:08.336989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236925d-eb84-4531-a88e-d0ec295415d1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:08.521711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:08.522628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:08.523132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:08.523758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:08.524561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:08.528484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:08.614338 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3857/7669] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:08 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:08.619390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:08.640509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045747d-1d7b-46b4-aa62-8273f9b4deab admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:08.662817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:08.666860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:08.667741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:08.668056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:08.669370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:08.671161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:08.696780 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3813/7670] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:08.701782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:08.734402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029d9f3-49fe-48e2-9296-5860100e3091 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:08.749373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1f86c-eb03-4142-ae46-112f7c04ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:08.751741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f86c-eb03-4142-ae46-112f7c04ff69 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:08.752262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f86c-eb03-4142-ae46-112f7c04ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:08.754668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f86c-eb03-4142-ae46-112f7c04ff69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:08.755619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1f86c-eb03-4142-ae46-112f7c04ff69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:08.759256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1f86c-eb03-4142-ae46-112f7c04ff69 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:08.799451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:08.802022 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3858/7671] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:08.812249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc323c-e96d-4e29-8312-62eeec7a944d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:08.831531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:08.832226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:08.832527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:08.832788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] PATH_INFO: `/v3/projects/c70c736480b04371bf6ce2d1de73cdbf/users/da088a65263048e09a3d478356c9de4b/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:08.854766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70c736480b04371bf6ce2d1de73cdbf, user_id=da088a65263048e09a3d478356c9de4b, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:08.861409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:08.987957 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3814/7672] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:08 2022] PUT /identity/v3/projects/c70c736480b04371bf6ce2d1de73cdbf/users/da088a65263048e09a3d478356c9de4b/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:09.000970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:09.001303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:09.001629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:09.062038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] MFA Rules not processed for user `da088a65263048e09a3d478356c9de4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:09.064748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:09.162978 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:09.241257 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3859/7673] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:09.254266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:09.256602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:09.358732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f194d99-aebd-4648-8096-8734d76aafd2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:09.364563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914babb5-4d6b-40dd-9077-2e074b57baef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:09.365519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914babb5-4d6b-40dd-9077-2e074b57baef service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:09.366309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914babb5-4d6b-40dd-9077-2e074b57baef service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:09.366821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914babb5-4d6b-40dd-9077-2e074b57baef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:09.378163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914babb5-4d6b-40dd-9077-2e074b57baef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:09.380357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914babb5-4d6b-40dd-9077-2e074b57baef service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:09.391591 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3815/7674] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:11.447628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:11.450863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:11.581009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8ca2-5697-4fb5-8a70-ca4647c341e3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:11.588634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:11.590157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:11.590703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:11.591239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] PATH_INFO: `/v3/users/518be4dd551c474c97aa3402e078dfc4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:11.592713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] RBAC: Authorizing `identity:delete_user(user_id=518be4dd551c474c97aa3402e078dfc4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:11.595526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:11.847503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518be4dd551c474c97aa3402e078dfc4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:11.848910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518be4dd551c474c97aa3402e078dfc4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:12.212777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518be4dd551c474c97aa3402e078dfc4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:12.230500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518be4dd551c474c97aa3402e078dfc4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:12.232569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518be4dd551c474c97aa3402e078dfc4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:12.298003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3860/7675] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:11 2022] DELETE /identity/v3/users/518be4dd551c474c97aa3402e078dfc4 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:12.299731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:12.300229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:12.300229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:12.383987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:12.385462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:12.472101 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:12.546879 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3816/7676] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:12.562597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:12.565638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:12.680627 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:12.713533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51cad2-fb1b-4b3e-aebf-ca9dea2a288b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:12.721670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:12.723874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:12.723874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:12.723874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:12.735220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:12.736721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:12.748763 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3861/7677] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:13.386633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:13.389157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:13.412497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bf55f-2cef-493a-adff-92b8c8e49b30 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:13.443828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:13.444800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:13.447803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:13.448176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] PATH_INFO: `/v3/projects/82a001b8807d45f0b56a394a9ab1adaf` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:13.449527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a001b8807d45f0b56a394a9ab1adaf)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:13.452773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:13.650669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a001b8807d45f0b56a394a9ab1adaf', 'request_id': 'req-0c38da1b-d7a4-44e8-a590-7b340762fb0a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:13.658235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a001b8807d45f0b56a394a9ab1adaf', 'request_id': 'req-0c38da1b-d7a4-44e8-a590-7b340762fb0a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:13.725282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a001b8807d45f0b56a394a9ab1adaf', 'request_id': 'req-0c38da1b-d7a4-44e8-a590-7b340762fb0a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:13.742688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] The token cache is being invalidate because project 82a001b8807d45f0b56a394a9ab1adaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:13.742959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:13.743731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:13.745333 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3817/7678] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:13 2022] DELETE /identity/v3/projects/82a001b8807d45f0b56a394a9ab1adaf => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:13.751173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:13.764789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f50f-569e-4a8e-91f9-32eb355b44ff service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:13.879442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:13.882156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:13.882156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:13.882156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] PATH_INFO: `/v3/users/7858763fc9274de39ad229f4b8b5e130` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:13.882156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7858763fc9274de39ad229f4b8b5e130)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:13.884357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:15.064644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7858763fc9274de39ad229f4b8b5e130'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:15.065718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7858763fc9274de39ad229f4b8b5e130'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:15.149890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7858763fc9274de39ad229f4b8b5e130'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:15.157933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7858763fc9274de39ad229f4b8b5e130'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:15.158659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0a58ee8d-78cf-430f-831f-3c21331fc2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7858763fc9274de39ad229f4b8b5e130'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:15.176381 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3862/7679] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:13 2022] DELETE /identity/v3/users/7858763fc9274de39ad229f4b8b5e130 => generated 0 bytes in 1426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:15.756072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:15.759931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:15.780083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38da1b-d7a4-44e8-a590-7b340762fb0a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:15.878515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:15.879183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:15.879469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:15.879839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] PATH_INFO: `/v3/projects/b7f91cb92f244d63b88681f530b7947b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:15.881106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f91cb92f244d63b88681f530b7947b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:15.883610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:16.128539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f91cb92f244d63b88681f530b7947b', 'request_id': 'req-f2760a73-3925-486e-8c21-8cbb2fc7e63e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:16.144406 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:16.148232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f91cb92f244d63b88681f530b7947b', 'request_id': 'req-f2760a73-3925-486e-8c21-8cbb2fc7e63e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:16.273199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f91cb92f244d63b88681f530b7947b', 'request_id': 'req-f2760a73-3925-486e-8c21-8cbb2fc7e63e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:16.290777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] The token cache is being invalidate because project b7f91cb92f244d63b88681f530b7947b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:16.291270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:16.291965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f2760a73-3925-486e-8c21-8cbb2fc7e63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:16.294204 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3818/7680] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:15 2022] DELETE /identity/v3/projects/b7f91cb92f244d63b88681f530b7947b => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:16.300492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefdaaf-706c-428e-a693-ec6a5dce46de None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.301021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefdaaf-706c-428e-a693-ec6a5dce46de None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.301843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefdaaf-706c-428e-a693-ec6a5dce46de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.352190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1aefdaaf-706c-428e-a693-ec6a5dce46de None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:16.353802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1aefdaaf-706c-428e-a693-ec6a5dce46de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:16.401530 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:16.417519 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3863/7681] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:16.435200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd69c-7d2c-49bc-9797-f7c00576856e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.435492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd69c-7d2c-49bc-9797-f7c00576856e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.435764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dd69c-7d2c-49bc-9797-f7c00576856e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.456081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-306dd69c-7d2c-49bc-9797-f7c00576856e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:16.459759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-306dd69c-7d2c-49bc-9797-f7c00576856e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:16.465929 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3819/7682] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:16.470835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefdaaf-706c-428e-a693-ec6a5dce46de None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:16.481657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefdaaf-706c-428e-a693-ec6a5dce46de None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:16.486427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:16.487173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.487328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.487610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.488240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:16.488605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:16.490377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:16.503312 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3864/7683] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:16.515484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd69c-7d2c-49bc-9797-f7c00576856e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:16.524785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dd69c-7d2c-49bc-9797-f7c00576856e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:16.529512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:16.530122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.530406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.530675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.531297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:16.533212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:16.634077 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3820/7684] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:16 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:16.634605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:16.647259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a886b5-b9bf-405d-8e8f-ba29407f539d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:16.708976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:16.709586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.709902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.716179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.716179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:16.716179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:16.818498 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3865/7685] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:16 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:16.822991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:16.836601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3599e98-8402-42fd-9313-f3e535cd753c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:16.838312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:16.838923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.839263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.839542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.840211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:16.841852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:16.852015 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3821/7686] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:16.856828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:16.866958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e4e5-b0d4-4d25-88aa-3bc19922fdec admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:16.872510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a3eb0-1bb3-46d1-98a7-ac9c0fc3a7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:16.873193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a3eb0-1bb3-46d1-98a7-ac9c0fc3a7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.873480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a3eb0-1bb3-46d1-98a7-ac9c0fc3a7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.873758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a3eb0-1bb3-46d1-98a7-ac9c0fc3a7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.874438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a3eb0-1bb3-46d1-98a7-ac9c0fc3a7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:16.876030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a3eb0-1bb3-46d1-98a7-ac9c0fc3a7c8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:16.887638 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3866/7687] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:16.891992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:16.902349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7f0b-01e3-4cfa-a251-ad3e23f8f2a1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:16.907597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:16.908254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:16.916429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:16.916429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] PATH_INFO: `/v3/projects/9ba2e76467984e5baef59901867ca096/users/aa323f259cde437a92fdc6090b4db0d2/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:16.925438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba2e76467984e5baef59901867ca096, user_id=aa323f259cde437a92fdc6090b4db0d2, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:16.928177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.016991 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3822/7688] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:16 2022] PUT /identity/v3/projects/9ba2e76467984e5baef59901867ca096/users/aa323f259cde437a92fdc6090b4db0d2/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:17.028114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3151a4-d952-46ee-8f5a-0fb7c9acf7b9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.028509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3151a4-d952-46ee-8f5a-0fb7c9acf7b9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.028790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3151a4-d952-46ee-8f5a-0fb7c9acf7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.060880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8f3151a4-d952-46ee-8f5a-0fb7c9acf7b9 None None] MFA Rules not processed for user `aa323f259cde437a92fdc6090b4db0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:17.062118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f3151a4-d952-46ee-8f5a-0fb7c9acf7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:17.141351 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3867/7689] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:17.145762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:17.221155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ebb0-5d86-4b92-84e1-9650e0feedd7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:17.225759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:17.226445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.226727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.227003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.227788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:17.229753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.362744 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3823/7690] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:17 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:17.366683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3151a4-d952-46ee-8f5a-0fb7c9acf7b9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:17.394988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3151a4-d952-46ee-8f5a-0fb7c9acf7b9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:17.470808 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:17.485650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:17.486303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.486586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.486863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.487516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:17.489456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.622339 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3868/7691] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:17 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:17.622738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:17.625048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:17.626829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:17.636757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35143f-495e-46b8-8751-0668fe4be155 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:17.640111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a080a2-8d2a-4290-b26f-aa93c5516828 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:17.642715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:17.643351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.643634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.643912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.644644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:17.646866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.652954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:17.654015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.654348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.654704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] PATH_INFO: `/v3/users/97626b9287be408dbd9486c725536860` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.655951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=97626b9287be408dbd9486c725536860)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:17.658006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.665038 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3824/7692] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:17.666825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:17.678925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3ace5-f375-45bd-b62c-8e4b586e0bc9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:17.683534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:17.684840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.685285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.685621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] PATH_INFO: `/v3/projects/f1dc92f99c894f6cabddc45d22228257/users/31b6c076c8ac4bbab9427d96aab1d0e3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.701842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dc92f99c894f6cabddc45d22228257, user_id=31b6c076c8ac4bbab9427d96aab1d0e3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:17.704490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.847899 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3825/7693] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:17 2022] PUT /identity/v3/projects/f1dc92f99c894f6cabddc45d22228257/users/31b6c076c8ac4bbab9427d96aab1d0e3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:17.851466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:17.882197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97626b9287be408dbd9486c725536860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:17.882937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97626b9287be408dbd9486c725536860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:17.890179 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:17.920842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a13c-94ff-4bec-b3cc-791967a380d9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:17.925649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:17.926296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.926582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.926858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.927507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:17.929095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.939663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3826/7694] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:17.943741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:17.955442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8644b-3809-40bc-8fdc-77c8914f5850 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:17.960757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae66a1-e266-42c8-897c-b46b772e3bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:17.961577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae66a1-e266-42c8-897c-b46b772e3bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.962001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae66a1-e266-42c8-897c-b46b772e3bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.962327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae66a1-e266-42c8-897c-b46b772e3bb0 admin admin] PATH_INFO: `/v3/projects/f1dc92f99c894f6cabddc45d22228257/users/31b6c076c8ac4bbab9427d96aab1d0e3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.964603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae66a1-e266-42c8-897c-b46b772e3bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dc92f99c894f6cabddc45d22228257, user_id=31b6c076c8ac4bbab9427d96aab1d0e3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:17.968826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae66a1-e266-42c8-897c-b46b772e3bb0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:17.982832 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3827/7695] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:17 2022] PUT /identity/v3/projects/f1dc92f99c894f6cabddc45d22228257/users/31b6c076c8ac4bbab9427d96aab1d0e3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:17.992575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:17.992870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:17.993149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:17.995639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97626b9287be408dbd9486c725536860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.006676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97626b9287be408dbd9486c725536860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.009919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cd8646c9-2595-4409-8d53-8bcc98ebebfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97626b9287be408dbd9486c725536860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.025106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] MFA Rules not processed for user `31b6c076c8ac4bbab9427d96aab1d0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:18.027580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:18.028366 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3869/7696] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:17 2022] DELETE /identity/v3/users/97626b9287be408dbd9486c725536860 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:18.033080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:18.038696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:18.038696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:18.055802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:18.057086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:18.108873 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3828/7697] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:18.122847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:18.124326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:18.130870 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3870/7698] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:18.140959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:18.142343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:18.187620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c06567-0e05-4afd-a30e-772c74f0fad4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:18.191590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:18.192300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:18.192685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:18.193055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:18.203211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:18.204755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:18.207866 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:18.214412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6ff35-9ada-4256-9fd0-fccc84ad5a36 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:18.216020 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3829/7699] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:18.221024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca218-6974-432c-9bae-3813e65e75c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:18.221646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca218-6974-432c-9bae-3813e65e75c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:18.221995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca218-6974-432c-9bae-3813e65e75c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:18.222320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca218-6974-432c-9bae-3813e65e75c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:18.236399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ca218-6974-432c-9bae-3813e65e75c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:18.238406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ca218-6974-432c-9bae-3813e65e75c1 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:18.249633 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3871/7700] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:18.617555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:18.619210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:18.667677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad39a3-1240-4699-9c05-bf251765b82a service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:18.674781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:18.675592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:18.675982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:18.676340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] PATH_INFO: `/v3/projects/7cb5b7d92b6747e2ad77bb50c906e7a5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:18.677582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb5b7d92b6747e2ad77bb50c906e7a5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:18.679966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:18.818987 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:18.832480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb5b7d92b6747e2ad77bb50c906e7a5', 'request_id': 'req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.838583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb5b7d92b6747e2ad77bb50c906e7a5', 'request_id': 'req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.939370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb5b7d92b6747e2ad77bb50c906e7a5', 'request_id': 'req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.955459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] The token cache is being invalidate because project 7cb5b7d92b6747e2ad77bb50c906e7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:18.955867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.957037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dddfb44-9926-4ad1-8fff-db7e271ef8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:18.959460 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3830/7701] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:18 2022] DELETE /identity/v3/projects/7cb5b7d92b6747e2ad77bb50c906e7a5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:18.967267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11c72-f0e0-48e3-8c08-67a27040b102 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:18.967267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11c72-f0e0-48e3-8c08-67a27040b102 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:18.967267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11c72-f0e0-48e3-8c08-67a27040b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:18.996012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d0f11c72-f0e0-48e3-8c08-67a27040b102 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:18.999013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d0f11c72-f0e0-48e3-8c08-67a27040b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:19.090086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3872/7702] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:19.097433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934e35-8969-48a5-9eaf-d3c7552d646d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.099648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934e35-8969-48a5-9eaf-d3c7552d646d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.099648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b934e35-8969-48a5-9eaf-d3c7552d646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.120978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2b934e35-8969-48a5-9eaf-d3c7552d646d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:19.122566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2b934e35-8969-48a5-9eaf-d3c7552d646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:19.134378 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3831/7703] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:19.138083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11c72-f0e0-48e3-8c08-67a27040b102 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.147938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11c72-f0e0-48e3-8c08-67a27040b102 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.153466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.154232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.154706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.155058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.155792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:19.156100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.157722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.175853 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3873/7704] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:19.177180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934e35-8969-48a5-9eaf-d3c7552d646d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.192582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b934e35-8969-48a5-9eaf-d3c7552d646d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.198235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.198877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.199161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.199442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.200925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.203132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.327172 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3832/7705] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:19 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:19.332178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.345501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40788e-925d-462d-8f28-ec185748f6c4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.430027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.432121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.432310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.432648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.433358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.435699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.457654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.459443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:19.536248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de129-fb6e-4aed-a4df-fb193476a0c6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.541051 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3874/7706] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:19 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:19.544885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.553981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b6c076c8ac4bbab9427d96aab1d0e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1dc92f99c894f6cabddc45d22228257', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.555803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.556338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.556858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.557954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ed2fc-2c3a-45ea-a2ae-ffb1b0c16456 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.560841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:19.561487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.563616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.565004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.572195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.572195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.572195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.572195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.572195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.585165 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3833/7707] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:51:19.586368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.588944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3875/7708] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:19.591445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.600359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092c638-1f62-4e6d-895c-98991ee76d6c tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.603669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b441410-b7ad-4cd9-b2c6-63989e882349 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.606934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b6c076c8ac4bbab9427d96aab1d0e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1dc92f99c894f6cabddc45d22228257', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.607660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.608055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.608441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.608812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.609421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.609534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.609703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.610025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.610720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.612000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.612325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.625865 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3876/7709] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:19.633037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.644446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f8a6-bf12-4325-a896-71fa9347263e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.649689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88649ee-8f16-4662-a23f-e1cc2bfc0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.650396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88649ee-8f16-4662-a23f-e1cc2bfc0e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.650678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88649ee-8f16-4662-a23f-e1cc2bfc0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.651090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88649ee-8f16-4662-a23f-e1cc2bfc0e34 admin admin] PATH_INFO: `/v3/projects/230e38d46d4e433f8d5043383f9cefd3/users/b206b07f948e44239251a745a6e787fd/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.667970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88649ee-8f16-4662-a23f-e1cc2bfc0e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230e38d46d4e433f8d5043383f9cefd3, user_id=b206b07f948e44239251a745a6e787fd, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.673364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88649ee-8f16-4662-a23f-e1cc2bfc0e34 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.737740 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3834/7710] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:19 2022] POST /identity/v3/projects => generated 354 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:19.738776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.803077 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3877/7711] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:19 2022] PUT /identity/v3/projects/230e38d46d4e433f8d5043383f9cefd3/users/b206b07f948e44239251a745a6e787fd/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:19.806655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407fe4-cd73-4b87-9d1f-ffc136269283 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.821493 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:19.827268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.827566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.827842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.858945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] MFA Rules not processed for user `b206b07f948e44239251a745a6e787fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:19.860173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:19.870004 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:19.875300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b6c076c8ac4bbab9427d96aab1d0e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1dc92f99c894f6cabddc45d22228257', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.875918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.876201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.876476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.877185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:19.877521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.879233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.894823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3835/7712] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:51:19.942634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.953008 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3878/7713] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:19.953366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8225b-915f-4c5e-b83f-2b154d9de603 tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:19.961072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31b6c076c8ac4bbab9427d96aab1d0e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1dc92f99c894f6cabddc45d22228257', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:19.961072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:19.961072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:19.961404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] PATH_INFO: `/v3/projects/c44e6f08cdf74b0e9367ed201640fdc9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:19.961404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c44e6f08cdf74b0e9367ed201640fdc9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:19.963050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:19.966240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:19.967412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:20.041109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd91f-92f4-4c3e-a9db-4709c3a07b45 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:20.046065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:20.047111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:20.047469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:20.047814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:20.058431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:20.062477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:20.075374 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3879/7714] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:20.087183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44e6f08cdf74b0e9367ed201640fdc9', 'request_id': 'req-a0d961d3-ef6f-4047-b46b-aea582a07e6a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:20.094224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44e6f08cdf74b0e9367ed201640fdc9', 'request_id': 'req-a0d961d3-ef6f-4047-b46b-aea582a07e6a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:20.212527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44e6f08cdf74b0e9367ed201640fdc9', 'request_id': 'req-a0d961d3-ef6f-4047-b46b-aea582a07e6a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:20.225753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] The token cache is being invalidate because project c44e6f08cdf74b0e9367ed201640fdc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:20.225986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:20.226830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a0d961d3-ef6f-4047-b46b-aea582a07e6a tempest-VolumeQuotaClassesTest-248348552 tempest-VolumeQuotaClassesTest-248348552-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:20.228465 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3836/7715] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:19 2022] DELETE /identity/v3/projects/c44e6f08cdf74b0e9367ed201640fdc9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:21.054396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:21.056117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:21.145560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1020422-e016-4f5e-8b86-ea938e044366 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:21.235755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:21.236550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:21.236914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:21.237246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] PATH_INFO: `/v3/users/aa323f259cde437a92fdc6090b4db0d2` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:21.238543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa323f259cde437a92fdc6090b4db0d2)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:21.240621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:21.245911 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:21.527302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa323f259cde437a92fdc6090b4db0d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:21.527999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa323f259cde437a92fdc6090b4db0d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:21.615452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa323f259cde437a92fdc6090b4db0d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:21.620293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa323f259cde437a92fdc6090b4db0d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:21.620978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa323f259cde437a92fdc6090b4db0d2'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:21.640135 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3880/7716] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:21 2022] DELETE /identity/v3/users/aa323f259cde437a92fdc6090b4db0d2 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:21.644807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823751d4-61bc-4433-ab2a-1cfe20fad024 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:21.645352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823751d4-61bc-4433-ab2a-1cfe20fad024 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:21.645512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823751d4-61bc-4433-ab2a-1cfe20fad024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:21.666243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-823751d4-61bc-4433-ab2a-1cfe20fad024 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:21.667463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-823751d4-61bc-4433-ab2a-1cfe20fad024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:21.729845 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3837/7717] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:21.740390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:21.741879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:21.802351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bdf1c-0a58-4ef5-97cf-243d8c3e01f3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:21.808038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:21.809399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:21.809873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:21.810299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:21.822886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:21.827292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:21.836384 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3881/7718] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:22.364114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:22.364593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:22.365013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:22.366613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:22.368694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:22.387719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fecf45-0bfe-4156-acae-57e68f898047 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:22.389369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:22.390936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:22.436032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:22.436743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:22.437092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:22.437311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] PATH_INFO: `/v3/projects/9ba2e76467984e5baef59901867ca096` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:22.441780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba2e76467984e5baef59901867ca096)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:22.443852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:22.496566 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:22.552500 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3838/7719] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:51:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:22.553433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:22.554798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:22.612869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b3e03-5395-40f7-a56d-86d2e7daaeab None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:22.614304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba2e76467984e5baef59901867ca096', 'request_id': 'req-54db67e4-7935-495f-8ef7-62392840d9a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:22.621551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba2e76467984e5baef59901867ca096', 'request_id': 'req-54db67e4-7935-495f-8ef7-62392840d9a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:22.692793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:22.693601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:22.693839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:22.694136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] PATH_INFO: `/v3/users/da088a65263048e09a3d478356c9de4b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:22.695318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da088a65263048e09a3d478356c9de4b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:22.697249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:22.713166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba2e76467984e5baef59901867ca096', 'request_id': 'req-54db67e4-7935-495f-8ef7-62392840d9a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:22.726782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] The token cache is being invalidate because project 9ba2e76467984e5baef59901867ca096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:22.727081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:22.727735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:22.729342 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3882/7720] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:22 2022] DELETE /identity/v3/projects/9ba2e76467984e5baef59901867ca096 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:22.730155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:22.731536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:22.742128 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:22.821233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db67e4-7935-495f-8ef7-62392840d9a6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:22.827425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:22.828107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:22.828402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:22.828676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:22.830575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:22.906090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:22.907688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:22.916392 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3883/7721] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:51:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:51:22.917315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:22.922698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:22.933648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7287f-caa5-4fef-8f52-4641230f47ce service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:22.938871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:22.939647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:22.939924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:22.940210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] PATH_INFO: `/v3/users/31b6c076c8ac4bbab9427d96aab1d0e3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:22.941402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b6c076c8ac4bbab9427d96aab1d0e3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:22.943477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:22.998328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da088a65263048e09a3d478356c9de4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.013342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da088a65263048e09a3d478356c9de4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.021344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da088a65263048e09a3d478356c9de4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.022279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da088a65263048e09a3d478356c9de4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.133301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ece30e79-821e-494c-9e0c-169850f89de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da088a65263048e09a3d478356c9de4b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.140980 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3839/7722] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:22 2022] DELETE /identity/v3/users/da088a65263048e09a3d478356c9de4b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:23.145647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008f0ad-3835-4247-812f-92deef988ced None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:23.145968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008f0ad-3835-4247-812f-92deef988ced None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:23.146250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008f0ad-3835-4247-812f-92deef988ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:23.167014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f008f0ad-3835-4247-812f-92deef988ced None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:23.168136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f008f0ad-3835-4247-812f-92deef988ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:23.234594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b6c076c8ac4bbab9427d96aab1d0e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.235255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b6c076c8ac4bbab9427d96aab1d0e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.239236 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3840/7723] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:23.249995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008f0ad-3835-4247-812f-92deef988ced None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:23.254180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f008f0ad-3835-4247-812f-92deef988ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:23.325672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008f0ad-3835-4247-812f-92deef988ced None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:23.329942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:23.330568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:23.330851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:23.331125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:23.349178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:23.349178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:23.351660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b6c076c8ac4bbab9427d96aab1d0e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.354061 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3841/7724] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:23.359824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b6c076c8ac4bbab9427d96aab1d0e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.362487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b6c076c8ac4bbab9427d96aab1d0e3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:23.386559 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3884/7725] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:22 2022] DELETE /identity/v3/users/31b6c076c8ac4bbab9427d96aab1d0e3 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:23.427182 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:23.561733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:23.561733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:23.566311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e899-f136-4913-98d1-1e8eb31362f9 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:23.628668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:23.629328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:23.629632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:23.629911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:23.632021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:23.646913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:23.648656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:23.665101 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3842/7726] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:23.961058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:23.962583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:24.015566 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:24.062767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab27cc-4fbc-4552-ab33-68b87cd7dedd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.067667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.070360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.070360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.070360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] PATH_INFO: `/v3/projects/f1dc92f99c894f6cabddc45d22228257` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.070669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dc92f99c894f6cabddc45d22228257)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.072486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.103354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.103354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:24.116022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017d1e6-ee25-4f95-b022-4a96f0072f84 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.122365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.124187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.124629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.125379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] PATH_INFO: `/v3/projects/c70c736480b04371bf6ce2d1de73cdbf` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.128005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70c736480b04371bf6ce2d1de73cdbf)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.135017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.241690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dc92f99c894f6cabddc45d22228257', 'request_id': 'req-17f31d09-cc83-4229-a916-49c6b8d30d63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.248412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dc92f99c894f6cabddc45d22228257', 'request_id': 'req-17f31d09-cc83-4229-a916-49c6b8d30d63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.276548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70c736480b04371bf6ce2d1de73cdbf', 'request_id': 'req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.282698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70c736480b04371bf6ce2d1de73cdbf', 'request_id': 'req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.324911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dc92f99c894f6cabddc45d22228257', 'request_id': 'req-17f31d09-cc83-4229-a916-49c6b8d30d63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.336796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] The token cache is being invalidate because project f1dc92f99c894f6cabddc45d22228257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:24.337189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.337890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17f31d09-cc83-4229-a916-49c6b8d30d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.339400 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3885/7727] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:23 2022] DELETE /identity/v3/projects/f1dc92f99c894f6cabddc45d22228257 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:24.344342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139d24-d0c3-4283-b06e-98d80068092b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.344561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139d24-d0c3-4283-b06e-98d80068092b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.344835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139d24-d0c3-4283-b06e-98d80068092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.366210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-75139d24-d0c3-4283-b06e-98d80068092b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:24.367432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-75139d24-d0c3-4283-b06e-98d80068092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:24.375617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70c736480b04371bf6ce2d1de73cdbf', 'request_id': 'req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.388016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] The token cache is being invalidate because project c70c736480b04371bf6ce2d1de73cdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:24.388308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.389167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ce9a31a0-e052-4f4b-88b3-f4bf1d519927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:24.391263 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3843/7728] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:24 2022] DELETE /identity/v3/projects/c70c736480b04371bf6ce2d1de73cdbf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:24.396360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0feb2d-1554-4721-afc1-498b07e33acf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.396844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0feb2d-1554-4721-afc1-498b07e33acf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.397291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0feb2d-1554-4721-afc1-498b07e33acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.415466 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:24.442993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9e0feb2d-1554-4721-afc1-498b07e33acf None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:24.444220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9e0feb2d-1554-4721-afc1-498b07e33acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:24.451093 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3886/7729] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:24.452963 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3844/7730] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:24.458234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859b47-1549-4dff-a1ea-a97f9680dd37 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.458937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859b47-1549-4dff-a1ea-a97f9680dd37 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.459118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0859b47-1549-4dff-a1ea-a97f9680dd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.466992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293804c-93dd-4f7b-85d6-d26e04f972f1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.467307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293804c-93dd-4f7b-85d6-d26e04f972f1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.467588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293804c-93dd-4f7b-85d6-d26e04f972f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.479455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d0859b47-1549-4dff-a1ea-a97f9680dd37 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:24.481931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d0859b47-1549-4dff-a1ea-a97f9680dd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:24.488987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8293804c-93dd-4f7b-85d6-d26e04f972f1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:24.490211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8293804c-93dd-4f7b-85d6-d26e04f972f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:24.490335 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3887/7731] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:24.494584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859b47-1549-4dff-a1ea-a97f9680dd37 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.500214 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3845/7732] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:24.505381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0859b47-1549-4dff-a1ea-a97f9680dd37 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.507802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293804c-93dd-4f7b-85d6-d26e04f972f1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.513804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.514535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.514913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.515262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.515986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:24.516364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.517205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293804c-93dd-4f7b-85d6-d26e04f972f1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.518314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.521933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.522610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.522976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.523098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.523711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:24.524208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.525790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.537912 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3888/7733] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:51:24.538872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.554236 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3846/7734] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:51:24.554357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb918-938e-4598-891f-c3eafe37cee6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.555443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.560217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.560841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.561128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.561469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.562150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.564721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.576632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887169d1-76b4-476f-85bc-d9df9da2bdbc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.583376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.584000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.584281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.584552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.585261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.587362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.665602 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3889/7735] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:24.670066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.687072 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3847/7736] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:24.695059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.736597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ade3fa-4fde-4899-9687-5f67e269aaed admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.761521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d6db3-1855-47e9-b235-32b63e3a8330 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.772359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.773040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.773326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.773606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.774653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.776240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.799077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.799679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.799967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.800247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.800918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.802992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.859844 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3848/7737] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:24.860961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.871459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445069b8-ba32-432f-bb28-803dd829c7fd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.877774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.878351 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3890/7738] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:24 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:24.880162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.880162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.880162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.880162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.881981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.882746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.893365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1534f-8332-4fb1-9a40-cfd9f98462f1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.898105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.898703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.898983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.899279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.899920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.901858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3849/7739] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:24.901997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.904911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.916071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3891/7740] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:24.916234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70acea-9e20-478d-b2c2-06f573fdfddd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.917081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.921608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.922251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.922721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.922843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.923504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.925094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.927545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6642-c665-475a-90e3-d52de47715b7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.930485 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:24.932696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.933319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.933600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.934464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.934791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.936371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:24.936583 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3850/7741] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:24.945823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.948233 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3892/7742] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:24.952059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:24.955697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c6e6b-81b4-457f-9d1d-89a42819166c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.966519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6990811-3fdc-44db-8643-4d3b4ec5f45a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:24.966659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e522b-c38b-46e1-b3ed-624e2142a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.966659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e522b-c38b-46e1-b3ed-624e2142a038 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.966659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e522b-c38b-46e1-b3ed-624e2142a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.966659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e522b-c38b-46e1-b3ed-624e2142a038 admin admin] PATH_INFO: `/v3/projects/e8a07ae3c92d4dad8c852a6331716d11/users/d7d8e24e5dee4a7899769c92c6754995/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.971290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b846-137b-4a3d-9bde-c3a5a7fbc801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:24.971290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b846-137b-4a3d-9bde-c3a5a7fbc801 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:24.971290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b846-137b-4a3d-9bde-c3a5a7fbc801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:24.971290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b846-137b-4a3d-9bde-c3a5a7fbc801 admin admin] PATH_INFO: `/v3/projects/e0283e5386a4462498917164bea4d66b/users/aaae72d6b81a4879819b17c0bc42652d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:24.984746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e522b-c38b-46e1-b3ed-624e2142a038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a07ae3c92d4dad8c852a6331716d11, user_id=d7d8e24e5dee4a7899769c92c6754995, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:24.987422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e522b-c38b-46e1-b3ed-624e2142a038 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.001937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b846-137b-4a3d-9bde-c3a5a7fbc801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0283e5386a4462498917164bea4d66b, user_id=aaae72d6b81a4879819b17c0bc42652d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.006955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b846-137b-4a3d-9bde-c3a5a7fbc801 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.055531 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3851/7743] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:24 2022] PUT /identity/v3/projects/e8a07ae3c92d4dad8c852a6331716d11/users/d7d8e24e5dee4a7899769c92c6754995/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:25.066675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0435-b0e6-4126-a484-310ed2a39a1f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.066970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0435-b0e6-4126-a484-310ed2a39a1f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.067270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c0435-b0e6-4126-a484-310ed2a39a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.079316 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:25.087107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3893/7744] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:24 2022] PUT /identity/v3/projects/e0283e5386a4462498917164bea4d66b/users/aaae72d6b81a4879819b17c0bc42652d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:25.099593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46811c-2f8f-469e-9c1e-75bdcdfaba58 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.099889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46811c-2f8f-469e-9c1e-75bdcdfaba58 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.100166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46811c-2f8f-469e-9c1e-75bdcdfaba58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.104211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-940c0435-b0e6-4126-a484-310ed2a39a1f None None] MFA Rules not processed for user `d7d8e24e5dee4a7899769c92c6754995`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:25.106871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-940c0435-b0e6-4126-a484-310ed2a39a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:25.133640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ee46811c-2f8f-469e-9c1e-75bdcdfaba58 None None] MFA Rules not processed for user `aaae72d6b81a4879819b17c0bc42652d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:25.135300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ee46811c-2f8f-469e-9c1e-75bdcdfaba58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:25.183235 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3852/7745] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:25.188408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c0435-b0e6-4126-a484-310ed2a39a1f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.215775 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3894/7746] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:25.220947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46811c-2f8f-469e-9c1e-75bdcdfaba58 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.267222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c0435-b0e6-4126-a484-310ed2a39a1f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.272067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.272970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.273081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.273273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.273933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.275817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.288709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46811c-2f8f-469e-9c1e-75bdcdfaba58 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.294827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.295514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.295871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.296137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.296767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.298733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.383304 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3853/7747] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:25.384093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.416857 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3895/7748] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:25.422432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.463962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57721e22-a4f8-4e1c-8681-5e067172e210 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.495492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9560e4-f82d-49cb-b70d-8ec881917a04 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.500466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.501068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.501347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.501626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.502303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.504231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.521066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.521676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.521988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.522395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.522902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.524825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.616207 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3896/7749] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:25.620211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.628672 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:25.634351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b942-eae3-4820-a708-4d1d7b6ddac2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.636245 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3854/7750] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:25.640561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.644997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.645614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.645945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.649583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.649583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.649583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.653061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086fe06-91fa-466a-8c36-494329581ea4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.659798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3897/7751] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:25.659973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.660526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.661217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.661497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.662209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.663481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.664198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.676078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011996af-bf99-4434-a3fa-21898f66ea8f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.678424 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3855/7752] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:25.680764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.681197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.681408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.681687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.681993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.682663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.684895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.694046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fe74c-c283-4b6d-b61b-0733cba7058d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.699242 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3898/7753] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:25.700318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.700500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.700680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.700878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.700987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] PATH_INFO: `/v3/projects/9e82387a479d49bea8f748d3b555fec7/users/4df545b96ef24138bd1574330b2d122c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.710851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff3d90-71b4-442f-b372-8f274dc36a43 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.715492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c2dea-00df-49eb-9de9-1bf4fb33630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.716132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c2dea-00df-49eb-9de9-1bf4fb33630e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.716407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c2dea-00df-49eb-9de9-1bf4fb33630e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.716576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e82387a479d49bea8f748d3b555fec7, user_id=4df545b96ef24138bd1574330b2d122c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.716687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c2dea-00df-49eb-9de9-1bf4fb33630e admin admin] PATH_INFO: `/v3/projects/ce333f22bcc2416684314dbab32faba9/users/42f7f49fd622428e801e2849710a06d0/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.719313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.731617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c2dea-00df-49eb-9de9-1bf4fb33630e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce333f22bcc2416684314dbab32faba9, user_id=42f7f49fd622428e801e2849710a06d0, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.734459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c2dea-00df-49eb-9de9-1bf4fb33630e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.741141 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:25.790343 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3856/7754] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:25 2022] PUT /identity/v3/projects/9e82387a479d49bea8f748d3b555fec7/users/4df545b96ef24138bd1574330b2d122c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:25.794855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.821961 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3899/7755] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:25 2022] PUT /identity/v3/projects/ce333f22bcc2416684314dbab32faba9/users/42f7f49fd622428e801e2849710a06d0/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:25.832107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8325-71b1-424b-b4eb-72a533b45f6a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.832396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8325-71b1-424b-b4eb-72a533b45f6a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.832680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8325-71b1-424b-b4eb-72a533b45f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.861580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-63ca8325-71b1-424b-b4eb-72a533b45f6a None None] MFA Rules not processed for user `42f7f49fd622428e801e2849710a06d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:25.862651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aaca4-e6c2-4dba-805c-43165504be23 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.862877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-63ca8325-71b1-424b-b4eb-72a533b45f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:25.925121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.925748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.926123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.926400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.927049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.928870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.940098 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3900/7756] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:25.940989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8325-71b1-424b-b4eb-72a533b45f6a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.943921 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3857/7757] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:25.944537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:25.952168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8325-71b1-424b-b4eb-72a533b45f6a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.954470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11909c60-9f1b-42b7-ad5b-bf79db644d2e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:25.956786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.957273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.957557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.957861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.958488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.959302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9909748-007c-46ad-8674-782c6dcbfd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:25.959948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9909748-007c-46ad-8674-782c6dcbfd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.960230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9909748-007c-46ad-8674-782c6dcbfd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.960387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.960506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9909748-007c-46ad-8674-782c6dcbfd07 admin admin] PATH_INFO: `/v3/projects/9e82387a479d49bea8f748d3b555fec7/users/4df545b96ef24138bd1574330b2d122c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:25.962441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9909748-007c-46ad-8674-782c6dcbfd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e82387a479d49bea8f748d3b555fec7, user_id=4df545b96ef24138bd1574330b2d122c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:25.965067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9909748-007c-46ad-8674-782c6dcbfd07 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:25.975361 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3858/7758] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:25 2022] PUT /identity/v3/projects/9e82387a479d49bea8f748d3b555fec7/users/4df545b96ef24138bd1574330b2d122c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:25.986160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:25.986449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:25.986730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.014577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] MFA Rules not processed for user `4df545b96ef24138bd1574330b2d122c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:26.015797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:26.075041 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3901/7759] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:26.085296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:26.088517 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3859/7760] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:26.108431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:26.110427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:26.163768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe0ba1-cf3d-4c14-b9c6-f3cf438e9ba4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:26.168978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:26.169609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.169926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.170208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.170848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:26.172831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:26.178284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5e9f-8349-48c7-bf86-4a52a57bfffe None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:26.229726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:26.230397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.230713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.230991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.284895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3902/7761] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:26 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:26.286066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:26.288733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:26.290295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:26.297202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851457d3-ab17-45e8-898e-8e6f309ea9fb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:26.303213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3860/7762] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:26.303213 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:26.303382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:26.303382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.303871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.304427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.305798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:26.307009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:26.321865 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3903/7763] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:26.325582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:26.338673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4235f-44f3-44f8-ab09-070cd723d21e service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:26.345068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:26.345900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.346279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.346968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] PATH_INFO: `/v3/projects/9dc24bf882b04573a5feb3a5b5e80b45/users/cbd08e4d87b14d1daf67aa7d2c7c992f/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.363450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc24bf882b04573a5feb3a5b5e80b45, user_id=cbd08e4d87b14d1daf67aa7d2c7c992f, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:26.366092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:26.448897 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:26.455446 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3861/7764] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:26 2022] PUT /identity/v3/projects/9dc24bf882b04573a5feb3a5b5e80b45/users/cbd08e4d87b14d1daf67aa7d2c7c992f/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:26.461008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:26.474549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07cdb6-a1a0-44be-bc4a-9dc0a4947bbf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:26.542151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f663df-78c7-42fb-aadc-ff3b61b41425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:26.542803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f663df-78c7-42fb-aadc-ff3b61b41425 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.543605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f663df-78c7-42fb-aadc-ff3b61b41425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.544385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f663df-78c7-42fb-aadc-ff3b61b41425 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.545037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f663df-78c7-42fb-aadc-ff3b61b41425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:26.546676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f663df-78c7-42fb-aadc-ff3b61b41425 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:26.556705 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3904/7765] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:26.561605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:26.572196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d623f0-29bf-4a9f-a8e4-bf378d85f5ac admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:26.586621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:26.586621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.586621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.586621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] PATH_INFO: `/v3/projects/9dc24bf882b04573a5feb3a5b5e80b45/users/cbd08e4d87b14d1daf67aa7d2c7c992f/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.587000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc24bf882b04573a5feb3a5b5e80b45, user_id=cbd08e4d87b14d1daf67aa7d2c7c992f, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:26.587000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:26.593212 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3862/7766] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:26 2022] PUT /identity/v3/projects/9dc24bf882b04573a5feb3a5b5e80b45/users/cbd08e4d87b14d1daf67aa7d2c7c992f/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:26.603388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.603709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.603992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.633255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] MFA Rules not processed for user `cbd08e4d87b14d1daf67aa7d2c7c992f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:26.634514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:26.714132 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3905/7767] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:26.726061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:26.727771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:26.789537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155abdc1-e8c4-4f29-ab6c-b82afb5549ba admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:26.793900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:26.794715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:26.795002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:26.795279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:26.804464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:26.805957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:26.815888 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3863/7768] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:27.021573 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:27.244359 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:27.939581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:27.941198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:27.955734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cba05-b884-4809-8e13-eb73cc6d5906 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:27.959503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:27.960199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:27.960547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:27.966567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:28.022386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:28.023954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:28.034300 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3906/7769] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:29.511166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:29.513484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:29.581250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a051eae-129e-4273-8881-afb15fa2edc4 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:29.585180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b091e4c-dcb4-4ace-a10d-89ddb63d74e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:29.585790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091e4c-dcb4-4ace-a10d-89ddb63d74e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:29.586099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091e4c-dcb4-4ace-a10d-89ddb63d74e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:29.586371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b091e4c-dcb4-4ace-a10d-89ddb63d74e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:29.649105 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:29.653278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b091e4c-dcb4-4ace-a10d-89ddb63d74e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:29.655479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b091e4c-dcb4-4ace-a10d-89ddb63d74e0 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:29.669956 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3864/7770] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:32.243966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:32.245613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:32.321501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b88b84-a18e-44a4-ac63-574d5d42efda service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:32.326778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:32.327470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:32.327751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:32.328025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] PATH_INFO: `/v3/users/b206b07f948e44239251a745a6e787fd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:32.329245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b206b07f948e44239251a745a6e787fd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:32.331309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:32.429309 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:32.543683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b206b07f948e44239251a745a6e787fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:32.545931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b206b07f948e44239251a745a6e787fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:32.678684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b206b07f948e44239251a745a6e787fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:32.687746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b206b07f948e44239251a745a6e787fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:32.688685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b206b07f948e44239251a745a6e787fd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:32.710046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3907/7771] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:32 2022] DELETE /identity/v3/users/b206b07f948e44239251a745a6e787fd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:32.715529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:32.716843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:32.719852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:32.756622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:32.756622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:32.838261 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3865/7772] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:32.849691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:32.851903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:33.049345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e6cf1-f847-48fd-aa7e-f9638445d616 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:33.064083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efaa446-128d-4749-a4b8-ae0e06840e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:33.065194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efaa446-128d-4749-a4b8-ae0e06840e8a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:33.065693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efaa446-128d-4749-a4b8-ae0e06840e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:33.066331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efaa446-128d-4749-a4b8-ae0e06840e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:33.088781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efaa446-128d-4749-a4b8-ae0e06840e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:33.092480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efaa446-128d-4749-a4b8-ae0e06840e8a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:33.109952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3908/7773] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:33.456115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:33.457773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:33.472349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939cc8d-0753-474c-8903-a74916fc72c4 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:33.483795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:33.484458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:33.485022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:33.485461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] PATH_INFO: `/v3/projects/230e38d46d4e433f8d5043383f9cefd3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:33.486925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=230e38d46d4e433f8d5043383f9cefd3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:33.489723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:33.686155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230e38d46d4e433f8d5043383f9cefd3', 'request_id': 'req-78b94d8e-1467-4651-a8a9-cb7122a845fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:33.697641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230e38d46d4e433f8d5043383f9cefd3', 'request_id': 'req-78b94d8e-1467-4651-a8a9-cb7122a845fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:33.775335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230e38d46d4e433f8d5043383f9cefd3', 'request_id': 'req-78b94d8e-1467-4651-a8a9-cb7122a845fa'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:33.790449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] The token cache is being invalidate because project 230e38d46d4e433f8d5043383f9cefd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:33.790682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:33.791353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-78b94d8e-1467-4651-a8a9-cb7122a845fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:33.793132 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3866/7774] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:33 2022] DELETE /identity/v3/projects/230e38d46d4e433f8d5043383f9cefd3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:33.798652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873562-b5ae-4c8a-9ca6-2d6b08384433 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:33.802016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873562-b5ae-4c8a-9ca6-2d6b08384433 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:33.802016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873562-b5ae-4c8a-9ca6-2d6b08384433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:33.824869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-67873562-b5ae-4c8a-9ca6-2d6b08384433 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:33.827332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-67873562-b5ae-4c8a-9ca6-2d6b08384433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:33.932260 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3909/7775] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:33.933947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e32c6-5fd9-4825-b516-6a4d817d5783 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:33.934235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e32c6-5fd9-4825-b516-6a4d817d5783 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:33.935103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e32c6-5fd9-4825-b516-6a4d817d5783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:33.961398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-655e32c6-5fd9-4825-b516-6a4d817d5783 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:33.963023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-655e32c6-5fd9-4825-b516-6a4d817d5783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:33.972672 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3867/7776] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:33.978520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873562-b5ae-4c8a-9ca6-2d6b08384433 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:33.992557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873562-b5ae-4c8a-9ca6-2d6b08384433 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:34.000022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:34.000946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:34.007157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:34.007157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:34.007157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:34.007157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:34.007157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:34.021673 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3910/7777] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:34.026289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e32c6-5fd9-4825-b516-6a4d817d5783 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:34.038105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e32c6-5fd9-4825-b516-6a4d817d5783 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:34.045634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:34.046693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:34.047132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:34.047579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:34.049265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:34.051685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:34.160257 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3868/7778] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:34 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:34.164535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:34.180959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e04f1-40c3-44a1-851f-f676ad53da86 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:34.255942 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:34.318454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:34.319096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:34.319383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:34.319658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:34.320311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:34.324693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:34.431603 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3911/7779] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:34 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:34.436820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:34.460206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484af32-3dde-4236-8028-c3bf5cbece6b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:34.474044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:34.483540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:34.483649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:34.483884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:34.486973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:34.489403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:34.525519 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3869/7780] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:34.533796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:34.554086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba354c5-e6b1-4dd3-926f-0ed385eaae0e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:34.565961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d243e-c8c6-466c-8eb3-fd83831798d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:34.566515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d243e-c8c6-466c-8eb3-fd83831798d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:34.566801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d243e-c8c6-466c-8eb3-fd83831798d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:34.567261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d243e-c8c6-466c-8eb3-fd83831798d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:34.567939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d243e-c8c6-466c-8eb3-fd83831798d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:34.569667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d243e-c8c6-466c-8eb3-fd83831798d8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:34.609894 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3912/7781] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:34.611157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:34.628750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db66cc1-f34c-44ec-941c-97e8bf72d100 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:34.639283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:34.639973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:34.640259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:34.640539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] PATH_INFO: `/v3/projects/d0a7a9d2ce414582b2c6bd92c939110e/users/ed66c8ceadea46edb80c7441b87015f4/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:34.671468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a7a9d2ce414582b2c6bd92c939110e, user_id=ed66c8ceadea46edb80c7441b87015f4, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:34.674881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:34.753335 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3870/7782] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:34 2022] PUT /identity/v3/projects/d0a7a9d2ce414582b2c6bd92c939110e/users/ed66c8ceadea46edb80c7441b87015f4/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:34.766220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d1642-d748-4a70-90b0-c9dc2b703a18 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:34.766518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d1642-d748-4a70-90b0-c9dc2b703a18 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:34.766801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d1642-d748-4a70-90b0-c9dc2b703a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:34.806757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6c6d1642-d748-4a70-90b0-c9dc2b703a18 None None] MFA Rules not processed for user `ed66c8ceadea46edb80c7441b87015f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:34.807998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6c6d1642-d748-4a70-90b0-c9dc2b703a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:34.884621 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3913/7783] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:34.896249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:34.898097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:34.929180 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:35.003498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aeaf9-65be-442b-b010-1d10f8b346b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:35.027778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458bc34-2b8b-4a8a-a257-e7a7be5a0aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:35.028630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458bc34-2b8b-4a8a-a257-e7a7be5a0aad service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:35.028915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458bc34-2b8b-4a8a-a257-e7a7be5a0aad service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:35.029244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458bc34-2b8b-4a8a-a257-e7a7be5a0aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:35.044261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458bc34-2b8b-4a8a-a257-e7a7be5a0aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:35.046653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458bc34-2b8b-4a8a-a257-e7a7be5a0aad service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:35.062619 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3871/7784] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:35.990781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d1642-d748-4a70-90b0-c9dc2b703a18 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:36.085557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d1642-d748-4a70-90b0-c9dc2b703a18 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:36.097428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:36.097428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:36.097428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:36.097428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] PATH_INFO: `/v3/users/ed66c8ceadea46edb80c7441b87015f4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:36.097981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed66c8ceadea46edb80c7441b87015f4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:36.098984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:36.358265 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:36.373373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed66c8ceadea46edb80c7441b87015f4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:36.374132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed66c8ceadea46edb80c7441b87015f4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:36.483972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed66c8ceadea46edb80c7441b87015f4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:36.501556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed66c8ceadea46edb80c7441b87015f4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:36.502675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed66c8ceadea46edb80c7441b87015f4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:36.546356 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3914/7785] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:35 2022] DELETE /identity/v3/users/ed66c8ceadea46edb80c7441b87015f4 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:36.550684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:36.551285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:36.551285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:36.579853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:36.585139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:36.670252 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3872/7786] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:36.680196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:36.681695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:36.757653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c8077-a07d-498e-b6d0-3c6d04e75860 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:36.763439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:36.764287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:36.764697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:36.765071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:36.778180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:36.780206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:36.793267 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3915/7787] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:37.602329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:37.603840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:37.619886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fbbb0-9c65-48dc-8bff-6b841c9881ad None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:37.627148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:37.628825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:37.633078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:37.633078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] PATH_INFO: `/v3/projects/d0a7a9d2ce414582b2c6bd92c939110e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:37.633078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a7a9d2ce414582b2c6bd92c939110e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:37.634078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:37.691292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:37.692785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:37.787913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a7a9d2ce414582b2c6bd92c939110e', 'request_id': 'req-69cf35e1-3e0e-47af-a68e-968605ea4e2b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:37.798291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a7a9d2ce414582b2c6bd92c939110e', 'request_id': 'req-69cf35e1-3e0e-47af-a68e-968605ea4e2b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:37.806457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2fd1b-b4b5-4c21-96c7-6dd6d478af4b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:37.860607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd39c-2a0c-4e5c-bf7a-17ad00449d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:37.861226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd39c-2a0c-4e5c-bf7a-17ad00449d22 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:37.861509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd39c-2a0c-4e5c-bf7a-17ad00449d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:37.861786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd39c-2a0c-4e5c-bf7a-17ad00449d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:37.863565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8e3dd39c-2a0c-4e5c-bf7a-17ad00449d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:37.872781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a7a9d2ce414582b2c6bd92c939110e', 'request_id': 'req-69cf35e1-3e0e-47af-a68e-968605ea4e2b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:37.885410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] The token cache is being invalidate because project d0a7a9d2ce414582b2c6bd92c939110e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:37.885757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:37.887492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-69cf35e1-3e0e-47af-a68e-968605ea4e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:37.892992 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3873/7788] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:37 2022] DELETE /identity/v3/projects/d0a7a9d2ce414582b2c6bd92c939110e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:37.893155 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:37.895471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bbf3-b661-4484-abc0-276a02487eab None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:37.896251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bbf3-b661-4484-abc0-276a02487eab None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:37.896597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487bbf3-b661-4484-abc0-276a02487eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:37.917352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5487bbf3-b661-4484-abc0-276a02487eab None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:37.919113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5487bbf3-b661-4484-abc0-276a02487eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:37.945921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd39c-2a0c-4e5c-bf7a-17ad00449d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:37.947294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd39c-2a0c-4e5c-bf7a-17ad00449d22 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:37.954901 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:37.957012 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3916/7789] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:37.985975 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3874/7790] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:37.989482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad01b-bc8b-4600-bbc9-0712447ae22a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:37.989770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad01b-bc8b-4600-bbc9-0712447ae22a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:37.990086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad01b-bc8b-4600-bbc9-0712447ae22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.010044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-245ad01b-bc8b-4600-bbc9-0712447ae22a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:38.011256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-245ad01b-bc8b-4600-bbc9-0712447ae22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:38.019545 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3917/7791] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:38.023733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487bbf3-b661-4484-abc0-276a02487eab None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.035433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135e5d6-b475-43e3-81bd-f23087737b38 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.036352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135e5d6-b475-43e3-81bd-f23087737b38 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.036636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135e5d6-b475-43e3-81bd-f23087737b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.036799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487bbf3-b661-4484-abc0-276a02487eab None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:38.041385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:38.042025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.042308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.042581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.043224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:38.044059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:38.045834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:38.058559 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3875/7792] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:38.059128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c135e5d6-b475-43e3-81bd-f23087737b38 None None] MFA Rules not processed for user `d7d8e24e5dee4a7899769c92c6754995`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:38.060961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c135e5d6-b475-43e3-81bd-f23087737b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:38.063827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.073510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421580da-722f-4e51-ab9c-5f1d3cdaeeea admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:38.078329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:38.078924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.079203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.079482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.082620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:38.082620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:38.118823 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3918/7793] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:38.183633 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3876/7794] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:38 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:38.187798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135e5d6-b475-43e3-81bd-f23087737b38 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.200351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135e5d6-b475-43e3-81bd-f23087737b38 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:38.259356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:38.259982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.260271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.260710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.261348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:38.263396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:38.364678 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3919/7795] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:38 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:38.368781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.379645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec53c-0604-4db1-b84f-c020d6d951b8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:38.384427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:38.385027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.385308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.385579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.390514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:38.390514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:38.401063 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3877/7796] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:38.402374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.414820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbd562-5a73-461c-817d-6c7e125ef734 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:38.424023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646356ed-a615-484a-9277-119efe2604a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:38.424604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646356ed-a615-484a-9277-119efe2604a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.424867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646356ed-a615-484a-9277-119efe2604a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.426594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646356ed-a615-484a-9277-119efe2604a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.426594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646356ed-a615-484a-9277-119efe2604a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:38.427408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646356ed-a615-484a-9277-119efe2604a0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:38.438855 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3920/7797] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:38.442957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.460143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d364fa-fc5b-4588-9646-9ef09836bd0e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:38.471506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:38.472265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.472619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.472967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] PATH_INFO: `/v3/projects/c76d7b1fdb454f48921bba9e2e546cac/users/b025c0371a1c4dae86be1a2bd1b6d7cf/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.498213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76d7b1fdb454f48921bba9e2e546cac, user_id=b025c0371a1c4dae86be1a2bd1b6d7cf, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:38.501339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:38.610634 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3878/7798] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:38 2022] PUT /identity/v3/projects/c76d7b1fdb454f48921bba9e2e546cac/users/b025c0371a1c4dae86be1a2bd1b6d7cf/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:38.615740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff20de-9166-4393-b0c2-21bef84b0456 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.616060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff20de-9166-4393-b0c2-21bef84b0456 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.616638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff20de-9166-4393-b0c2-21bef84b0456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.667636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b3ff20de-9166-4393-b0c2-21bef84b0456 None None] MFA Rules not processed for user `b025c0371a1c4dae86be1a2bd1b6d7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:38.669074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b3ff20de-9166-4393-b0c2-21bef84b0456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:38.725139 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:38.737955 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3921/7799] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:38.742489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.810741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dd02d-b3ec-4910-b655-d54b61b29137 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:38.816632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:38.816632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:38.816632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:38.816632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:38.817176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:38.819089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:38.917085 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3879/7800] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:38 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:38.921727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff20de-9166-4393-b0c2-21bef84b0456 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:38.936545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff20de-9166-4393-b0c2-21bef84b0456 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:39.006039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:39.006671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.006947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.007221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.007911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:39.009888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:39.121555 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3922/7801] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:38 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:39.123401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:39.134119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91349a5-a357-49a1-bad7-7fe9657533e5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:39.139337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:39.139955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.140256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.140514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.145255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:39.145255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:39.154727 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3880/7802] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:39.159028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:39.169347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d46f-2d14-420a-adf3-0cec05932246 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:39.173939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:39.174505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.174782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.175053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] PATH_INFO: `/v3/projects/b2b22e42588e46b28b8b0658c7c0e502/users/192a711994b44a48889c785835ac57b7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.190147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b22e42588e46b28b8b0658c7c0e502, user_id=192a711994b44a48889c785835ac57b7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:39.192775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:39.292231 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3923/7803] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:39 2022] PUT /identity/v3/projects/b2b22e42588e46b28b8b0658c7c0e502/users/192a711994b44a48889c785835ac57b7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:39.296809 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:39.307460 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ec82c-991b-4438-8f32-0497c9abcbbd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:39.349371 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:39.365422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d51832-8d62-488d-a700-04a6d0545919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:39.366071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51832-8d62-488d-a700-04a6d0545919 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.366347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51832-8d62-488d-a700-04a6d0545919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.367137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51832-8d62-488d-a700-04a6d0545919 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.367289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51832-8d62-488d-a700-04a6d0545919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:39.368951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51832-8d62-488d-a700-04a6d0545919 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:39.383965 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3881/7804] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:39.385268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:39.396271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2eb7e-7741-47b1-a9c1-6c466141ddad admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:39.400958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:39.401608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.401924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.405946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] PATH_INFO: `/v3/projects/b2b22e42588e46b28b8b0658c7c0e502/users/192a711994b44a48889c785835ac57b7/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.405946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b22e42588e46b28b8b0658c7c0e502, user_id=192a711994b44a48889c785835ac57b7, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:39.408270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:39.421148 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3924/7805] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:39 2022] PUT /identity/v3/projects/b2b22e42588e46b28b8b0658c7c0e502/users/192a711994b44a48889c785835ac57b7/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:39.432503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.432789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.433107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.463052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] MFA Rules not processed for user `192a711994b44a48889c785835ac57b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:39.464273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:39.541839 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3882/7806] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:39.554314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:39.555990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:39.619756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105b06e-8017-40a3-9d26-1da95545a9bf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:39.623725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:39.624331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.624610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.624931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.634084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:39.635505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:39.645211 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3925/7807] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:39.884635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:39.886709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:39.901892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48524103-67c6-40c1-a846-76443afcbd7a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:39.905535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e1a59-a714-437e-9b14-299557b1cbce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:39.906235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1a59-a714-437e-9b14-299557b1cbce service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:39.906511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1a59-a714-437e-9b14-299557b1cbce service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:39.906780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1a59-a714-437e-9b14-299557b1cbce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:39.972356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e1a59-a714-437e-9b14-299557b1cbce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:39.974254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e1a59-a714-437e-9b14-299557b1cbce service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:39.983660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3883/7808] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:43.819429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:43.842243 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:43.891576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5526ea-6a19-47cf-9a6f-8b9f0eab84b5 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:43.896638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:43.897346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:43.897755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:43.898067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] PATH_INFO: `/v3/users/b025c0371a1c4dae86be1a2bd1b6d7cf` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:43.899297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b025c0371a1c4dae86be1a2bd1b6d7cf)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:43.901431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:44.100840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b025c0371a1c4dae86be1a2bd1b6d7cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.102109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b025c0371a1c4dae86be1a2bd1b6d7cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.170149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b025c0371a1c4dae86be1a2bd1b6d7cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.178441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b025c0371a1c4dae86be1a2bd1b6d7cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.179141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b025c0371a1c4dae86be1a2bd1b6d7cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.200452 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3926/7809] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:43 2022] DELETE /identity/v3/users/b025c0371a1c4dae86be1a2bd1b6d7cf => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:44.202327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:44.203733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:44.204017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:44.224671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:44.225984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:44.287502 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3884/7810] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:44.297627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:44.299090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:44.363683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e24e-d323-4057-b52a-3cb15e7876dc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:44.375307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5f73d-91db-4718-8945-557e61c4abf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:44.375307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5f73d-91db-4718-8945-557e61c4abf7 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:44.375307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5f73d-91db-4718-8945-557e61c4abf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:44.375307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5f73d-91db-4718-8945-557e61c4abf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:44.384487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5f73d-91db-4718-8945-557e61c4abf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:44.386040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5f73d-91db-4718-8945-557e61c4abf7 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:44.398729 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3927/7811] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:44.426505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:44.427960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:44.437067 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:44.441224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248bd08-082a-4e63-908b-8148302607a2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:44.446454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:44.447152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:44.452938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:44.452938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] PATH_INFO: `/v3/users/aaae72d6b81a4879819b17c0bc42652d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:44.452938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaae72d6b81a4879819b17c0bc42652d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:44.452938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:44.774400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaae72d6b81a4879819b17c0bc42652d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.789101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaae72d6b81a4879819b17c0bc42652d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.796397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaae72d6b81a4879819b17c0bc42652d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.797173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaae72d6b81a4879819b17c0bc42652d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.862957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaae72d6b81a4879819b17c0bc42652d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:44.870632 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3885/7812] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:44 2022] DELETE /identity/v3/users/aaae72d6b81a4879819b17c0bc42652d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:44.875879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:44.876383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:44.876497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:44.896371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:44.897974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:44.899023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:44.900467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:44.939323 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:44.969898 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3928/7813] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:44.980246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:44.981740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:44.988111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef339-e271-4f7d-a946-fa8b92b3a10f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:44.994686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:44.995337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:44.995832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:44.996128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] PATH_INFO: `/v3/projects/c76d7b1fdb454f48921bba9e2e546cac` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:44.998307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76d7b1fdb454f48921bba9e2e546cac)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:45.000360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:45.050043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305350a0-e0df-4fe6-9188-bf963fc64f40 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:45.053661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:45.054305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:45.054589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:45.054863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:45.064863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:45.066355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:45.076595 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3929/7814] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:45.104827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76d7b1fdb454f48921bba9e2e546cac', 'request_id': 'req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.111335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76d7b1fdb454f48921bba9e2e546cac', 'request_id': 'req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.180703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76d7b1fdb454f48921bba9e2e546cac', 'request_id': 'req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.193516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] The token cache is being invalidate because project c76d7b1fdb454f48921bba9e2e546cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:45.193827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.194569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.196370 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3886/7815] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:44 2022] DELETE /identity/v3/projects/c76d7b1fdb454f48921bba9e2e546cac => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:45.200895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:45.211427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331759-8c5a-48dd-b028-00b9e89f2dc4 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:45.272299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:45.272950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:45.273268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:45.273550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] PATH_INFO: `/v3/users/192a711994b44a48889c785835ac57b7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:45.274778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192a711994b44a48889c785835ac57b7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:45.276728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:45.595555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192a711994b44a48889c785835ac57b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.596170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192a711994b44a48889c785835ac57b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.643514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:45.645109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:45.660271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffbb3-0f14-4d55-ae6b-f2f72b97dc42 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:45.665250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:45.665857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:45.666320 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:45.666767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] PATH_INFO: `/v3/projects/e0283e5386a4462498917164bea4d66b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:45.667972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0283e5386a4462498917164bea4d66b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:45.669972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:45.673260 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:45.703438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192a711994b44a48889c785835ac57b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.711341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192a711994b44a48889c785835ac57b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.713119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192a711994b44a48889c785835ac57b7'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.726442 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:45.731419 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3930/7816] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:45 2022] DELETE /identity/v3/users/192a711994b44a48889c785835ac57b7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:45.797730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0283e5386a4462498917164bea4d66b', 'request_id': 'req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.806403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0283e5386a4462498917164bea4d66b', 'request_id': 'req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.901491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0283e5386a4462498917164bea4d66b', 'request_id': 'req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.916830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] The token cache is being invalidate because project e0283e5386a4462498917164bea4d66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:45.917055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.917898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:45.923981 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3887/7817] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:45 2022] DELETE /identity/v3/projects/e0283e5386a4462498917164bea4d66b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:45.926365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:45.928050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:46.022754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667d41-a0f4-4e2d-adc3-42e7ee75e2b0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:46.095596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:46.096328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.096612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.096890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] PATH_INFO: `/v3/users/42f7f49fd622428e801e2849710a06d0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.098074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f7f49fd622428e801e2849710a06d0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:46.100043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:46.179453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:46.181022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:46.223044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8ffbd-3d6f-4792-a9f2-c2d76ec907cf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:46.227806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:46.228574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.228935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.229323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] PATH_INFO: `/v3/projects/b2b22e42588e46b28b8b0658c7c0e502` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.230590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b22e42588e46b28b8b0658c7c0e502)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:46.232695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:46.302818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f7f49fd622428e801e2849710a06d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.303469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f7f49fd622428e801e2849710a06d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.350297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b22e42588e46b28b8b0658c7c0e502', 'request_id': 'req-3daead7f-92c8-4771-9924-90a586dfe8ef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.360860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b22e42588e46b28b8b0658c7c0e502', 'request_id': 'req-3daead7f-92c8-4771-9924-90a586dfe8ef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.375163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f7f49fd622428e801e2849710a06d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.384023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f7f49fd622428e801e2849710a06d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.384738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa1a3a35-9837-48b4-9628-5a30d13f63eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f7f49fd622428e801e2849710a06d0'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.402931 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3931/7818] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:45 2022] DELETE /identity/v3/users/42f7f49fd622428e801e2849710a06d0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:46.457864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b22e42588e46b28b8b0658c7c0e502', 'request_id': 'req-3daead7f-92c8-4771-9924-90a586dfe8ef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.473084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] The token cache is being invalidate because project b2b22e42588e46b28b8b0658c7c0e502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:46.473368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.474050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3daead7f-92c8-4771-9924-90a586dfe8ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:46.475786 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3888/7819] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:46 2022] DELETE /identity/v3/projects/b2b22e42588e46b28b8b0658c7c0e502 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:46.480524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74b6e-4707-4840-94b0-bd0151ff86fd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.480816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74b6e-4707-4840-94b0-bd0151ff86fd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.481094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74b6e-4707-4840-94b0-bd0151ff86fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.503080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b9f74b6e-4707-4840-94b0-bd0151ff86fd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:46.504316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9f74b6e-4707-4840-94b0-bd0151ff86fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:46.540533 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:46.595050 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3932/7820] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:46.601409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2e5a2-5d3f-44a9-9244-fccf774b6a39 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.601867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2e5a2-5d3f-44a9-9244-fccf774b6a39 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.602161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2e5a2-5d3f-44a9-9244-fccf774b6a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.622787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aab2e5a2-5d3f-44a9-9244-fccf774b6a39 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:46.624968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aab2e5a2-5d3f-44a9-9244-fccf774b6a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:46.632576 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3889/7821] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:46.637352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74b6e-4707-4840-94b0-bd0151ff86fd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:46.654753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74b6e-4707-4840-94b0-bd0151ff86fd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:46.659982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:46.660606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.661024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.661310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.661999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:46.662306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:46.663922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:46.677299 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3933/7822] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:46.686217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2e5a2-5d3f-44a9-9244-fccf774b6a39 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:46.696342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2e5a2-5d3f-44a9-9244-fccf774b6a39 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:46.701629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:46.705318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.705318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.705318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.705318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:46.705836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:46.805427 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3890/7823] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:46 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:46.810312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:46.820374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b990-0e8b-45ca-810f-89803675976d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:46.847799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:46.849600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:46.889594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:46.890407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.890691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.890965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.891745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:46.893739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:46.907481 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:46.926342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd03c27-4b3e-4a47-ac52-79fe19afc0c9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:46.931035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:46.931672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:46.931956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:46.932231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] PATH_INFO: `/v3/projects/ce333f22bcc2416684314dbab32faba9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:46.933366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce333f22bcc2416684314dbab32faba9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:46.936284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:46.999096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3934/7824] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:46 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:47.004644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:47.015162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe362c22-fe1a-469d-b89f-df3f87961408 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:47.020110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:47.020732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:47.021017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:47.021295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:47.021980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:47.023575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:47.035973 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3935/7825] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:47.039879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:47.050149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14404e-de57-4c07-a681-06f811af9566 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:47.054749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:47.055314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:47.055594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:47.055868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:47.056492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:47.058089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:47.071917 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3936/7826] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:47.072912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:47.077293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce333f22bcc2416684314dbab32faba9', 'request_id': 'req-238c6add-c5e0-4079-9ec6-864153168d3e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.082946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab6977-9be6-41d7-ad70-f60757763a51 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:47.083400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce333f22bcc2416684314dbab32faba9', 'request_id': 'req-238c6add-c5e0-4079-9ec6-864153168d3e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.141595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2d620-9493-405e-9c14-7dfedfc470b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:47.142275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d620-9493-405e-9c14-7dfedfc470b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:47.142560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d620-9493-405e-9c14-7dfedfc470b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:47.142846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d620-9493-405e-9c14-7dfedfc470b9 admin admin] PATH_INFO: `/v3/projects/120e63d6d0304a49be4ce2d741676dc9/users/c448909500474751ac88a656f2f0f496/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:47.158061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2d620-9493-405e-9c14-7dfedfc470b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120e63d6d0304a49be4ce2d741676dc9, user_id=c448909500474751ac88a656f2f0f496, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:47.160432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce333f22bcc2416684314dbab32faba9', 'request_id': 'req-238c6add-c5e0-4079-9ec6-864153168d3e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.161012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2d620-9493-405e-9c14-7dfedfc470b9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:47.176439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] The token cache is being invalidate because project ce333f22bcc2416684314dbab32faba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:47.176752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.177413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.178947 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3891/7827] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:46 2022] DELETE /identity/v3/projects/ce333f22bcc2416684314dbab32faba9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:47.182787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:47.184060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:47.196802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c6add-c5e0-4079-9ec6-864153168d3e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:47.201805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:47.202438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:47.202718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:47.203048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] PATH_INFO: `/v3/users/cbd08e4d87b14d1daf67aa7d2c7c992f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:47.204163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd08e4d87b14d1daf67aa7d2c7c992f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:47.206299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:47.236363 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3937/7828] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:47 2022] PUT /identity/v3/projects/120e63d6d0304a49be4ce2d741676dc9/users/c448909500474751ac88a656f2f0f496/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:47.247391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:47.247679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:47.247956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:47.261786 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:47.276006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] MFA Rules not processed for user `c448909500474751ac88a656f2f0f496`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:47.277210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:47.342379 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3938/7829] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:47.346788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:47.348141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:47.364560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd08e4d87b14d1daf67aa7d2c7c992f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.377550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd08e4d87b14d1daf67aa7d2c7c992f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.384650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd08e4d87b14d1daf67aa7d2c7c992f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.385622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd08e4d87b14d1daf67aa7d2c7c992f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.487006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a812c-26f0-4ef2-864b-c811932b08ac None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:47.491814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:47.492463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:47.492772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:47.493023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:47.493653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:47.496610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:47.563664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd08e4d87b14d1daf67aa7d2c7c992f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:47.570297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3892/7830] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:47 2022] DELETE /identity/v3/users/cbd08e4d87b14d1daf67aa7d2c7c992f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:47.717119 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3939/7831] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:47 2022] POST /identity/v3/projects => generated 387 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:47.721751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:47.723157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:47.772724 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:47.788484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5cbd3-4994-4095-9cad-01b66ad7b950 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:47.843623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:47.844197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:47.844472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:47.844742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:47.845372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:47.847299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:47.989288 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3893/7832] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:47 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:47.990556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.001745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fb929-ba9d-48d3-bc3f-e4176dec0d57 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.006482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.007082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.007365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.007643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.008280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.009906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.021727 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3940/7833] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:48.026081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.036496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c5997-537d-443f-be2e-1027bfc79f1b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.041318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.042011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.042291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.042561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] PATH_INFO: `/v3/projects/5cd9e39e184c41c4b167fe028e00c3c0/users/5abf0331858e424facf55ea634a0a508/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.057579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd9e39e184c41c4b167fe028e00c3c0, user_id=5abf0331858e424facf55ea634a0a508, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.061239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.087463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.089183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.103460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe22c7-919a-4158-a0fc-9419c3b9da7e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.108479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.110222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.110600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.110781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] PATH_INFO: `/v3/projects/9dc24bf882b04573a5feb3a5b5e80b45` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.111912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc24bf882b04573a5feb3a5b5e80b45)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.113999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.189579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3894/7834] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:48 2022] PUT /identity/v3/projects/5cd9e39e184c41c4b167fe028e00c3c0/users/5abf0331858e424facf55ea634a0a508/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:48.193422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.250654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc24bf882b04573a5feb3a5b5e80b45', 'request_id': 'req-2223067b-5850-4d76-a469-98d7c091238f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.257250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc24bf882b04573a5feb3a5b5e80b45', 'request_id': 'req-2223067b-5850-4d76-a469-98d7c091238f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.258400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b8de7-5b6b-44d2-bc8c-99aaff95f5ca admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.315343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.316053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.316395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.316694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.317328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.318961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.330518 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3895/7835] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:48.338762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc24bf882b04573a5feb3a5b5e80b45', 'request_id': 'req-2223067b-5850-4d76-a469-98d7c091238f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.338917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.339031 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:48.344871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a929fd-875e-45c9-9e1f-330f1efa5ce7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.347032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] The token cache is being invalidate because project 9dc24bf882b04573a5feb3a5b5e80b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:48.347308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.347958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2223067b-5850-4d76-a469-98d7c091238f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.349451 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3941/7836] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:48 2022] DELETE /identity/v3/projects/9dc24bf882b04573a5feb3a5b5e80b45 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:48.353941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650563f-7331-4a6e-831e-e3bd2d704972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.353941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650563f-7331-4a6e-831e-e3bd2d704972 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.353941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650563f-7331-4a6e-831e-e3bd2d704972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.353941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650563f-7331-4a6e-831e-e3bd2d704972 admin admin] PATH_INFO: `/v3/projects/5cd9e39e184c41c4b167fe028e00c3c0/users/5abf0331858e424facf55ea634a0a508/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.354302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650563f-7331-4a6e-831e-e3bd2d704972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd9e39e184c41c4b167fe028e00c3c0, user_id=5abf0331858e424facf55ea634a0a508, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.355209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67578-24a0-46b2-8d10-e468bbe07423 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.355488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67578-24a0-46b2-8d10-e468bbe07423 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.355761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b67578-24a0-46b2-8d10-e468bbe07423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.355953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650563f-7331-4a6e-831e-e3bd2d704972 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.368338 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3896/7837] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:48 2022] PUT /identity/v3/projects/5cd9e39e184c41c4b167fe028e00c3c0/users/5abf0331858e424facf55ea634a0a508/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:48.377094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-84b67578-24a0-46b2-8d10-e468bbe07423 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:48.378470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-84b67578-24a0-46b2-8d10-e468bbe07423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.454508 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:48.460509 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3942/7838] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:48.467229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.467512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.467791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.474431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977a6e2-806b-4f59-b85c-17194dc5f2e9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.474738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977a6e2-806b-4f59-b85c-17194dc5f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.475048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977a6e2-806b-4f59-b85c-17194dc5f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.495527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5977a6e2-806b-4f59-b85c-17194dc5f2e9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:48.496245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] MFA Rules not processed for user `5abf0331858e424facf55ea634a0a508`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:48.496886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5977a6e2-806b-4f59-b85c-17194dc5f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.497198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.505172 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3943/7839] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:48.509472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977a6e2-806b-4f59-b85c-17194dc5f2e9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.519553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977a6e2-806b-4f59-b85c-17194dc5f2e9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.524409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.525008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.525290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.525594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.526287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:48.526590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.528915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.546282 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3944/7840] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:51:48.547364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.557464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266caf45-3e31-4638-be5d-454679040a7c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.563110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.563735 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.576502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.576502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.576502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.576502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.577436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3897/7841] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:48.586828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.588372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.651449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54214d-8b32-4f9b-8aa8-cad8984f415f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.656025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.656647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.656926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.657199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.665484 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3945/7842] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:48 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:48.666692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.667596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.669189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.680505 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3898/7843] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:48.737782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ced1-d06c-406f-9e0e-1663d3c2f0be admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.752301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.753169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.753538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.753949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.755122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.756994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.826383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.827812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.841902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bee0c0-4d32-40b9-9b00-4471f8aec8d9 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.846437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.847055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.847411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.847687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] PATH_INFO: `/v3/users/c448909500474751ac88a656f2f0f496` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.848843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c448909500474751ac88a656f2f0f496)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.850770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.861014 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3946/7844] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:48 2022] POST /identity/v3/users => generated 304 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:48.865304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.875921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72299989-f4c9-462f-aa01-edc64717b18c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.880744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.882179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.882179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.882179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.882536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.884134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.895294 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3947/7845] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:48.906118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.915984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87386e-fce3-46f7-b637-ef24fd34dd7b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.920869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.921480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.921862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.922178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.926867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.926867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.936389 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3948/7846] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:51:48.940726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.952256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951ba1-1767-470d-adbe-77d31d5cfd05 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.957279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bcdd8-0f45-4f3d-9300-68f2a8f2c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.957975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bcdd8-0f45-4f3d-9300-68f2a8f2c63b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.961135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bcdd8-0f45-4f3d-9300-68f2a8f2c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.961135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bcdd8-0f45-4f3d-9300-68f2a8f2c63b admin admin] PATH_INFO: `/v3/projects/bf1769deed6f41ea897d82b72a286a53/users/89b6fd3389d5416ca0eb9376e7654976/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.975461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bcdd8-0f45-4f3d-9300-68f2a8f2c63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1769deed6f41ea897d82b72a286a53, user_id=89b6fd3389d5416ca0eb9376e7654976, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.978188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bcdd8-0f45-4f3d-9300-68f2a8f2c63b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.980371 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:49.093362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c448909500474751ac88a656f2f0f496'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.106631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c448909500474751ac88a656f2f0f496'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.112542 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:49.114770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c448909500474751ac88a656f2f0f496'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.115532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c448909500474751ac88a656f2f0f496'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.133128 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3949/7847] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:48 2022] PUT /identity/v3/projects/bf1769deed6f41ea897d82b72a286a53/users/89b6fd3389d5416ca0eb9376e7654976/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:49.144945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.145298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.145580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.174772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] MFA Rules not processed for user `89b6fd3389d5416ca0eb9376e7654976`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:49.175973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.216339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-5d714919-457a-4d3d-9002-8c02641f0a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c448909500474751ac88a656f2f0f496'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.223609 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3899/7848] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:48 2022] DELETE /identity/v3/users/c448909500474751ac88a656f2f0f496 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:49.228160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.228453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.228846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.244691 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3950/7849] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:49.248910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:49.250178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.250826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.252462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.318024 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3900/7850] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:49.323572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd0994-09f4-41ed-bcf0-440bbe24070e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.328729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.329322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.329454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.329660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.329936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.330674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.330795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.332616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.392997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28a662-80c5-454c-ab24-c47a27fe8ede None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.397169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.397784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.398107 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.398387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.408889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.410650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.424595 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3901/7851] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:49.438667 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3951/7852] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/projects => generated 407 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:49.442935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.454982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d3af-2bc7-49ca-b7c7-4dd7ddfc8b65 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.524699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.525031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.525947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.526578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.526873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.529026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.672532 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3902/7853] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/users => generated 310 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:49.679050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.705312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cbde9-fc70-4f67-8c09-f5bb17a9799b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.710546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.711862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.712137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.712416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.713496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.715140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.727347 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3952/7854] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:49.731749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.742494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f85df-c077-46c7-95ce-bf9f2e360c3e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.748861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.749534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.749844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.750142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] PATH_INFO: `/v3/projects/6a97349e6f754ab98255911ae4a938b6/users/51343680af524e7288f9afcb5cfb5048/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.769852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a97349e6f754ab98255911ae4a938b6, user_id=51343680af524e7288f9afcb5cfb5048, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.773033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.832668 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:49.838483 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3903/7855] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:49 2022] PUT /identity/v3/projects/6a97349e6f754ab98255911ae4a938b6/users/51343680af524e7288f9afcb5cfb5048/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:49.842701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.853376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732c0cb-c436-4ce1-ae1f-bf487bf4be5d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.928399 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:49.928581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.930436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.935195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.935913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.936259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.936619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.937443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.939208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.946985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d648-fcfa-4d5a-a9f1-e72cf18c22c3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.952821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.953406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.953841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.954256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] PATH_INFO: `/v3/projects/120e63d6d0304a49be4ce2d741676dc9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.955555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=120e63d6d0304a49be4ce2d741676dc9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.956465 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3953/7856] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:49.957757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.961117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.978405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4426e-2ee2-4a12-9114-ca19bddc76e8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.984378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652d28-8823-42c1-bff5-762fc76dbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.985047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652d28-8823-42c1-bff5-762fc76dbc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.985331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652d28-8823-42c1-bff5-762fc76dbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.985612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652d28-8823-42c1-bff5-762fc76dbc08 admin admin] PATH_INFO: `/v3/projects/6a97349e6f754ab98255911ae4a938b6/users/51343680af524e7288f9afcb5cfb5048/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.987604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652d28-8823-42c1-bff5-762fc76dbc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a97349e6f754ab98255911ae4a938b6, user_id=51343680af524e7288f9afcb5cfb5048, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.990311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652d28-8823-42c1-bff5-762fc76dbc08 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:50.002115 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3954/7857] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:49 2022] PUT /identity/v3/projects/6a97349e6f754ab98255911ae4a938b6/users/51343680af524e7288f9afcb5cfb5048/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:50.013545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:50.013902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:50.014201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:50.041795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] MFA Rules not processed for user `51343680af524e7288f9afcb5cfb5048`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:50.043122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:50.067692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120e63d6d0304a49be4ce2d741676dc9', 'request_id': 'req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.073555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120e63d6d0304a49be4ce2d741676dc9', 'request_id': 'req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.117382 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3955/7858] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:50 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:50.128759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:50.130107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:50.165754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120e63d6d0304a49be4ce2d741676dc9', 'request_id': 'req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.177996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] The token cache is being invalidate because project 120e63d6d0304a49be4ce2d741676dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:50.178218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.178857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.180360 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3904/7859] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:49 2022] DELETE /identity/v3/projects/120e63d6d0304a49be4ce2d741676dc9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:50.184214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:50.185623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:50.189899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5bd7-8752-45fb-b5c1-563741718d86 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:50.239480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:50.240229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:50.240579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:50.240850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:50.242768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:50.251549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed293-1ef8-494f-aa54-9d82ce74e2fb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:50.256457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:50.257092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:50.257379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:50.257656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] PATH_INFO: `/v3/users/5abf0331858e424facf55ea634a0a508` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:50.258844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abf0331858e424facf55ea634a0a508)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:50.260766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:50.310431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:50.311893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:50.321735 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3956/7860] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:50 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:50.479892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abf0331858e424facf55ea634a0a508'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.492704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abf0331858e424facf55ea634a0a508'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.500557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abf0331858e424facf55ea634a0a508'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.502137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abf0331858e424facf55ea634a0a508'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.645612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abf0331858e424facf55ea634a0a508'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:50.652078 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3905/7861] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:50 2022] DELETE /identity/v3/users/5abf0331858e424facf55ea634a0a508 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:50.754579 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:50.838147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:50.839605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:50.852212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bbfe0-fc76-4724-96b7-de7f6b3c9572 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:50.904180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3783ca-5196-4b23-81d2-35fac1b8bec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:50.904814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3783ca-5196-4b23-81d2-35fac1b8bec7 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:50.905096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3783ca-5196-4b23-81d2-35fac1b8bec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:50.905367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3783ca-5196-4b23-81d2-35fac1b8bec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:50.907289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cc3783ca-5196-4b23-81d2-35fac1b8bec7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:50.978267 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:50.981908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3783ca-5196-4b23-81d2-35fac1b8bec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:50.983492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3783ca-5196-4b23-81d2-35fac1b8bec7 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:50.995422 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3957/7862] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:50 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:51.162908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:51.163148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:51.234379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830369d7-113c-44b0-b8ce-10d8b590bb2c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:51.239041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:51.239707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:51.239987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:51.240262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] PATH_INFO: `/v3/projects/5cd9e39e184c41c4b167fe028e00c3c0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:51.241396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd9e39e184c41c4b167fe028e00c3c0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:51.243469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:51.382883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd9e39e184c41c4b167fe028e00c3c0', 'request_id': 'req-dacd694d-96c7-410a-877f-0d33034b0131'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:51.391352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd9e39e184c41c4b167fe028e00c3c0', 'request_id': 'req-dacd694d-96c7-410a-877f-0d33034b0131'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:51.511762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd9e39e184c41c4b167fe028e00c3c0', 'request_id': 'req-dacd694d-96c7-410a-877f-0d33034b0131'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:51.526443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] The token cache is being invalidate because project 5cd9e39e184c41c4b167fe028e00c3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:51.528820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:51.529898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-dacd694d-96c7-410a-877f-0d33034b0131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:51.531896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3906/7863] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:51 2022] DELETE /identity/v3/projects/5cd9e39e184c41c4b167fe028e00c3c0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:51.536909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa94f8-e71a-4581-aa18-744954337a21 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:51.537944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa94f8-e71a-4581-aa18-744954337a21 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:51.538223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa94f8-e71a-4581-aa18-744954337a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:51.558419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e9aa94f8-e71a-4581-aa18-744954337a21 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:51.560299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e9aa94f8-e71a-4581-aa18-744954337a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:51.619042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3958/7864] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:51.627569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf30b3-2e0f-4d87-9886-fa10bbec25ef None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:51.627852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf30b3-2e0f-4d87-9886-fa10bbec25ef None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:51.628145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf30b3-2e0f-4d87-9886-fa10bbec25ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:51.647924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-38bf30b3-2e0f-4d87-9886-fa10bbec25ef None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:51.649110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-38bf30b3-2e0f-4d87-9886-fa10bbec25ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:51.657486 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3907/7865] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:51.662293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa94f8-e71a-4581-aa18-744954337a21 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:51.673403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa94f8-e71a-4581-aa18-744954337a21 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:51.678615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:51.679073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:51.681456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:51.681456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:51.681456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:51.681456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:51.682431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:51.694774 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3959/7866] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:51.699359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf30b3-2e0f-4d87-9886-fa10bbec25ef None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:51.708719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf30b3-2e0f-4d87-9886-fa10bbec25ef None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:51.713428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:51.714050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:51.714328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:51.714596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:51.715226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:51.717673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:51.888640 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3908/7867] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:51 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:51.892652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:51.903831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ee6c-6049-4f8a-8fda-99743997fd5e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:51.960754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:51.961407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:51.961697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:51.962006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:51.962680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:51.964767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:52.077876 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3960/7868] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:51 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:52.085063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:52.095627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5b31-2109-4457-836c-2dc5aa465bc3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:52.100463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:52.101003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.101286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.101560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.102237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:52.103825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:52.118018 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3909/7869] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:52.119297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:52.130168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3561-7e7e-4be2-a27d-423c89afda32 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:52.134916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09fa9b-2d8c-49c0-a1de-c492a6818d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:52.135515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09fa9b-2d8c-49c0-a1de-c492a6818d7f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.135864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09fa9b-2d8c-49c0-a1de-c492a6818d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.136134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09fa9b-2d8c-49c0-a1de-c492a6818d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.136790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09fa9b-2d8c-49c0-a1de-c492a6818d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:52.138405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09fa9b-2d8c-49c0-a1de-c492a6818d7f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:52.149401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3961/7870] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:52.153801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:52.164869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a506d01-b7c1-4bfb-bd9f-99eaaf12f812 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:52.170552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:52.171269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.171551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.171825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] PATH_INFO: `/v3/projects/e627b93c37e94aab846b2d720a76ca81/users/7bd985d55ede4ce18b445cd469c97ab8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.191432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e627b93c37e94aab846b2d720a76ca81, user_id=7bd985d55ede4ce18b445cd469c97ab8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:52.194380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:52.333732 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3910/7871] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:52 2022] PUT /identity/v3/projects/e627b93c37e94aab846b2d720a76ca81/users/7bd985d55ede4ce18b445cd469c97ab8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:52.347472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480482d6-bc8a-4252-a37d-0ecebb976137 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.347841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480482d6-bc8a-4252-a37d-0ecebb976137 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.348185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480482d6-bc8a-4252-a37d-0ecebb976137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.376822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-480482d6-bc8a-4252-a37d-0ecebb976137 None None] MFA Rules not processed for user `7bd985d55ede4ce18b445cd469c97ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:52.377980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-480482d6-bc8a-4252-a37d-0ecebb976137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:52.407054 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:52.447680 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3962/7872] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:52.454130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:52.521664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a26dbb-0f99-406e-92b2-ad00f26ab446 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:52.526510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:52.527157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.527503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.527782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.528482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:52.530399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:52.636391 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3911/7873] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:52 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:52.641485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480482d6-bc8a-4252-a37d-0ecebb976137 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:52.653717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480482d6-bc8a-4252-a37d-0ecebb976137 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:52.721746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:52.722400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.722738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.723036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.723722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:52.725679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:52.847113 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3963/7874] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:52 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:52.851170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:52.861652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dba7f-6104-4b37-a19f-35d61cc3bd9b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:52.866126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:52.866716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.867018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.867593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.868253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:52.869884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:52.881026 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3912/7875] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:52.885229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:52.896953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08a175-cfa7-4150-9938-827e3c97df40 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:52.901719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:52.902468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:52.902745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:52.903590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] PATH_INFO: `/v3/projects/1e25128f1b4646ddbf69735dca2d21f5/users/3e3c3ba74e7d4fedb1425ebe8ab3b53a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:52.911947 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:52.919127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e25128f1b4646ddbf69735dca2d21f5, user_id=3e3c3ba74e7d4fedb1425ebe8ab3b53a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:52.923281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:53.055415 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:53.066760 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3964/7876] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:52 2022] PUT /identity/v3/projects/1e25128f1b4646ddbf69735dca2d21f5/users/3e3c3ba74e7d4fedb1425ebe8ab3b53a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:53.070881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:53.082439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311a0e3-170a-47f6-a70e-107059e2b321 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:53.142680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73b829-3b2c-450b-918a-f3562533002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:53.143353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b829-3b2c-450b-918a-f3562533002d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:53.143558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b829-3b2c-450b-918a-f3562533002d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:53.143835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b829-3b2c-450b-918a-f3562533002d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:53.144484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73b829-3b2c-450b-918a-f3562533002d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:53.146126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73b829-3b2c-450b-918a-f3562533002d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:53.156603 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3913/7877] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:53.161137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:53.171798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867c0ec-a3df-4785-81c4-8c85a7a78cce admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:53.177078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:53.177896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:53.178065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:53.178305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] PATH_INFO: `/v3/projects/1e25128f1b4646ddbf69735dca2d21f5/users/3e3c3ba74e7d4fedb1425ebe8ab3b53a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:53.180277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e25128f1b4646ddbf69735dca2d21f5, user_id=3e3c3ba74e7d4fedb1425ebe8ab3b53a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:53.182961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:53.194243 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3965/7878] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:53 2022] PUT /identity/v3/projects/1e25128f1b4646ddbf69735dca2d21f5/users/3e3c3ba74e7d4fedb1425ebe8ab3b53a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:53.211953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314e93-c9e6-42b3-8bc3-03f32b233250 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:53.212254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314e93-c9e6-42b3-8bc3-03f32b233250 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:53.212541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314e93-c9e6-42b3-8bc3-03f32b233250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:53.240161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-98314e93-c9e6-42b3-8bc3-03f32b233250 None None] MFA Rules not processed for user `3e3c3ba74e7d4fedb1425ebe8ab3b53a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:53.241382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98314e93-c9e6-42b3-8bc3-03f32b233250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:53.310221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3914/7879] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:53.321274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:53.322993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:53.386939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7817-f7bd-47cc-898b-5973254c8f7e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:53.391681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25e48a-93cf-4234-b1c2-ceefa33bfe24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:53.392320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e48a-93cf-4234-b1c2-ceefa33bfe24 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:53.392717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e48a-93cf-4234-b1c2-ceefa33bfe24 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:53.392902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e48a-93cf-4234-b1c2-ceefa33bfe24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:53.413429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25e48a-93cf-4234-b1c2-ceefa33bfe24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:53.413429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25e48a-93cf-4234-b1c2-ceefa33bfe24 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:53.414878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3966/7880] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:53.496838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98314e93-c9e6-42b3-8bc3-03f32b233250 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:53.565889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98314e93-c9e6-42b3-8bc3-03f32b233250 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:53.570627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:53.571274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:53.571558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:53.571836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] PATH_INFO: `/v3/users/7bd985d55ede4ce18b445cd469c97ab8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:53.572986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd985d55ede4ce18b445cd469c97ab8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:53.575505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:53.806403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd985d55ede4ce18b445cd469c97ab8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:53.812870 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:53.820500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd985d55ede4ce18b445cd469c97ab8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:53.827451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd985d55ede4ce18b445cd469c97ab8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:53.828145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd985d55ede4ce18b445cd469c97ab8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:53.915220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd985d55ede4ce18b445cd469c97ab8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:53.922654 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3915/7881] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:53 2022] DELETE /identity/v3/users/7bd985d55ede4ce18b445cd469c97ab8 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:53.927220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:53.927741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:53.927841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:53.946862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:53.948074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:54.020653 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3967/7882] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:54.037455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.045088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:54.105506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ed68-03d2-4a6e-baa5-de2bdde93442 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.110310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.110925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.117323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.117323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.121378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.123697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.133403 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3916/7883] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:54.741226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.742822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:54.756009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dcbca-ae11-47e6-8149-f5ca3fe4c62e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.763645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.764327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.764671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.764944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] PATH_INFO: `/v3/projects/e627b93c37e94aab846b2d720a76ca81` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.766121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e627b93c37e94aab846b2d720a76ca81)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.768208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.917217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e627b93c37e94aab846b2d720a76ca81', 'request_id': 'req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:54.924596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e627b93c37e94aab846b2d720a76ca81', 'request_id': 'req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.016988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e627b93c37e94aab846b2d720a76ca81', 'request_id': 'req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.027652 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:55.033447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] The token cache is being invalidate because project e627b93c37e94aab846b2d720a76ca81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:55.033743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.034967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.036492 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3968/7884] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:54 2022] DELETE /identity/v3/projects/e627b93c37e94aab846b2d720a76ca81 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:55.040422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:55.052470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dc27-d116-474f-b7de-1c79d4fbdd46 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:55.105636 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:55.123522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:55.126318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:55.126318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:55.126318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] PATH_INFO: `/v3/users/3e3c3ba74e7d4fedb1425ebe8ab3b53a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:55.126318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3c3ba74e7d4fedb1425ebe8ab3b53a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:55.130156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:55.355749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3c3ba74e7d4fedb1425ebe8ab3b53a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.371187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3c3ba74e7d4fedb1425ebe8ab3b53a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.380102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3c3ba74e7d4fedb1425ebe8ab3b53a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.380577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3c3ba74e7d4fedb1425ebe8ab3b53a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.508924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-965af3d7-d477-41e8-88b0-2d8b7ab3fb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3c3ba74e7d4fedb1425ebe8ab3b53a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:55.516610 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3917/7885] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:55 2022] DELETE /identity/v3/users/3e3c3ba74e7d4fedb1425ebe8ab3b53a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:56.133230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:56.136049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:56.154627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26f8c-1ff0-4648-a1ce-6d2db8ff57ba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:56.267781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:56.269120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:56.269472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:56.269674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] PATH_INFO: `/v3/projects/1e25128f1b4646ddbf69735dca2d21f5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:56.271344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e25128f1b4646ddbf69735dca2d21f5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:56.273279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:56.435718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e25128f1b4646ddbf69735dca2d21f5', 'request_id': 'req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:56.443261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e25128f1b4646ddbf69735dca2d21f5', 'request_id': 'req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:56.548353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e25128f1b4646ddbf69735dca2d21f5', 'request_id': 'req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:56.571582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] The token cache is being invalidate because project 1e25128f1b4646ddbf69735dca2d21f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:56.571934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:56.572631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-546d3a71-1ebf-4ea2-92ce-69a70e3b1c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:56.574685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3969/7886] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:56 2022] DELETE /identity/v3/projects/1e25128f1b4646ddbf69735dca2d21f5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:56.579682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e0af-97db-4b1d-b8e9-5582f8a9782b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:56.580673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e0af-97db-4b1d-b8e9-5582f8a9782b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:56.580980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e0af-97db-4b1d-b8e9-5582f8a9782b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:56.605237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0a07e0af-97db-4b1d-b8e9-5582f8a9782b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:56.607205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0a07e0af-97db-4b1d-b8e9-5582f8a9782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:56.685775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3918/7887] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:56.693678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9baeeb-10a0-4d5f-8b46-71258218ac0b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:56.694133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9baeeb-10a0-4d5f-8b46-71258218ac0b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:56.694443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9baeeb-10a0-4d5f-8b46-71258218ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:56.724426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fb9baeeb-10a0-4d5f-8b46-71258218ac0b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:56.725711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fb9baeeb-10a0-4d5f-8b46-71258218ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:56.734968 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3970/7888] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:56.739471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e0af-97db-4b1d-b8e9-5582f8a9782b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:56.750454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e0af-97db-4b1d-b8e9-5582f8a9782b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:56.755670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:56.756288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:56.756568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:56.756842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:56.757882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:56.757882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:56.759564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:56.774625 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3919/7889] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:51:56.779084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9baeeb-10a0-4d5f-8b46-71258218ac0b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:56.790665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9baeeb-10a0-4d5f-8b46-71258218ac0b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:56.797991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:56.799209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:56.800042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:56.800540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:56.801765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:56.805116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:56.927525 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3971/7890] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:56 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:56.930181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:56.941939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709053b-381d-466d-b552-2d6bc1f4434a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:56.992357 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:57.003091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:57.003715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.003999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.004274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.004917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:57.007027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:57.127838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3920/7891] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:56 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:57.142598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:57.153618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86897e0d-70ef-4365-b1bf-9d247cd97ca2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:57.158307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:57.159171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.159454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.159729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.160368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:57.161998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:57.172421 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3972/7892] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:57.176612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:57.187224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bee00-5822-4245-8e21-6989b1e0a1ed admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:57.191862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183fc60-dfe3-41a4-ad1d-b71b559a0655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:57.192453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fc60-dfe3-41a4-ad1d-b71b559a0655 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.192732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fc60-dfe3-41a4-ad1d-b71b559a0655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.193115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fc60-dfe3-41a4-ad1d-b71b559a0655 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.193752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183fc60-dfe3-41a4-ad1d-b71b559a0655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:57.195359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183fc60-dfe3-41a4-ad1d-b71b559a0655 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:57.206959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3921/7893] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:57.211548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:57.222319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf3d59-86bc-4f74-b2f7-0834689e1c3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:57.226950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:57.229693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.229693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.229693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] PATH_INFO: `/v3/projects/8484e78839d2436499119e2eca81c8a4/users/048a799a65c74519bec6649dc29bad66/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.246310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=8484e78839d2436499119e2eca81c8a4, user_id=048a799a65c74519bec6649dc29bad66, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:57.249681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:57.336867 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3973/7894] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:57 2022] PUT /identity/v3/projects/8484e78839d2436499119e2eca81c8a4/users/048a799a65c74519bec6649dc29bad66/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:57.347775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41542-3126-4afd-aff4-d7fc25143e08 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.348066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41542-3126-4afd-aff4-d7fc25143e08 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.348345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41542-3126-4afd-aff4-d7fc25143e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.394113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-68a41542-3126-4afd-aff4-d7fc25143e08 None None] MFA Rules not processed for user `048a799a65c74519bec6649dc29bad66`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:57.395980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-68a41542-3126-4afd-aff4-d7fc25143e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:57.497956 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3922/7895] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:57.502703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:57.553139 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:57.595828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9cbe1-128c-40ba-b71d-0e40b9b55fda admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:57.601288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:57.602687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.602687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.602989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.603645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:57.606009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:57.749418 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3974/7896] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:57 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:57.753510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41542-3126-4afd-aff4-d7fc25143e08 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:57.765973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41542-3126-4afd-aff4-d7fc25143e08 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:57.835349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:57.835972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.836255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.836531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.837170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:57.839135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:57.947140 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3923/7897] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:57 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:57.948668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:57.962177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe37e25-5a86-42ce-ab98-9649ce2ee12a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:57.968664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:57.969452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:57.969869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:57.970250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:57.971050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:57.972760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:57.990270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:57.991053 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3975/7898] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:58.006182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331add5f-4fa0-4bed-89fc-db5d824b75e1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:58.011492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d09c5-344c-4de1-afb7-c70d41090917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:58.012748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d09c5-344c-4de1-afb7-c70d41090917 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:58.013704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d09c5-344c-4de1-afb7-c70d41090917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:58.014028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d09c5-344c-4de1-afb7-c70d41090917 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:58.014753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d09c5-344c-4de1-afb7-c70d41090917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:58.016487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d09c5-344c-4de1-afb7-c70d41090917 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:58.030401 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3924/7899] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:58.035274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:58.050820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c3e88-fca7-420a-8f47-ca0bd74f1ba0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:58.061585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:58.064134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:58.064652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:58.065070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] PATH_INFO: `/v3/projects/e7d274ea0db74cbe8ce9966429d67ac5/users/0be78dc0003d456f8a637d4e906b0fcf/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:58.087885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d274ea0db74cbe8ce9966429d67ac5, user_id=0be78dc0003d456f8a637d4e906b0fcf, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:58.092041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:58.226472 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3976/7900] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:58 2022] PUT /identity/v3/projects/e7d274ea0db74cbe8ce9966429d67ac5/users/0be78dc0003d456f8a637d4e906b0fcf/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:58.238764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace5ce5-6ec6-4427-a481-139241d869cb None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:58.239504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace5ce5-6ec6-4427-a481-139241d869cb None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:58.239778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace5ce5-6ec6-4427-a481-139241d869cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:58.273291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0ace5ce5-6ec6-4427-a481-139241d869cb None None] MFA Rules not processed for user `0be78dc0003d456f8a637d4e906b0fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:58.274466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0ace5ce5-6ec6-4427-a481-139241d869cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:58.302820 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:58.348934 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3925/7901] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:58.353571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:58.439902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b71fb-6f8c-4811-8c11-e859d5118860 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:58.444791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:58.445552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:58.445915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:58.446279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:58.447553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:58.449756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:58.582304 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3977/7902] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:58 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:58.586348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace5ce5-6ec6-4427-a481-139241d869cb None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:58.597972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace5ce5-6ec6-4427-a481-139241d869cb None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:58.660102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:58.660797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:58.661082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:58.661389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:58.662172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:58.664358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:58.766765 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3926/7903] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:58 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:51:58.771051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:58.786153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62586-bc90-46f3-840a-c27913b0bec9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:58.791915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:58.792530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:58.792860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:58.793141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:58.793873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:58.795609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:58.807895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3978/7904] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:58.812250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:58.822716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e299d-a7c2-4977-bbf5-d8d6afb3bdcb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:58.828846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:58.829729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:58.830056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:58.830332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] PATH_INFO: `/v3/projects/9ca117a2579141e49e676965dcde0253/users/1325144bfdd94f4f927b7cd51b09c93e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:58.848632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca117a2579141e49e676965dcde0253, user_id=1325144bfdd94f4f927b7cd51b09c93e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:58.851323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:58.975660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3927/7905] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:58 2022] PUT /identity/v3/projects/9ca117a2579141e49e676965dcde0253/users/1325144bfdd94f4f927b7cd51b09c93e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:58.976890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:58.988348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd0c9f-817a-44c8-99a6-e6af8b26db29 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:59.042207 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:59.055111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104faa86-ba42-474a-8439-20dcb197f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:59.055828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104faa86-ba42-474a-8439-20dcb197f47b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:59.056188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104faa86-ba42-474a-8439-20dcb197f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:59.056511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104faa86-ba42-474a-8439-20dcb197f47b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:59.057213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104faa86-ba42-474a-8439-20dcb197f47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:59.059016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104faa86-ba42-474a-8439-20dcb197f47b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:59.074404 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3979/7906] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:59.075785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:59.086724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc48a52-5d78-4336-afa0-b338ecc4449b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:59.091810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:59.100837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:59.100837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:59.100837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] PATH_INFO: `/v3/projects/9ca117a2579141e49e676965dcde0253/users/1325144bfdd94f4f927b7cd51b09c93e/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:59.100837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca117a2579141e49e676965dcde0253, user_id=1325144bfdd94f4f927b7cd51b09c93e, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:59.100837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:59.111620 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3928/7907] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:59 2022] PUT /identity/v3/projects/9ca117a2579141e49e676965dcde0253/users/1325144bfdd94f4f927b7cd51b09c93e/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:59.123432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:59.124277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:59.124725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:59.157392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] MFA Rules not processed for user `1325144bfdd94f4f927b7cd51b09c93e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:59.159159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:59.265882 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3980/7908] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:51:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:51:59.274528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:59.277328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:59.379335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d3926-2ace-45c8-86f5-91b21ea15af5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:59.384442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:59.385401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:59.385770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:59.386112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:59.397914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:59.399388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:59.415702 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3929/7909] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:59.586797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:59.588223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:59.605055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ea59-f1db-4c55-b4b8-bdc96e1a5d6e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:59.609638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62121659-781d-45c0-a141-cdfff8cc01a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:59.610293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121659-781d-45c0-a141-cdfff8cc01a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:59.610591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121659-781d-45c0-a141-cdfff8cc01a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:59.610861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121659-781d-45c0-a141-cdfff8cc01a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:59.679264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62121659-781d-45c0-a141-cdfff8cc01a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:59.680831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62121659-781d-45c0-a141-cdfff8cc01a4 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:59.691577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3981/7910] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:05.271624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:05.273191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:05.306491 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:05.366009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0ebd-7aeb-414a-8181-35fef59239eb service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:05.371912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:05.372766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:05.373943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:05.374229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] PATH_INFO: `/v3/users/89b6fd3389d5416ca0eb9376e7654976` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:05.376095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b6fd3389d5416ca0eb9376e7654976)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:05.380311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:05.742714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b6fd3389d5416ca0eb9376e7654976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:05.767958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b6fd3389d5416ca0eb9376e7654976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:05.778921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b6fd3389d5416ca0eb9376e7654976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:05.780122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b6fd3389d5416ca0eb9376e7654976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:05.896601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b6fd3389d5416ca0eb9376e7654976'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:05.904739 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3930/7911] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:05 2022] DELETE /identity/v3/users/89b6fd3389d5416ca0eb9376e7654976 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:05.910871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:05.910871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:05.911388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:05.937695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:05.938998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:06.013636 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3982/7912] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:06.023909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:06.025396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:06.092225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce359b-a1df-4d74-9e95-6be39e932f23 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:06.095814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:06.096426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:06.096702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:06.096970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:06.107806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:06.109248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:06.120407 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3931/7913] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:06.659957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:06.662729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:06.665078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:06.666584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:06.683648 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:06.689583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b480b4-e87f-4448-8ba0-1f55fc1291a1 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:06.694560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:06.695423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:06.695615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:06.695897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] PATH_INFO: `/v3/projects/bf1769deed6f41ea897d82b72a286a53` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:06.697136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1769deed6f41ea897d82b72a286a53)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:06.699657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:06.792438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2ae61-22be-4832-af45-c703e9e94591 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:06.799199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:06.800130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:06.800595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:06.801032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:06.803244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:06.819673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:06.821618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:06.826473 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:06.839059 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3983/7914] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:52:06.844843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1769deed6f41ea897d82b72a286a53', 'request_id': 'req-2283a0bf-c685-4e0d-a000-666fbe0e8014'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:06.857061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1769deed6f41ea897d82b72a286a53', 'request_id': 'req-2283a0bf-c685-4e0d-a000-666fbe0e8014'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:06.932022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1769deed6f41ea897d82b72a286a53', 'request_id': 'req-2283a0bf-c685-4e0d-a000-666fbe0e8014'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:06.951380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] The token cache is being invalidate because project bf1769deed6f41ea897d82b72a286a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:06.951529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:06.952331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:06.954056 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3932/7915] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:06 2022] DELETE /identity/v3/projects/bf1769deed6f41ea897d82b72a286a53 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:06.962978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:06.974578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a42ea-d089-4f8a-88ea-6502f5a60afe service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:07.049044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:07.049772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:07.050210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:07.050563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] PATH_INFO: `/v3/users/51343680af524e7288f9afcb5cfb5048` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:07.052280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51343680af524e7288f9afcb5cfb5048)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:07.054182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:07.242602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51343680af524e7288f9afcb5cfb5048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:07.243284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51343680af524e7288f9afcb5cfb5048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:07.331309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51343680af524e7288f9afcb5cfb5048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:07.339661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51343680af524e7288f9afcb5cfb5048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:07.340892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51343680af524e7288f9afcb5cfb5048'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:07.360193 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3984/7916] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:06 2022] DELETE /identity/v3/users/51343680af524e7288f9afcb5cfb5048 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:07.822764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:07.825330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:07.840987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283a0bf-c685-4e0d-a000-666fbe0e8014 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:07.894702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:07.896535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:07.920405 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:07.947636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:07.948602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:07.948886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:07.950029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] PATH_INFO: `/v3/users/048a799a65c74519bec6649dc29bad66` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:07.951415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048a799a65c74519bec6649dc29bad66)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:07.955117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:07.998908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32601c09-a0b0-4341-bf40-01a2b14ff85a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:08.004413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:08.005154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.005506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.006120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] PATH_INFO: `/v3/projects/6a97349e6f754ab98255911ae4a938b6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.014284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a97349e6f754ab98255911ae4a938b6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:08.014284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:08.214337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048a799a65c74519bec6649dc29bad66'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.221484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a97349e6f754ab98255911ae4a938b6', 'request_id': 'req-6a5e47ea-81a5-4118-96c5-ef62759fd134'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.236981 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a97349e6f754ab98255911ae4a938b6', 'request_id': 'req-6a5e47ea-81a5-4118-96c5-ef62759fd134'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.240686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048a799a65c74519bec6649dc29bad66'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.252135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048a799a65c74519bec6649dc29bad66'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.252958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048a799a65c74519bec6649dc29bad66'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.330726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a97349e6f754ab98255911ae4a938b6', 'request_id': 'req-6a5e47ea-81a5-4118-96c5-ef62759fd134'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.344976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] The token cache is being invalidate because project 6a97349e6f754ab98255911ae4a938b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:08.345320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.345959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a5e47ea-81a5-4118-96c5-ef62759fd134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.347552 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3985/7917] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:07 2022] DELETE /identity/v3/projects/6a97349e6f754ab98255911ae4a938b6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:08.352474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1149-a6d4-4a01-9e18-eebba173642f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.353039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1149-a6d4-4a01-9e18-eebba173642f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.359916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1149-a6d4-4a01-9e18-eebba173642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.377628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-aa6a1149-a6d4-4a01-9e18-eebba173642f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:08.378909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aa6a1149-a6d4-4a01-9e18-eebba173642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:08.431958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6bd6588f-6d69-4169-9429-1b7090447a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048a799a65c74519bec6649dc29bad66'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:08.442060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3933/7918] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:07 2022] DELETE /identity/v3/users/048a799a65c74519bec6649dc29bad66 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:08.446735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.448268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.448990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.482310 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3986/7919] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:08.483540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:08.485201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:08.491661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a552-cfe5-467f-b845-5cbde0e76bd0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.492557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a552-cfe5-467f-b845-5cbde0e76bd0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.492881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a552-cfe5-467f-b845-5cbde0e76bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.523350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e6f0a552-cfe5-467f-b845-5cbde0e76bd0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:08.524656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e6f0a552-cfe5-467f-b845-5cbde0e76bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:08.538176 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:08.565137 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3934/7920] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:08.573956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:08.576225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:08.577973 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:08.603478 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3987/7921] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:08.610956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0a552-cfe5-467f-b845-5cbde0e76bd0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:08.622992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0a552-cfe5-467f-b845-5cbde0e76bd0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:08.629703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:08.630499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.630786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.631072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.631799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:08.632017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:08.634169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:08.656336 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3988/7922] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:08.664439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:08.669011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528c876-b20a-4151-9fb8-01e2bff4648f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:08.676028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:08.676884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.677166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.677476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.684656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe63851-3e3c-4918-a38d-ad2e1bded234 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:08.692011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:08.694240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.694366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:08.694880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.695349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.696185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:08.696299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:08.698684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:08.710802 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3935/7923] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:08.831576 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3989/7924] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:08 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:08.835659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:08.846998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8228-5c41-4471-bb68-4d460a0e1b7a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:08.916206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:08.917416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:08.917928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:08.919308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:08.919944 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:08.921940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.032230 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3936/7925] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:08 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:09.036265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.047082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca02fb-6220-4b8c-a170-4c379aa822be admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.056280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.056280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.056567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.056827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.057492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.059899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.071947 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3990/7926] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:09.077193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.088614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1f993-928d-4637-bde2-57caee369499 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.094524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.097722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.097722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.097722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.097722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.098231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.112436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3937/7927] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:52:09.116859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.130945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38659163-eaae-49ad-8364-f471eacd1ddc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.136616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24df7c-12a8-4cf1-8c5d-e36ef7ae3cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.140297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24df7c-12a8-4cf1-8c5d-e36ef7ae3cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.140297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24df7c-12a8-4cf1-8c5d-e36ef7ae3cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.140297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24df7c-12a8-4cf1-8c5d-e36ef7ae3cb5 admin admin] PATH_INFO: `/v3/projects/e66976ae686e4c529cc6f6ef0cf05a29/users/d23e7b67cb1748eb8cea63c42c7c5d65/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.154461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24df7c-12a8-4cf1-8c5d-e36ef7ae3cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66976ae686e4c529cc6f6ef0cf05a29, user_id=d23e7b67cb1748eb8cea63c42c7c5d65, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.157426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24df7c-12a8-4cf1-8c5d-e36ef7ae3cb5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.236744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.239098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:09.256118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdb92d-e593-4bbe-9073-b6e34822609b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.261700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.263573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.263984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.264370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] PATH_INFO: `/v3/projects/8484e78839d2436499119e2eca81c8a4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.265786 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3991/7928] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:09 2022] PUT /identity/v3/projects/e66976ae686e4c529cc6f6ef0cf05a29/users/d23e7b67cb1748eb8cea63c42c7c5d65/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:09.265955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8484e78839d2436499119e2eca81c8a4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.268043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.278797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd22b5-d6d5-447f-8c9e-a94088f2483d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.280091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd22b5-d6d5-447f-8c9e-a94088f2483d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.280364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd22b5-d6d5-447f-8c9e-a94088f2483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.319855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9ccd22b5-d6d5-447f-8c9e-a94088f2483d None None] MFA Rules not processed for user `d23e7b67cb1748eb8cea63c42c7c5d65`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:09.330236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ccd22b5-d6d5-447f-8c9e-a94088f2483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:09.389200 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3992/7929] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:09.393464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd22b5-d6d5-447f-8c9e-a94088f2483d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.433595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8484e78839d2436499119e2eca81c8a4', 'request_id': 'req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.443636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8484e78839d2436499119e2eca81c8a4', 'request_id': 'req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.450864 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:09.467883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd22b5-d6d5-447f-8c9e-a94088f2483d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.472512 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:09.524446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.525064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.525343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.526680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.526680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.528381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.546453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8484e78839d2436499119e2eca81c8a4', 'request_id': 'req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.559373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] The token cache is being invalidate because project 8484e78839d2436499119e2eca81c8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:09.559609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.560259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.561771 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3938/7930] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:09 2022] DELETE /identity/v3/projects/8484e78839d2436499119e2eca81c8a4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:09.565655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.566951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:09.579680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3211b3-2ed0-46ca-8195-6e33d139dbd1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.584667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.585316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.585596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.585935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] PATH_INFO: `/v3/users/0be78dc0003d456f8a637d4e906b0fcf` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.587236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be78dc0003d456f8a637d4e906b0fcf)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.589132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.639527 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3993/7931] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:09 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:09.643677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.645351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:09.713144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ed95-36e4-4fc1-99fe-d67356cd07b1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.718394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.719011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.719290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.719563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.720193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.722174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.801156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be78dc0003d456f8a637d4e906b0fcf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.804438 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3994/7932] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:09 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:09.808543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.816019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be78dc0003d456f8a637d4e906b0fcf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.824071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be78dc0003d456f8a637d4e906b0fcf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.826850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be78dc0003d456f8a637d4e906b0fcf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.828877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207afa0-9c1f-42c1-901f-d5cb1b102814 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.833714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.834356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.834636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.834913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.835559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.837183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.848326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3995/7933] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:52:09.858399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:09.860036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:09.872739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a82fb-3610-4be9-ae53-7cf3d34678a8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:09.877419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:09.878129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:09.878389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:09.878665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] PATH_INFO: `/v3/projects/d33d116d6cc64fc5ad54fa3a5a07ab90/users/64e2820284db46b3ae141f9d0941ff9b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:09.890903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be78dc0003d456f8a637d4e906b0fcf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:09.894561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33d116d6cc64fc5ad54fa3a5a07ab90, user_id=64e2820284db46b3ae141f9d0941ff9b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:09.897351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:09.900643 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3939/7934] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:09 2022] DELETE /identity/v3/users/0be78dc0003d456f8a637d4e906b0fcf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:09.968110 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3996/7935] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:09 2022] PUT /identity/v3/projects/d33d116d6cc64fc5ad54fa3a5a07ab90/users/64e2820284db46b3ae141f9d0941ff9b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:09.971835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.039518 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3d98e-6005-4391-b61c-a5e9b5d6f7cf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.105454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeab6d-bd50-473c-a5d2-565f064e4fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.106207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeab6d-bd50-473c-a5d2-565f064e4fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.106552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeab6d-bd50-473c-a5d2-565f064e4fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.106968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeab6d-bd50-473c-a5d2-565f064e4fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.107686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeab6d-bd50-473c-a5d2-565f064e4fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.109349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeab6d-bd50-473c-a5d2-565f064e4fe2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.121507 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3940/7936] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:10.125623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.138155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa331e-1cb8-4c16-a813-5a9c41a370be admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.143472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.144217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.144559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.144902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] PATH_INFO: `/v3/projects/d33d116d6cc64fc5ad54fa3a5a07ab90/users/64e2820284db46b3ae141f9d0941ff9b/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.146950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33d116d6cc64fc5ad54fa3a5a07ab90, user_id=64e2820284db46b3ae141f9d0941ff9b, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.149705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.161983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3997/7937] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:10 2022] PUT /identity/v3/projects/d33d116d6cc64fc5ad54fa3a5a07ab90/users/64e2820284db46b3ae141f9d0941ff9b/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:10.172801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.173088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.173360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.186985 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:10.203203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] MFA Rules not processed for user `64e2820284db46b3ae141f9d0941ff9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:10.204521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.287290 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3941/7938] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:10.301134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.303164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.341239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.343201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.348499 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:10.390433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dcdc9-1668-4646-9c7e-1a887b77bbfa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.394566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.395349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.395631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.395906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.411043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.417309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.430408 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3998/7939] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:10.491926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57608b-f0d1-4ce2-a159-78fafc6afd69 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.494506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.495166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.495923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.496387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] PATH_INFO: `/v3/projects/e7d274ea0db74cbe8ce9966429d67ac5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.498031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d274ea0db74cbe8ce9966429d67ac5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.504012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.556925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.558396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.626015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d274ea0db74cbe8ce9966429d67ac5', 'request_id': 'req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:10.630168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067ec4b-ad5b-4f0f-bd02-65508669dade service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.633432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d274ea0db74cbe8ce9966429d67ac5', 'request_id': 'req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:10.682187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.682847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.683130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.683403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.685770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.713835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d274ea0db74cbe8ce9966429d67ac5', 'request_id': 'req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:10.726364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] The token cache is being invalidate because project e7d274ea0db74cbe8ce9966429d67ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:10.726733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:10.727452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:10.732302 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3942/7940] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:10 2022] DELETE /identity/v3/projects/e7d274ea0db74cbe8ce9966429d67ac5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:10.732302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.732302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.762562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.763911 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:10.764050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.775060 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 3999/7941] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:52:10.776089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.786875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37742bc1-9891-4615-b740-7a8d23a4938f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.792420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.794611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.794611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.794611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] PATH_INFO: `/v3/users/1325144bfdd94f4f927b7cd51b09c93e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.795562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1325144bfdd94f4f927b7cd51b09c93e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.797798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.807882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad9c4f-d593-49b7-a18f-a7d7f475a3f6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.812880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.813750 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.814189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.814569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.816496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.906909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.909119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.919025 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3943/7942] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:10.993739 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:11.000598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1325144bfdd94f4f927b7cd51b09c93e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.001280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1325144bfdd94f4f927b7cd51b09c93e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.060149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1325144bfdd94f4f927b7cd51b09c93e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.068391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1325144bfdd94f4f927b7cd51b09c93e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.069656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1325144bfdd94f4f927b7cd51b09c93e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.088760 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4000/7943] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:10 2022] DELETE /identity/v3/users/1325144bfdd94f4f927b7cd51b09c93e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:11.409790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:11.409790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:11.423654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116d39-f3f8-4851-8053-ce0b950723e3 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:11.483082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:11.483726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:11.484007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:11.484282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] PATH_INFO: `/v3/users/d23e7b67cb1748eb8cea63c42c7c5d65` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:11.485424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23e7b67cb1748eb8cea63c42c7c5d65)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:11.487513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:11.678547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:11.680613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:11.690401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23e7b67cb1748eb8cea63c42c7c5d65'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.698456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f96d12-2b0a-44fa-97be-cae747b893c9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:11.711239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23e7b67cb1748eb8cea63c42c7c5d65'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.715782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:11.716973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:11.716973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:11.717161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] PATH_INFO: `/v3/projects/9ca117a2579141e49e676965dcde0253` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:11.718500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca117a2579141e49e676965dcde0253)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:11.720502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:11.726355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23e7b67cb1748eb8cea63c42c7c5d65'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.726355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23e7b67cb1748eb8cea63c42c7c5d65'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.728367 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:11.796866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4871c36f-ad6e-4be8-965d-734b16b856af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23e7b67cb1748eb8cea63c42c7c5d65'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.803485 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3944/7944] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:11 2022] DELETE /identity/v3/users/d23e7b67cb1748eb8cea63c42c7c5d65 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:11.807723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:11.808041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:11.808349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:11.830145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:11.838418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:11.840653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca117a2579141e49e676965dcde0253', 'request_id': 'req-17d11792-667b-46cd-bc97-dcd9b9837ed1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.847538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca117a2579141e49e676965dcde0253', 'request_id': 'req-17d11792-667b-46cd-bc97-dcd9b9837ed1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.902556 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3945/7945] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:11.913091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:11.914673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:11.919575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca117a2579141e49e676965dcde0253', 'request_id': 'req-17d11792-667b-46cd-bc97-dcd9b9837ed1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.932413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] The token cache is being invalidate because project 9ca117a2579141e49e676965dcde0253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:11.932684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.934025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-17d11792-667b-46cd-bc97-dcd9b9837ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:11.936642 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4001/7946] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:11 2022] DELETE /identity/v3/projects/9ca117a2579141e49e676965dcde0253 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:11.942687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d878fe9-55f1-4116-97ca-f65ba3ffa4f2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:11.942881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d878fe9-55f1-4116-97ca-f65ba3ffa4f2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:11.943159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d878fe9-55f1-4116-97ca-f65ba3ffa4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:11.974886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6d878fe9-55f1-4116-97ca-f65ba3ffa4f2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:11.976282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6d878fe9-55f1-4116-97ca-f65ba3ffa4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:11.985459 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4002/7947] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:11.994786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1654d0c-5b96-4627-a70c-01e80321fc77 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.001989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1654d0c-5b96-4627-a70c-01e80321fc77 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.001989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1654d0c-5b96-4627-a70c-01e80321fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.022000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64175b-a06d-4de2-b627-f6139e66f9d7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.024411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f1654d0c-5b96-4627-a70c-01e80321fc77 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:12.025833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1654d0c-5b96-4627-a70c-01e80321fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:12.027773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.028879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.029318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.029716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.032615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:12.037107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4003/7948] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:12.041595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1654d0c-5b96-4627-a70c-01e80321fc77 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.052217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1654d0c-5b96-4627-a70c-01e80321fc77 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.055459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.057349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.057652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.058164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.058453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.059480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.060009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:12.060311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.062782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.077599 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4004/7949] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:52:12.082515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.085055 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3946/7950] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:52:12.093749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854a20-baed-4ba5-9061-73b091338532 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.100347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.105308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.105308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.105308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.105308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.105800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.212543 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4005/7951] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:12 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:12.213713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.223956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c858-18f7-4594-91f4-fbd4f12aaa39 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.290375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.291004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.291287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.291591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.292242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.294937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.380625 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3947/7952] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:12 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:12.382257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.397650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549519-70d2-4b98-8ed6-fce03df0ba88 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.411420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.412053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.412338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.412610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.413582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.415033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.436003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4006/7953] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:12.440874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.452634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408e2d5-a99d-4dbf-851b-97e70d39acbf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.457418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.458152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.458441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.458717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.459367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.461102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.473375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3948/7954] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:12.477524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.492371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d8de8-2ee8-49f8-b292-fa57ada0af05 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.498978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db631fa0-ab29-4837-a689-e11d00b91060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.499807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631fa0-ab29-4837-a689-e11d00b91060 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.500089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631fa0-ab29-4837-a689-e11d00b91060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.505057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631fa0-ab29-4837-a689-e11d00b91060 admin admin] PATH_INFO: `/v3/projects/4949768b7289422daadd916fd8444438/users/cfca1b233b6944449d5ab45dd6efb8a9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.519295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db631fa0-ab29-4837-a689-e11d00b91060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4949768b7289422daadd916fd8444438, user_id=cfca1b233b6944449d5ab45dd6efb8a9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.522327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db631fa0-ab29-4837-a689-e11d00b91060 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.531648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.534048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:12.549230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb4ce-51b7-4855-8c0b-1e45c6bf5562 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.554261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.554923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.555321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.555602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] PATH_INFO: `/v3/projects/e66976ae686e4c529cc6f6ef0cf05a29` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.556977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66976ae686e4c529cc6f6ef0cf05a29)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.558818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.573207 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:12.603547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4007/7955] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:12 2022] PUT /identity/v3/projects/4949768b7289422daadd916fd8444438/users/cfca1b233b6944449d5ab45dd6efb8a9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:12.609699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.610024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.610306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.631627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:12.633061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:12.644772 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:12.690353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66976ae686e4c529cc6f6ef0cf05a29', 'request_id': 'req-3651eaae-56e3-4b48-92ef-56956a921915'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:12.696851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66976ae686e4c529cc6f6ef0cf05a29', 'request_id': 'req-3651eaae-56e3-4b48-92ef-56956a921915'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:12.701298 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4008/7956] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:12.711032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.712470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:12.776521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b4257-671a-4960-b89a-bd63651f532c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.785557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66976ae686e4c529cc6f6ef0cf05a29', 'request_id': 'req-3651eaae-56e3-4b48-92ef-56956a921915'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:12.802730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] The token cache is being invalidate because project e66976ae686e4c529cc6f6ef0cf05a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:12.803267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:12.804306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:12.806160 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3949/7957] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:12 2022] DELETE /identity/v3/projects/e66976ae686e4c529cc6f6ef0cf05a29 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:12.815218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:12.817003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:12.849316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.850087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.850579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.850979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.853547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:12.913135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651eaae-56e3-4b48-92ef-56956a921915 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:12.920630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:12.921511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:12.922380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:12.922813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] PATH_INFO: `/v3/users/64e2820284db46b3ae141f9d0941ff9b` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:12.924725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e2820284db46b3ae141f9d0941ff9b)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.927579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.954480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:12.958770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:12.970363 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4009/7958] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:52:13.134712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e2820284db46b3ae141f9d0941ff9b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:13.152248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e2820284db46b3ae141f9d0941ff9b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:13.164468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e2820284db46b3ae141f9d0941ff9b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:13.165787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e2820284db46b3ae141f9d0941ff9b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:13.234232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe497285-7dd0-4e1f-89a5-705d2913d2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e2820284db46b3ae141f9d0941ff9b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:13.241485 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3950/7959] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:12 2022] DELETE /identity/v3/users/64e2820284db46b3ae141f9d0941ff9b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:14.338978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:14.350708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037324-6b08-47a2-9ae7-d98978b6e92f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:14.373369 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:14.450577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:14.451309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:14.451536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:14.451802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] PATH_INFO: `/v3/projects/d33d116d6cc64fc5ad54fa3a5a07ab90` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:14.453001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33d116d6cc64fc5ad54fa3a5a07ab90)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:14.455190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:14.607984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33d116d6cc64fc5ad54fa3a5a07ab90', 'request_id': 'req-d1f52492-4f17-4205-8196-9decfb9fbb69'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:14.614877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33d116d6cc64fc5ad54fa3a5a07ab90', 'request_id': 'req-d1f52492-4f17-4205-8196-9decfb9fbb69'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:14.711729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33d116d6cc64fc5ad54fa3a5a07ab90', 'request_id': 'req-d1f52492-4f17-4205-8196-9decfb9fbb69'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:14.727798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] The token cache is being invalidate because project d33d116d6cc64fc5ad54fa3a5a07ab90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:14.728123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:14.728810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d1f52492-4f17-4205-8196-9decfb9fbb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:14.730915 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4010/7960] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:14 2022] DELETE /identity/v3/projects/d33d116d6cc64fc5ad54fa3a5a07ab90 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:14.735756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507af52-d553-4bf6-b4d2-e26f16f101e5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:14.736271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507af52-d553-4bf6-b4d2-e26f16f101e5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:14.736374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507af52-d553-4bf6-b4d2-e26f16f101e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:14.757001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f507af52-d553-4bf6-b4d2-e26f16f101e5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:14.758352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f507af52-d553-4bf6-b4d2-e26f16f101e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:14.772205 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:14.821322 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3951/7961] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:14.829845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42640f5-71b5-46ce-bab8-efe3d6744edc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:14.830327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42640f5-71b5-46ce-bab8-efe3d6744edc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:14.834017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42640f5-71b5-46ce-bab8-efe3d6744edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:14.856344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d42640f5-71b5-46ce-bab8-efe3d6744edc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:14.857615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d42640f5-71b5-46ce-bab8-efe3d6744edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:14.875726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4011/7962] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:14.876981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507af52-d553-4bf6-b4d2-e26f16f101e5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:14.897369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507af52-d553-4bf6-b4d2-e26f16f101e5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:14.899568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:14.900483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:14.901111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:14.903886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:14.904505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:14.904786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:14.905059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:14.905721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:14.906651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:14.908268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:14.939376 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3952/7963] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:14.944506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:14.956116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] MFA Rules not processed for user `cfca1b233b6944449d5ab45dd6efb8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:14.957351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:14.960499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a1785-231e-47fb-8ad8-8e4b71f970d2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:14.983035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:14.983672 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:14.983965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:14.984524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:14.985296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:14.987308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.051744 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4012/7964] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:15.053596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.055650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:15.077524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67f74-d286-49eb-83eb-98838032e5d4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.084090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.096824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.096824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.096824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.097396 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3953/7965] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:14 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:15.097511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.097511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.099829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.170631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96a183-60c1-4911-a695-39faea4f3a84 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.175533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.176144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.176427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.176702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.177329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.179279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.200049 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4013/7966] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:15 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:15.203345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.217304 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:15.275731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75339f-c551-43d2-9b58-4f03384c79ec admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.281410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.282137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.282425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.282700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.283329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.285525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.305534 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3954/7967] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:15 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:15.306644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.309916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:15.323066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d141929-b409-49b2-9362-f0b571a1f78c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.328510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.332102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.332102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.332102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] PATH_INFO: `/v3/users/86a886019b814956b33a4858c1d27f41` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.332102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a886019b814956b33a4858c1d27f41)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.332932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.391505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4014/7968] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:15 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:15.391505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.399357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc8af7-ecf2-4b37-abfe-14c88f64f238 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.409049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.409677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.409983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.410279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.410990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.412475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.424058 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4015/7969] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:15.424887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.435157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf43d0-f9a5-4d82-9ff7-f5cafc69353e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.440020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.440603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.440885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.441160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.441784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.443447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.454353 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4016/7970] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:15.455183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.465971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460fde-3119-435c-b707-a83f9f76e84f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.470731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.471318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.471614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.471879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.472510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.474110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.484405 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4017/7971] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:15.485154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.495190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c423-88cd-4788-af40-c602a04a10f6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.500310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.500958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.501366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.501652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] PATH_INFO: `/v3/projects/4dcdb0aa786946249194e4853ed76d0e/users/c44870dab0b34153844c07cc43ae77ae/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.517122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcdb0aa786946249194e4853ed76d0e, user_id=c44870dab0b34153844c07cc43ae77ae, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.520447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.533645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a886019b814956b33a4858c1d27f41'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:15.546047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a886019b814956b33a4858c1d27f41'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:15.553058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a886019b814956b33a4858c1d27f41'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:15.553766 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a886019b814956b33a4858c1d27f41'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:15.599576 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4018/7972] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:15 2022] PUT /identity/v3/projects/4dcdb0aa786946249194e4853ed76d0e/users/c44870dab0b34153844c07cc43ae77ae/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:15.600970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.602348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:15.633676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a886019b814956b33a4858c1d27f41'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:15.640802 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3955/7973] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:15 2022] DELETE /identity/v3/users/86a886019b814956b33a4858c1d27f41 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:15.641805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.643262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:15.670587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6a89c-4e23-441d-acde-f63c4156484a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.725099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c03d1-28d3-4dfc-b327-e05eae7e683c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.730080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.730928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.731561 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.731839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.732707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.734350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.737606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.738308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.738589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.739326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] PATH_INFO: `/v3/projects/fd0c99a08ba748a484aff693b87979a8/users/2f9b4dd6a12f4060b25d95bb4c503c9d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.745101 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3956/7974] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:15.754572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.756985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0c99a08ba748a484aff693b87979a8, user_id=2f9b4dd6a12f4060b25d95bb4c503c9d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.759784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.766463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476799c-ff4e-4a69-bdf1-1cf63f1b942c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.772076 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:15.773644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a2122-0e4e-46b2-a081-7cd43e2a26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.774343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2122-0e4e-46b2-a081-7cd43e2a26f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.774629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2122-0e4e-46b2-a081-7cd43e2a26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.774908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a2122-0e4e-46b2-a081-7cd43e2a26f2 admin admin] PATH_INFO: `/v3/projects/4dcdb0aa786946249194e4853ed76d0e/users/c44870dab0b34153844c07cc43ae77ae/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.776858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a2122-0e4e-46b2-a081-7cd43e2a26f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcdb0aa786946249194e4853ed76d0e, user_id=c44870dab0b34153844c07cc43ae77ae, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.780534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a2122-0e4e-46b2-a081-7cd43e2a26f2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:15.791321 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3957/7975] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:15 2022] PUT /identity/v3/projects/4dcdb0aa786946249194e4853ed76d0e/users/c44870dab0b34153844c07cc43ae77ae/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:15.828200 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4019/7976] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:15 2022] PUT /identity/v3/projects/fd0c99a08ba748a484aff693b87979a8/users/2f9b4dd6a12f4060b25d95bb4c503c9d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:15.833382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.833678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.833992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.853902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:15.855018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:15.915310 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3958/7977] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:15.925746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.927481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:15.974631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:15.976101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:15.988363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70ad0b-6f18-4790-8aa6-19b7cb9e2fc7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.994359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:15.995012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:15.995292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:15.995623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] PATH_INFO: `/v3/projects/cc16736c5a50425d86e1e454146035f3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:15.998330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc16736c5a50425d86e1e454146035f3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:15.998544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7c0ae-937d-44fc-84ef-c6bc01cfae85 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:15.999985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:16.003215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f5d5f-875e-4be6-9147-e7b1f8b2aacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:16.003838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5d5f-875e-4be6-9147-e7b1f8b2aacb service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.004118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5d5f-875e-4be6-9147-e7b1f8b2aacb service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.004398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5d5f-875e-4be6-9147-e7b1f8b2aacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.017949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f5d5f-875e-4be6-9147-e7b1f8b2aacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:16.019787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f5d5f-875e-4be6-9147-e7b1f8b2aacb service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:16.031800 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4020/7978] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:16.146560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc16736c5a50425d86e1e454146035f3', 'request_id': 'req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:16.152260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc16736c5a50425d86e1e454146035f3', 'request_id': 'req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:16.259990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc16736c5a50425d86e1e454146035f3', 'request_id': 'req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:16.271317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] The token cache is being invalidate because project cc16736c5a50425d86e1e454146035f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:16.271625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:16.272515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-89449cf8-219a-4b26-9ae0-5dd4a3b7cf80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:16.274387 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3959/7979] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:15 2022] DELETE /identity/v3/projects/cc16736c5a50425d86e1e454146035f3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:16.279616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f43b8f-fc28-4592-bdee-6e5d9197cd18 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.282445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f43b8f-fc28-4592-bdee-6e5d9197cd18 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.282445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f43b8f-fc28-4592-bdee-6e5d9197cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.303511 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:16.308219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-25f43b8f-fc28-4592-bdee-6e5d9197cd18 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:16.310165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-25f43b8f-fc28-4592-bdee-6e5d9197cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:16.373198 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4021/7980] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:16.381531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae294c-c882-4bd5-a83d-35115536fa0d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.381888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae294c-c882-4bd5-a83d-35115536fa0d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.382174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae294c-c882-4bd5-a83d-35115536fa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.406529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-76ae294c-c882-4bd5-a83d-35115536fa0d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:16.407794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-76ae294c-c882-4bd5-a83d-35115536fa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:16.416228 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3960/7981] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:16.422545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f43b8f-fc28-4592-bdee-6e5d9197cd18 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:16.435398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f43b8f-fc28-4592-bdee-6e5d9197cd18 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:16.458946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:16.458946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.458946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.458946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.459364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:16.459364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:16.459364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:16.459364 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4022/7982] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:16.462066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae294c-c882-4bd5-a83d-35115536fa0d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:16.472880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae294c-c882-4bd5-a83d-35115536fa0d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:16.478812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:16.479447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.479760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.480114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.482007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:16.483936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:16.625159 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3961/7983] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:16 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:16.629553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:16.641868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a685-a2b9-4d9f-8d47-d72b98e777d4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:16.708384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:16.709034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.709488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.709876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.710632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:16.712772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:16.826745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4023/7984] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:16 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:16.827948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:16.840262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86934a-700e-40bd-b3b1-1838adaa507a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:16.845378 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:16.848317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:16.848908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.849699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.849699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.850127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:16.851906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:16.866950 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3962/7985] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:16.871007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:16.884787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef58911-c161-430a-b8ec-71c8c747bade admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:16.893024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab9564-022f-40dd-b449-b9c4afe11768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:16.893830 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab9564-022f-40dd-b449-b9c4afe11768 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.895212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab9564-022f-40dd-b449-b9c4afe11768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.895781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab9564-022f-40dd-b449-b9c4afe11768 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.896562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab9564-022f-40dd-b449-b9c4afe11768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:16.899924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab9564-022f-40dd-b449-b9c4afe11768 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:16.916094 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4024/7986] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:16.921642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:16.932749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d4888-e187-478d-b934-ec06e2170402 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:16.938799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:16.940406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:16.940406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:16.940406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] PATH_INFO: `/v3/projects/5948f5b6faba4cb7b663f2e34160f393/users/55f639b2e9674b24bce37850dcea20f8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:16.963864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5948f5b6faba4cb7b663f2e34160f393, user_id=55f639b2e9674b24bce37850dcea20f8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:16.963864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:17.056948 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:17.063644 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3963/7987] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:16 2022] PUT /identity/v3/projects/5948f5b6faba4cb7b663f2e34160f393/users/55f639b2e9674b24bce37850dcea20f8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:17.162131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4513-771b-4d79-ba17-2ab2bcef22b3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.162415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4513-771b-4d79-ba17-2ab2bcef22b3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.162695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4513-771b-4d79-ba17-2ab2bcef22b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.195415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b7eb4513-771b-4d79-ba17-2ab2bcef22b3 None None] MFA Rules not processed for user `55f639b2e9674b24bce37850dcea20f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:17.200768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b7eb4513-771b-4d79-ba17-2ab2bcef22b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:17.265709 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4025/7988] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:17.270366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:17.344041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f39ecf-9324-4fd8-838f-8a8ab2173629 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:17.349272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce189a90-04dd-40b6-82fa-91515ace861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:17.350077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189a90-04dd-40b6-82fa-91515ace861f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.350808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189a90-04dd-40b6-82fa-91515ace861f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.350808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189a90-04dd-40b6-82fa-91515ace861f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.351270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce189a90-04dd-40b6-82fa-91515ace861f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:17.353174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce189a90-04dd-40b6-82fa-91515ace861f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:17.497432 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3964/7989] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:17 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:17.503019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4513-771b-4d79-ba17-2ab2bcef22b3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:17.517654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4513-771b-4d79-ba17-2ab2bcef22b3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:17.581982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:17.582604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.582878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.583270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.583910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:17.585851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:17.621783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5129-dea9-45b2-b8a7-e28745025022 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.622202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5129-dea9-45b2-b8a7-e28745025022 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.622488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5129-dea9-45b2-b8a7-e28745025022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.656287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-acbe5129-dea9-45b2-b8a7-e28745025022 None None] MFA Rules not processed for user `c44870dab0b34153844c07cc43ae77ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:17.657591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-acbe5129-dea9-45b2-b8a7-e28745025022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:17.686869 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4026/7990] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:17 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:17.688327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:17.700128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42511a9-6570-4477-b77e-4c0413589e3f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:17.705963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:17.706697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.710251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.710251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.710251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:17.710251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:17.725501 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4027/7991] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:17.731721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:17.744277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e23f6a-c67f-4141-a5fe-eb26eb255747 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:17.749673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69738f-f9b8-4b68-aa87-4347985d8fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:17.750417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69738f-f9b8-4b68-aa87-4347985d8fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.750671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69738f-f9b8-4b68-aa87-4347985d8fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.750940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69738f-f9b8-4b68-aa87-4347985d8fc3 admin admin] PATH_INFO: `/v3/projects/cf3d65b7689c47e1804fcf1e1f034e01/users/a3d29160159c43a996c27f3952a736ad/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.766901 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3965/7992] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:17.770663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d3359-4cf7-4596-812d-f8c1b0958b7f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.771856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d3359-4cf7-4596-812d-f8c1b0958b7f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.772005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69738f-f9b8-4b68-aa87-4347985d8fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3d65b7689c47e1804fcf1e1f034e01, user_id=a3d29160159c43a996c27f3952a736ad, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:17.772381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d3359-4cf7-4596-812d-f8c1b0958b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.774774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69738f-f9b8-4b68-aa87-4347985d8fc3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:17.806531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-158d3359-4cf7-4596-812d-f8c1b0958b7f None None] MFA Rules not processed for user `2f9b4dd6a12f4060b25d95bb4c503c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:17.806531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-158d3359-4cf7-4596-812d-f8c1b0958b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:17.863908 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4028/7993] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:17 2022] PUT /identity/v3/projects/cf3d65b7689c47e1804fcf1e1f034e01/users/a3d29160159c43a996c27f3952a736ad/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:17.867971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.868267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.868544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.877410 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3966/7994] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:17.878497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d3359-4cf7-4596-812d-f8c1b0958b7f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:17.893064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d3359-4cf7-4596-812d-f8c1b0958b7f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:17.900177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] MFA Rules not processed for user `cfca1b233b6944449d5ab45dd6efb8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:17.901409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:17.932619 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:17.963002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:17.963641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:17.963931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:17.964217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:17.965258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:17.967147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:17.973283 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4029/7995] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:17.974607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:17.978973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:17.986471 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3967/7996] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:17.987544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:18.000666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b2433-ef01-4057-8de3-6f4407941fda admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:18.004464 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:18.010034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:18.010715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.010994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.013208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] PATH_INFO: `/v3/projects/cf3d65b7689c47e1804fcf1e1f034e01/users/a3d29160159c43a996c27f3952a736ad/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.015405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3d65b7689c47e1804fcf1e1f034e01, user_id=a3d29160159c43a996c27f3952a736ad, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:18.018019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:18.031145 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3968/7997] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:17 2022] PUT /identity/v3/projects/cf3d65b7689c47e1804fcf1e1f034e01/users/a3d29160159c43a996c27f3952a736ad/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:18.032281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:18.041434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:18.053591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051cfb3-64db-4968-9dcf-f1e1e4d6ed74 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:18.107462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f23e4-24fe-432b-9893-ea32e211e78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:18.108142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f23e4-24fe-432b-9893-ea32e211e78a service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.108420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f23e4-24fe-432b-9893-ea32e211e78a service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.108837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f23e4-24fe-432b-9893-ea32e211e78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.152845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b865d0-bb59-4f5b-a8b9-67f90176ec40 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:18.159003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:18.159617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.159900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.160179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.162082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:18.170087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f23e4-24fe-432b-9893-ea32e211e78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:18.171553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f23e4-24fe-432b-9893-ea32e211e78a service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:18.181315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4030/7998] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:18.183703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f74cc1-962a-461d-be32-0c30e7f83de6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.184015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f74cc1-962a-461d-be32-0c30e7f83de6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.184230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f74cc1-962a-461d-be32-0c30e7f83de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.219209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d2f74cc1-962a-461d-be32-0c30e7f83de6 None None] MFA Rules not processed for user `a3d29160159c43a996c27f3952a736ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:18.219209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d2f74cc1-962a-461d-be32-0c30e7f83de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:18.227674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:18.229626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:18.242494 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3969/7999] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:18.314472 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4031/8000] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:18.320612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:18.326113 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:18.337542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62fbc8-abde-432f-b1e1-1e20b4a79e47 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:18.343008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:18.343648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.344003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.344197 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.344896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:18.346557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:18.487818 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3970/8001] 10.222.0.59 () {60 vars in 1149 bytes} [Sun Aug 28 01:52:18 2022] POST /identity/v3/domains => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:18.492522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f74cc1-962a-461d-be32-0c30e7f83de6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:18.503794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f74cc1-962a-461d-be32-0c30e7f83de6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:18.578388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:18.579024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.579311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.579596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.580408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:18.582839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:18.650757 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:18.769216 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4032/8002] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:18 2022] POST /identity/v3/users => generated 347 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:18.770478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:18.782641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead68e6-7bcf-4281-b55b-576dea758d13 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:18.787870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:18.788699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.789211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.789738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.790610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:18.793515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:18.919073 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3971/8003] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:18 2022] POST /identity/v3/users => generated 323 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:18.924491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:18.936786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bf3c5-ec14-4f9e-bf87-da5e9ccc6ebd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:18.942798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:18.943824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:18.944287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:18.944757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users/e6f2caf4d0e34db9aa05935eda8e75e5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:18.965480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:get_user(user_id=e6f2caf4d0e34db9aa05935eda8e75e5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:18.967969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:18.970071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4033/8004] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:52:18 2022] GET /identity/v3/users/e6f2caf4d0e34db9aa05935eda8e75e5 => generated 347 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:18.978222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:19.008927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bba49-38ba-4a79-8188-3f8e45a3c840 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:19.016175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:19.016864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:19.017612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:19.018136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:19.019031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Adding query filter params (domain_id=bbe05498fe384c99b965c77ce0a92d9a) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:19.019394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:19.021590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:19.040700 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3972/8005] 10.222.0.59 () {58 vars in 1207 bytes} [Sun Aug 28 01:52:18 2022] GET /identity/v3/users?domain_id=bbe05498fe384c99b965c77ce0a92d9a => generated 484 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:19.048217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:19.063585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0c42-2d40-47de-8226-81ac0eb12f54 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:19.068868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:19.069214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:19.069661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:19.070337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:19.071233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:19.073283 n-d-master-1 devstack@keystone.service[82007]: WARNING py.warnings [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:52:19.073283 n-d-master-1 devstack@keystone.service[82007]: warnings.warn(msg) Aug 28 01:52:19.073283 n-d-master-1 devstack@keystone.service[82007]: Aug 28 01:52:19.075037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:19.134554 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4034/8006] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:19 2022] GET /identity/v3/users => generated 8298 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:19.136181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:19.149017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4adb90-a376-4451-9ad0-723483dc686c tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:19.153984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:19.154773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:19.155134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:19.155351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:19.156191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1328789607) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:19.156494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:19.158919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:19.184882 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3973/8007] 10.222.0.59 () {58 vars in 1189 bytes} [Sun Aug 28 01:52:19 2022] GET /identity/v3/users?name=tempest-test_user-1328789607 => generated 475 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:19.193866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:19.205717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2c3bf-2da7-4de7-8d58-e1a52d6041b5 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:19.213576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:19.214422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:19.214913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:19.215182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:19.215910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:19.216286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:19.218156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:19.245286 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4035/8008] 10.222.0.59 () {58 vars in 1149 bytes} [Sun Aug 28 01:52:19 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:19.251788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:19.263537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee01e98-bbd9-424e-8858-47aaf8307787 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:19.268567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:19.269204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:19.269537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:19.269791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users/c98cff36c336455fa0818584f5730003` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:19.286206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c98cff36c336455fa0818584f5730003)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:19.288205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:19.437020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98cff36c336455fa0818584f5730003'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:19.450015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98cff36c336455fa0818584f5730003'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:19.457016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98cff36c336455fa0818584f5730003'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:19.461284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98cff36c336455fa0818584f5730003'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:19.461284 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:19.633656 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98cff36c336455fa0818584f5730003'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:19.645313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:19.645843 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3974/8009] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:19 2022] DELETE /identity/v3/users/c98cff36c336455fa0818584f5730003 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:19.647116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:19.661319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0add88-a162-4156-989b-6dd5a62a0dc8 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:19.720789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:19.721518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:19.721938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:19.722223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/users/e6f2caf4d0e34db9aa05935eda8e75e5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:19.723482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e6f2caf4d0e34db9aa05935eda8e75e5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:19.725427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:19.742202 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:19.879602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f2caf4d0e34db9aa05935eda8e75e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:19.880287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f2caf4d0e34db9aa05935eda8e75e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.034056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f2caf4d0e34db9aa05935eda8e75e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.045791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f2caf4d0e34db9aa05935eda8e75e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.046506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f2caf4d0e34db9aa05935eda8e75e5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.073685 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4036/8010] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:19 2022] DELETE /identity/v3/users/e6f2caf4d0e34db9aa05935eda8e75e5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:20.074914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:20.087023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba8c3-09a9-4a61-bc9b-a17588f065b0 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:20.164871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:20.165512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:20.165795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:20.166100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/domains/bbe05498fe384c99b965c77ce0a92d9a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:20.167321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bbe05498fe384c99b965c77ce0a92d9a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:20.169570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:20.192732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.193548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.289491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.290132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.293298 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3975/8011] 10.222.0.59 () {60 vars in 1249 bytes} [Sun Aug 28 01:52:20 2022] PATCH /identity/v3/domains/bbe05498fe384c99b965c77ce0a92d9a => generated 276 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:20.297656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:20.299712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:20.312979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df561ee7-3d9f-405a-b499-7ed48877b4ea tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:20.380106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3d29160159c43a996c27f3952a736ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf3d65b7689c47e1804fcf1e1f034e01', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:20.381263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:20.381628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:20.381927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] PATH_INFO: `/v3/domains/bbe05498fe384c99b965c77ce0a92d9a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:20.395654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bbe05498fe384c99b965c77ce0a92d9a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:20.397337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:20.432849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.439606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.563467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a', 'request_id': 'req-5c9ec929-e217-408a-9789-e81f1ca45e12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.571069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a', 'request_id': 'req-5c9ec929-e217-408a-9789-e81f1ca45e12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.653935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a', 'request_id': 'req-5c9ec929-e217-408a-9789-e81f1ca45e12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.655498 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:20.665766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] The token cache is being invalidate because project bbe05498fe384c99b965c77ce0a92d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:20.666089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.674646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.675462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a', 'request_id': 'req-5c9ec929-e217-408a-9789-e81f1ca45e12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.676113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a', 'request_id': 'req-5c9ec929-e217-408a-9789-e81f1ca45e12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.676740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5c9ec929-e217-408a-9789-e81f1ca45e12 tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bbe05498fe384c99b965c77ce0a92d9a', 'request_id': 'req-5c9ec929-e217-408a-9789-e81f1ca45e12'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:20.685980 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4037/8012] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:52:20 2022] DELETE /identity/v3/domains/bbe05498fe384c99b965c77ce0a92d9a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:20.690128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:20.691714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:20.759839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77244e8-ac15-4231-8cf7-088105b148dd tempest-UsersV3TestJSON-1269081102 tempest-UsersV3TestJSON-1269081102-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:20.819521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:20.820094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:20.820380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:20.820711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] PATH_INFO: `/v3/users/55f639b2e9674b24bce37850dcea20f8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:20.821918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f639b2e9674b24bce37850dcea20f8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:20.823888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:20.829999 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:UPDATE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:21.122979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f639b2e9674b24bce37850dcea20f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:21.134727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f639b2e9674b24bce37850dcea20f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:21.141857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f639b2e9674b24bce37850dcea20f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:21.142688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f639b2e9674b24bce37850dcea20f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:21.256568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f639b2e9674b24bce37850dcea20f8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:21.264223 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3976/8013] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:20 2022] DELETE /identity/v3/users/55f639b2e9674b24bce37850dcea20f8 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:21.268940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:21.269468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:21.269750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:21.301344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:21.302671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:21.374033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4038/8014] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:21.380966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:21.382401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:21.451702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb08f9-9772-46a0-acff-6cceabd82f2c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:21.455319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:21.455934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:21.456212 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:21.456485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:21.466025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:21.467521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:21.477418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3977/8015] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:21.999769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:22.002166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:22.023448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a9b0-a800-4838-9f8a-f08e665f5d8e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:22.025319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:22.026315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:22.026601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:22.026959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] PATH_INFO: `/v3/projects/5948f5b6faba4cb7b663f2e34160f393` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:22.028970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5948f5b6faba4cb7b663f2e34160f393)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:22.030988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:22.189623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5948f5b6faba4cb7b663f2e34160f393', 'request_id': 'req-fa95b9fe-09ec-4db1-a119-6825f25ead68'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.196025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5948f5b6faba4cb7b663f2e34160f393', 'request_id': 'req-fa95b9fe-09ec-4db1-a119-6825f25ead68'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.317198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5948f5b6faba4cb7b663f2e34160f393', 'request_id': 'req-fa95b9fe-09ec-4db1-a119-6825f25ead68'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.332415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] The token cache is being invalidate because project 5948f5b6faba4cb7b663f2e34160f393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:22.333224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.334160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.336428 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4039/8016] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:21 2022] DELETE /identity/v3/projects/5948f5b6faba4cb7b663f2e34160f393 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:22.347035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:22.364899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac05c-9bfe-496d-8cdf-f3fafe615cab service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:22.455457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:22.456207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:22.456773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:22.457103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] PATH_INFO: `/v3/users/a3d29160159c43a996c27f3952a736ad` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:22.458440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d29160159c43a996c27f3952a736ad)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:22.460747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:22.691502 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:22.705234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d29160159c43a996c27f3952a736ad'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.718574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d29160159c43a996c27f3952a736ad'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.727332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d29160159c43a996c27f3952a736ad'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.728062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d29160159c43a996c27f3952a736ad'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.843485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-93cad380-d887-4f94-a8b7-04fbbe7f6666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d29160159c43a996c27f3952a736ad'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:22.852468 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3978/8017] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:22 2022] DELETE /identity/v3/users/a3d29160159c43a996c27f3952a736ad => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:23.506374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:23.508831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:23.546578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b9fe-09ec-4db1-a119-6825f25ead68 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:23.601528 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:23.611732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:23.612549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:23.612836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:23.613105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] PATH_INFO: `/v3/projects/cf3d65b7689c47e1804fcf1e1f034e01` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:23.615870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3d65b7689c47e1804fcf1e1f034e01)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:23.620473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:23.773932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3d65b7689c47e1804fcf1e1f034e01', 'request_id': 'req-1e64856b-2efa-4ccf-9163-9714d9b10d3a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:23.782812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3d65b7689c47e1804fcf1e1f034e01', 'request_id': 'req-1e64856b-2efa-4ccf-9163-9714d9b10d3a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:23.876190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3d65b7689c47e1804fcf1e1f034e01', 'request_id': 'req-1e64856b-2efa-4ccf-9163-9714d9b10d3a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:23.891252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] The token cache is being invalidate because project cf3d65b7689c47e1804fcf1e1f034e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:23.891548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:23.892270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e64856b-2efa-4ccf-9163-9714d9b10d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:23.893843 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4040/8018] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:23 2022] DELETE /identity/v3/projects/cf3d65b7689c47e1804fcf1e1f034e01 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:23.899205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:23.900360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:23.900709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:23.931993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:23.933577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:23.999869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3979/8019] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:24.007750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925594f-b791-4461-8a3b-5a09b5ec6d02 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.011343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925594f-b791-4461-8a3b-5a09b5ec6d02 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.011343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925594f-b791-4461-8a3b-5a09b5ec6d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.028109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.029851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:24.034256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e925594f-b791-4461-8a3b-5a09b5ec6d02 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:24.035741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e925594f-b791-4461-8a3b-5a09b5ec6d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:24.048998 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4041/8020] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:24.050742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925594f-b791-4461-8a3b-5a09b5ec6d02 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.066173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925594f-b791-4461-8a3b-5a09b5ec6d02 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.071714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.072433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.072726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.073122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.073655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:24.075872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.077543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:24.091909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4042/8021] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:52:24.096550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.117090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943804e-dad5-4089-95ca-2a614d47f895 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.125891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.126520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.126945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.127224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.128046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.134999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:24.144141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7fb16-7f0f-4730-b018-2db71f69bdc1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.152273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.152935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.153285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.153707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.155562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:24.171030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.172815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:24.190435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3980/8022] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:24.217493 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4043/8023] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:24 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:24.218978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.231693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff328a5-7b37-43b9-85ab-16e7e7d558bc service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.266964 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:24.294778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.295322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.295623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.295898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.296552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.298652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:24.455066 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3981/8024] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:24 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:24.458976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.470031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca3544-47a1-4e33-ad1a-716d06f370f4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.487756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.488446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.488860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.489152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.490263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.491497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:24.510770 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4044/8025] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:24.512332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.522925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a651b-9bca-49e5-9e29-fd3f46ea9410 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.528244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a86f-7e06-473a-a8ca-e2b904f37802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.528928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a86f-7e06-473a-a8ca-e2b904f37802 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.529214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a86f-7e06-473a-a8ca-e2b904f37802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.530350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a86f-7e06-473a-a8ca-e2b904f37802 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.530864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92a86f-7e06-473a-a8ca-e2b904f37802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.532603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92a86f-7e06-473a-a8ca-e2b904f37802 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:24.547898 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3982/8026] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:24.551095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.562298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cfaa3-4074-44bc-8be4-a7a29596ff64 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.567251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.571207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.571207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.571207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] PATH_INFO: `/v3/projects/5c595b43f17c42879bcf8c0eaad1847f/users/9c39344e02b148a9a43010b31cb87067/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.587580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c595b43f17c42879bcf8c0eaad1847f, user_id=9c39344e02b148a9a43010b31cb87067, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.593976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:24.742789 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4045/8027] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:24 2022] PUT /identity/v3/projects/5c595b43f17c42879bcf8c0eaad1847f/users/9c39344e02b148a9a43010b31cb87067/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:24.754654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52a45-89a5-4cff-862b-b90ce62c5dc2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.754953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52a45-89a5-4cff-862b-b90ce62c5dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.757474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52a45-89a5-4cff-862b-b90ce62c5dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.791389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-11b52a45-89a5-4cff-862b-b90ce62c5dc2 None None] MFA Rules not processed for user `9c39344e02b148a9a43010b31cb87067`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:24.794033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-11b52a45-89a5-4cff-862b-b90ce62c5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:24.882268 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3983/8028] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:24.887185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:24.981581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d5149-3f87-4ca9-abac-43230571893d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:24.987058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:24.987672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:24.987977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:24.988250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:24.988882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:24.990892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:25.003564 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:25.149211 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4046/8029] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:24 2022] POST /identity/v3/projects => generated 367 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:25.154318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52a45-89a5-4cff-862b-b90ce62c5dc2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:25.165412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52a45-89a5-4cff-862b-b90ce62c5dc2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:25.226328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:25.226954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:25.227242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:25.227522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:25.228153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:25.230715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:25.336943 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3984/8030] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:25 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:25.338146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:25.349202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87292d8-e296-4ac7-bbf5-494be771bb34 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:25.354012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:25.354625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:25.355455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:25.355849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:25.356529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:25.358176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:25.373524 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4047/8031] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:52:25.374757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:25.386031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02591fc0-3e9a-46ce-8de3-b117d28fc54c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:25.391012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:25.391673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:25.391982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:25.392234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] PATH_INFO: `/v3/projects/1ec9528689f64da2b382e62849f61e42/users/c66c658195ea4226b4fe534393b035cf/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:25.409084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec9528689f64da2b382e62849f61e42, user_id=c66c658195ea4226b4fe534393b035cf, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:25.411323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:25.517957 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3985/8032] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:25 2022] PUT /identity/v3/projects/1ec9528689f64da2b382e62849f61e42/users/c66c658195ea4226b4fe534393b035cf/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:25.522102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:25.533360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cb9b1-8b19-4d0b-8481-ba9086333c30 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:25.597708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a959-5c7c-4354-abb9-b69bb6161b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:25.598366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a959-5c7c-4354-abb9-b69bb6161b44 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:25.605827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a959-5c7c-4354-abb9-b69bb6161b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:25.605827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a959-5c7c-4354-abb9-b69bb6161b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:25.605827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67a959-5c7c-4354-abb9-b69bb6161b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:25.605827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67a959-5c7c-4354-abb9-b69bb6161b44 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:25.615322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4048/8033] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:25.616499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:25.627692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7331971-1e76-4541-8819-f22c130a3aa0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:25.632537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:25.633204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:25.633492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:25.633772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] PATH_INFO: `/v3/projects/1ec9528689f64da2b382e62849f61e42/users/c66c658195ea4226b4fe534393b035cf/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:25.635876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec9528689f64da2b382e62849f61e42, user_id=c66c658195ea4226b4fe534393b035cf, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:25.638813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:25.641246 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:25.650171 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3986/8034] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:25 2022] PUT /identity/v3/projects/1ec9528689f64da2b382e62849f61e42/users/c66c658195ea4226b4fe534393b035cf/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:25.661174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa0af-e8a7-4be2-834e-b6cdd0815d8e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:25.661467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa0af-e8a7-4be2-834e-b6cdd0815d8e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:25.661751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa0af-e8a7-4be2-834e-b6cdd0815d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:25.691706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-212fa0af-e8a7-4be2-834e-b6cdd0815d8e None None] MFA Rules not processed for user `c66c658195ea4226b4fe534393b035cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:25.692927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-212fa0af-e8a7-4be2-834e-b6cdd0815d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:25.766600 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4049/8035] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:25.771814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:25.788635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e9904-8ccf-47ca-929b-5e916acf3473 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:25.795836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:25.798178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:25.800271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:25.800726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:25.802501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:25.806445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:25.967733 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3987/8036] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:52:25 2022] POST /identity/v3/projects => generated 328 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:25.972203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fa0af-e8a7-4be2-834e-b6cdd0815d8e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:25.987767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fa0af-e8a7-4be2-834e-b6cdd0815d8e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:26.066505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:26.067366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:26.067754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:26.068415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:26.069641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:26.072328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:26.085010 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:26.210479 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4050/8037] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:25 2022] POST /identity/v3/users => generated 413 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:26.214922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:26.226029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eec3e-fb90-4e5c-b3bc-c73a47e008a8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:26.238513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:26.239559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:26.240090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:26.240573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:26.241253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:26.243002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:26.357772 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3988/8038] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:26 2022] POST /identity/v3/roles => generated 243 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:26.361594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:26.372587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475e237-b879-4a60-9773-8d87e20c82b0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:26.377337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:26.378014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:26.378305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:26.378599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:26.383555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:26.383555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:26.502779 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4051/8039] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:26 2022] POST /identity/v3/roles => generated 247 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:26.506997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:26.517969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb820-fa1a-451b-8a06-5a8b500d398c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:26.522760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:26.523417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:26.523706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:26.523988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/7e6ab324fc2f4706b408ca77f2a55484/users/cfb1104ca24b4a1e96d73b4014d631c4/roles/eb0a4f7e007a48a2bc7bc126d88cd258` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:26.541182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7e6ab324fc2f4706b408ca77f2a55484, user_id=cfb1104ca24b4a1e96d73b4014d631c4, role_id=eb0a4f7e007a48a2bc7bc126d88cd258)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:26.544429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:26.627993 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3989/8040] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:26 2022] PUT /identity/v3/projects/7e6ab324fc2f4706b408ca77f2a55484/users/cfb1104ca24b4a1e96d73b4014d631c4/roles/eb0a4f7e007a48a2bc7bc126d88cd258 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:26.634876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:26.645829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5065-3a65-4992-baae-de9baf069fbb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:26.705218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ae188-afb3-4789-827e-b120e9fa000e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:26.705827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae188-afb3-4789-827e-b120e9fa000e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:26.706109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae188-afb3-4789-827e-b120e9fa000e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:26.706494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae188-afb3-4789-827e-b120e9fa000e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/7e6ab324fc2f4706b408ca77f2a55484/users/cfb1104ca24b4a1e96d73b4014d631c4/roles/718fc435172043ffb2c0b6821049fe15` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:26.708611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ae188-afb3-4789-827e-b120e9fa000e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7e6ab324fc2f4706b408ca77f2a55484, user_id=cfb1104ca24b4a1e96d73b4014d631c4, role_id=718fc435172043ffb2c0b6821049fe15)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:26.711268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ae188-afb3-4789-827e-b120e9fa000e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:26.837714 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4052/8041] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:26 2022] PUT /identity/v3/projects/7e6ab324fc2f4706b408ca77f2a55484/users/cfb1104ca24b4a1e96d73b4014d631c4/roles/718fc435172043ffb2c0b6821049fe15 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:26.842510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:26.853843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e511e-efc2-4dd0-b98f-d0e8b4efc6ea tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:26.913709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d428bf-b587-42f9-8b33-60eda07362ce tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:26.914358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d428bf-b587-42f9-8b33-60eda07362ce tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:26.914647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d428bf-b587-42f9-8b33-60eda07362ce tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:26.914926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d428bf-b587-42f9-8b33-60eda07362ce tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:26.915592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d428bf-b587-42f9-8b33-60eda07362ce tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:26.917525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d428bf-b587-42f9-8b33-60eda07362ce tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:26.958663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3990/8042] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:26 2022] GET /identity/v3/users => generated 8051 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:52:26.963702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce4fa-fa73-42aa-bc4f-9a39fc640d5c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:26.963992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce4fa-fa73-42aa-bc4f-9a39fc640d5c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:26.964272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce4fa-fa73-42aa-bc4f-9a39fc640d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:27.003151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ec9ce4fa-fa73-42aa-bc4f-9a39fc640d5c None None] MFA Rules not processed for user `cfb1104ca24b4a1e96d73b4014d631c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:27.004367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ec9ce4fa-fa73-42aa-bc4f-9a39fc640d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:27.072829 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4053/8043] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:26 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:27.084968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8131cd-24ca-4261-a7af-39cab4a69196 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:27.085523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8131cd-24ca-4261-a7af-39cab4a69196 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:27.085879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8131cd-24ca-4261-a7af-39cab4a69196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:27.115087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cb8131cd-24ca-4261-a7af-39cab4a69196 None None] MFA Rules not processed for user `cfb1104ca24b4a1e96d73b4014d631c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:27.116030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cb8131cd-24ca-4261-a7af-39cab4a69196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:27.124482 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3991/8044] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:27.128878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce4fa-fa73-42aa-bc4f-9a39fc640d5c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:27.139102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce4fa-fa73-42aa-bc4f-9a39fc640d5c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:27.143343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfb1104ca24b4a1e96d73b4014d631c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6ab324fc2f4706b408ca77f2a55484', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1380324187', 'tempest-DelegatedRole-261936231'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:27.143966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:27.144245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:27.144520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:27.146092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] RBAC: Authorizing `identity:create_trust()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:27.152327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:27.206715 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:27.322907 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4054/8045] 10.222.0.59 () {60 vars in 1174 bytes} [Sun Aug 28 01:52:27 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:27.332563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8131cd-24ca-4261-a7af-39cab4a69196 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:27.345758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8131cd-24ca-4261-a7af-39cab4a69196 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:27.350900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:27.351523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:27.358808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:27.358808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:27.358808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:27.358808 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:52:27.358808 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:52:27.358808 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:52:27.359292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:27.362200 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3992/8046] 10.222.0.59 () {58 vars in 1155 bytes} [Sun Aug 28 01:52:27 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:27.369192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:27.382578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1a97-4f61-494b-a34a-f90d2e9d5e32 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:27.389694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfb1104ca24b4a1e96d73b4014d631c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6ab324fc2f4706b408ca77f2a55484', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1380324187', 'tempest-DelegatedRole-261936231'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:27.390518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:27.391060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:27.391416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] PATH_INFO: `/v3/OS-TRUST/trusts/437596b1800c4afa9e75928db81ba1a5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:27.403670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] RBAC: Authorizing `identity:delete_trust(trust_id=437596b1800c4afa9e75928db81ba1a5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:27.409873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:27.533669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '437596b1800c4afa9e75928db81ba1a5', 'request_id': 'req-e25e8653-e25e-41de-ab5a-e31c09574d82'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:27.534431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '437596b1800c4afa9e75928db81ba1a5', 'request_id': 'req-e25e8653-e25e-41de-ab5a-e31c09574d82'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:27.607875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '437596b1800c4afa9e75928db81ba1a5', 'request_id': 'req-e25e8653-e25e-41de-ab5a-e31c09574d82'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:27.614922 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4055/8047] 10.222.0.59 () {58 vars in 1254 bytes} [Sun Aug 28 01:52:27 2022] DELETE /identity/v3/OS-TRUST/trusts/437596b1800c4afa9e75928db81ba1a5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:27.619064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:27.621402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:27.639172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ade5-4667-494f-9189-ed07a26315c8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:27.647324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfb1104ca24b4a1e96d73b4014d631c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6ab324fc2f4706b408ca77f2a55484', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1380324187', 'tempest-DelegatedRole-261936231'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:27.648000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:27.648286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:27.648563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] PATH_INFO: `/v3/OS-TRUST/trusts/437596b1800c4afa9e75928db81ba1a5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Could not find trust: 437596b1800c4afa9e75928db81ba1a5.: keystone.exception.TrustNotFound: Could not find trust: 437596b1800c4afa9e75928db81ba1a5. Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 01:52:27.687465 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 437596b1800c4afa9e75928db81ba1a5. Aug 28 01:52:27.688996 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:27.690048 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3993/8048] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:27 2022] GET /identity/v3/OS-TRUST/trusts/437596b1800c4afa9e75928db81ba1a5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:52:27.693416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:27.695220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:27.710896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e8653-e25e-41de-ab5a-e31c09574d82 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:27.716683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:27.717390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:27.717681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:27.717994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/718fc435172043ffb2c0b6821049fe15` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:27.719622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=718fc435172043ffb2c0b6821049fe15)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:27.721228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:27.943878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role 718fc435172043ffb2c0b6821049fe15 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:27.944238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:27.944997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:27.946996 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4056/8049] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:27 2022] DELETE /identity/v3/roles/718fc435172043ffb2c0b6821049fe15 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:27.951792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:27.953523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:27.968955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fc14-bea0-4ed0-b428-dc7f07cd7543 tempest-TrustsV3TestJSON-952199025 tempest-user-690134062] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:28.026380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:28.027368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:28.027648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:28.027938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/eb0a4f7e007a48a2bc7bc126d88cd258` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:28.029367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eb0a4f7e007a48a2bc7bc126d88cd258)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:28.031160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:28.039598 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:28.207772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role eb0a4f7e007a48a2bc7bc126d88cd258 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:28.208098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.208799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.210662 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3994/8050] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:27 2022] DELETE /identity/v3/roles/eb0a4f7e007a48a2bc7bc126d88cd258 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:28.215068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:28.225615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c7db-bfc5-4359-8d06-19615cf88a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:28.285530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:28.286241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:28.286528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:28.286803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users/cfb1104ca24b4a1e96d73b4014d631c4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:28.287967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cfb1104ca24b4a1e96d73b4014d631c4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:28.289985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:28.465244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb1104ca24b4a1e96d73b4014d631c4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.466385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb1104ca24b4a1e96d73b4014d631c4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.567864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb1104ca24b4a1e96d73b4014d631c4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.578251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb1104ca24b4a1e96d73b4014d631c4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.578994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb1104ca24b4a1e96d73b4014d631c4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.581804 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=12 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:28.606061 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4057/8051] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:28 2022] DELETE /identity/v3/users/cfb1104ca24b4a1e96d73b4014d631c4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:28.608165 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:28.609644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:28.628713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3234ee-f4b4-4987-b084-4b60f4392150 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:28.690933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:28.691582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:28.691862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:28.692135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/7e6ab324fc2f4706b408ca77f2a55484` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:28.693339 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e6ab324fc2f4706b408ca77f2a55484)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:28.695280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:28.952571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6ab324fc2f4706b408ca77f2a55484', 'request_id': 'req-507211ca-d000-4569-b272-f3b1844b489b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:28.958702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6ab324fc2f4706b408ca77f2a55484', 'request_id': 'req-507211ca-d000-4569-b272-f3b1844b489b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:29.047543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6ab324fc2f4706b408ca77f2a55484', 'request_id': 'req-507211ca-d000-4569-b272-f3b1844b489b'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:29.062017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] The token cache is being invalidate because project 7e6ab324fc2f4706b408ca77f2a55484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:29.062471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:29.063433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:29.065486 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3995/8052] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:28 2022] DELETE /identity/v3/projects/7e6ab324fc2f4706b408ca77f2a55484 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:29.070483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:29.071949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:29.086646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a98aca-d8ee-49db-bd80-983a2b9e9328 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:29.151232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:29.152403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:29.152686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:29.158273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:29.158273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:29.158273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:29.326969 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4058/8053] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:52:29 2022] POST /identity/v3/projects => generated 329 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:29.331537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:29.332995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:29.347407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507211ca-d000-4569-b272-f3b1844b489b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:29.409503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:29.411240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:29.411240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:29.411240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:29.411240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:29.413146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:29.423567 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:29.556457 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3996/8054] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:29 2022] POST /identity/v3/users => generated 413 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:29.561584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:29.573291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77ac94-0721-4e57-94d8-37c3dcd2f093 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:29.578846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:29.579540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:29.579833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:29.580111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:29.580852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:29.582527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:29.660489 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4059/8055] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:29 2022] POST /identity/v3/roles => generated 244 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:29.667144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:29.678760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda22a-cf5a-4a49-858b-8f341a55c96c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:29.685292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:29.686135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:29.695458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:29.702294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:29.702860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:29.704474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:29.830994 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3997/8056] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:29 2022] POST /identity/v3/roles => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:29.831440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:29.843320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c89ea-c178-4d3f-9e51-a6e71350832b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:29.848945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:29.849593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:29.849924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:29.850213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/028f1dcffa944403bcd3feb9851cb004/users/7f0672d6d42e4a09b01f83a937be529f/roles/b9d6ce0725df4920b37beb029649567b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:29.871895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=028f1dcffa944403bcd3feb9851cb004, user_id=7f0672d6d42e4a09b01f83a937be529f, role_id=b9d6ce0725df4920b37beb029649567b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:29.874673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:29.972160 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4060/8057] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:29 2022] PUT /identity/v3/projects/028f1dcffa944403bcd3feb9851cb004/users/7f0672d6d42e4a09b01f83a937be529f/roles/b9d6ce0725df4920b37beb029649567b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:29.979031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:29.990226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4df2c-72f5-43d8-8dd8-d4474daaf99e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:30.053754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddb0ba-2d34-440c-b35f-fd61db9eeb10 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:30.054508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddb0ba-2d34-440c-b35f-fd61db9eeb10 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:30.054799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddb0ba-2d34-440c-b35f-fd61db9eeb10 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:30.055074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddb0ba-2d34-440c-b35f-fd61db9eeb10 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/028f1dcffa944403bcd3feb9851cb004/users/7f0672d6d42e4a09b01f83a937be529f/roles/c485741f2beb44ffbe8880b8dc89edcb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:30.057292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddb0ba-2d34-440c-b35f-fd61db9eeb10 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=028f1dcffa944403bcd3feb9851cb004, user_id=7f0672d6d42e4a09b01f83a937be529f, role_id=c485741f2beb44ffbe8880b8dc89edcb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:30.060814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddb0ba-2d34-440c-b35f-fd61db9eeb10 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:30.211431 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3998/8058] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:29 2022] PUT /identity/v3/projects/028f1dcffa944403bcd3feb9851cb004/users/7f0672d6d42e4a09b01f83a937be529f/roles/c485741f2beb44ffbe8880b8dc89edcb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:30.216307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:30.229123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66dfb5-8565-4302-9aaf-1d650a5a5087 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:30.296586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1b8b9-4a66-4848-86e5-a53af964b644 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:30.299821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b8b9-4a66-4848-86e5-a53af964b644 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:30.299821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b8b9-4a66-4848-86e5-a53af964b644 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:30.299821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b8b9-4a66-4848-86e5-a53af964b644 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:30.299821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1b8b9-4a66-4848-86e5-a53af964b644 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:30.300568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1b8b9-4a66-4848-86e5-a53af964b644 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:30.332194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4061/8059] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:30 2022] GET /identity/v3/users => generated 8051 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:52:30.337491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba0bf-9b37-4d1b-ab97-7c24ea224b0e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:30.337780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba0bf-9b37-4d1b-ab97-7c24ea224b0e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:30.338090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba0bf-9b37-4d1b-ab97-7c24ea224b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:30.378734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fbfba0bf-9b37-4d1b-ab97-7c24ea224b0e None None] MFA Rules not processed for user `7f0672d6d42e4a09b01f83a937be529f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:30.380137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fbfba0bf-9b37-4d1b-ab97-7c24ea224b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:30.476996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 3999/8060] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:30.487584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7b09-fcb3-4388-8d6b-bdd124699a12 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:30.487881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7b09-fcb3-4388-8d6b-bdd124699a12 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:30.488679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f7b09-fcb3-4388-8d6b-bdd124699a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:30.508578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fe4f7b09-fcb3-4388-8d6b-bdd124699a12 None None] MFA Rules not processed for user `7f0672d6d42e4a09b01f83a937be529f`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:30.509885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fe4f7b09-fcb3-4388-8d6b-bdd124699a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:30.518712 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4062/8061] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:30.526080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfba0bf-9b37-4d1b-ab97-7c24ea224b0e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:30.537511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfba0bf-9b37-4d1b-ab97-7c24ea224b0e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:30.546407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0672d6d42e4a09b01f83a937be529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '028f1dcffa944403bcd3feb9851cb004', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1125435616', 'tempest-DelegatedRole-1322103613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:30.547117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:30.547474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:30.547830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:30.548753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: Authorizing `identity:create_trust()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:30.550035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:30.623605 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:30.718757 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4000/8062] 10.222.0.59 () {60 vars in 1174 bytes} [Sun Aug 28 01:52:30 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:30.725628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f7b09-fcb3-4388-8d6b-bdd124699a12 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:30.735148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f7b09-fcb3-4388-8d6b-bdd124699a12 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:30.739674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0672d6d42e4a09b01f83a937be529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '028f1dcffa944403bcd3feb9851cb004', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1125435616', 'tempest-DelegatedRole-1322103613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:30.740738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:30.741019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:30.741293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:30.741995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:30.749180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:30.757281 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4063/8063] 10.222.0.59 () {58 vars in 1252 bytes} [Sun Aug 28 01:52:30 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=7f0672d6d42e4a09b01f83a937be529f => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:30.761834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:30.771893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1fa11-b5c0-45c3-a9d2-2ee48e7beab8 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:30.778660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0672d6d42e4a09b01f83a937be529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '028f1dcffa944403bcd3feb9851cb004', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1125435616', 'tempest-DelegatedRole-1322103613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:30.779310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:30.779594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:30.779872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] PATH_INFO: `/v3/OS-TRUST/trusts/dbcd7f4951104936b6667b8ae78865e3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:30.787533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: Authorizing `identity:delete_trust(trust_id=dbcd7f4951104936b6667b8ae78865e3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:30.789250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:30.901280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'dbcd7f4951104936b6667b8ae78865e3', 'request_id': 'req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:30.907141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'dbcd7f4951104936b6667b8ae78865e3', 'request_id': 'req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:30.907141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'dbcd7f4951104936b6667b8ae78865e3', 'request_id': 'req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:31.001619 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4001/8064] 10.222.0.59 () {58 vars in 1254 bytes} [Sun Aug 28 01:52:30 2022] DELETE /identity/v3/OS-TRUST/trusts/dbcd7f4951104936b6667b8ae78865e3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:31.007944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:31.010054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:31.024610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddee32c-9bb8-48ff-aa90-073e9ebd217d tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:31.029074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f0672d6d42e4a09b01f83a937be529f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '028f1dcffa944403bcd3feb9851cb004', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1125435616', 'tempest-DelegatedRole-1322103613'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:31.029705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:31.030025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:31.030302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] PATH_INFO: `/v3/OS-TRUST/trusts/dbcd7f4951104936b6667b8ae78865e3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Could not find trust: dbcd7f4951104936b6667b8ae78865e3.: keystone.exception.TrustNotFound: Could not find trust: dbcd7f4951104936b6667b8ae78865e3. Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 01:52:31.043104 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: dbcd7f4951104936b6667b8ae78865e3. Aug 28 01:52:31.044513 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:52:31.046290 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4064/8065] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:31 2022] GET /identity/v3/OS-TRUST/trusts/dbcd7f4951104936b6667b8ae78865e3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:52:31.053454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:31.054994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:31.071248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2adf3-ec06-4f97-aa4e-8fc36c6858e0 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:31.076525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:31.077253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:31.077542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:31.078274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/c485741f2beb44ffbe8880b8dc89edcb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:31.079426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c485741f2beb44ffbe8880b8dc89edcb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:31.081116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:31.329932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role c485741f2beb44ffbe8880b8dc89edcb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:31.330254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:31.330943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:31.332753 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4002/8066] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:31 2022] DELETE /identity/v3/roles/c485741f2beb44ffbe8880b8dc89edcb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:31.336933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:31.338672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:31.348127 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:31.355491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31529c-4e93-453b-b82e-fe5034733300 tempest-TrustsV3TestJSON-1948843950 tempest-user-331386955] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:31.418946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:31.419590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:31.419876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:31.420157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/b9d6ce0725df4920b37beb029649567b` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:31.426932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b9d6ce0725df4920b37beb029649567b)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:31.426932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:31.665114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role b9d6ce0725df4920b37beb029649567b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:31.665467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:31.666258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:31.668195 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4065/8067] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:31 2022] DELETE /identity/v3/roles/b9d6ce0725df4920b37beb029649567b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:31.675892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:31.687726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbd9b-5b02-4f45-bb68-37117700bd2b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:31.753274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:31.755323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:31.755323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:31.755323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users/7f0672d6d42e4a09b01f83a937be529f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:31.755882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7f0672d6d42e4a09b01f83a937be529f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:31.757789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:32.052753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0672d6d42e4a09b01f83a937be529f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.065520 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=13 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:32.066789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0672d6d42e4a09b01f83a937be529f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.075588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0672d6d42e4a09b01f83a937be529f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.084714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0672d6d42e4a09b01f83a937be529f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.210376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0672d6d42e4a09b01f83a937be529f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.217470 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4003/8068] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:31 2022] DELETE /identity/v3/users/7f0672d6d42e4a09b01f83a937be529f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:32.223550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:32.224993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:32.239445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04c707-2097-4e70-8e2a-d0d6c703ba60 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:32.358399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:32.359086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:32.359329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:32.359611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/028f1dcffa944403bcd3feb9851cb004` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:32.360759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_project(project_id=028f1dcffa944403bcd3feb9851cb004)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:32.362733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:32.651458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028f1dcffa944403bcd3feb9851cb004', 'request_id': 'req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.660904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028f1dcffa944403bcd3feb9851cb004', 'request_id': 'req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.742276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028f1dcffa944403bcd3feb9851cb004', 'request_id': 'req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.748440 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:32.755412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] The token cache is being invalidate because project 028f1dcffa944403bcd3feb9851cb004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:32.758293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.758293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:32.758293 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4066/8069] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:32 2022] DELETE /identity/v3/projects/028f1dcffa944403bcd3feb9851cb004 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:32.764210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:32.766090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:32.779552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504caad-3f94-4ecd-a435-df9ea4c49ccf tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:32.841481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:32.842173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:32.842438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:32.842710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:32.843334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:32.845218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:32.946284 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4004/8070] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:52:32 2022] POST /identity/v3/projects => generated 329 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:32.947457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:32.948930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:32.962749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b997c9-96cd-48a2-ba5f-9c17dd0fa3b9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:33.047374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:33.048091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:33.049018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:33.049018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:33.049777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:33.051978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:33.172781 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4067/8071] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:32 2022] POST /identity/v3/users => generated 413 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:33.177193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:33.193448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff1ba2-c49e-4951-a7a0-04bf71aea85d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:33.198405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:33.199380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:33.199842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:33.200201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:33.201208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:33.202836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:33.310184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4005/8072] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:33 2022] POST /identity/v3/roles => generated 244 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:33.315730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:33.329347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb40bc-b0a8-4dab-aeaa-596f27dc4686 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:33.340681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:33.340681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:33.340681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:33.341028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:33.341028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:33.341317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:33.437279 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4068/8073] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:33 2022] POST /identity/v3/roles => generated 247 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:33.439057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:33.454437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c325d-853f-4607-9604-4e446b59f221 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:33.467652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:33.468359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:33.468599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:33.468968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/e553342c93244acea8e318b3cb746e55/users/b800e610700b4fac834f44902d92dbf4/roles/fbf09f88b88b441bb8142b45bb0f11d5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:33.498880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e553342c93244acea8e318b3cb746e55, user_id=b800e610700b4fac834f44902d92dbf4, role_id=fbf09f88b88b441bb8142b45bb0f11d5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:33.501876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:33.629782 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4006/8074] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:33 2022] PUT /identity/v3/projects/e553342c93244acea8e318b3cb746e55/users/b800e610700b4fac834f44902d92dbf4/roles/fbf09f88b88b441bb8142b45bb0f11d5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:33.633783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:33.647864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b608-ab35-48f1-821b-f6221a6ec98f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:33.714185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c111c97-ad06-4da4-a804-2414b0fa9e00 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:33.714843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c111c97-ad06-4da4-a804-2414b0fa9e00 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:33.715249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c111c97-ad06-4da4-a804-2414b0fa9e00 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:33.715549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c111c97-ad06-4da4-a804-2414b0fa9e00 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/e553342c93244acea8e318b3cb746e55/users/b800e610700b4fac834f44902d92dbf4/roles/1308e567d6654948ba92f63539cd7e64` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:33.718742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c111c97-ad06-4da4-a804-2414b0fa9e00 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e553342c93244acea8e318b3cb746e55, user_id=b800e610700b4fac834f44902d92dbf4, role_id=1308e567d6654948ba92f63539cd7e64)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:33.721633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c111c97-ad06-4da4-a804-2414b0fa9e00 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:33.802131 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4069/8075] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:33 2022] PUT /identity/v3/projects/e553342c93244acea8e318b3cb746e55/users/b800e610700b4fac834f44902d92dbf4/roles/1308e567d6654948ba92f63539cd7e64 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:33.806938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:33.819386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092071-11e0-434d-be11-b4ab68885f98 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:33.906559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ba8c7-8f2e-4ec8-9cec-50bc944da7ff tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:33.907185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba8c7-8f2e-4ec8-9cec-50bc944da7ff tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:33.907505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba8c7-8f2e-4ec8-9cec-50bc944da7ff tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:33.907781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ba8c7-8f2e-4ec8-9cec-50bc944da7ff tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:33.908739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ba8c7-8f2e-4ec8-9cec-50bc944da7ff tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:33.910625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ba8c7-8f2e-4ec8-9cec-50bc944da7ff tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:33.941609 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4007/8076] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:33 2022] GET /identity/v3/users => generated 8051 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:33.946687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf953a2b-8df7-46bd-bcf8-76bb6d048d7f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:33.946973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf953a2b-8df7-46bd-bcf8-76bb6d048d7f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:33.951026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf953a2b-8df7-46bd-bcf8-76bb6d048d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:33.989609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bf953a2b-8df7-46bd-bcf8-76bb6d048d7f None None] MFA Rules not processed for user `b800e610700b4fac834f44902d92dbf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:33.990949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bf953a2b-8df7-46bd-bcf8-76bb6d048d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:34.067618 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4070/8077] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:34.077783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7f8f-3190-4095-8c0e-9647e62eaaf5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.078317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7f8f-3190-4095-8c0e-9647e62eaaf5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.078633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d7f8f-3190-4095-8c0e-9647e62eaaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.098119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f04d7f8f-3190-4095-8c0e-9647e62eaaf5 None None] MFA Rules not processed for user `b800e610700b4fac834f44902d92dbf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:34.099309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f04d7f8f-3190-4095-8c0e-9647e62eaaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:34.107575 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4008/8078] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:34.112327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf953a2b-8df7-46bd-bcf8-76bb6d048d7f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.123201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf953a2b-8df7-46bd-bcf8-76bb6d048d7f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.128648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.129304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.129585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.136100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.136100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:create_trust()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.136100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.335267 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4071/8079] 10.222.0.59 () {60 vars in 1174 bytes} [Sun Aug 28 01:52:34 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:34.340602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7f8f-3190-4095-8c0e-9647e62eaaf5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.349463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d7f8f-3190-4095-8c0e-9647e62eaaf5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.354645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.355310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.355588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.355889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.362554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:get_trust(trust_id=c022e023676b4997b2c96933f6ccd46c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.364017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.368319 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:34.373134 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4009/8080] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:34 2022] GET /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c => generated 859 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:52:34.377269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.388015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cef0a-bd0d-4b5c-81c6-bf6f7fc1c91b tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.392572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.393242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.393527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.393825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.400280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=c022e023676b4997b2c96933f6ccd46c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.401733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.412591 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4072/8081] 10.222.0.59 () {58 vars in 1269 bytes} [Sun Aug 28 01:52:34 2022] GET /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles => generated 371 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:34.414550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.430857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baec6-ea4c-41c8-a10a-dbbeba853247 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.434366 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:34.443679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.443679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.443679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.444010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/fbf09f88b88b441bb8142b45bb0f11d5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.447054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c022e023676b4997b2c96933f6ccd46c, role_id=fbf09f88b88b441bb8142b45bb0f11d5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.449263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.457143 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4010/8082] 10.222.0.59 () {58 vars in 1368 bytes} [Sun Aug 28 01:52:34 2022] GET /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/fbf09f88b88b441bb8142b45bb0f11d5 => generated 244 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:34.461214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.476686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8369be1-d39b-4e8a-bca4-af2f43265b8d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.483127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.484401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.484401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.484401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/fbf09f88b88b441bb8142b45bb0f11d5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.494581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c022e023676b4997b2c96933f6ccd46c, role_id=fbf09f88b88b441bb8142b45bb0f11d5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.496755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.505905 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4073/8083] 10.222.0.59 () {58 vars in 1369 bytes} [Sun Aug 28 01:52:34 2022] HEAD /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/fbf09f88b88b441bb8142b45bb0f11d5 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 01:52:34.522008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.532370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0898f2-8d76-489c-aa3b-72ec31cd8688 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.536920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.539882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.539882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.539882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/1308e567d6654948ba92f63539cd7e64` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.544569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c022e023676b4997b2c96933f6ccd46c, role_id=1308e567d6654948ba92f63539cd7e64)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.546128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Could not find role: 1308e567d6654948ba92f63539cd7e64.: keystone.exception.RoleNotFound: Could not find role: 1308e567d6654948ba92f63539cd7e64. Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 01:52:34.556351 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1308e567d6654948ba92f63539cd7e64. Aug 28 01:52:34.557464 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:34.558504 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4011/8084] 10.222.0.59 () {58 vars in 1368 bytes} [Sun Aug 28 01:52:34 2022] GET /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/1308e567d6654948ba92f63539cd7e64 => generated 110 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:52:34.562355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.573065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e66b84-6d78-4143-8fbb-6ae9cec58712 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.578211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.579624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `HEAD` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.579988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.580326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/1308e567d6654948ba92f63539cd7e64` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.587636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c022e023676b4997b2c96933f6ccd46c, role_id=1308e567d6654948ba92f63539cd7e64)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.589786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Could not find role: 1308e567d6654948ba92f63539cd7e64.: keystone.exception.RoleNotFound: Could not find role: 1308e567d6654948ba92f63539cd7e64. Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 01:52:34.603519 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1308e567d6654948ba92f63539cd7e64. Aug 28 01:52:34.605421 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:52:34.613079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.613652 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4074/8085] 10.222.0.59 () {58 vars in 1369 bytes} [Sun Aug 28 01:52:34 2022] HEAD /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c/roles/1308e567d6654948ba92f63539cd7e64 => generated 0 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 01:52:34.626982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709615e8-80d1-48d1-aceb-63c27be0b16d tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.632825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.633599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.633990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.634359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.649306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorizing `identity:delete_trust(trust_id=c022e023676b4997b2c96933f6ccd46c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.649306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:34.794578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c022e023676b4997b2c96933f6ccd46c', 'request_id': 'req-9aca26b5-3adc-4f63-91c0-864215188e95'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:34.795604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c022e023676b4997b2c96933f6ccd46c', 'request_id': 'req-9aca26b5-3adc-4f63-91c0-864215188e95'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:34.796489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c022e023676b4997b2c96933f6ccd46c', 'request_id': 'req-9aca26b5-3adc-4f63-91c0-864215188e95'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:34.922985 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4012/8086] 10.222.0.59 () {58 vars in 1254 bytes} [Sun Aug 28 01:52:34 2022] DELETE /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:34.927173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.928958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:34.943250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808681-89d1-4795-90e8-8fca02ac7dae tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.947818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea285d-1e09-4855-ab38-fe3358816487 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b800e610700b4fac834f44902d92dbf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e553342c93244acea8e318b3cb746e55', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1831073330', 'tempest-DelegatedRole-1914758305'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.948549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea285d-1e09-4855-ab38-fe3358816487 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.948931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea285d-1e09-4855-ab38-fe3358816487 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.949207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea285d-1e09-4855-ab38-fe3358816487 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] PATH_INFO: `/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-28ea285d-1e09-4855-ab38-fe3358816487 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Could not find trust: c022e023676b4997b2c96933f6ccd46c.: keystone.exception.TrustNotFound: Could not find trust: c022e023676b4997b2c96933f6ccd46c. Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 01:52:34.958509 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c022e023676b4997b2c96933f6ccd46c. Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:52:34.959651 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4075/8087] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:34 2022] GET /identity/v3/OS-TRUST/trusts/c022e023676b4997b2c96933f6ccd46c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:52:34.963788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:34.965249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:34.980846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca26b5-3adc-4f63-91c0-864215188e95 tempest-TrustsV3TestJSON-1033815992 tempest-user-733033876] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:34.986164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:34.986792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:34.987075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:34.987350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/1308e567d6654948ba92f63539cd7e64` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:34.988734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1308e567d6654948ba92f63539cd7e64)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:34.990580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:35.006342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952960ef-8edf-4e07-a3cf-d5fd8fed49a4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:35.006714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952960ef-8edf-4e07-a3cf-d5fd8fed49a4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:35.007019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952960ef-8edf-4e07-a3cf-d5fd8fed49a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:35.026618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-952960ef-8edf-4e07-a3cf-d5fd8fed49a4 None None] MFA Rules not processed for user `d7d8e24e5dee4a7899769c92c6754995`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:35.028259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-952960ef-8edf-4e07-a3cf-d5fd8fed49a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:35.098928 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4076/8088] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:35.247928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role 1308e567d6654948ba92f63539cd7e64 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:35.248277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.248975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.251464 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4013/8089] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:34 2022] DELETE /identity/v3/roles/1308e567d6654948ba92f63539cd7e64 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:35.260800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952960ef-8edf-4e07-a3cf-d5fd8fed49a4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:35.284032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952960ef-8edf-4e07-a3cf-d5fd8fed49a4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:35.310967 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:35.353901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:35.355238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:35.355651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:35.355992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/fbf09f88b88b441bb8142b45bb0f11d5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:35.358276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fbf09f88b88b441bb8142b45bb0f11d5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:35.360049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:35.506486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:35.507937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:35.569122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role fbf09f88b88b441bb8142b45bb0f11d5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:35.570347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.571246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.574902 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4077/8090] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:35 2022] DELETE /identity/v3/roles/fbf09f88b88b441bb8142b45bb0f11d5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:35.582963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:35.584539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:35.598567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed10637-9046-4f56-b137-6f8f357a850d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:35.656287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:35.657016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:35.657304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:35.657610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:35.659754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:35.659951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd253-4624-497a-9b02-8b2adbed0979 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:35.664869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:35.665552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:35.665926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:35.667001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users/b800e610700b4fac834f44902d92dbf4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:35.669725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b800e610700b4fac834f44902d92dbf4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:35.671806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:35.672188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:35.673618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:35.686809 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4014/8091] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:52:35.826218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b800e610700b4fac834f44902d92dbf4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.827109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b800e610700b4fac834f44902d92dbf4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.919154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b800e610700b4fac834f44902d92dbf4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.929577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b800e610700b4fac834f44902d92dbf4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.929577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b800e610700b4fac834f44902d92dbf4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:35.947639 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4078/8092] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:35 2022] DELETE /identity/v3/users/b800e610700b4fac834f44902d92dbf4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:35.952582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:35.959505 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:35.966507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2585-9038-4d08-ba4c-f50d98281c52 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:36.029359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:36.030054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:36.030335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:36.030643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/e553342c93244acea8e318b3cb746e55` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:36.031767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e553342c93244acea8e318b3cb746e55)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:36.034064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:36.300145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e553342c93244acea8e318b3cb746e55', 'request_id': 'req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:36.311966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e553342c93244acea8e318b3cb746e55', 'request_id': 'req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:36.387943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e553342c93244acea8e318b3cb746e55', 'request_id': 'req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:36.400027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] The token cache is being invalidate because project e553342c93244acea8e318b3cb746e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:36.400324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:36.401283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:36.403801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4015/8093] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:35 2022] DELETE /identity/v3/projects/e553342c93244acea8e318b3cb746e55 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:36.409590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:36.411206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:36.427138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e94e46-844e-4d95-9718-30e6b98694b4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:36.436097 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:36.484970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:36.485602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:36.486024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:36.486193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:36.486832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:36.488761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:36.612182 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4079/8094] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:52:36 2022] POST /identity/v3/projects => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:36.617426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:36.618884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:36.646823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd5d2-f8ad-4cbb-8fad-067308e4d9cd tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:36.735544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:36.736194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:36.736545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:36.736830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:36.737489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:36.739749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:36.879863 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4016/8095] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:36 2022] POST /identity/v3/users => generated 413 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:36.887196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:36.898327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ec1f6-527f-42ef-b76c-a145355a2def tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:36.903780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:36.904441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:36.904781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:36.905102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:36.905761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:36.915202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.015401 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4080/8096] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:36 2022] POST /identity/v3/roles => generated 244 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:37.021549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.032619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82cfd2-2df6-4d05-9653-3ba27df5a123 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.037727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.038589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.039684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.040114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.040977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.043871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.166874 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4017/8097] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:37 2022] POST /identity/v3/roles => generated 247 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:37.170585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.181469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368095-7cb9-4444-a048-aad6363d2835 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.188264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.188924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.189214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.189478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/adb45c3dbb784f27910b862aca1426da/users/240e30c16bd842a2a8ebb289ebccf952/roles/3a7abe0814c94320b72e9755337365dd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.208201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=adb45c3dbb784f27910b862aca1426da, user_id=240e30c16bd842a2a8ebb289ebccf952, role_id=3a7abe0814c94320b72e9755337365dd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.210933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.317115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.318034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:37.335453 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4081/8098] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:37 2022] PUT /identity/v3/projects/adb45c3dbb784f27910b862aca1426da/users/240e30c16bd842a2a8ebb289ebccf952/roles/3a7abe0814c94320b72e9755337365dd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:37.336656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.390147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa68a7-a660-4ff9-a78e-5efc24cf4f68 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.410801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed19c9-5bbc-4427-8ecf-33b3721d825d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.415844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.416518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.416806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.417841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/adb45c3dbb784f27910b862aca1426da/users/240e30c16bd842a2a8ebb289ebccf952/roles/e80111de525e43bb92ecad08cfd9228e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.420475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=adb45c3dbb784f27910b862aca1426da, user_id=240e30c16bd842a2a8ebb289ebccf952, role_id=e80111de525e43bb92ecad08cfd9228e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.423313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.443139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.443682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.443964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.444245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.446055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:37.525125 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4082/8099] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:37 2022] PUT /identity/v3/projects/adb45c3dbb784f27910b862aca1426da/users/240e30c16bd842a2a8ebb289ebccf952/roles/e80111de525e43bb92ecad08cfd9228e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:37.525372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.526002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.527640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.528734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:37.543576 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4018/8100] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:52:37.544493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.554226 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:37.561026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a599-59bb-4738-bdfe-6f79e794cb1b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.603656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc698f-3de2-4fa0-9c48-86f09512e131 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.611072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abc608-b69b-457d-a4a0-9dea489f6007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.611734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abc608-b69b-457d-a4a0-9dea489f6007 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.612019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abc608-b69b-457d-a4a0-9dea489f6007 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.612294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abc608-b69b-457d-a4a0-9dea489f6007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.626943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e0abc608-b69b-457d-a4a0-9dea489f6007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:37.639098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4323a-1578-43bc-8d7e-35e4176ba2bb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.642660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4323a-1578-43bc-8d7e-35e4176ba2bb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.643051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4323a-1578-43bc-8d7e-35e4176ba2bb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.643051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4323a-1578-43bc-8d7e-35e4176ba2bb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.643669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4323a-1578-43bc-8d7e-35e4176ba2bb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.645523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4323a-1578-43bc-8d7e-35e4176ba2bb tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.679631 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4019/8101] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:37 2022] GET /identity/v3/users => generated 8051 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:37.684720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bc233-e3a1-4d05-8c80-5e5240922d06 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.685007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bc233-e3a1-4d05-8c80-5e5240922d06 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.685285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bc233-e3a1-4d05-8c80-5e5240922d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.700070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abc608-b69b-457d-a4a0-9dea489f6007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.701933 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:37.703798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abc608-b69b-457d-a4a0-9dea489f6007 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.715507 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4083/8102] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:37.725485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f36bc233-e3a1-4d05-8c80-5e5240922d06 None None] MFA Rules not processed for user `240e30c16bd842a2a8ebb289ebccf952`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:37.726489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f36bc233-e3a1-4d05-8c80-5e5240922d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:37.797743 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4020/8103] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:37.809024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585960a-6ecb-4594-835d-12cb9e3b290a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.809308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585960a-6ecb-4594-835d-12cb9e3b290a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.809579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585960a-6ecb-4594-835d-12cb9e3b290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.829990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8585960a-6ecb-4594-835d-12cb9e3b290a None None] MFA Rules not processed for user `240e30c16bd842a2a8ebb289ebccf952`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:37.831529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8585960a-6ecb-4594-835d-12cb9e3b290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:37.839903 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4084/8104] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:37.844166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bc233-e3a1-4d05-8c80-5e5240922d06 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.853567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bc233-e3a1-4d05-8c80-5e5240922d06 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.858786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e30c16bd842a2a8ebb289ebccf952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adb45c3dbb784f27910b862aca1426da', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1327059448', 'tempest-DelegatedRole-2037375702'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.859451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.859715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.859994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.860707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] RBAC: Authorizing `identity:create_trust()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.861884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 28 01:52:37.961757 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 28 01:52:37.962699 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 28 01:52:37.963798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 28 01:52:37.963798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 28 01:52:37.963798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 28 01:52:37.963798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 28 01:52:37.963798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 01:52:37.963798 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:37.963798 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4021/8105] 10.222.0.59 () {60 vars in 1174 bytes} [Sun Aug 28 01:52:37 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 115 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 01:52:37.968993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585960a-6ecb-4594-835d-12cb9e3b290a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:37.983916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585960a-6ecb-4594-835d-12cb9e3b290a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:37.992256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:37.992892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:37.993179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:37.993459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/e80111de525e43bb92ecad08cfd9228e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:37.994887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e80111de525e43bb92ecad08cfd9228e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:37.997671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:38.239129 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:38.245137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role e80111de525e43bb92ecad08cfd9228e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:38.246067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.247199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.251431 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4085/8106] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:37 2022] DELETE /identity/v3/roles/e80111de525e43bb92ecad08cfd9228e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:38.255655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:38.257464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:38.277001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83212c-3b94-47d9-9188-0e13ce321860 tempest-TrustsV3TestJSON-42619097 tempest-user-496438559] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:38.335493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:38.336123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:38.336414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:38.336720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/3a7abe0814c94320b72e9755337365dd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:38.338221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a7abe0814c94320b72e9755337365dd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:38.346526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:38.477043 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:38.610064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role 3a7abe0814c94320b72e9755337365dd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:38.610355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.611043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.616012 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4022/8107] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:38 2022] DELETE /identity/v3/roles/3a7abe0814c94320b72e9755337365dd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:38.617059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:38.636099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b4c14-8ef2-4ed2-b90d-e9c9e2f6e422 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:38.702399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:38.703062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:38.703350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:38.703652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users/240e30c16bd842a2a8ebb289ebccf952` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:38.704836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_user(user_id=240e30c16bd842a2a8ebb289ebccf952)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:38.706800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:38.883030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240e30c16bd842a2a8ebb289ebccf952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.883667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240e30c16bd842a2a8ebb289ebccf952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.888485 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:38.984084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240e30c16bd842a2a8ebb289ebccf952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.998942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240e30c16bd842a2a8ebb289ebccf952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:38.999689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240e30c16bd842a2a8ebb289ebccf952'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:39.022315 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4086/8108] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:38 2022] DELETE /identity/v3/users/240e30c16bd842a2a8ebb289ebccf952 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:39.026773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:39.028602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:39.044017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b105bb-3336-483b-be15-85e441575fb8 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:39.114099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:39.114744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:39.115027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:39.115305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/adb45c3dbb784f27910b862aca1426da` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:39.116476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_project(project_id=adb45c3dbb784f27910b862aca1426da)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:39.118382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:39.253261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb45c3dbb784f27910b862aca1426da', 'request_id': 'req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:39.262329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb45c3dbb784f27910b862aca1426da', 'request_id': 'req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:39.376520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb45c3dbb784f27910b862aca1426da', 'request_id': 'req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:39.390126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] The token cache is being invalidate because project adb45c3dbb784f27910b862aca1426da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:39.391232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:39.391232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:39.392874 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4023/8109] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:39 2022] DELETE /identity/v3/projects/adb45c3dbb784f27910b862aca1426da => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:39.398487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:39.400049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:39.418004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe48a8-1fe1-4945-9fa4-8585d9b6476f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:39.494637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:39.496060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:39.496344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:39.496619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:39.497289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:39.499262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:39.641322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4087/8110] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:52:39 2022] POST /identity/v3/projects => generated 329 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:39.642865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:39.644725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:39.660757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd8eef-4dc6-4cf1-9b35-ea7228dfd29e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:39.731388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:39.732446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:39.732921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:39.740137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:39.740137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:39.740137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:39.888505 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4024/8111] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:39 2022] POST /identity/v3/users => generated 413 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:39.898499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:39.912433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f33cf7-9e04-4d37-9c08-2aa889ee8fc4 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:39.917854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:39.918479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:39.918761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:39.919045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:39.919744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:39.921384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:40.030500 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4088/8112] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:39 2022] POST /identity/v3/roles => generated 243 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:40.036769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:40.049172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943f14-db89-48ef-a9fb-766c4447b2f7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:40.057703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:40.058364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:40.058652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:40.058956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:40.059616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:40.061704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:40.070389 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=87,keystone:DELETE=8,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:40.218551 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4025/8113] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:40 2022] POST /identity/v3/roles => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:40.226269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:40.242926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba3d95-dd7f-48ee-b977-896f11f74b5f tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:40.251792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:40.251792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:40.251792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:40.252050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/b7c80a62fc6149c5a73cda33550b96e4/users/d2309c371d404aaa8490641f29687773/roles/8ab9762245ea450baab9152f88b4ed52` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:40.274534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7c80a62fc6149c5a73cda33550b96e4, user_id=d2309c371d404aaa8490641f29687773, role_id=8ab9762245ea450baab9152f88b4ed52)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:40.278021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:40.421566 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4089/8114] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:40 2022] PUT /identity/v3/projects/b7c80a62fc6149c5a73cda33550b96e4/users/d2309c371d404aaa8490641f29687773/roles/8ab9762245ea450baab9152f88b4ed52 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:40.427048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:40.438291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc1458-a67d-473e-b38d-274ba96a1827 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:40.505876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f76157-6873-4ca4-a94e-ab0c9bda6a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:40.510157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76157-6873-4ca4-a94e-ab0c9bda6a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:40.510157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76157-6873-4ca4-a94e-ab0c9bda6a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:40.510157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76157-6873-4ca4-a94e-ab0c9bda6a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/b7c80a62fc6149c5a73cda33550b96e4/users/d2309c371d404aaa8490641f29687773/roles/cef635227eb84f6dbe4368e9f0b54909` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:40.510157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f76157-6873-4ca4-a94e-ab0c9bda6a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b7c80a62fc6149c5a73cda33550b96e4, user_id=d2309c371d404aaa8490641f29687773, role_id=cef635227eb84f6dbe4368e9f0b54909)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:40.512740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f76157-6873-4ca4-a94e-ab0c9bda6a2d tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:40.639203 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4026/8115] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:40 2022] PUT /identity/v3/projects/b7c80a62fc6149c5a73cda33550b96e4/users/d2309c371d404aaa8490641f29687773/roles/cef635227eb84f6dbe4368e9f0b54909 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:40.643323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:40.655632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeacb97-5244-454b-9a2c-9fdf70c73c3c tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:40.720230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a93a-d938-480d-8108-c513810ed538 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:40.720959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a93a-d938-480d-8108-c513810ed538 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:40.721266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a93a-d938-480d-8108-c513810ed538 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:40.721551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a93a-d938-480d-8108-c513810ed538 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:40.722333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a93a-d938-480d-8108-c513810ed538 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:40.728002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a93a-d938-480d-8108-c513810ed538 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:40.770302 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4090/8116] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:40 2022] GET /identity/v3/users => generated 8051 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:40.775579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16070b2-2b0b-4110-b4bf-2f80a5040155 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:40.776306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16070b2-2b0b-4110-b4bf-2f80a5040155 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:40.776306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16070b2-2b0b-4110-b4bf-2f80a5040155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:40.845439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d16070b2-2b0b-4110-b4bf-2f80a5040155 None None] MFA Rules not processed for user `d2309c371d404aaa8490641f29687773`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:40.846835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d16070b2-2b0b-4110-b4bf-2f80a5040155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:40.952956 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4027/8117] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:40.962879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719b1fa-dd2e-4d2b-b801-c0f89ce22736 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:40.963232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719b1fa-dd2e-4d2b-b801-c0f89ce22736 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:40.963517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719b1fa-dd2e-4d2b-b801-c0f89ce22736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:40.985062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8719b1fa-dd2e-4d2b-b801-c0f89ce22736 None None] MFA Rules not processed for user `d2309c371d404aaa8490641f29687773`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:40.986351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8719b1fa-dd2e-4d2b-b801-c0f89ce22736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:40.999326 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4091/8118] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:41.003894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16070b2-2b0b-4110-b4bf-2f80a5040155 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.014701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16070b2-2b0b-4110-b4bf-2f80a5040155 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.022030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.023084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.023930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.024281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.025199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:create_trust()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.026746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.206095 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4028/8119] 10.222.0.59 () {60 vars in 1174 bytes} [Sun Aug 28 01:52:41 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:41.218247 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719b1fa-dd2e-4d2b-b801-c0f89ce22736 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.227933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719b1fa-dd2e-4d2b-b801-c0f89ce22736 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.232745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.233392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.233769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.234085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.236482 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:41.241868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:get_trust(trust_id=69b653cb122f415a94e14b2f13789096)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.248047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.260890 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4092/8120] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:41 2022] GET /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096 => generated 833 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:41.263226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.270146 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:41.275100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6241186-ef91-4acd-bbdc-07b494600d01 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.280749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.281673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.281777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.283006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.292590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=69b653cb122f415a94e14b2f13789096)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.296754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.305698 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4029/8121] 10.222.0.59 () {58 vars in 1269 bytes} [Sun Aug 28 01:52:41 2022] GET /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:41.312013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.321959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f5d31-5d00-4095-a1ad-87ee0afb19f6 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.326974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.327620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.327975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.328252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/8ab9762245ea450baab9152f88b4ed52` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.334781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:get_role_for_trust(trust_id=69b653cb122f415a94e14b2f13789096, role_id=8ab9762245ea450baab9152f88b4ed52)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.336757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.343976 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4093/8122] 10.222.0.59 () {58 vars in 1368 bytes} [Sun Aug 28 01:52:41 2022] GET /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/8ab9762245ea450baab9152f88b4ed52 => generated 243 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:41.348939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.359528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc390854-fa60-460a-8dc9-f78feb343abe tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.375071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.375796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.376081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.376409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/8ab9762245ea450baab9152f88b4ed52` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.386867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:get_role_for_trust(trust_id=69b653cb122f415a94e14b2f13789096, role_id=8ab9762245ea450baab9152f88b4ed52)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.388412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.398939 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4030/8123] 10.222.0.59 () {58 vars in 1369 bytes} [Sun Aug 28 01:52:41 2022] HEAD /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/8ab9762245ea450baab9152f88b4ed52 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 01:52:41.413622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.431599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89342af-a1eb-4693-8e5b-6f8289a54556 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.437584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.443451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.443451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.443451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/cef635227eb84f6dbe4368e9f0b54909` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.452335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:get_role_for_trust(trust_id=69b653cb122f415a94e14b2f13789096, role_id=cef635227eb84f6dbe4368e9f0b54909)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.454143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Could not find role: cef635227eb84f6dbe4368e9f0b54909.: keystone.exception.RoleNotFound: Could not find role: cef635227eb84f6dbe4368e9f0b54909. Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 01:52:41.467487 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: cef635227eb84f6dbe4368e9f0b54909. Aug 28 01:52:41.468749 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:52:41.470964 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4094/8124] 10.222.0.59 () {58 vars in 1368 bytes} [Sun Aug 28 01:52:41 2022] GET /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/cef635227eb84f6dbe4368e9f0b54909 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:52:41.474818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.495488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2466e5d-e8fb-4cf8-9e3d-223f7c1cc54c tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.500486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.501225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.501644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.502026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/cef635227eb84f6dbe4368e9f0b54909` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.512333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:get_role_for_trust(trust_id=69b653cb122f415a94e14b2f13789096, role_id=cef635227eb84f6dbe4368e9f0b54909)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.513931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Could not find role: cef635227eb84f6dbe4368e9f0b54909.: keystone.exception.RoleNotFound: Could not find role: cef635227eb84f6dbe4368e9f0b54909. Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 01:52:41.531254 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: cef635227eb84f6dbe4368e9f0b54909. Aug 28 01:52:41.532494 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:41.533745 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4031/8125] 10.222.0.59 () {58 vars in 1369 bytes} [Sun Aug 28 01:52:41 2022] HEAD /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096/roles/cef635227eb84f6dbe4368e9f0b54909 => generated 0 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 01:52:41.537710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.548667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cc822-6f44-4f31-9104-c5b77a1fe57a tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.554126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.554750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.555083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.555405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.569068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorizing `identity:delete_trust(trust_id=69b653cb122f415a94e14b2f13789096)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.570708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:41.710474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '69b653cb122f415a94e14b2f13789096', 'request_id': 'req-c6e630cd-e33a-4e57-abea-b1a3d039df2e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:41.711949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '69b653cb122f415a94e14b2f13789096', 'request_id': 'req-c6e630cd-e33a-4e57-abea-b1a3d039df2e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:41.838759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '69b653cb122f415a94e14b2f13789096', 'request_id': 'req-c6e630cd-e33a-4e57-abea-b1a3d039df2e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:41.849512 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4095/8126] 10.222.0.59 () {58 vars in 1254 bytes} [Sun Aug 28 01:52:41 2022] DELETE /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:41.850598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.852416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:41.868011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794e054-6973-4dbd-a132-ca8898cf76ef tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.874153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2309c371d404aaa8490641f29687773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7c80a62fc6149c5a73cda33550b96e4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-690512858', 'tempest-NotDelegatedRole-428371879'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.874795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.875070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.875342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] PATH_INFO: `/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Could not find trust: 69b653cb122f415a94e14b2f13789096.: keystone.exception.TrustNotFound: Could not find trust: 69b653cb122f415a94e14b2f13789096. Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 01:52:41.885623 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 69b653cb122f415a94e14b2f13789096. Aug 28 01:52:41.887086 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:41.889942 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4032/8127] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:41 2022] GET /identity/v3/OS-TRUST/trusts/69b653cb122f415a94e14b2f13789096 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 01:52:41.892555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:41.894037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:41.918319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e630cd-e33a-4e57-abea-b1a3d039df2e tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:41.918319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:41.922396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:41.922879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:41.923164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/cef635227eb84f6dbe4368e9f0b54909` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:41.924621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cef635227eb84f6dbe4368e9f0b54909)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:41.926289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:42.104349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role cef635227eb84f6dbe4368e9f0b54909 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:42.108992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.108992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.108992 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4096/8128] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:41 2022] DELETE /identity/v3/roles/cef635227eb84f6dbe4368e9f0b54909 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:42.111975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:42.113915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:42.132905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62203166-69a8-408c-815f-d42ab1708c83 tempest-TrustsV3TestJSON-1956796745 tempest-user-115526603] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:42.140059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:42.140059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:42.199621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:42.200360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:42.200626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:42.200905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/8ab9762245ea450baab9152f88b4ed52` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:42.202377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ab9762245ea450baab9152f88b4ed52)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:42.204014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:42.217211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1875-6895-42be-bfbe-b15ab1583137 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:42.221156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:42.221767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:42.222081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:42.222353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:42.224206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:42.275189 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:42.310905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:42.313293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:42.333896 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4097/8129] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:52:42.413988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role 8ab9762245ea450baab9152f88b4ed52 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:42.414290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.414978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.424463 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4033/8130] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:42 2022] DELETE /identity/v3/roles/8ab9762245ea450baab9152f88b4ed52 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:42.425632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:42.437898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a6fd-2806-459f-a484-21cc1652f215 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:42.496770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:42.497503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:42.497861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:42.503187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users/d2309c371d404aaa8490641f29687773` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:42.503187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d2309c371d404aaa8490641f29687773)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:42.503187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:42.650709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2309c371d404aaa8490641f29687773'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.652112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2309c371d404aaa8490641f29687773'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.790355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2309c371d404aaa8490641f29687773'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.799439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2309c371d404aaa8490641f29687773'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.800229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2309c371d404aaa8490641f29687773'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:42.818589 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4098/8131] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:42 2022] DELETE /identity/v3/users/d2309c371d404aaa8490641f29687773 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:42.822925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:42.824551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:42.837885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5515e9-c011-49e8-860b-e42580d8095b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:42.900625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:42.901269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:42.901552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:42.901861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/b7c80a62fc6149c5a73cda33550b96e4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:42.902994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7c80a62fc6149c5a73cda33550b96e4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:42.904893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:42.913320 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:43.148112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c80a62fc6149c5a73cda33550b96e4', 'request_id': 'req-72911e24-0414-4e29-9009-a9b45f64d23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:43.153966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c80a62fc6149c5a73cda33550b96e4', 'request_id': 'req-72911e24-0414-4e29-9009-a9b45f64d23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:43.241499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c80a62fc6149c5a73cda33550b96e4', 'request_id': 'req-72911e24-0414-4e29-9009-a9b45f64d23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:43.254788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] The token cache is being invalidate because project b7c80a62fc6149c5a73cda33550b96e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:43.255084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:43.255791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:43.257422 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4034/8132] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:42 2022] DELETE /identity/v3/projects/b7c80a62fc6149c5a73cda33550b96e4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:43.264863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:43.266300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:43.280290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f51627-e217-45ab-bbd0-f57634b664f0 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:43.330873 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:43.339608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:43.340225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:43.340564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:43.343864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:43.343864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:43.343864 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:43.437007 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4099/8133] 10.222.0.59 () {60 vars in 1152 bytes} [Sun Aug 28 01:52:43 2022] POST /identity/v3/projects => generated 329 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:43.440751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:43.442261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:43.467352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72911e24-0414-4e29-9009-a9b45f64d23e tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:43.550680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:43.551503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:43.551777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:43.552115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:43.552843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:43.554895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:43.668619 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4035/8134] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:43 2022] POST /identity/v3/users => generated 416 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:43.672490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:43.683884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2c65-c28f-4834-baa2-4a736806ece6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:43.694346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:43.694346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:43.694346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:43.694643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:43.694643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:43.694643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:43.799660 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4100/8135] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:43 2022] POST /identity/v3/roles => generated 243 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:43.806471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:43.817109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf7372-de68-44bb-93a2-5480a67e5ef1 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:43.822097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:43.822879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:43.824227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:43.824792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:43.825204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:43.826858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:43.954863 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4036/8136] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:43 2022] POST /identity/v3/roles => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:43.963275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:43.974671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb26b31-6a18-4cd4-8799-675df600331a tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:43.983281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:43.983753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:43.984044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:43.984329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/2de047fcff6f41ceadca2dac123bada6/users/19989231b5a44a93a5363d98e4d15e89/roles/54ee3cb877d64aa6bf5df4745dd5c748` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.001278 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2de047fcff6f41ceadca2dac123bada6, user_id=19989231b5a44a93a5363d98e4d15e89, role_id=54ee3cb877d64aa6bf5df4745dd5c748)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.004069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.150964 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4101/8137] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:43 2022] PUT /identity/v3/projects/2de047fcff6f41ceadca2dac123bada6/users/19989231b5a44a93a5363d98e4d15e89/roles/54ee3cb877d64aa6bf5df4745dd5c748 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:44.158444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.176147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc2163-867f-4090-a7e2-e9454fc9b02b tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.238592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cb98a-435c-4e79-b819-b89c56767b99 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.239284 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb98a-435c-4e79-b819-b89c56767b99 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.239573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb98a-435c-4e79-b819-b89c56767b99 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.239854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cb98a-435c-4e79-b819-b89c56767b99 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/2de047fcff6f41ceadca2dac123bada6/users/19989231b5a44a93a5363d98e4d15e89/roles/89647e9d07f042e89faf7b247be8f882` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.242170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb98a-435c-4e79-b819-b89c56767b99 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2de047fcff6f41ceadca2dac123bada6, user_id=19989231b5a44a93a5363d98e4d15e89, role_id=89647e9d07f042e89faf7b247be8f882)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.245308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cb98a-435c-4e79-b819-b89c56767b99 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.318761 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4037/8138] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:44 2022] PUT /identity/v3/projects/2de047fcff6f41ceadca2dac123bada6/users/19989231b5a44a93a5363d98e4d15e89/roles/89647e9d07f042e89faf7b247be8f882 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:44.327932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.339872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca81aa-4dc9-41d8-9424-d52c567493d9 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.400101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed46e6-ce6c-421b-a954-00a94e68efb7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.400717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed46e6-ce6c-421b-a954-00a94e68efb7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.401004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed46e6-ce6c-421b-a954-00a94e68efb7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.401794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed46e6-ce6c-421b-a954-00a94e68efb7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.403884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed46e6-ce6c-421b-a954-00a94e68efb7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.404376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed46e6-ce6c-421b-a954-00a94e68efb7 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.440701 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4102/8139] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:44 2022] GET /identity/v3/users => generated 8054 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:44.445420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75fb1b-776d-4d26-808f-e3b48af59a9d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.445714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75fb1b-776d-4d26-808f-e3b48af59a9d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.446033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75fb1b-776d-4d26-808f-e3b48af59a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.454280 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:44.488416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bc75fb1b-776d-4d26-808f-e3b48af59a9d None None] MFA Rules not processed for user `19989231b5a44a93a5363d98e4d15e89`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:44.489631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bc75fb1b-776d-4d26-808f-e3b48af59a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:44.562914 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4038/8140] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:44 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:52:44.572431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044099-2bf5-432a-85d4-63cea4d831e6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.572731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044099-2bf5-432a-85d4-63cea4d831e6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.580582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1044099-2bf5-432a-85d4-63cea4d831e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.594795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f1044099-2bf5-432a-85d4-63cea4d831e6 None None] MFA Rules not processed for user `19989231b5a44a93a5363d98e4d15e89`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:44.597652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1044099-2bf5-432a-85d4-63cea4d831e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:44.610424 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4103/8141] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:44 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:44.611446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75fb1b-776d-4d26-808f-e3b48af59a9d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.625962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75fb1b-776d-4d26-808f-e3b48af59a9d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.630947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.631900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.632504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.632842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.633835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:create_trust()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.635219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.789833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4039/8142] 10.222.0.59 () {60 vars in 1174 bytes} [Sun Aug 28 01:52:44 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:44.790034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1044099-2bf5-432a-85d4-63cea4d831e6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.793727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1044099-2bf5-432a-85d4-63cea4d831e6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.798817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.799463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.799774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.800335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.806688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:get_trust(trust_id=e6d3c9de128944b2b70c87ab7bf8f0a6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.808273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.815750 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4104/8143] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:44 2022] GET /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6 => generated 834 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:44.819925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.831151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34be2-51d6-4e90-ba49-14d6b96f5a50 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.835655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.836480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.836480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.837845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.844486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e6d3c9de128944b2b70c87ab7bf8f0a6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.846374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.854060 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4040/8144] 10.222.0.59 () {58 vars in 1269 bytes} [Sun Aug 28 01:52:44 2022] GET /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles => generated 370 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:44.858369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.868091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433554c-2409-40ff-8f7c-55713dffed3e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.872902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.873581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.873964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.874936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/54ee3cb877d64aa6bf5df4745dd5c748` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.880823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e6d3c9de128944b2b70c87ab7bf8f0a6, role_id=54ee3cb877d64aa6bf5df4745dd5c748)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.882322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.890039 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4105/8145] 10.222.0.59 () {58 vars in 1368 bytes} [Sun Aug 28 01:52:44 2022] GET /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/54ee3cb877d64aa6bf5df4745dd5c748 => generated 243 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:44.894631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.904307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc2bd6-fab6-412d-95af-a5fa9c3f6ee1 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.908949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.909592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.909912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.910193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/54ee3cb877d64aa6bf5df4745dd5c748` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.916328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e6d3c9de128944b2b70c87ab7bf8f0a6, role_id=54ee3cb877d64aa6bf5df4745dd5c748)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.917854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.927986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4041/8146] 10.222.0.59 () {58 vars in 1369 bytes} [Sun Aug 28 01:52:44 2022] HEAD /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/54ee3cb877d64aa6bf5df4745dd5c748 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 01:52:44.929203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.940343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340182-cde2-4351-9e68-ce3434ff731e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.944658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.945387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.945748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.946119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/89647e9d07f042e89faf7b247be8f882` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.953556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e6d3c9de128944b2b70c87ab7bf8f0a6, role_id=89647e9d07f042e89faf7b247be8f882)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.955145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Could not find role: 89647e9d07f042e89faf7b247be8f882.: keystone.exception.RoleNotFound: Could not find role: 89647e9d07f042e89faf7b247be8f882. Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 01:52:44.966580 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 89647e9d07f042e89faf7b247be8f882. Aug 28 01:52:44.967719 n-d-master-1 devstack@keystone.service[82007]: ERROR keystone.server.flask.application Aug 28 01:52:44.971066 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4106/8147] 10.222.0.59 () {58 vars in 1368 bytes} [Sun Aug 28 01:52:44 2022] GET /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/89647e9d07f042e89faf7b247be8f882 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:52:44.972879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:44.985067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121afd5-853b-47d5-8f95-0d27456ff21e tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:44.990311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:44.990951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `HEAD` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:44.991232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:44.991512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/89647e9d07f042e89faf7b247be8f882` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:44.998115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e6d3c9de128944b2b70c87ab7bf8f0a6, role_id=89647e9d07f042e89faf7b247be8f882)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:44.999535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Could not find role: 89647e9d07f042e89faf7b247be8f882.: keystone.exception.RoleNotFound: Could not find role: 89647e9d07f042e89faf7b247be8f882. Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 01:52:45.009774 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 89647e9d07f042e89faf7b247be8f882. Aug 28 01:52:45.011955 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:45.012260 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4042/8148] 10.222.0.59 () {58 vars in 1369 bytes} [Sun Aug 28 01:52:44 2022] HEAD /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6/roles/89647e9d07f042e89faf7b247be8f882 => generated 0 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 01:52:45.015785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:45.027441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004510e-3e7f-4167-b450-e2504c6c3ca4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:45.031627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:45.032246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:45.032521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:45.033206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:45.040432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorizing `identity:delete_trust(trust_id=e6d3c9de128944b2b70c87ab7bf8f0a6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:45.042073 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:45.121734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e6d3c9de128944b2b70c87ab7bf8f0a6', 'request_id': 'req-89494bc0-684e-4d20-87d5-e086ac4e0373'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:45.122648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e6d3c9de128944b2b70c87ab7bf8f0a6', 'request_id': 'req-89494bc0-684e-4d20-87d5-e086ac4e0373'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:45.227231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e6d3c9de128944b2b70c87ab7bf8f0a6', 'request_id': 'req-89494bc0-684e-4d20-87d5-e086ac4e0373'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:45.230288 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:45.240569 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4107/8149] 10.222.0.59 () {58 vars in 1254 bytes} [Sun Aug 28 01:52:45 2022] DELETE /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:45.246292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:45.249346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:45.275273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f6549-b958-4d42-9e6c-e72540f00832 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:45.277967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19989231b5a44a93a5363d98e4d15e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2de047fcff6f41ceadca2dac123bada6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549051502', 'tempest-NotDelegatedRole-218023377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:45.278610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:45.278919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:45.279238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] PATH_INFO: `/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Could not find trust: e6d3c9de128944b2b70c87ab7bf8f0a6.: keystone.exception.TrustNotFound: Could not find trust: e6d3c9de128944b2b70c87ab7bf8f0a6. Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 01:52:45.292373 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e6d3c9de128944b2b70c87ab7bf8f0a6. Aug 28 01:52:45.294042 n-d-master-1 devstack@keystone.service[82006]: ERROR keystone.server.flask.application Aug 28 01:52:45.295873 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4043/8150] 10.222.0.59 () {58 vars in 1251 bytes} [Sun Aug 28 01:52:45 2022] GET /identity/v3/OS-TRUST/trusts/e6d3c9de128944b2b70c87ab7bf8f0a6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 01:52:45.297653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:45.304345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:45.337117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494bc0-684e-4d20-87d5-e086ac4e0373 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:45.357591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:45.358437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:45.358756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:45.359590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/89647e9d07f042e89faf7b247be8f882` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:45.361622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=89647e9d07f042e89faf7b247be8f882)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:45.363432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:45.572552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role 89647e9d07f042e89faf7b247be8f882 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:45.574942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:45.575842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:45.581316 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4108/8151] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:45 2022] DELETE /identity/v3/roles/89647e9d07f042e89faf7b247be8f882 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:45.583171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:45.585845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:45.608632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ce80-1771-4590-adf1-96ff2b6fd7d4 tempest-TrustsV3TestJSON-1819053651 tempest-user-2033586842] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:45.630597 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:45.686978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:45.687888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:45.688325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:45.688756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/roles/54ee3cb877d64aa6bf5df4745dd5c748` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:45.690356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_role(role_id=54ee3cb877d64aa6bf5df4745dd5c748)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:45.692271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:45.897959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invalidating the token cache because role 54ee3cb877d64aa6bf5df4745dd5c748 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:45.899078 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:45.899981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:45.906272 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4044/8152] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:45 2022] DELETE /identity/v3/roles/54ee3cb877d64aa6bf5df4745dd5c748 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:45.908037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:45.920064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd2fad-9ccb-47c0-8321-47948f0bc787 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:46.037579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:46.038304 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:46.038782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:46.039062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/users/19989231b5a44a93a5363d98e4d15e89` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:46.040289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_user(user_id=19989231b5a44a93a5363d98e4d15e89)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:46.043290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:46.172228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19989231b5a44a93a5363d98e4d15e89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.172909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19989231b5a44a93a5363d98e4d15e89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.254477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19989231b5a44a93a5363d98e4d15e89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.274529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19989231b5a44a93a5363d98e4d15e89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.279458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19989231b5a44a93a5363d98e4d15e89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.315935 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4109/8153] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:45 2022] DELETE /identity/v3/users/19989231b5a44a93a5363d98e4d15e89 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:46.319840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:46.321251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:46.355820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c3514-d228-4a88-a57c-38d995c69951 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:46.435009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c66c658195ea4226b4fe534393b035cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ec9528689f64da2b382e62849f61e42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:46.435663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:46.435950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:46.436455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] PATH_INFO: `/v3/projects/2de047fcff6f41ceadca2dac123bada6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:46.437593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2de047fcff6f41ceadca2dac123bada6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:46.439534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:46.718028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de047fcff6f41ceadca2dac123bada6', 'request_id': 'req-46f98e14-c730-4b3a-b35c-a11dde8ea389'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.724776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de047fcff6f41ceadca2dac123bada6', 'request_id': 'req-46f98e14-c730-4b3a-b35c-a11dde8ea389'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.820961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de047fcff6f41ceadca2dac123bada6', 'request_id': 'req-46f98e14-c730-4b3a-b35c-a11dde8ea389'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.833454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] The token cache is being invalidate because project 2de047fcff6f41ceadca2dac123bada6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:46.833754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.834461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46f98e14-c730-4b3a-b35c-a11dde8ea389 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:46.835943 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4045/8154] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:46 2022] DELETE /identity/v3/projects/2de047fcff6f41ceadca2dac123bada6 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:46.843137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:46.844545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:46.887881 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:46.919569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc031e-baa4-473c-8114-69309992ade6 tempest-TrustsV3TestJSON-183964917 tempest-TrustsV3TestJSON-183964917-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:46.982175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:46.983034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:46.983514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:46.983797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] PATH_INFO: `/v3/users/9c39344e02b148a9a43010b31cb87067` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:46.984951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c39344e02b148a9a43010b31cb87067)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:46.987071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:47.217452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c39344e02b148a9a43010b31cb87067'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:47.218244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c39344e02b148a9a43010b31cb87067'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:47.289667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c39344e02b148a9a43010b31cb87067'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:47.299056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c39344e02b148a9a43010b31cb87067'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:47.299905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c39344e02b148a9a43010b31cb87067'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:47.323953 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4110/8155] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:46 2022] DELETE /identity/v3/users/9c39344e02b148a9a43010b31cb87067 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:47.325983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:47.326454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:47.326643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:47.353696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:47.355224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:47.359446 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:47.433498 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4046/8156] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:47.443921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:47.445362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:47.532855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef016a-1392-47c5-9971-a2acf1810d8f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:47.542593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:47.543550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:47.543998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:47.544435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:47.558128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:47.560428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:47.591045 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4111/8157] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:48.120459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:48.124386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:48.155546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81b2f7-d1ad-40ad-be9b-487ef56452d0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:48.160912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:48.161684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:48.162143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:48.162532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] PATH_INFO: `/v3/projects/5c595b43f17c42879bcf8c0eaad1847f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:48.163739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c595b43f17c42879bcf8c0eaad1847f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:48.166075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:48.280309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c595b43f17c42879bcf8c0eaad1847f', 'request_id': 'req-51f817c2-b28e-4098-a6e8-630e6c52cc4d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.289240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c595b43f17c42879bcf8c0eaad1847f', 'request_id': 'req-51f817c2-b28e-4098-a6e8-630e6c52cc4d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.356288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c595b43f17c42879bcf8c0eaad1847f', 'request_id': 'req-51f817c2-b28e-4098-a6e8-630e6c52cc4d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.369444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] The token cache is being invalidate because project 5c595b43f17c42879bcf8c0eaad1847f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:48.369736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.370602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.372583 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4047/8158] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:48 2022] DELETE /identity/v3/projects/5c595b43f17c42879bcf8c0eaad1847f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:48.376349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:48.384649 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:48.392843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceada414-902d-4d64-96cd-ec241078241f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:48.486145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:48.486824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:48.487224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:48.487506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] PATH_INFO: `/v3/users/c66c658195ea4226b4fe534393b035cf` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:48.488662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66c658195ea4226b4fe534393b035cf)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:48.492106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:48.648862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66c658195ea4226b4fe534393b035cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.649534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66c658195ea4226b4fe534393b035cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.695575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66c658195ea4226b4fe534393b035cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.704665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66c658195ea4226b4fe534393b035cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.706463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-641ccb3f-03ce-4366-815a-63d73b1d2dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66c658195ea4226b4fe534393b035cf'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:48.733953 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4112/8159] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:48 2022] DELETE /identity/v3/users/c66c658195ea4226b4fe534393b035cf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:49.249100 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:49.250593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:49.265506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f817c2-b28e-4098-a6e8-630e6c52cc4d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:49.332243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:49.332907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:49.333191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:49.333522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] PATH_INFO: `/v3/projects/1ec9528689f64da2b382e62849f61e42` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:49.334774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec9528689f64da2b382e62849f61e42)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:49.336713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:49.470633 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:49.480630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec9528689f64da2b382e62849f61e42', 'request_id': 'req-8ed1907a-6a27-4961-9186-e322a5f6f069'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:49.486479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec9528689f64da2b382e62849f61e42', 'request_id': 'req-8ed1907a-6a27-4961-9186-e322a5f6f069'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:49.584056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec9528689f64da2b382e62849f61e42', 'request_id': 'req-8ed1907a-6a27-4961-9186-e322a5f6f069'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:49.607086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] The token cache is being invalidate because project 1ec9528689f64da2b382e62849f61e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:49.607400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:49.608171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8ed1907a-6a27-4961-9186-e322a5f6f069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:49.613251 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4048/8160] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:49 2022] DELETE /identity/v3/projects/1ec9528689f64da2b382e62849f61e42 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:49.614622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2e31-e6b9-4a7c-8680-0e9fb4cbb45d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:49.619925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2e31-e6b9-4a7c-8680-0e9fb4cbb45d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:49.619925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2e31-e6b9-4a7c-8680-0e9fb4cbb45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:49.653071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-543e2e31-e6b9-4a7c-8680-0e9fb4cbb45d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:49.655123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-543e2e31-e6b9-4a7c-8680-0e9fb4cbb45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:49.747981 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4113/8161] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:49.748527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13b2a7-4a39-4139-8b99-0ae297384a96 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:49.748814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13b2a7-4a39-4139-8b99-0ae297384a96 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:49.749088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13b2a7-4a39-4139-8b99-0ae297384a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:49.773602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8b13b2a7-4a39-4139-8b99-0ae297384a96 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:49.774870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8b13b2a7-4a39-4139-8b99-0ae297384a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:49.787950 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4049/8162] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:49.789434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2e31-e6b9-4a7c-8680-0e9fb4cbb45d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:49.802599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2e31-e6b9-4a7c-8680-0e9fb4cbb45d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:49.808921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:49.809894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:49.810614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:49.811273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:49.812483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:52:49.813037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:49.815137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:49.833647 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4114/8163] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:49.837771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13b2a7-4a39-4139-8b99-0ae297384a96 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:49.848291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13b2a7-4a39-4139-8b99-0ae297384a96 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:49.853267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:49.853943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:49.858904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:49.858904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:49.858904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:49.858904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:49.938614 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4050/8164] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:49 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:49.942687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:49.954035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085578e6-ea75-498b-8164-665c0b4b5fee admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:49.965651 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:50.039318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:50.039934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.040219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.040494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.041138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:50.044191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:50.158265 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4115/8165] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:49 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:50.159881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:50.173514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039cd67-a462-4f4a-8663-68e1006a4f31 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:50.186980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:50.187649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.187936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.188243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.188906 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:50.190852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:50.206282 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4051/8166] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:50.207474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:50.219630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728527d-fa0b-4c49-8505-3e60fd4a29be admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:50.224747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21640e-fa85-4bab-b18c-7e3bb75a1b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:50.225359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21640e-fa85-4bab-b18c-7e3bb75a1b85 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.225642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21640e-fa85-4bab-b18c-7e3bb75a1b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.225947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21640e-fa85-4bab-b18c-7e3bb75a1b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.231542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21640e-fa85-4bab-b18c-7e3bb75a1b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:50.231542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21640e-fa85-4bab-b18c-7e3bb75a1b85 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:50.242486 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4116/8167] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:50.247160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:50.257976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57628a-c7fd-4197-bc5d-ee03148bc812 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:50.262109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:50.262898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.263247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.263590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] PATH_INFO: `/v3/projects/86d92b9f4ed34e26bcbbea93977b32f3/users/2f45311a78cb4cfb8703352e5e60fd63/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.285613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d92b9f4ed34e26bcbbea93977b32f3, user_id=2f45311a78cb4cfb8703352e5e60fd63, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:50.303569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:50.385373 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4052/8168] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:50 2022] PUT /identity/v3/projects/86d92b9f4ed34e26bcbbea93977b32f3/users/2f45311a78cb4cfb8703352e5e60fd63/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:50.395850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b2a57-165b-4420-a3f8-12baead73781 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.396143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b2a57-165b-4420-a3f8-12baead73781 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.396457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b2a57-165b-4420-a3f8-12baead73781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.438217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-606b2a57-165b-4420-a3f8-12baead73781 None None] MFA Rules not processed for user `2f45311a78cb4cfb8703352e5e60fd63`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:50.438217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-606b2a57-165b-4420-a3f8-12baead73781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:50.522616 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4117/8169] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:50.527701 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:50.624184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836688f-4fa6-419a-b29f-4afe1c826f3a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:50.629769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:50.630829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.631251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.631590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.632362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:50.635330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:50.738125 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4053/8170] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:50 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:50.738941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b2a57-165b-4420-a3f8-12baead73781 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:50.759118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b2a57-165b-4420-a3f8-12baead73781 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:50.835488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:50.836240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.836519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.836798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.838007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:50.840408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:50.957119 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4118/8171] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:50 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:50.958394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:50.969862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784553b7-cd2d-4f2a-bac9-860425e30da2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:50.974822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:50.975611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:50.975963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:50.976343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:50.977059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:50.979990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.011572 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4054/8172] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:51.015846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:51.026533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4a7b-86d0-4e53-8b04-166a54b95021 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:51.031220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:51.031881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.032352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.032934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] PATH_INFO: `/v3/projects/c7773e58569449b9871658d93dbed5ce/users/ee2751874a3c4a83aa28853cbc9cc887/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.036372 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:51.049232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7773e58569449b9871658d93dbed5ce, user_id=ee2751874a3c4a83aa28853cbc9cc887, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:51.051973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.131822 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4119/8173] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:51 2022] PUT /identity/v3/projects/c7773e58569449b9871658d93dbed5ce/users/ee2751874a3c4a83aa28853cbc9cc887/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:51.135789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:51.146874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0e3a-f222-4b5d-9c94-107a1099d9e9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:51.181007 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:51.207534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa865ea-3f67-4903-8d52-0d0380188bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:51.208259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa865ea-3f67-4903-8d52-0d0380188bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.208613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa865ea-3f67-4903-8d52-0d0380188bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.209093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa865ea-3f67-4903-8d52-0d0380188bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.209844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa865ea-3f67-4903-8d52-0d0380188bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:51.211564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa865ea-3f67-4903-8d52-0d0380188bf9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.223801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4055/8174] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:52:51.227760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:51.239490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651d8f2-1f82-4616-9cd7-01b6e5ba6578 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:51.245265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:51.246423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.246952 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.247456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] PATH_INFO: `/v3/projects/c7773e58569449b9871658d93dbed5ce/users/ee2751874a3c4a83aa28853cbc9cc887/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.249832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7773e58569449b9871658d93dbed5ce, user_id=ee2751874a3c4a83aa28853cbc9cc887, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:51.253339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.276056 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4120/8175] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:51 2022] PUT /identity/v3/projects/c7773e58569449b9871658d93dbed5ce/users/ee2751874a3c4a83aa28853cbc9cc887/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:51.277952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8ecc-8137-4085-8c58-ee8430c52548 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.278253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8ecc-8137-4085-8c58-ee8430c52548 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.278537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8ecc-8137-4085-8c58-ee8430c52548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.314997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-064e8ecc-8137-4085-8c58-ee8430c52548 None None] MFA Rules not processed for user `ee2751874a3c4a83aa28853cbc9cc887`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:51.316298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-064e8ecc-8137-4085-8c58-ee8430c52548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:51.423611 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4056/8176] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:51.429049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:51.446951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911fa62-9fc6-451b-839c-c4a005d53a24 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:51.457825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:51.458538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.458770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.459054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.459690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:51.461534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.591171 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4121/8177] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:51 2022] POST /identity/v3/projects => generated 358 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:51.595611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e8ecc-8137-4085-8c58-ee8430c52548 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:51.608034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e8ecc-8137-4085-8c58-ee8430c52548 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:51.705489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:51.706450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.706745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.707026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.707680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:51.709943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.801254 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4057/8178] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:51 2022] POST /identity/v3/users => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:51.806161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:51.819855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4599be7-37fd-4a23-966d-cfe3f3f45ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:51.829602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:51.829602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.829602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.830066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/7360f38c23c64a5d91fe7107ca6cd680` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.846863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:get_user(user_id=7360f38c23c64a5d91fe7107ca6cd680)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:51.849070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.850851 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4122/8179] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:52:51 2022] GET /identity/v3/users/7360f38c23c64a5d91fe7107ca6cd680 => generated 373 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:51.855836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:51.866727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7a9a-538e-473d-bf77-baec68f020fe tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:51.871651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:51.873625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:51.873625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:51.873625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/7360f38c23c64a5d91fe7107ca6cd680` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:51.874125 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7360f38c23c64a5d91fe7107ca6cd680)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:51.876241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:51.983313 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:51.995914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7360f38c23c64a5d91fe7107ca6cd680'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.014590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7360f38c23c64a5d91fe7107ca6cd680'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.023052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7360f38c23c64a5d91fe7107ca6cd680'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.024133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7360f38c23c64a5d91fe7107ca6cd680'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.097408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7360f38c23c64a5d91fe7107ca6cd680'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.103859 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4058/8180] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:51 2022] DELETE /identity/v3/users/7360f38c23c64a5d91fe7107ca6cd680 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:52.106496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:52.108285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:52.122229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceeaa45-60bf-43a2-b011-4eaa3be6cc77 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:52.185874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:52.186525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:52.186809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:52.187087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/fe6241b747824950839363f1a6b3bb8e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:52.188260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fe6241b747824950839363f1a6b3bb8e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:52.190264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:52.325154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6241b747824950839363f1a6b3bb8e', 'request_id': 'req-678a7bc9-b55d-42a2-9a37-12fa446cd388'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.331574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6241b747824950839363f1a6b3bb8e', 'request_id': 'req-678a7bc9-b55d-42a2-9a37-12fa446cd388'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.409770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6241b747824950839363f1a6b3bb8e', 'request_id': 'req-678a7bc9-b55d-42a2-9a37-12fa446cd388'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.424173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] The token cache is being invalidate because project fe6241b747824950839363f1a6b3bb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:52.424579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.425288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:52.426947 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4123/8181] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:52 2022] DELETE /identity/v3/projects/fe6241b747824950839363f1a6b3bb8e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:52.431950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:52.443568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429e1c-fde7-465e-8694-3f6680a6711e tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:52.507223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:52.507847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:52.508166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:52.508446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:52.509079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:52.511884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:52.586695 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4059/8182] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:52 2022] POST /identity/v3/projects => generated 360 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:52.590976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:52.592409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:52.605900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a7bc9-b55d-42a2-9a37-12fa446cd388 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:52.627696 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:52.667167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:52.667764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:52.668050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:52.668322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:52.669009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:52.670999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:52.771116 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4124/8183] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:52 2022] POST /identity/v3/users => generated 417 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:52.777132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:52.794242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7965f4-d2c4-4982-b47a-faf4b9a8bc23 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:52.800062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:52.800970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:52.801270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:52.801596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:52.802299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:52.804219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:52.868124 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4060/8184] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:52 2022] POST /identity/v3/roles => generated 240 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:52.873229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:52.885539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31246-19ba-4ca0-8dcf-075334680eec tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:52.890721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:52.891584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:52.892214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:52.892649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2203f632513c41828d8776377861d498` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:52.915159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:get_user(user_id=2203f632513c41828d8776377861d498)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:52.919472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:52.922579 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4125/8185] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:52:52 2022] GET /identity/v3/users/2203f632513c41828d8776377861d498 => generated 417 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:52:52.926838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:52.941388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5fc5d-e922-4c5f-9b50-9fdb0d9bc0e7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:52.946486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:52.947323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:52.947445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:52.947668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/roles/ff64225eee59490a8e500d0c1a0978ea` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:52.949918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:get_role(role_id=ff64225eee59490a8e500d0c1a0978ea)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:52.951130 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:52:52.951130 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:52:52.951130 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:52:52.952028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:52.953461 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4061/8186] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:52:52 2022] GET /identity/v3/roles/ff64225eee59490a8e500d0c1a0978ea => generated 240 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:52.962492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:52.974239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140add9c-0b53-4b69-9659-421c91e5bd40 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:52.985022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:52.985954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:52.986505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:52.986999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:52.987874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:52.990429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.091107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4126/8187] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:52 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:53.096673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.109438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544611e7-5442-4331-83ff-d970b4182125 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.188619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.189187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.189477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.189760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/bd5c79a1650e4016a00152c489a195a0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.191037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd5c79a1650e4016a00152c489a195a0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.193458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.195539 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4062/8188] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:52:53 2022] GET /identity/v3/projects/bd5c79a1650e4016a00152c489a195a0 => generated 359 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:53.200713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.212071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f090-8035-4c97-8550-d364fcc2d0a5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.217148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.217838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.218143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.218419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/bd5c79a1650e4016a00152c489a195a0/users/2203f632513c41828d8776377861d498/roles/ff64225eee59490a8e500d0c1a0978ea` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.220671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd5c79a1650e4016a00152c489a195a0, user_id=2203f632513c41828d8776377861d498, role_id=ff64225eee59490a8e500d0c1a0978ea)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.223622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.336032 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4127/8189] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:53 2022] PUT /identity/v3/projects/bd5c79a1650e4016a00152c489a195a0/users/2203f632513c41828d8776377861d498/roles/ff64225eee59490a8e500d0c1a0978ea => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:53.345805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.356583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788f51-364a-4d7e-9a42-531cc709cf10 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.393481 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:53.428086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.428702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.428986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.429261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.429921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.431800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.509925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.513091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:53.562533 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4063/8190] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:53 2022] POST /identity/v3/projects => generated 359 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:53.569744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.621804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e1b64-615a-49e4-b19b-1c04227ea7d1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.645574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cbfe2-beea-4edf-ad2e-093564312ed1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.654786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.655480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.655765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.656042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/e33a4ca3d0b54c4ba82d7ad5e540ea30` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.658683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:get_project(project_id=e33a4ca3d0b54c4ba82d7ad5e540ea30)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.661961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.665496 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4064/8191] 10.222.0.59 () {58 vars in 1230 bytes} [Sun Aug 28 01:52:53 2022] GET /identity/v3/projects/e33a4ca3d0b54c4ba82d7ad5e540ea30 => generated 359 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:53.670052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.687045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0adf44-12c4-4d5f-9a4e-3a1cc2b7881c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.692405 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:53.695742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.696900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.697446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.697977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/e33a4ca3d0b54c4ba82d7ad5e540ea30/users/2203f632513c41828d8776377861d498/roles/ff64225eee59490a8e500d0c1a0978ea` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.702047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e33a4ca3d0b54c4ba82d7ad5e540ea30, user_id=2203f632513c41828d8776377861d498, role_id=ff64225eee59490a8e500d0c1a0978ea)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.702931 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.703825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.703961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.704160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.706618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:53.709604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.786668 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4065/8192] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:52:53 2022] PUT /identity/v3/projects/e33a4ca3d0b54c4ba82d7ad5e540ea30/users/2203f632513c41828d8776377861d498/roles/ff64225eee59490a8e500d0c1a0978ea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:53.799757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.799908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.799908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.805827 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4128/8193] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:52:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:52:53.871186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187c58-708d-4535-90a5-6d797cc3ae1c tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.877068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.877857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.878588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.878936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2203f632513c41828d8776377861d498/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.880229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=2203f632513c41828d8776377861d498)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.883337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:53.953660 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4066/8194] 10.222.0.59 () {58 vars in 1248 bytes} [Sun Aug 28 01:52:53 2022] GET /identity/v3/users/2203f632513c41828d8776377861d498/projects => generated 842 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:53.954348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:53.966070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194616da-2df1-4398-bd99-06ecb537d4a8 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:53.971053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:53.972018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:53.972636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:53.973013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/e33a4ca3d0b54c4ba82d7ad5e540ea30` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:53.974926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e33a4ca3d0b54c4ba82d7ad5e540ea30)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:53.977130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:54.206202 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33a4ca3d0b54c4ba82d7ad5e540ea30', 'request_id': 'req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.214823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33a4ca3d0b54c4ba82d7ad5e540ea30', 'request_id': 'req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.284302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33a4ca3d0b54c4ba82d7ad5e540ea30', 'request_id': 'req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.301914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] The token cache is being invalidate because project e33a4ca3d0b54c4ba82d7ad5e540ea30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:54.302490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.303248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.306649 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4129/8195] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:53 2022] DELETE /identity/v3/projects/e33a4ca3d0b54c4ba82d7ad5e540ea30 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:52:54.309634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:54.311861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:54.339544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853c680-2289-49d7-9413-6677eb565cf1 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:54.356993 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:54.430491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:54.431430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:54.431802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:54.432394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/bd5c79a1650e4016a00152c489a195a0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:54.433718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd5c79a1650e4016a00152c489a195a0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:54.435812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:54.678336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5c79a1650e4016a00152c489a195a0', 'request_id': 'req-c17447ae-fd15-417a-bcaa-ad01b585f3b2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.686345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5c79a1650e4016a00152c489a195a0', 'request_id': 'req-c17447ae-fd15-417a-bcaa-ad01b585f3b2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.774363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5c79a1650e4016a00152c489a195a0', 'request_id': 'req-c17447ae-fd15-417a-bcaa-ad01b585f3b2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.811855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] The token cache is being invalidate because project bd5c79a1650e4016a00152c489a195a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:54.812530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.814527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:54.817419 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4067/8196] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:54 2022] DELETE /identity/v3/projects/bd5c79a1650e4016a00152c489a195a0 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:54.821313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:54.835372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d96fa-04ce-4be9-a24f-a726483a0dd5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:54.911543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:54.912261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:54.912594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:54.912880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/roles/ff64225eee59490a8e500d0c1a0978ea` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:54.914416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ff64225eee59490a8e500d0c1a0978ea)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:54.917284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:54.940416 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:55.015522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invalidating the token cache because role ff64225eee59490a8e500d0c1a0978ea has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:55.016178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.016508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.018342 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4130/8197] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:54 2022] DELETE /identity/v3/roles/ff64225eee59490a8e500d0c1a0978ea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:55.022619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:55.024124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:55.063464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17447ae-fd15-417a-bcaa-ad01b585f3b2 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:55.169179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:55.170503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:55.170943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:55.171396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2203f632513c41828d8776377861d498` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:55.172907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2203f632513c41828d8776377861d498)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:55.175261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:55.295003 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:55.299193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2203f632513c41828d8776377861d498'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.314233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2203f632513c41828d8776377861d498'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.325958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2203f632513c41828d8776377861d498'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.326570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2203f632513c41828d8776377861d498'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.395593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2203f632513c41828d8776377861d498'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.405865 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4068/8198] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:55 2022] DELETE /identity/v3/users/2203f632513c41828d8776377861d498 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:55.411145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:55.414386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:55.432594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e9c65-dc27-4037-892d-d200f883dfaa tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:55.547461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:55.548045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:55.548332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:55.549302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/5349eba5397c482d815a6af80bd143af` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:55.550826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5349eba5397c482d815a6af80bd143af)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:55.552679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:55.681029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5349eba5397c482d815a6af80bd143af', 'request_id': 'req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.689425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5349eba5397c482d815a6af80bd143af', 'request_id': 'req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.742337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5349eba5397c482d815a6af80bd143af', 'request_id': 'req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.755280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] The token cache is being invalidate because project 5349eba5397c482d815a6af80bd143af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:55.755579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.756260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-897a3f53-09f0-4914-bcf5-bdf5a788d7bd tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:55.757745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4131/8199] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:55 2022] DELETE /identity/v3/projects/5349eba5397c482d815a6af80bd143af => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:55.764286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:55.765777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:55.780863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333c2b5-e55d-486f-b2cc-05e4c7af0239 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:55.856380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:55.857063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:55.857324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:55.857602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2f45311a78cb4cfb8703352e5e60fd63` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:55.858867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f45311a78cb4cfb8703352e5e60fd63)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:55.859882 n-d-master-1 devstack@keystone.service[82006]: WARNING py.warnings [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 01:52:55.859882 n-d-master-1 devstack@keystone.service[82006]: warnings.warn(msg) Aug 28 01:52:55.859882 n-d-master-1 devstack@keystone.service[82006]: Aug 28 01:52:55.861096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:55.986708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.112507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invalidating the token cache because user 2f45311a78cb4cfb8703352e5e60fd63 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:56.116106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.116106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.116106 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4069/8200] 10.222.0.59 () {60 vars in 1243 bytes} [Sun Aug 28 01:52:55 2022] PATCH /identity/v3/users/2f45311a78cb4cfb8703352e5e60fd63 => generated 296 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:56.120537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9e0d-18cf-4c59-9687-7da1bd70a212 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:56.121229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9e0d-18cf-4c59-9687-7da1bd70a212 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:56.121229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9e0d-18cf-4c59-9687-7da1bd70a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:56.162289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bb9a9e0d-18cf-4c59-9687-7da1bd70a212 None None] MFA Rules not processed for user `2f45311a78cb4cfb8703352e5e60fd63`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:56.163731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bb9a9e0d-18cf-4c59-9687-7da1bd70a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:56.168084 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4132/8201] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:56 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:52:56.171966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:56.173757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:56.187884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec0360-6fab-4ad5-b9d3-c7ee92ba50c9 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:56.192884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:56.193693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:56.194066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:56.194412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2f45311a78cb4cfb8703352e5e60fd63` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:56.195708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f45311a78cb4cfb8703352e5e60fd63)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:56.197803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:56.300259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.379358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invalidating the token cache because user 2f45311a78cb4cfb8703352e5e60fd63 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:56.379674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.380731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d670a4f4-5620-4659-b180-be3e8257ea01 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.386269 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4070/8202] 10.222.0.59 () {60 vars in 1243 bytes} [Sun Aug 28 01:52:56 2022] PATCH /identity/v3/users/2f45311a78cb4cfb8703352e5e60fd63 => generated 296 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:56.387546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9e0d-18cf-4c59-9687-7da1bd70a212 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:56.409244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9e0d-18cf-4c59-9687-7da1bd70a212 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:56.414873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:56.415606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:56.416653 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:56.417019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2f45311a78cb4cfb8703352e5e60fd63` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:56.445910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f45311a78cb4cfb8703352e5e60fd63)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:56.449239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:56.595663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.678094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invalidating the token cache because user 2f45311a78cb4cfb8703352e5e60fd63 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:56.679156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.680157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:56.687471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4133/8203] 10.222.0.59 () {60 vars in 1243 bytes} [Sun Aug 28 01:52:56 2022] PATCH /identity/v3/users/2f45311a78cb4cfb8703352e5e60fd63 => generated 296 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:56.693083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f22bec-6b89-4cc5-811a-8b201abed785 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:56.693083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f22bec-6b89-4cc5-811a-8b201abed785 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:56.693083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f22bec-6b89-4cc5-811a-8b201abed785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:56.749616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-51f22bec-6b89-4cc5-811a-8b201abed785 None None] MFA Rules not processed for user `2f45311a78cb4cfb8703352e5e60fd63`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:56.751725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-51f22bec-6b89-4cc5-811a-8b201abed785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:56.755464 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4071/8204] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:56 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:52:56.759987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:56.763287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:56.783237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494e234-c3ff-4c1d-8362-492d56e8acd7 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:56.795160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:56.795880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:56.796169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:56.796468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2f45311a78cb4cfb8703352e5e60fd63` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:56.798253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:update_user(user_id=2f45311a78cb4cfb8703352e5e60fd63)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:56.800170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:56.825593 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=4,keystone:UPDATE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:56.951694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:57.052637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invalidating the token cache because user 2f45311a78cb4cfb8703352e5e60fd63 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:57.053019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:57.053699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:57.060504 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4134/8205] 10.222.0.59 () {60 vars in 1243 bytes} [Sun Aug 28 01:52:56 2022] PATCH /identity/v3/users/2f45311a78cb4cfb8703352e5e60fd63 => generated 296 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:57.063280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f22bec-6b89-4cc5-811a-8b201abed785 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:57.075143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f22bec-6b89-4cc5-811a-8b201abed785 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:57.079801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856aca2-5d99-4b7d-b1a4-a227f7fd1c19 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:57.080413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856aca2-5d99-4b7d-b1a4-a227f7fd1c19 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:57.080706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856aca2-5d99-4b7d-b1a4-a227f7fd1c19 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:57.080980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856aca2-5d99-4b7d-b1a4-a227f7fd1c19 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:57.081613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856aca2-5d99-4b7d-b1a4-a227f7fd1c19 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:57.084095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856aca2-5d99-4b7d-b1a4-a227f7fd1c19 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:57.195087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:57.197357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:57.203173 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4072/8206] 10.222.0.59 () {60 vars in 1143 bytes} [Sun Aug 28 01:52:57 2022] POST /identity/v3/users => generated 265 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:57.213344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31db646-6c38-4500-97b3-25df6a844ab4 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:57.230806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20074059-bb7a-4685-90aa-f1aa5bd80f96 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:57.231502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074059-bb7a-4685-90aa-f1aa5bd80f96 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:57.231796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074059-bb7a-4685-90aa-f1aa5bd80f96 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:57.232079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074059-bb7a-4685-90aa-f1aa5bd80f96 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/49d4bf86e7a34c5c851c0ab429d96d89/password` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:57.389096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-20074059-bb7a-4685-90aa-f1aa5bd80f96 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '49d4bf86e7a34c5c851c0ab429d96d89'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:57.499319 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4135/8207] 10.222.0.59 () {60 vars in 1269 bytes} [Sun Aug 28 01:52:57 2022] POST /identity/v3/users/49d4bf86e7a34c5c851c0ab429d96d89/password => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:58.506161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e6f61-450e-4b7c-b0b8-d0d49c665613 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:58.506161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e6f61-450e-4b7c-b0b8-d0d49c665613 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:58.506161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e6f61-450e-4b7c-b0b8-d0d49c665613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:58.540517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b71e6f61-450e-4b7c-b0b8-d0d49c665613 None None] MFA Rules not processed for user `49d4bf86e7a34c5c851c0ab429d96d89`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:58.542984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b71e6f61-450e-4b7c-b0b8-d0d49c665613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:58.546469 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4073/8208] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:52:58 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 01:52:58.550704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20074059-bb7a-4685-90aa-f1aa5bd80f96 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:58.562517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20074059-bb7a-4685-90aa-f1aa5bd80f96 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:58.567257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:58.567947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:58.568223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:58.568501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:58.575177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:58.577383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:58.583808 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4136/8209] 10.222.0.59 () {56 vars in 1263 bytes} [Sun Aug 28 01:52:58 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 01:52:58.587957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e6f61-450e-4b7c-b0b8-d0d49c665613 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:58.600981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e6f61-450e-4b7c-b0b8-d0d49c665613 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:58.607057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:58.607695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:58.607977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:58.608253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/49d4bf86e7a34c5c851c0ab429d96d89` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:58.609387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49d4bf86e7a34c5c851c0ab429d96d89)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:58.611601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:58.638208 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=8,keystone:SELECT=82,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:58.737739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d4bf86e7a34c5c851c0ab429d96d89'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:58.749727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d4bf86e7a34c5c851c0ab429d96d89'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:58.756794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d4bf86e7a34c5c851c0ab429d96d89'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:58.757528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d4bf86e7a34c5c851c0ab429d96d89'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:58.826742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d4bf86e7a34c5c851c0ab429d96d89'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:58.833423 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4074/8210] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:58 2022] DELETE /identity/v3/users/49d4bf86e7a34c5c851c0ab429d96d89 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:58.839254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:58.849294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90852bbb-6163-4b6b-8ff9-79562c40d384 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:58.911536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:58.912148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:58.912480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:58.925234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:58.925234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:58.925234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:59.043048 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4137/8211] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:52:58 2022] POST /identity/v3/users => generated 364 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:52:59.044219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:59.046010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:59.061988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d8671-584e-4a5a-a157-bb0563d12a08 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:59.067286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:59.068025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:59.068319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:59.068599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:59.069298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:59.071225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:59.164421 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4075/8212] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:52:59 2022] POST /identity/v3/projects => generated 359 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:52:59.165680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:59.177311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2d675-9e5d-48e6-b597-e8a3491a8a3a tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:59.237197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:59.237872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:59.238161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:59.238439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2a1f75f019f040998ef62a634e882390` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:59.252138 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=3,keystone:SELECT=90,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:59.254664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:update_user(user_id=2a1f75f019f040998ef62a634e882390)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:59.256768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:59.364196 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4138/8213] 10.222.0.59 () {60 vars in 1244 bytes} [Sun Aug 28 01:52:59 2022] PATCH /identity/v3/users/2a1f75f019f040998ef62a634e882390 => generated 523 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:52:59.368409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:59.379488 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919be7-440b-4434-b8f8-5608105d7025 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:59.384527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:59.386035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:59.386328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:59.387221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2a1f75f019f040998ef62a634e882390` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:59.450151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:get_user(user_id=2a1f75f019f040998ef62a634e882390)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:59.450151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:59.450151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4076/8214] 10.222.0.59 () {58 vars in 1221 bytes} [Sun Aug 28 01:52:59 2022] GET /identity/v3/users/2a1f75f019f040998ef62a634e882390 => generated 389 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:52:59.450455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:59.461447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236be4a-488d-48cc-bc42-c8b9572b7372 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:59.467307 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:59.467990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:59.468252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:59.468530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/projects/1a352db21cfd40f2a69c0aa40beedc67` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:59.473854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a352db21cfd40f2a69c0aa40beedc67)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:59.473854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:59.606478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a352db21cfd40f2a69c0aa40beedc67', 'request_id': 'req-6a174fca-3726-40e9-8852-059c1de568c5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.612549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a352db21cfd40f2a69c0aa40beedc67', 'request_id': 'req-6a174fca-3726-40e9-8852-059c1de568c5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.692700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a352db21cfd40f2a69c0aa40beedc67', 'request_id': 'req-6a174fca-3726-40e9-8852-059c1de568c5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.703893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] The token cache is being invalidate because project 1a352db21cfd40f2a69c0aa40beedc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:52:59.704210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.704926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.706491 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4139/8215] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:52:59 2022] DELETE /identity/v3/projects/1a352db21cfd40f2a69c0aa40beedc67 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:52:59.710744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:59.712671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:59.725602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86510f-c0bc-4847-bde0-f9da80911dea tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:59.783358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2751874a3c4a83aa28853cbc9cc887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7773e58569449b9871658d93dbed5ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:59.784075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:59.784419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:59.784816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] PATH_INFO: `/v3/users/2a1f75f019f040998ef62a634e882390` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:59.786075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2a1f75f019f040998ef62a634e882390)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:59.788108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:59.904009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1f75f019f040998ef62a634e882390'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.915158 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:59.918675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1f75f019f040998ef62a634e882390'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.927048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1f75f019f040998ef62a634e882390'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:52:59.928099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1f75f019f040998ef62a634e882390'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:00.009785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-7d7a52d8-be77-4e77-8e25-f75ec8b43414 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1f75f019f040998ef62a634e882390'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:00.018478 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4077/8216] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:52:59 2022] DELETE /identity/v3/users/2a1f75f019f040998ef62a634e882390 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:00.023631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:00.025256 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:00.100622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a174fca-3726-40e9-8852-059c1de568c5 tempest-UsersV3TestJSON-1267738257 tempest-UsersV3TestJSON-1267738257-project-admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:00.158843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:00.159405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:00.159682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:00.159957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] PATH_INFO: `/v3/users/2f45311a78cb4cfb8703352e5e60fd63` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:00.175051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f45311a78cb4cfb8703352e5e60fd63)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:00.179496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:00.179496 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:00.360813 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:00.361502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:00.506946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:00.516186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:00.516867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f45311a78cb4cfb8703352e5e60fd63'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:00.538222 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4140/8217] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:00 2022] DELETE /identity/v3/users/2f45311a78cb4cfb8703352e5e60fd63 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:00.543137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:00.543426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:00.543703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:00.565013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:00.566307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:00.631244 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4078/8218] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:00.641322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:00.643098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:00.717590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e52ab-ecc8-4948-ac43-75a1d0d863cf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:00.721462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:00.722521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:00.722711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:00.723099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:00.741846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:00.754257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:00.755641 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4141/8219] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:01.204831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:01.207047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:01.222209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e4b4-b765-4c59-8947-5c47d047116f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:01.227300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:01.228037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:01.228404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:01.228788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] PATH_INFO: `/v3/projects/86d92b9f4ed34e26bcbbea93977b32f3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:01.230618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d92b9f4ed34e26bcbbea93977b32f3)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:01.232714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:01.358719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d92b9f4ed34e26bcbbea93977b32f3', 'request_id': 'req-b066397c-853b-4367-9e18-59e9f981ac73'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.364981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d92b9f4ed34e26bcbbea93977b32f3', 'request_id': 'req-b066397c-853b-4367-9e18-59e9f981ac73'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.430265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d92b9f4ed34e26bcbbea93977b32f3', 'request_id': 'req-b066397c-853b-4367-9e18-59e9f981ac73'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.445403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] The token cache is being invalidate because project 86d92b9f4ed34e26bcbbea93977b32f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:01.445702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.446401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.451066 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4079/8220] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:01 2022] DELETE /identity/v3/projects/86d92b9f4ed34e26bcbbea93977b32f3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:01.452543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:01.463789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64041d6-cb02-453c-ba65-28d1cc63411e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:01.555336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:01.555974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:01.556253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:01.556526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] PATH_INFO: `/v3/users/ee2751874a3c4a83aa28853cbc9cc887` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:01.557709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2751874a3c4a83aa28853cbc9cc887)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:01.559651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:01.586519 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:01.736461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2751874a3c4a83aa28853cbc9cc887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.737142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2751874a3c4a83aa28853cbc9cc887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.820835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2751874a3c4a83aa28853cbc9cc887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.828697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2751874a3c4a83aa28853cbc9cc887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.829334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b3f3a70f-4136-400f-9118-b1d6f983218d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2751874a3c4a83aa28853cbc9cc887'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:01.847069 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4142/8221] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:01 2022] DELETE /identity/v3/users/ee2751874a3c4a83aa28853cbc9cc887 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:02.275028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:02.277954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:02.301706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066397c-853b-4367-9e18-59e9f981ac73 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:02.377912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:02.378662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:02.379039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:02.379381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] PATH_INFO: `/v3/projects/c7773e58569449b9871658d93dbed5ce` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:02.380590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7773e58569449b9871658d93dbed5ce)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:02.382661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:02.385594 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:02.509000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7773e58569449b9871658d93dbed5ce', 'request_id': 'req-ec025764-ef3c-4bf3-b259-427fd4184b1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:02.515141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7773e58569449b9871658d93dbed5ce', 'request_id': 'req-ec025764-ef3c-4bf3-b259-427fd4184b1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:02.591973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7773e58569449b9871658d93dbed5ce', 'request_id': 'req-ec025764-ef3c-4bf3-b259-427fd4184b1f'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:02.605062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] The token cache is being invalidate because project c7773e58569449b9871658d93dbed5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:02.605369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:02.606055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-ec025764-ef3c-4bf3-b259-427fd4184b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:02.607605 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4080/8222] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:02 2022] DELETE /identity/v3/projects/c7773e58569449b9871658d93dbed5ce => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:02.612565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187fae-6b60-4cf8-bfb5-0c8f83689086 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:02.612862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187fae-6b60-4cf8-bfb5-0c8f83689086 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:02.613137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187fae-6b60-4cf8-bfb5-0c8f83689086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:02.634729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-42187fae-6b60-4cf8-bfb5-0c8f83689086 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:02.636000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-42187fae-6b60-4cf8-bfb5-0c8f83689086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:02.700855 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4143/8223] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:02.710275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10a06-ad47-4425-a332-7cfce7ccc1e1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:02.710787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10a06-ad47-4425-a332-7cfce7ccc1e1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:02.711076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10a06-ad47-4425-a332-7cfce7ccc1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:02.737113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-98f10a06-ad47-4425-a332-7cfce7ccc1e1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:02.737113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-98f10a06-ad47-4425-a332-7cfce7ccc1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:02.766056 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4081/8224] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:02.767640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187fae-6b60-4cf8-bfb5-0c8f83689086 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:02.780966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187fae-6b60-4cf8-bfb5-0c8f83689086 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:02.786325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:02.787575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:02.788010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:02.788461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:02.789433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:02.789737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:02.792205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:02.805966 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4144/8225] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:02.812153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10a06-ad47-4425-a332-7cfce7ccc1e1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:02.823343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10a06-ad47-4425-a332-7cfce7ccc1e1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:02.828357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:02.829023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:02.829308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:02.836736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:02.836736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:02.836736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:02.979998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4082/8226] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:02 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:02.984237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:02.994985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61588d7c-7ec5-4543-9a22-c4b424f3a3d6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.222860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.223513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.223793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.224066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.225076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:03.228044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:03.354045 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4145/8227] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:02 2022] POST /identity/v3/users => generated 284 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:03.359791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:03.372391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362fe0c-e877-4887-b83b-4acb95a32dfa admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.377361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.378077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.378436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.378815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.379524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:03.381233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:03.392956 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4083/8228] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:03.397259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:03.414764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe11dd4-2673-4d31-aedc-6d24f3d5c3a0 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.418097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153fad-8986-4cc2-889c-d97cbd896c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.424445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153fad-8986-4cc2-889c-d97cbd896c79 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.424445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153fad-8986-4cc2-889c-d97cbd896c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.424445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153fad-8986-4cc2-889c-d97cbd896c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.424445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5153fad-8986-4cc2-889c-d97cbd896c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:03.424445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5153fad-8986-4cc2-889c-d97cbd896c79 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:03.435475 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4146/8229] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:03.446214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:03.457996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1606d-335a-49da-b575-4dd66238f7b9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.462813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.464382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.464523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.464725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] PATH_INFO: `/v3/projects/877471c90fb046abadc5bd641aee7868/users/e84a0d13840d42fab5491927a6f2bd56/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.479527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=877471c90fb046abadc5bd641aee7868, user_id=e84a0d13840d42fab5491927a6f2bd56, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:03.482215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:03.672709 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4084/8230] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:03 2022] PUT /identity/v3/projects/877471c90fb046abadc5bd641aee7868/users/e84a0d13840d42fab5491927a6f2bd56/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:03.684741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249047-4a99-4a01-bed7-8ff4fca437e2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.684741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249047-4a99-4a01-bed7-8ff4fca437e2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.684741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8249047-4a99-4a01-bed7-8ff4fca437e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.717326 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:03.736101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b8249047-4a99-4a01-bed7-8ff4fca437e2 None None] MFA Rules not processed for user `e84a0d13840d42fab5491927a6f2bd56`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:03.737432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b8249047-4a99-4a01-bed7-8ff4fca437e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:03.806170 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4147/8231] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:03.811381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:03.823093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f06b23-2e08-46cc-b345-24826519e7bd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.827479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051226-e279-45bf-89ce-7780b89147b8 tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84a0d13840d42fab5491927a6f2bd56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877471c90fb046abadc5bd641aee7868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.828305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051226-e279-45bf-89ce-7780b89147b8 tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.828679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051226-e279-45bf-89ce-7780b89147b8 tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.829032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051226-e279-45bf-89ce-7780b89147b8 tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] PATH_INFO: `/v3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.830694 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4085/8232] 10.222.0.59 () {58 vars in 1104 bytes} [Sun Aug 28 01:53:03 2022] GET /identity/v3 => generated 255 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:03.835372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8249047-4a99-4a01-bed7-8ff4fca437e2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:03.844814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8249047-4a99-4a01-bed7-8ff4fca437e2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.849174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324a7d-9863-4c5a-9560-2bf591fda98c tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84a0d13840d42fab5491927a6f2bd56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877471c90fb046abadc5bd641aee7868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.849768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324a7d-9863-4c5a-9560-2bf591fda98c tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.850138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324a7d-9863-4c5a-9560-2bf591fda98c tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.850419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324a7d-9863-4c5a-9560-2bf591fda98c tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] PATH_INFO: `/v3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.851909 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4148/8233] 10.222.0.59 () {58 vars in 1104 bytes} [Sun Aug 28 01:53:03 2022] GET /identity/v3 => generated 255 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:03.857133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051226-e279-45bf-89ce-7780b89147b8 tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:03.867305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051226-e279-45bf-89ce-7780b89147b8 tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.885993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e98a5-0b9d-4a89-b32c-e3d42c0a738d tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84a0d13840d42fab5491927a6f2bd56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '877471c90fb046abadc5bd641aee7868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.885993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e98a5-0b9d-4a89-b32c-e3d42c0a738d tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.885993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e98a5-0b9d-4a89-b32c-e3d42c0a738d tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.886327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e98a5-0b9d-4a89-b32c-e3d42c0a738d tempest-TestApiDiscovery-466378223 tempest-TestApiDiscovery-466378223-project] PATH_INFO: `/v3` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.886327 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4086/8234] 10.222.0.59 () {58 vars in 1104 bytes} [Sun Aug 28 01:53:03 2022] GET /identity/v3 => generated 255 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:53:03.890132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129838-4c76-416d-8490-30860eb7dacb None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.890418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129838-4c76-416d-8490-30860eb7dacb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.890696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73129838-4c76-416d-8490-30860eb7dacb None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.892429 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4149/8235] 10.222.0.59 () {56 vars in 895 bytes} [Sun Aug 28 01:53:03 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:53:03.897114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5edc-e24f-4450-8cd9-98c29c831ba0 None None] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.897508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5edc-e24f-4450-8cd9-98c29c831ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.897938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5edc-e24f-4450-8cd9-98c29c831ba0 None None] PATH_INFO: `/` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.899578 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4087/8236] 10.222.0.59 () {56 vars in 895 bytes} [Sun Aug 28 01:53:03 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:53:03.905611 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129838-4c76-416d-8490-30860eb7dacb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:03.986043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73129838-4c76-416d-8490-30860eb7dacb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:03.990796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:03.994969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:03.994969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:03.994969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] PATH_INFO: `/v3/users/e84a0d13840d42fab5491927a6f2bd56` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:03.994969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84a0d13840d42fab5491927a6f2bd56)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:03.995846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:04.219637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84a0d13840d42fab5491927a6f2bd56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:04.220960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84a0d13840d42fab5491927a6f2bd56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:04.327684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84a0d13840d42fab5491927a6f2bd56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:04.335044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84a0d13840d42fab5491927a6f2bd56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:04.336380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84a0d13840d42fab5491927a6f2bd56'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:04.357670 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4150/8237] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:03 2022] DELETE /identity/v3/users/e84a0d13840d42fab5491927a6f2bd56 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:04.362131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:04.362613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:04.362700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:04.384456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:04.386506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:04.477992 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4088/8238] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:04.479059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:04.479059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:04.519805 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:04.596030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1bde7-4146-4a91-841b-8d0da67c2316 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:04.600883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9013bd-213a-44f6-9ccc-bb32688d9bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:04.604570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9013bd-213a-44f6-9ccc-bb32688d9bbf service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:04.604570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9013bd-213a-44f6-9ccc-bb32688d9bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:04.604570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9013bd-213a-44f6-9ccc-bb32688d9bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:04.615169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9013bd-213a-44f6-9ccc-bb32688d9bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:04.617292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9013bd-213a-44f6-9ccc-bb32688d9bbf service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:04.631634 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4151/8239] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:05.099477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:05.102612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:05.129838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75c353-957b-487a-aff3-6527ce52b62c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:05.138801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:05.145945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:05.146465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:05.147229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] PATH_INFO: `/v3/projects/877471c90fb046abadc5bd641aee7868` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:05.149426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877471c90fb046abadc5bd641aee7868)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:05.156820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:05.202446 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:05.326732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877471c90fb046abadc5bd641aee7868', 'request_id': 'req-76fe9d14-473e-4ccd-b947-de1d197abe18'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:05.336689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877471c90fb046abadc5bd641aee7868', 'request_id': 'req-76fe9d14-473e-4ccd-b947-de1d197abe18'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:05.447047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877471c90fb046abadc5bd641aee7868', 'request_id': 'req-76fe9d14-473e-4ccd-b947-de1d197abe18'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:05.475076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] The token cache is being invalidate because project 877471c90fb046abadc5bd641aee7868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:05.475770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:05.476775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-76fe9d14-473e-4ccd-b947-de1d197abe18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:05.487372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711aad4-35f8-45c0-baab-9bf4da4f0415 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:05.488472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711aad4-35f8-45c0-baab-9bf4da4f0415 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:05.488985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711aad4-35f8-45c0-baab-9bf4da4f0415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:05.500035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4089/8240] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:05 2022] DELETE /identity/v3/projects/877471c90fb046abadc5bd641aee7868 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:05.518464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b711aad4-35f8-45c0-baab-9bf4da4f0415 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:05.520191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b711aad4-35f8-45c0-baab-9bf4da4f0415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:05.639270 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4152/8241] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:05.642756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3a1f-acdb-4e20-aec4-8b18992b8def None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:05.643119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3a1f-acdb-4e20-aec4-8b18992b8def None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:05.643469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3a1f-acdb-4e20-aec4-8b18992b8def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:05.668742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-868e3a1f-acdb-4e20-aec4-8b18992b8def None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:05.670011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-868e3a1f-acdb-4e20-aec4-8b18992b8def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:05.679839 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4090/8242] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:05.685101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711aad4-35f8-45c0-baab-9bf4da4f0415 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:05.695638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711aad4-35f8-45c0-baab-9bf4da4f0415 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:05.700678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:05.701342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:05.701631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:05.702035 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:05.702705 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:05.702994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:05.704601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:05.717586 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4153/8243] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:05.726880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e3a1f-acdb-4e20-aec4-8b18992b8def None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:05.737624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e3a1f-acdb-4e20-aec4-8b18992b8def None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:05.742860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:05.743495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:05.743978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:05.744912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:05.746044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:05.747989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:05.848994 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4091/8244] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:05 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:05.850154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:05.861784 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079525e-b792-45e5-b4f8-559e5f4a5883 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:05.927960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:05.928780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:05.929067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:05.929349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:05.930030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:05.932259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.015080 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4154/8245] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:05 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:06.016306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.027849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bb68d-eaf6-4d69-a156-1ee68367595d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.032984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.033677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.033920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.034300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.034886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.036551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.047937 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4092/8246] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:53:06.052077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.063012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e43c72-b985-4725-92a8-8590231b8bc5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.067887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.068553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.068836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.069112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] PATH_INFO: `/v3/projects/2dfd91d45dc94b138eae3c6aa535016e/users/1c3997aed8a94478b65e73aa51a041cc/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.085933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfd91d45dc94b138eae3c6aa535016e, user_id=1c3997aed8a94478b65e73aa51a041cc, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.088829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.172416 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4155/8247] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:06 2022] PUT /identity/v3/projects/2dfd91d45dc94b138eae3c6aa535016e/users/1c3997aed8a94478b65e73aa51a041cc/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:06.178472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.190462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7cc5c-c991-405b-b9f0-bd30a91c2db0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.264181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae1204-de1a-410e-bf6e-0ee8473c6a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.264839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1204-de1a-410e-bf6e-0ee8473c6a37 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.265162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1204-de1a-410e-bf6e-0ee8473c6a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.265442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1204-de1a-410e-bf6e-0ee8473c6a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.266129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1204-de1a-410e-bf6e-0ee8473c6a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.267732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1204-de1a-410e-bf6e-0ee8473c6a37 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.279247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4093/8248] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:06.283651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.296692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91707-f2e5-429f-b959-2ee3a364e64e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.301990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.302716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.303001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.306013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] PATH_INFO: `/v3/projects/2dfd91d45dc94b138eae3c6aa535016e/users/1c3997aed8a94478b65e73aa51a041cc/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.306770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfd91d45dc94b138eae3c6aa535016e, user_id=1c3997aed8a94478b65e73aa51a041cc, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.310043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.312762 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:06.331449 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4156/8249] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:06 2022] PUT /identity/v3/projects/2dfd91d45dc94b138eae3c6aa535016e/users/1c3997aed8a94478b65e73aa51a041cc/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:06.333171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345ddc-3d4b-43b3-bc48-cf139ce57f8a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.333682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345ddc-3d4b-43b3-bc48-cf139ce57f8a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.334007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345ddc-3d4b-43b3-bc48-cf139ce57f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.371979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-19345ddc-3d4b-43b3-bc48-cf139ce57f8a None None] MFA Rules not processed for user `1c3997aed8a94478b65e73aa51a041cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:06.373270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-19345ddc-3d4b-43b3-bc48-cf139ce57f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:06.451961 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:06.475179 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4094/8250] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:06.480239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.545714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175fc74-e193-43ea-b7ef-5d2e728d0760 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.551760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.552383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.552665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.552943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.553603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.555545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.680375 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4157/8251] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:06 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:53:06.685482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19345ddc-3d4b-43b3-bc48-cf139ce57f8a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.697144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19345ddc-3d4b-43b3-bc48-cf139ce57f8a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.763238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.763997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.764387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.764763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.765528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.767868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.855728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4095/8252] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:06 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:06.859787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.872346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bcc8f-c173-4c65-afd5-96060058f388 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.877218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.881901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.881901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.881901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.881901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.881901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.891537 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4158/8253] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:06.895618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.906875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40819d3-b721-4e31-847a-d1b83f71ad36 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.911889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0817-219c-403b-96d1-78f26dc807dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.912499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0817-219c-403b-96d1-78f26dc807dc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.912780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0817-219c-403b-96d1-78f26dc807dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.913059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0817-219c-403b-96d1-78f26dc807dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.913718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0817-219c-403b-96d1-78f26dc807dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.915352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0817-219c-403b-96d1-78f26dc807dc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:06.926569 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4096/8254] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:06.930949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:06.943701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41986b-f697-47f6-9bce-6ec0e490591e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:06.949062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:06.949774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:06.950483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:06.950688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] PATH_INFO: `/v3/projects/749277e044ff4ff393fc78f2b33fe513/users/e2a0719539104f178479325b7aeb6b81/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:06.968142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] RBAC: Authorizing `identity:create_grant(project_id=749277e044ff4ff393fc78f2b33fe513, user_id=e2a0719539104f178479325b7aeb6b81, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:06.970899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:07.123514 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4159/8255] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:06 2022] PUT /identity/v3/projects/749277e044ff4ff393fc78f2b33fe513/users/e2a0719539104f178479325b7aeb6b81/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:07.133905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57ce7-001f-4def-9c1d-23a12c7dfb3b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:07.134314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57ce7-001f-4def-9c1d-23a12c7dfb3b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:07.134838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57ce7-001f-4def-9c1d-23a12c7dfb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:07.170782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-00a57ce7-001f-4def-9c1d-23a12c7dfb3b None None] MFA Rules not processed for user `e2a0719539104f178479325b7aeb6b81`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:07.172880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-00a57ce7-001f-4def-9c1d-23a12c7dfb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:07.277712 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4097/8256] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:07.291965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:07.293642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:07.393940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712848d7-f52d-469a-9275-84ead323373f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:07.393940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5fc6-d678-46f0-8525-f8daf4068e48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:07.393940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5fc6-d678-46f0-8525-f8daf4068e48 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:07.393940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5fc6-d678-46f0-8525-f8daf4068e48 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:07.394345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5fc6-d678-46f0-8525-f8daf4068e48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:07.456789 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:07.470674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5fc6-d678-46f0-8525-f8daf4068e48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:07.471598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5fc6-d678-46f0-8525-f8daf4068e48 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:07.489290 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4160/8257] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:08.522668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57ce7-001f-4def-9c1d-23a12c7dfb3b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:08.585966 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:08.611328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57ce7-001f-4def-9c1d-23a12c7dfb3b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:08.617578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:08.618368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:08.618650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:08.619526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] PATH_INFO: `/v3/users/1c3997aed8a94478b65e73aa51a041cc` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:08.620298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3997aed8a94478b65e73aa51a041cc)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:08.622358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:08.835076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3997aed8a94478b65e73aa51a041cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:08.877419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3997aed8a94478b65e73aa51a041cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:08.885296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3997aed8a94478b65e73aa51a041cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:08.886134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3997aed8a94478b65e73aa51a041cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:08.952035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3997aed8a94478b65e73aa51a041cc'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:08.961985 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4098/8258] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:08 2022] DELETE /identity/v3/users/1c3997aed8a94478b65e73aa51a041cc => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:08.964569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:08.965125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:08.965430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:08.986092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:08.987352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:09.048510 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4161/8259] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:09.059730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:09.061295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:09.128739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec17d1-1a9e-49d2-ac0b-22e02d20d098 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:09.133718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:09.133718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:09.134615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:09.134615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:09.144975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:09.146492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:09.157887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4099/8260] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:09.620624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:09.622173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:09.649863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00790c34-8371-4fe0-9ea2-dad270c0a727 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:09.665030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:09.667633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:09.671958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:09.671958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] PATH_INFO: `/v3/projects/2dfd91d45dc94b138eae3c6aa535016e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:09.673598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dfd91d45dc94b138eae3c6aa535016e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:09.680554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:09.826029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dfd91d45dc94b138eae3c6aa535016e', 'request_id': 'req-c49a5621-0780-4825-b5ba-e5b94aecfad4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:09.836408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dfd91d45dc94b138eae3c6aa535016e', 'request_id': 'req-c49a5621-0780-4825-b5ba-e5b94aecfad4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:09.949517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dfd91d45dc94b138eae3c6aa535016e', 'request_id': 'req-c49a5621-0780-4825-b5ba-e5b94aecfad4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:09.965486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] The token cache is being invalidate because project 2dfd91d45dc94b138eae3c6aa535016e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:09.966213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:09.966551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:09.970916 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4162/8261] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:09 2022] DELETE /identity/v3/projects/2dfd91d45dc94b138eae3c6aa535016e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:09.974975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:09.987089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4ffc7-f27e-41c4-8c19-81cd075d08d7 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:10.075984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:10.081542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:10.081542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:10.081542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] PATH_INFO: `/v3/users/e2a0719539104f178479325b7aeb6b81` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:10.081542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a0719539104f178479325b7aeb6b81)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:10.081542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:10.115304 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:10.172542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:10.174344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:10.304454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5621-0780-4825-b5ba-e5b94aecfad4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:10.316383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:10.317431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:10.319673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:10.321161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:10.332954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a0719539104f178479325b7aeb6b81'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:10.333253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:10.360876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a0719539104f178479325b7aeb6b81'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:10.362730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:10.366540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:10.368959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a0719539104f178479325b7aeb6b81'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:10.373493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a0719539104f178479325b7aeb6b81'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:10.414616 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4163/8262] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:53:10.472596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-66d94ca1-02cc-4ce5-a96b-0f831a712e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a0719539104f178479325b7aeb6b81'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:10.480939 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4100/8263] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:09 2022] DELETE /identity/v3/users/e2a0719539104f178479325b7aeb6b81 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:11.580821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:11.582703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:11.609695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaa760-721f-47f9-a10f-9069d37c9585 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:11.620394 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:11.692590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:11.693236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:11.693517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:11.693954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] PATH_INFO: `/v3/projects/749277e044ff4ff393fc78f2b33fe513` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:11.695106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749277e044ff4ff393fc78f2b33fe513)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:11.697799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:11.862115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749277e044ff4ff393fc78f2b33fe513', 'request_id': 'req-eb51e343-69d9-4d07-a059-3daae079ac79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:11.868547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749277e044ff4ff393fc78f2b33fe513', 'request_id': 'req-eb51e343-69d9-4d07-a059-3daae079ac79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:11.974853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749277e044ff4ff393fc78f2b33fe513', 'request_id': 'req-eb51e343-69d9-4d07-a059-3daae079ac79'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:11.998766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] The token cache is being invalidate because project 749277e044ff4ff393fc78f2b33fe513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:11.999378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:12.000151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-eb51e343-69d9-4d07-a059-3daae079ac79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:12.002793 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4164/8264] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:11 2022] DELETE /identity/v3/projects/749277e044ff4ff393fc78f2b33fe513 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:12.007675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d151a7-1e03-4332-80e5-838d75643b32 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.008261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d151a7-1e03-4332-80e5-838d75643b32 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.008261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d151a7-1e03-4332-80e5-838d75643b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.046275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-84d151a7-1e03-4332-80e5-838d75643b32 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:12.048207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84d151a7-1e03-4332-80e5-838d75643b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:12.112105 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4101/8265] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:12.121616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cff150-1760-4c86-8fe4-ef3ee384194b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.131244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cff150-1760-4c86-8fe4-ef3ee384194b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.131554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cff150-1760-4c86-8fe4-ef3ee384194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.155872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d5cff150-1760-4c86-8fe4-ef3ee384194b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:12.157703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d5cff150-1760-4c86-8fe4-ef3ee384194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:12.167091 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4165/8266] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:12.173173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d151a7-1e03-4332-80e5-838d75643b32 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:12.184143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d151a7-1e03-4332-80e5-838d75643b32 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:12.188930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:12.189534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.189828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.190117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.190768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:12.191070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:12.192651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:12.205667 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4102/8267] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:53:12.210027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cff150-1760-4c86-8fe4-ef3ee384194b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:12.220561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cff150-1760-4c86-8fe4-ef3ee384194b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:12.226608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:12.227236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.227613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.227893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.228581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:12.230644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:12.355303 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4166/8268] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:12 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:12.359153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:12.370044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700aeb5-80ac-493d-be01-356410cb82ae admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:12.446842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:12.447447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.447732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.448011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.448657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:12.450801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:12.561111 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4103/8269] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:12 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:12.565024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:12.576457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5f03-54c2-4aed-b897-a5e0faa1ed96 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:12.582628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:12.583270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.583510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.583797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.584502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:12.587199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:12.599388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4167/8270] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:12.604520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:12.616441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71831eb2-0833-4992-b4c3-61bde32fb66a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:12.623565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da685-b714-4646-8293-70cae658e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:12.624374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da685-b714-4646-8293-70cae658e2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.624747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da685-b714-4646-8293-70cae658e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.625106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da685-b714-4646-8293-70cae658e2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.625942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69da685-b714-4646-8293-70cae658e2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:12.627642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69da685-b714-4646-8293-70cae658e2c9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:12.633931 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:12.640045 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4104/8271] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:12.645432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:12.657381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6141b-960f-4f50-92d6-e3941059ff80 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:12.661972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:12.662636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.663023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.663267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] PATH_INFO: `/v3/projects/2a88069f5c654a11a73796d121205b3e/users/3745598b035a423497172099047a1584/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.680244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a88069f5c654a11a73796d121205b3e, user_id=3745598b035a423497172099047a1584, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:12.683402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:12.795990 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4168/8272] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:12 2022] PUT /identity/v3/projects/2a88069f5c654a11a73796d121205b3e/users/3745598b035a423497172099047a1584/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:12.806249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4643c-1d7f-4453-bba2-cfe42f09b624 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:12.806599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4643c-1d7f-4453-bba2-cfe42f09b624 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:12.807102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4643c-1d7f-4453-bba2-cfe42f09b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:12.847804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-49f4643c-1d7f-4453-bba2-cfe42f09b624 None None] MFA Rules not processed for user `3745598b035a423497172099047a1584`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:12.849170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-49f4643c-1d7f-4453-bba2-cfe42f09b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:12.923728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4105/8273] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:12.938851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:12.940785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:12.997234 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:13.029025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d298-a276-4586-b9c1-6ff88958796f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:13.034270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:13.034873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:13.035211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:13.037225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:13.049384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:13.051126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:13.062986 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4169/8274] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:13.371448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9412c-8ff0-40b7-866c-33a141879f04 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:13.372391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9412c-8ff0-40b7-866c-33a141879f04 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:13.372815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9412c-8ff0-40b7-866c-33a141879f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:13.405131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-15a9412c-8ff0-40b7-866c-33a141879f04 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:13.406520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15a9412c-8ff0-40b7-866c-33a141879f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:13.491878 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4106/8275] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:53:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:13.784627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:13.787736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:13.885285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998f181-6b39-4802-8200-b6ec7b9da07b service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:13.892819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:13.893442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:13.893719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:13.894008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:13.904003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:13.905662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:13.914144 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4170/8276] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:53:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:53:14.787922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33c5cd-149c-49a3-a8f2-cd6d8bb90f0d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:14.788497 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33c5cd-149c-49a3-a8f2-cd6d8bb90f0d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:14.788600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33c5cd-149c-49a3-a8f2-cd6d8bb90f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:14.832605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2f33c5cd-149c-49a3-a8f2-cd6d8bb90f0d None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:14.834258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2f33c5cd-149c-49a3-a8f2-cd6d8bb90f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:14.843562 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4107/8277] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:53:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:14.860677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:14.883785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffe4cb-1c32-49d5-8e88-850fa1210ea1 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:14.891925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:14.892745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:14.893192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:14.893562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:14.908999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:14.910829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:14.921765 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4171/8278] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:53:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:53:15.940301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7d3a-85ee-467f-bd21-97b1f09de79a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:15.941150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7d3a-85ee-467f-bd21-97b1f09de79a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:15.942588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e7d3a-85ee-467f-bd21-97b1f09de79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:15.976771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-548e7d3a-85ee-467f-bd21-97b1f09de79a None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:15.976771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-548e7d3a-85ee-467f-bd21-97b1f09de79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:15.979873 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4108/8279] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:53:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:15.999108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:16.016642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0cbc-7287-4a40-865c-75815f024eff service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:16.026869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:16.027781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:16.028368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:16.028946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:16.046951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:16.049383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:16.064329 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4172/8280] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:53:16.632560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483426-eba8-49c8-9118-30689476634e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:16.633071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483426-eba8-49c8-9118-30689476634e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:16.633504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483426-eba8-49c8-9118-30689476634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:16.664752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1a483426-eba8-49c8-9118-30689476634e None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:16.666924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1a483426-eba8-49c8-9118-30689476634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:16.698178 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4109/8281] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 01:53:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:16.718480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:16.754280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d90f-d4ed-4e12-ba2f-edba746c159f service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:16.770399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:16.771845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:16.772352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:16.773873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:16.795738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:16.798916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:16.823684 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4173/8282] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:53:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:53:17.857136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40708d18-16b8-4faa-bbb2-920eb3a7e599 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:17.857136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40708d18-16b8-4faa-bbb2-920eb3a7e599 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:17.857136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40708d18-16b8-4faa-bbb2-920eb3a7e599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:17.891160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-40708d18-16b8-4faa-bbb2-920eb3a7e599 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:17.893007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-40708d18-16b8-4faa-bbb2-920eb3a7e599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:17.904472 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4110/8283] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:53:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:17.939682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:17.954252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058b0b-80b7-4c16-b0eb-7fe93ec4d0b5 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:17.966794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:17.968366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:17.969101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:17.969536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:17.979984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:17.986935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:17.997989 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4174/8284] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:53:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:53:18.975433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb4fc7-643c-408c-87ef-655e8b6f9ab5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:18.975959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb4fc7-643c-408c-87ef-655e8b6f9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:18.976068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb4fc7-643c-408c-87ef-655e8b6f9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:19.020960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1dbb4fc7-643c-408c-87ef-655e8b6f9ab5 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:19.022496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1dbb4fc7-643c-408c-87ef-655e8b6f9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:19.051078 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4111/8285] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 01:53:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:19.068312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:19.086265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bda52-8569-4a0e-9d3f-887fe0012610 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:19.093708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390fcc8-15e0-48f8-aabb-afec9e4f56e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:19.094766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390fcc8-15e0-48f8-aabb-afec9e4f56e2 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:19.095268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390fcc8-15e0-48f8-aabb-afec9e4f56e2 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:19.095758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390fcc8-15e0-48f8-aabb-afec9e4f56e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:19.110330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390fcc8-15e0-48f8-aabb-afec9e4f56e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:19.112849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390fcc8-15e0-48f8-aabb-afec9e4f56e2 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:19.123432 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4175/8286] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:53:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:53:19.928305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb4fc7-643c-408c-87ef-655e8b6f9ab5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:20.011255 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:20.057752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb4fc7-643c-408c-87ef-655e8b6f9ab5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:20.060668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:20.061329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:20.061616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:20.061920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] PATH_INFO: `/v3/users/3745598b035a423497172099047a1584` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:20.063093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3745598b035a423497172099047a1584)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:20.071888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:20.359867 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3745598b035a423497172099047a1584'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:20.375716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3745598b035a423497172099047a1584'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:20.386323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3745598b035a423497172099047a1584'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:20.387445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3745598b035a423497172099047a1584'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:20.495613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3745598b035a423497172099047a1584'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:20.503676 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4112/8287] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:19 2022] DELETE /identity/v3/users/3745598b035a423497172099047a1584 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:20.511393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:20.512017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:20.512017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:20.539638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:20.541621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:20.646138 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4176/8288] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:20.665900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:20.665900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:20.741541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9f3bf-9463-4c4c-a996-ae608dd4522d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:20.747974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ee26-81bd-4611-b57a-1eb64e64f06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:20.748887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ee26-81bd-4611-b57a-1eb64e64f06a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:20.749359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ee26-81bd-4611-b57a-1eb64e64f06a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:20.750940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ee26-81bd-4611-b57a-1eb64e64f06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:20.768477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2ee26-81bd-4611-b57a-1eb64e64f06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:20.770398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2ee26-81bd-4611-b57a-1eb64e64f06a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:20.782843 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4113/8289] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:21.459776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:21.461244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:21.474812 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:21.490986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20285d-40cd-4f9b-a671-fac219ec6e6d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:21.504812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:21.504993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:21.505495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:21.505919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] PATH_INFO: `/v3/projects/2a88069f5c654a11a73796d121205b3e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:21.507573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a88069f5c654a11a73796d121205b3e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:21.512758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:21.695863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a88069f5c654a11a73796d121205b3e', 'request_id': 'req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:21.716755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a88069f5c654a11a73796d121205b3e', 'request_id': 'req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:21.852459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a88069f5c654a11a73796d121205b3e', 'request_id': 'req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:21.878021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] The token cache is being invalidate because project 2a88069f5c654a11a73796d121205b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:21.878772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:21.881626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-05a5ca6c-face-4e73-a1af-67bbc50b1d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:21.882791 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4177/8290] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:21 2022] DELETE /identity/v3/projects/2a88069f5c654a11a73796d121205b3e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:21.894249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6960-e951-41c6-8296-5b0d5baad9ae None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:21.895224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6960-e951-41c6-8296-5b0d5baad9ae None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:21.896021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6960-e951-41c6-8296-5b0d5baad9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:21.943915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-31cb6960-e951-41c6-8296-5b0d5baad9ae None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:21.945797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-31cb6960-e951-41c6-8296-5b0d5baad9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:22.035998 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4114/8291] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:22.050551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c508f-6fac-4311-93ae-35d9e49daa82 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.051127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c508f-6fac-4311-93ae-35d9e49daa82 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.051581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c508f-6fac-4311-93ae-35d9e49daa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.097726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-507c508f-6fac-4311-93ae-35d9e49daa82 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:22.104991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-507c508f-6fac-4311-93ae-35d9e49daa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:22.117719 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4178/8292] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:22.122837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb6960-e951-41c6-8296-5b0d5baad9ae None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:22.137968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb6960-e951-41c6-8296-5b0d5baad9ae None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:22.145203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:22.146718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.147471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.147791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.148487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:22.148971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:22.150886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:22.152940 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:22.166814 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4115/8293] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:53:22.172435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c508f-6fac-4311-93ae-35d9e49daa82 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:22.192885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c508f-6fac-4311-93ae-35d9e49daa82 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:22.203595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:22.204883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.205433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.207381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.208294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:22.211694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:22.332333 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4179/8294] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:22 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:22.336963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:22.365597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126137bd-8a12-4d8f-93ab-547677f7b7f9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:22.435799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:22.436423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.436704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.437031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.437786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:22.439741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:22.563369 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4116/8295] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:22 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:22.567385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:22.588096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3a0dd-392f-47ff-8332-dcc79bcd96db admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:22.598253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:22.599366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.599824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.600101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.600885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:22.610467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:22.628411 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4180/8296] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:53:22.629754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:22.652595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e181e-033c-4c95-96be-e233a8e60d31 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:22.658315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:22.658931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.659214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.659551 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.660205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:22.662053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:22.678005 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4117/8297] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:22.682246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:22.697543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4cce-6aa8-4384-ae02-ed6924e7c76d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:22.702736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24653eac-c754-40da-aff2-6bbd87f0d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:22.704605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653eac-c754-40da-aff2-6bbd87f0d9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.707336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:22.710552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:22.713565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653eac-c754-40da-aff2-6bbd87f0d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.714871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24653eac-c754-40da-aff2-6bbd87f0d9e1 admin admin] PATH_INFO: `/v3/projects/342651f31407407ca9e0197f6205dfdd/users/ac731abde4134d7abe383003f1eefead/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.749059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24653eac-c754-40da-aff2-6bbd87f0d9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342651f31407407ca9e0197f6205dfdd, user_id=ac731abde4134d7abe383003f1eefead, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:22.752260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24653eac-c754-40da-aff2-6bbd87f0d9e1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:22.824960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55993925-5dda-4cdd-9e15-1c4fad21c1ef admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:22.830370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:22.830980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.831263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.831538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.833271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:22.849978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:22.851939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:22.858946 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4181/8298] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:22 2022] PUT /identity/v3/projects/342651f31407407ca9e0197f6205dfdd/users/ac731abde4134d7abe383003f1eefead/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:22.866905 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4118/8299] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:22.878251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e874-9359-4246-9c05-a289986b3607 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:22.878499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e874-9359-4246-9c05-a289986b3607 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:22.878782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915e874-9359-4246-9c05-a289986b3607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:22.928291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5915e874-9359-4246-9c05-a289986b3607 None None] MFA Rules not processed for user `ac731abde4134d7abe383003f1eefead`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:22.929734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5915e874-9359-4246-9c05-a289986b3607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:23.078400 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4182/8300] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:23.087067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:23.099860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65b01-84a5-470b-99fd-74fff36854e2 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:23.174840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:23.175175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:23.175367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:23.176038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:23.176697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:23.178646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:23.185146 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:23.293026 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4119/8301] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:23 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:23.294028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e874-9359-4246-9c05-a289986b3607 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:23.308083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915e874-9359-4246-9c05-a289986b3607 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:23.324707 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:23.391882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:23.392690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:23.393545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:23.394173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:23.394966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:23.397138 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:23.537115 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4183/8302] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:23 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:23.541661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:23.557769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ff04a-7d27-4f0a-87f6-ace5af1e6c6e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:23.565796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:23.567247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:23.567638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:23.568958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:23.570142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:23.573121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:23.592833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4120/8303] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:23.593525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:23.618009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729897b-e0ed-4f69-9050-3e59592ecc30 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:23.635777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:23.636691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:23.637743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:23.638140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] PATH_INFO: `/v3/projects/9e9bee8b57524158b663ad9e91dddf64/users/48ef7624cca040e986c15f2d97e903ca/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:23.678572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9bee8b57524158b663ad9e91dddf64, user_id=48ef7624cca040e986c15f2d97e903ca, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:23.694590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:23.807543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:23.809683 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4184/8304] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:23 2022] PUT /identity/v3/projects/9e9bee8b57524158b663ad9e91dddf64/users/48ef7624cca040e986c15f2d97e903ca/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:23.824792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b480b4d-583f-4fc9-bbd4-24c5b897810c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:23.912268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46f3a-df41-49f8-a6d7-1b7dfcd1296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:23.912871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46f3a-df41-49f8-a6d7-1b7dfcd1296e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:23.913220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46f3a-df41-49f8-a6d7-1b7dfcd1296e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:23.913536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46f3a-df41-49f8-a6d7-1b7dfcd1296e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:23.914396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46f3a-df41-49f8-a6d7-1b7dfcd1296e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:23.917207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46f3a-df41-49f8-a6d7-1b7dfcd1296e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:23.931656 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4121/8305] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:53:23.936325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:23.942909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e13e1-1391-4f21-9f51-8ba2adf68be4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:23.948739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:23.949472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:23.949869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:23.950155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] PATH_INFO: `/v3/projects/9e9bee8b57524158b663ad9e91dddf64/users/48ef7624cca040e986c15f2d97e903ca/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:23.952233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9bee8b57524158b663ad9e91dddf64, user_id=48ef7624cca040e986c15f2d97e903ca, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:23.954897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:23.973538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4185/8306] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:23 2022] PUT /identity/v3/projects/9e9bee8b57524158b663ad9e91dddf64/users/48ef7624cca040e986c15f2d97e903ca/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:23.983275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:23.983493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:23.983695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:23.998142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:24.001741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:24.033259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] MFA Rules not processed for user `48ef7624cca040e986c15f2d97e903ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:24.036448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:24.139971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cf48e-4625-451f-8d32-213acd8a4088 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:24.154101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:24.155225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:24.155726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:24.156191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] PATH_INFO: `/v3/users/cfca1b233b6944449d5ab45dd6efb8a9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:24.157223 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4122/8307] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:24.158780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfca1b233b6944449d5ab45dd6efb8a9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:24.160717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:24.169207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:24.170969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:24.259014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bc909-31a0-4215-acd3-66e403b41aa7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:24.265623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:24.266364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:24.266719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:24.267050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:24.279815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:24.281323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:24.288022 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:24.296594 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4123/8308] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:53:24.480629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfca1b233b6944449d5ab45dd6efb8a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:24.481714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfca1b233b6944449d5ab45dd6efb8a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:24.549233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfca1b233b6944449d5ab45dd6efb8a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:24.560203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfca1b233b6944449d5ab45dd6efb8a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:24.560203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfca1b233b6944449d5ab45dd6efb8a9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:24.573497 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:24.619248 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4186/8309] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:23 2022] DELETE /identity/v3/users/cfca1b233b6944449d5ab45dd6efb8a9 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:25.184964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:25.211147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e407e8-767a-4570-92ee-b04abacb9cb4 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:25.365192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:25.366162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:25.366462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:25.366800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] PATH_INFO: `/v3/projects/4949768b7289422daadd916fd8444438` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:25.371700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4949768b7289422daadd916fd8444438)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:25.373640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:25.621095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4949768b7289422daadd916fd8444438', 'request_id': 'req-1b1ecdae-5bbb-432d-8a38-776930e288bf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:25.628101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4949768b7289422daadd916fd8444438', 'request_id': 'req-1b1ecdae-5bbb-432d-8a38-776930e288bf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:25.804946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4949768b7289422daadd916fd8444438', 'request_id': 'req-1b1ecdae-5bbb-432d-8a38-776930e288bf'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:25.833068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] The token cache is being invalidate because project 4949768b7289422daadd916fd8444438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:25.833362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:25.834524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:25.841580 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4124/8310] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:25 2022] DELETE /identity/v3/projects/4949768b7289422daadd916fd8444438 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:25.844377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:25.845999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:25.870466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f553ea-ab49-40ea-b309-c22fde4cf45e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:26.001060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:26.001708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:26.003749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:26.003749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] PATH_INFO: `/v3/users/c44870dab0b34153844c07cc43ae77ae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:26.008817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44870dab0b34153844c07cc43ae77ae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:26.011972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:26.284957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44870dab0b34153844c07cc43ae77ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:26.286181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44870dab0b34153844c07cc43ae77ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:26.369393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44870dab0b34153844c07cc43ae77ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:26.377854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44870dab0b34153844c07cc43ae77ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:26.378579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-932c86dc-00bf-4b2b-b7a9-5901c27c8bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44870dab0b34153844c07cc43ae77ae'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:26.412667 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4187/8311] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:25 2022] DELETE /identity/v3/users/c44870dab0b34153844c07cc43ae77ae => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:26.765332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:26.771810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:26.805630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ecdae-5bbb-432d-8a38-776930e288bf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:26.903658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:26.904298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:26.904577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:26.904848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] PATH_INFO: `/v3/projects/4dcdb0aa786946249194e4853ed76d0e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:26.906001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcdb0aa786946249194e4853ed76d0e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:26.908334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:27.017997 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:27.033987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcdb0aa786946249194e4853ed76d0e', 'request_id': 'req-aa51116d-b047-4830-8203-a4c5b136329e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:27.040257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcdb0aa786946249194e4853ed76d0e', 'request_id': 'req-aa51116d-b047-4830-8203-a4c5b136329e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:27.202676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcdb0aa786946249194e4853ed76d0e', 'request_id': 'req-aa51116d-b047-4830-8203-a4c5b136329e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:27.216598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] The token cache is being invalidate because project 4dcdb0aa786946249194e4853ed76d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:27.217256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:27.218696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aa51116d-b047-4830-8203-a4c5b136329e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:27.220835 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4125/8312] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:26 2022] DELETE /identity/v3/projects/4dcdb0aa786946249194e4853ed76d0e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:27.225753 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76d28-8e5f-4636-bc95-e7373aa2ed7a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.226846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76d28-8e5f-4636-bc95-e7373aa2ed7a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.227364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76d28-8e5f-4636-bc95-e7373aa2ed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.252502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b6d76d28-8e5f-4636-bc95-e7373aa2ed7a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:27.253880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6d76d28-8e5f-4636-bc95-e7373aa2ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:27.354727 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4188/8313] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:27.370347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6c81-9f20-407d-aadf-5c452245a946 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.370612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6c81-9f20-407d-aadf-5c452245a946 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.374533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6c81-9f20-407d-aadf-5c452245a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.413071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-82bc6c81-9f20-407d-aadf-5c452245a946 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:27.414568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-82bc6c81-9f20-407d-aadf-5c452245a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:27.427708 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4126/8314] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:27.432943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76d28-8e5f-4636-bc95-e7373aa2ed7a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:27.440565 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:27.449630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76d28-8e5f-4636-bc95-e7373aa2ed7a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:27.458619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:27.463770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.463770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.463770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.463770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:27.463770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:27.463770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:27.477592 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4189/8315] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:27.481746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6c81-9f20-407d-aadf-5c452245a946 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:27.492814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6c81-9f20-407d-aadf-5c452245a946 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:27.502516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:27.502516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.502516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.502516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.503090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:27.504487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:27.629507 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4127/8316] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:27 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:53:27.632267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:27.635502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:27.638298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:27.652572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f05e9-7db4-4f6b-a83a-ce6676fd2f1a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:27.763263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2351cbf-ce39-4d45-b40f-cdcc033601dd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:27.773933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:27.773933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.774270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:27.776993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.776993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] PATH_INFO: `/v3/users/ac731abde4134d7abe383003f1eefead` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.778237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.778237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.778237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.778631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac731abde4134d7abe383003f1eefead)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:27.778735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:27.778838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:27.778930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:27.917742 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4128/8317] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:27 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:27.921948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:27.933547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806860-1efa-4217-8cf7-87887636c1c6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:27.940146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:27.940744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.944462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.944462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.944462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:27.944462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:27.960855 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4129/8318] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:53:27.965018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:27.976840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212c476-17e4-4ea8-8dd5-3bdc4d4c72ca admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:27.982545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:27.985045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:27.985045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:27.985045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:27.985045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:27.986270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:28.000764 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4130/8319] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:28.004647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:28.015468 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee33c-f4a8-491c-a769-7d17b1acb701 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:28.020612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e337-35cd-4610-9b0e-3a1d41224e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:28.021269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e337-35cd-4610-9b0e-3a1d41224e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:28.021550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e337-35cd-4610-9b0e-3a1d41224e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:28.021854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e337-35cd-4610-9b0e-3a1d41224e62 admin admin] PATH_INFO: `/v3/projects/4185a34c8848445d8aceda7302407f9f/users/68a3bd2e6b564e898967f044bb438843/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:28.041679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac731abde4134d7abe383003f1eefead'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:28.042831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac731abde4134d7abe383003f1eefead'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:28.043259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4e337-35cd-4610-9b0e-3a1d41224e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4185a34c8848445d8aceda7302407f9f, user_id=68a3bd2e6b564e898967f044bb438843, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:28.046788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4e337-35cd-4610-9b0e-3a1d41224e62 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:28.223452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac731abde4134d7abe383003f1eefead'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:28.227192 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4131/8320] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:28 2022] PUT /identity/v3/projects/4185a34c8848445d8aceda7302407f9f/users/68a3bd2e6b564e898967f044bb438843/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:28.233196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac731abde4134d7abe383003f1eefead'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:28.234243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-d52d927d-0de3-4dda-b0fd-243599ccfb60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac731abde4134d7abe383003f1eefead'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:28.238426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:28.238789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:28.239137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:28.255989 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4190/8321] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:27 2022] DELETE /identity/v3/users/ac731abde4134d7abe383003f1eefead => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:28.262085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:28.262441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:28.262715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:28.283918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] MFA Rules not processed for user `68a3bd2e6b564e898967f044bb438843`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:28.285879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:28.293530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:28.295349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:28.304815 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:28.377582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4132/8322] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:28.389717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:28.391386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:28.402962 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4191/8323] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:28.414779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:28.416275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:28.430537 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:28.489770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefc79c-7c31-41f1-90bc-6d68488711c7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:28.494057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:28.495117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:28.495434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:28.495795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:28.512687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae9f9-ed03-4d74-afe6-533ccedf9acd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:28.516230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:28.518834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:28.519125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:28.519400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:28.529133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:28.531000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:28.531195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:28.535631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:28.545333 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4133/8324] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:53:28.545714 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4192/8325] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:53:28.575384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:28.577265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:28.597881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff669-f98b-4d74-95b2-d83d0af260a2 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:28.604920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:28.605733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:28.606059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:28.606370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] PATH_INFO: `/v3/users/68a3bd2e6b564e898967f044bb438843` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:28.607720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a3bd2e6b564e898967f044bb438843)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:28.609774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:28.996344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a3bd2e6b564e898967f044bb438843'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.020297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a3bd2e6b564e898967f044bb438843'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.031970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a3bd2e6b564e898967f044bb438843'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.033887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a3bd2e6b564e898967f044bb438843'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.183214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-aef3f049-1600-4066-9c3f-9f54bea3d788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a3bd2e6b564e898967f044bb438843'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.190754 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4134/8326] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:28 2022] DELETE /identity/v3/users/68a3bd2e6b564e898967f044bb438843 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:29.191759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:29.193314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:29.194247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:29.194542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:29.195086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:29.217141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1df675-5a01-4240-adc7-7b2153426798 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:29.229188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:29.230599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:29.259561 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:29.290406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:29.290406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:29.290406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:29.290406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] PATH_INFO: `/v3/projects/342651f31407407ca9e0197f6205dfdd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:29.291627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342651f31407407ca9e0197f6205dfdd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:29.291627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:29.296220 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4135/8327] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:29.310368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:29.312154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:29.376235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44039a2f-1469-44de-ad8d-2154c0bd8419 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:29.380919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:29.381524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:29.381803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:29.382168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:29.392796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:29.394329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:29.405102 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4136/8328] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:53:29.427599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342651f31407407ca9e0197f6205dfdd', 'request_id': 'req-13816736-a55f-4d71-b93b-345f496edc02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.434889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342651f31407407ca9e0197f6205dfdd', 'request_id': 'req-13816736-a55f-4d71-b93b-345f496edc02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.563002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342651f31407407ca9e0197f6205dfdd', 'request_id': 'req-13816736-a55f-4d71-b93b-345f496edc02'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.575190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] The token cache is being invalidate because project 342651f31407407ca9e0197f6205dfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:29.575505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.576217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:29.577734 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4193/8329] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:29 2022] DELETE /identity/v3/projects/342651f31407407ca9e0197f6205dfdd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:29.582047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:29.583499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:29.597923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67617b3-e90a-40ce-86c5-6ee70bd107db service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:29.660277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:29.660689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:29.660979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:29.661250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] PATH_INFO: `/v3/users/48ef7624cca040e986c15f2d97e903ca` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:29.662422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ef7624cca040e986c15f2d97e903ca)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:29.667210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:30.001658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:30.001658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:30.011086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ef7624cca040e986c15f2d97e903ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.021710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13816736-a55f-4d71-b93b-345f496edc02 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:30.024828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ef7624cca040e986c15f2d97e903ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.029462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:30.030470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.030756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.031059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] PATH_INFO: `/v3/projects/4185a34c8848445d8aceda7302407f9f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.032441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4185a34c8848445d8aceda7302407f9f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:30.032686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ef7624cca040e986c15f2d97e903ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.033797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ef7624cca040e986c15f2d97e903ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.034616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:30.191707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-11f02f9e-86c7-42b9-bf7a-c6a1af5a4a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ef7624cca040e986c15f2d97e903ca'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.207516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4137/8330] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:29 2022] DELETE /identity/v3/users/48ef7624cca040e986c15f2d97e903ca => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:30.207725 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:30.213998 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:30.230968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4185a34c8848445d8aceda7302407f9f', 'request_id': 'req-6bfcea8c-dc71-4b28-ab28-5c749094dec6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.240900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4185a34c8848445d8aceda7302407f9f', 'request_id': 'req-6bfcea8c-dc71-4b28-ab28-5c749094dec6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.357172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4185a34c8848445d8aceda7302407f9f', 'request_id': 'req-6bfcea8c-dc71-4b28-ab28-5c749094dec6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.370214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] The token cache is being invalidate because project 4185a34c8848445d8aceda7302407f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:30.370507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.371193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6bfcea8c-dc71-4b28-ab28-5c749094dec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:30.372743 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4194/8331] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:29 2022] DELETE /identity/v3/projects/4185a34c8848445d8aceda7302407f9f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:30.377797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29673a-401d-4687-bbf0-7f4803d5b761 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.378134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29673a-401d-4687-bbf0-7f4803d5b761 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.378403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29673a-401d-4687-bbf0-7f4803d5b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.399524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0e29673a-401d-4687-bbf0-7f4803d5b761 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:30.401181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0e29673a-401d-4687-bbf0-7f4803d5b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:30.468353 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4138/8332] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:30.487878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23482f-6c5e-45c7-a01d-b5693beac408 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.488219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23482f-6c5e-45c7-a01d-b5693beac408 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.488500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23482f-6c5e-45c7-a01d-b5693beac408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.510140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1f23482f-6c5e-45c7-a01d-b5693beac408 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:30.511369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1f23482f-6c5e-45c7-a01d-b5693beac408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:30.534681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29673a-401d-4687-bbf0-7f4803d5b761 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:30.545870 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4195/8333] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:30.554425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29673a-401d-4687-bbf0-7f4803d5b761 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:30.560711 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:30.561418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.561759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.574424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.574424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:30.574424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:30.574424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:30.581728 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4139/8334] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:30.585583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23482f-6c5e-45c7-a01d-b5693beac408 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:30.596575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23482f-6c5e-45c7-a01d-b5693beac408 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:30.602057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:30.602866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.603241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.603618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.604390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:30.606479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:30.727918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4196/8335] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:30 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:30.732167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:30.742337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb333-3135-4803-bbcf-0d2d73edcafb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:30.800434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:30.801053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.801336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.801611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.802274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:30.804183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:30.847334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:30.849069 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:30.862860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950cbb8-4661-41dd-a34a-2f48590690a4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:30.874111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:30.875142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.875142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.875465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] PATH_INFO: `/v3/projects/9e9bee8b57524158b663ad9e91dddf64` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.876536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9bee8b57524158b663ad9e91dddf64)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:30.878558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:30.923858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4140/8336] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:30 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:30.928043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:30.939741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c048c52-52d5-42c8-85e9-79c4d1a0f527 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:30.944581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:30.945180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.947492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.947773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.949508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:30.951187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:30.964493 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4141/8337] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:53:30.969785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:30.981298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb870-08bf-4aa7-bbd9-e1288b4fabe9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:30.986166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:30.986778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:30.987061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:30.987336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:30.987982 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:30.989606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.002856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4142/8338] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:31.012628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.025827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77602-6ca4-4465-a888-c32e1693f4a4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.030815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b140862-4fe9-4fcb-82e5-d3e58c4b528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.031741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140862-4fe9-4fcb-82e5-d3e58c4b528d admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.032033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140862-4fe9-4fcb-82e5-d3e58c4b528d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.032308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140862-4fe9-4fcb-82e5-d3e58c4b528d admin admin] PATH_INFO: `/v3/projects/59b29e1bde1f4dfba3545cc1443ede74/users/dd154b1857874986a756b77f6f578bf9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.064590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b140862-4fe9-4fcb-82e5-d3e58c4b528d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b29e1bde1f4dfba3545cc1443ede74, user_id=dd154b1857874986a756b77f6f578bf9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:31.064687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9bee8b57524158b663ad9e91dddf64', 'request_id': 'req-3c651730-8519-45d7-8751-d295b05e6b51'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:31.067619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b140862-4fe9-4fcb-82e5-d3e58c4b528d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.072276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9bee8b57524158b663ad9e91dddf64', 'request_id': 'req-3c651730-8519-45d7-8751-d295b05e6b51'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:31.229185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9bee8b57524158b663ad9e91dddf64', 'request_id': 'req-3c651730-8519-45d7-8751-d295b05e6b51'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:31.229371 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4143/8339] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:31 2022] PUT /identity/v3/projects/59b29e1bde1f4dfba3545cc1443ede74/users/dd154b1857874986a756b77f6f578bf9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:31.232805 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] The token cache is being invalidate because project 9e9bee8b57524158b663ad9e91dddf64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:31.233104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:31.233788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3c651730-8519-45d7-8751-d295b05e6b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:31.235722 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4197/8340] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:30 2022] DELETE /identity/v3/projects/9e9bee8b57524158b663ad9e91dddf64 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:31.238917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.239221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.239498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.240100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdfac-1270-4b18-8f0a-5cff7126b334 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.240390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdfac-1270-4b18-8f0a-5cff7126b334 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.240670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdfac-1270-4b18-8f0a-5cff7126b334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.260838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5fccdfac-1270-4b18-8f0a-5cff7126b334 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:31.263171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5fccdfac-1270-4b18-8f0a-5cff7126b334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:31.269155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] MFA Rules not processed for user `dd154b1857874986a756b77f6f578bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:31.270477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:31.284007 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:31.327547 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4198/8341] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:31.336529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d309-aa9d-477b-88ba-942803fb2bf1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.336872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d309-aa9d-477b-88ba-942803fb2bf1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.337216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d309-aa9d-477b-88ba-942803fb2bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.354912 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4144/8342] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:53:31.370903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.371578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b1a0d309-aa9d-477b-88ba-942803fb2bf1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:31.372716 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:31.373070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b1a0d309-aa9d-477b-88ba-942803fb2bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:31.383579 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4199/8343] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:31.402158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0d309-aa9d-477b-88ba-942803fb2bf1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.434794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0d309-aa9d-477b-88ba-942803fb2bf1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.440205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.441179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.441471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.441732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.442442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:31.443021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:31.444953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.465895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4200/8344] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:31.466883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da56c7-8550-4df3-8c48-c62dbe54ffc5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.470358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.470819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.471438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.471715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.471981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.476061 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:31.482631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:31.487697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcc180-893a-48a7-a97b-b89e0c0aff54 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.488066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.489170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.490533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.490915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.491261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.492157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:31.494441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.504449 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4145/8345] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:31.674059 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4201/8346] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:31 2022] POST /identity/v3/projects => generated 393 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:31.678608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.692861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e3197-fe44-48a8-a703-e954d6ed37ce service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.762653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.763392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.763675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.767423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.767423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:31.767423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.887048 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4146/8347] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:31 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:31.888386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.899455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c7ce-bcd2-4de0-9147-8c402288569e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.904788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.905723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.906047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.906321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.907238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:31.909217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.922546 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4202/8348] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:31.926397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.938425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d6ef3-1042-4d92-997b-82fcf98c06b5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.943741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb581af-977a-4756-b83a-6ce0203ff22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.944516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb581af-977a-4756-b83a-6ce0203ff22a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.944919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb581af-977a-4756-b83a-6ce0203ff22a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.945484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb581af-977a-4756-b83a-6ce0203ff22a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:31.946325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb581af-977a-4756-b83a-6ce0203ff22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:31.948878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb581af-977a-4756-b83a-6ce0203ff22a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:31.965884 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4147/8349] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:53:31.967802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:31.981958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb76b-e441-49d9-aee1-70a327e4b485 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:31.987352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:31.988180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:31.988472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:31.988804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] PATH_INFO: `/v3/projects/b389ccf416cf441c935ef2ada9966b76/users/99db854d4fd9489c90dc880af61aa8c9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:32.006988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b389ccf416cf441c935ef2ada9966b76, user_id=99db854d4fd9489c90dc880af61aa8c9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:32.010259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:32.163034 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4203/8350] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:31 2022] PUT /identity/v3/projects/b389ccf416cf441c935ef2ada9966b76/users/99db854d4fd9489c90dc880af61aa8c9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:32.164932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdcc36-417c-44f9-8aac-38fd792ef5bc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:32.166306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdcc36-417c-44f9-8aac-38fd792ef5bc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:32.166306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdcc36-417c-44f9-8aac-38fd792ef5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:32.213557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8abdcc36-417c-44f9-8aac-38fd792ef5bc None None] MFA Rules not processed for user `99db854d4fd9489c90dc880af61aa8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:32.223194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8abdcc36-417c-44f9-8aac-38fd792ef5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:32.317323 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4148/8351] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:32.328031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:32.329724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:32.396311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe0f6d-4bfc-44f5-bbda-bcfd053bac10 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:32.400333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:32.401745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:32.402078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:32.402357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:32.413919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:32.416143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:32.427571 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4204/8352] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:32.492961 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:34.639708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae9d1-2a76-4c68-a106-d4dd7043dd16 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:34.640323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae9d1-2a76-4c68-a106-d4dd7043dd16 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:34.640323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaae9d1-2a76-4c68-a106-d4dd7043dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:34.666207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0aaae9d1-2a76-4c68-a106-d4dd7043dd16 None None] MFA Rules not processed for user `dd154b1857874986a756b77f6f578bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:34.667583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0aaae9d1-2a76-4c68-a106-d4dd7043dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:34.734896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4149/8353] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:41.692622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:41.817156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3fdec-90fa-4e95-8d79-b16cde39d246 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:41.824109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:41.826615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:41.827201 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:41.827686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] PATH_INFO: `/v3/users/99db854d4fd9489c90dc880af61aa8c9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:41.829286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99db854d4fd9489c90dc880af61aa8c9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:41.831557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:42.183682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99db854d4fd9489c90dc880af61aa8c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:42.184363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99db854d4fd9489c90dc880af61aa8c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:42.187710 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:42.326081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99db854d4fd9489c90dc880af61aa8c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:42.334961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99db854d4fd9489c90dc880af61aa8c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:42.335895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99db854d4fd9489c90dc880af61aa8c9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:42.367907 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4205/8354] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:41 2022] DELETE /identity/v3/users/99db854d4fd9489c90dc880af61aa8c9 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:42.373297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:42.374691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:42.374691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:42.394856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:42.396336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:42.501866 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4150/8355] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:42.514321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:42.516047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:42.592555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c906ad-0643-4474-b2ce-b2f09b9f8711 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:42.596982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24997a6-ba33-41f7-9e45-ec6328a26588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:42.597696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24997a6-ba33-41f7-9e45-ec6328a26588 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:42.598150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24997a6-ba33-41f7-9e45-ec6328a26588 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:42.600115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24997a6-ba33-41f7-9e45-ec6328a26588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:42.612189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24997a6-ba33-41f7-9e45-ec6328a26588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:42.613655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24997a6-ba33-41f7-9e45-ec6328a26588 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:42.624437 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4206/8356] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:43.093881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:43.101285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:43.128971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e17d2-8836-4cf1-b5b9-c69a5f256f7a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:43.151033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:43.159826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:43.159826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:43.159826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] PATH_INFO: `/v3/projects/b389ccf416cf441c935ef2ada9966b76` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:43.159826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b389ccf416cf441c935ef2ada9966b76)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:43.159826 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:43.340624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b389ccf416cf441c935ef2ada9966b76', 'request_id': 'req-46185568-ef72-445d-b522-72ce485a8657'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:43.373566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b389ccf416cf441c935ef2ada9966b76', 'request_id': 'req-46185568-ef72-445d-b522-72ce485a8657'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:43.485762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b389ccf416cf441c935ef2ada9966b76', 'request_id': 'req-46185568-ef72-445d-b522-72ce485a8657'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:43.487250 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:43.507450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] The token cache is being invalidate because project b389ccf416cf441c935ef2ada9966b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:43.507746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:43.508491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-46185568-ef72-445d-b522-72ce485a8657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:43.510417 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4151/8357] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:43 2022] DELETE /identity/v3/projects/b389ccf416cf441c935ef2ada9966b76 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:43.515455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c529727-9f0a-47b5-ab99-004181407bba None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:43.516014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c529727-9f0a-47b5-ab99-004181407bba None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:43.516179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c529727-9f0a-47b5-ab99-004181407bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:43.539325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2c529727-9f0a-47b5-ab99-004181407bba None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:43.541465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2c529727-9f0a-47b5-ab99-004181407bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:43.653618 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4207/8358] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:43.664681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16530b2-efae-4325-bbce-c403d2efc896 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:43.665076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16530b2-efae-4325-bbce-c403d2efc896 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:43.665356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16530b2-efae-4325-bbce-c403d2efc896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:43.730259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b16530b2-efae-4325-bbce-c403d2efc896 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:43.734627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b16530b2-efae-4325-bbce-c403d2efc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:43.758332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4152/8359] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:43.762621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c529727-9f0a-47b5-ab99-004181407bba None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:43.775246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c529727-9f0a-47b5-ab99-004181407bba None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:43.782510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:43.783466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:43.784257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:43.784257 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:43.784713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:43.785019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:43.788151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:43.808502 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4208/8360] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:53:43.812511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16530b2-efae-4325-bbce-c403d2efc896 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:43.826726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16530b2-efae-4325-bbce-c403d2efc896 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:43.851116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:43.852224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:43.854063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:43.855916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:43.858515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:43.862749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:44.099184 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4153/8361] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:43 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:53:44.106505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:44.117072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe037da-90b8-40ee-87b6-f454dd8794ad admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:44.246158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:44.246793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:44.247082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:44.248708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:44.250427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:44.253430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:44.321755 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:44.408752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:44.423521 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4209/8362] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:44 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:44.432313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d28b5e-a2f0-4e37-bddb-9c744c2a228f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:44.437479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:44.446480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:44.447136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:44.448832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:44.449991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:44.458097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:44.475398 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4154/8363] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:44.479818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:44.496259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879e6fb-e698-4913-89d4-29c24d191a13 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:44.511947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33132d3-a530-4b5c-a186-9b659ceffb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:44.512680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33132d3-a530-4b5c-a186-9b659ceffb47 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:44.513022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33132d3-a530-4b5c-a186-9b659ceffb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:44.513369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33132d3-a530-4b5c-a186-9b659ceffb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:44.514130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33132d3-a530-4b5c-a186-9b659ceffb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:44.515927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33132d3-a530-4b5c-a186-9b659ceffb47 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:44.571914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4210/8364] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:53:44.573577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:44.592483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05465a-212d-4fbe-aa67-4f7f511a10f8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:44.603580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:44.611892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:44.612185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:44.612464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] PATH_INFO: `/v3/projects/c58564afe4504c0a89595edf560b5dcf/users/e1ab334c8a0340339d73b8c6642a426c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:44.646120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58564afe4504c0a89595edf560b5dcf, user_id=e1ab334c8a0340339d73b8c6642a426c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:44.649015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:44.764054 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4155/8365] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:44 2022] PUT /identity/v3/projects/c58564afe4504c0a89595edf560b5dcf/users/e1ab334c8a0340339d73b8c6642a426c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:44.774460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc478234-8afe-451c-a592-e01499469502 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:44.774879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc478234-8afe-451c-a592-e01499469502 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:44.775390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc478234-8afe-451c-a592-e01499469502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:44.808720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bc478234-8afe-451c-a592-e01499469502 None None] MFA Rules not processed for user `e1ab334c8a0340339d73b8c6642a426c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:44.812994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bc478234-8afe-451c-a592-e01499469502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:44.886798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4211/8366] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:44.897391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:44.899709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:44.981663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50e4d-7715-476d-bc7a-55e5db522100 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:44.994541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:44.995400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:44.995888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:44.996322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:45.025774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:45.027409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:45.052004 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4156/8367] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:45.099265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b3bbf-25f5-4ffe-9aaf-77be55c1ff41 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:45.099992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b3bbf-25f5-4ffe-9aaf-77be55c1ff41 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:45.099992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b3bbf-25f5-4ffe-9aaf-77be55c1ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:45.100799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:45.150993 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-220b3bbf-25f5-4ffe-9aaf-77be55c1ff41 None None] MFA Rules not processed for user `2680256107a841b6bba7b959a0952c02`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:45.152493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-220b3bbf-25f5-4ffe-9aaf-77be55c1ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:45.260205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7a25-1147-4076-8193-6f0b3c2e199b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:45.266873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:45.267712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:45.268002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:45.268287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] PATH_INFO: `/v3/users/e1ab334c8a0340339d73b8c6642a426c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:45.269995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ab334c8a0340339d73b8c6642a426c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:45.272397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:45.330752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4212/8368] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:45.527022 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:45.557453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ab334c8a0340339d73b8c6642a426c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:45.584032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ab334c8a0340339d73b8c6642a426c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:45.592223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ab334c8a0340339d73b8c6642a426c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:45.593073 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ab334c8a0340339d73b8c6642a426c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:45.680091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ab334c8a0340339d73b8c6642a426c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:45.695094 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4157/8369] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:45 2022] DELETE /identity/v3/users/e1ab334c8a0340339d73b8c6642a426c => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:45.697317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:45.697828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:45.697924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:45.730120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:45.731601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:45.838347 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4213/8370] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:45.848144 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:45.850346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:45.931885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91acfd-d3b1-4491-8829-962794359452 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:45.937959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c7190-8a21-4c26-aef6-4806f4bbb530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:45.950302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7190-8a21-4c26-aef6-4806f4bbb530 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:45.950878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7190-8a21-4c26-aef6-4806f4bbb530 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:45.951311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7190-8a21-4c26-aef6-4806f4bbb530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:45.965345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c7190-8a21-4c26-aef6-4806f4bbb530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:45.967703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c7190-8a21-4c26-aef6-4806f4bbb530 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:45.991697 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4158/8371] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:46.716556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:46.719162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:46.730273 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:46.746061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb592b6-8f88-46ef-b4ca-94c224f2d0eb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:46.767290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:46.770577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:46.770577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:46.770577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] PATH_INFO: `/v3/projects/c58564afe4504c0a89595edf560b5dcf` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:46.771296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58564afe4504c0a89595edf560b5dcf)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:46.778125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:46.958368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58564afe4504c0a89595edf560b5dcf', 'request_id': 'req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:46.975596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58564afe4504c0a89595edf560b5dcf', 'request_id': 'req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:47.076467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58564afe4504c0a89595edf560b5dcf', 'request_id': 'req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:47.093415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] The token cache is being invalidate because project c58564afe4504c0a89595edf560b5dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:47.095415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:47.098061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c4e64c98-e6a0-4e9f-a05c-1e782e5f9429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:47.102123 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4214/8372] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:46 2022] DELETE /identity/v3/projects/c58564afe4504c0a89595edf560b5dcf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:47.107731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a9683-9566-496d-b6f8-97fafa7aabac None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:47.108712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a9683-9566-496d-b6f8-97fafa7aabac None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:47.108993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a9683-9566-496d-b6f8-97fafa7aabac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:47.150883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-941a9683-9566-496d-b6f8-97fafa7aabac None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:47.152190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-941a9683-9566-496d-b6f8-97fafa7aabac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:47.228025 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4159/8373] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:47.236434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa516f-4d39-4988-a2bd-cd633eb6dae9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:47.236720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa516f-4d39-4988-a2bd-cd633eb6dae9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:47.242665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa516f-4d39-4988-a2bd-cd633eb6dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:47.262828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-78aa516f-4d39-4988-a2bd-cd633eb6dae9 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:47.264732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78aa516f-4d39-4988-a2bd-cd633eb6dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:47.278797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4215/8374] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:47.283441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a9683-9566-496d-b6f8-97fafa7aabac None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:47.294512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a9683-9566-496d-b6f8-97fafa7aabac None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:47.303679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:47.304676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:47.304951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:47.306324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:47.307012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:47.307319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:47.308949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:47.326314 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4160/8375] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:53:47.328625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa516f-4d39-4988-a2bd-cd633eb6dae9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:47.345361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa516f-4d39-4988-a2bd-cd633eb6dae9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:47.362315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:47.362957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:47.363242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:47.363550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:47.364172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:47.366231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:47.534701 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4216/8376] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:47 2022] POST /identity/v3/projects => generated 403 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:47.538964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:47.556699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949259e0-b392-46c0-ad73-c731cd99ec1b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:47.638676 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:47.667122 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:47.667931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:47.668336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:47.668890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:47.669531 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:47.672562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:47.772958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:47.784375 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4161/8377] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:47 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:47.793637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5d830-965c-424e-9f11-0866b52890e2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:47.804737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:47.806205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:47.806709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:47.807183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:47.808092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:47.810149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:47.838417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:47.845712 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4217/8378] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:47.850962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76248ef8-71c8-45c1-a437-93caf94a7350 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:47.866742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e2730-11e5-4db7-bce1-5e5dbb51e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:47.903145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2730-11e5-4db7-bce1-5e5dbb51e787 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:47.904299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2730-11e5-4db7-bce1-5e5dbb51e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:47.909034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2730-11e5-4db7-bce1-5e5dbb51e787 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:47.910111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e2730-11e5-4db7-bce1-5e5dbb51e787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:47.918075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e2730-11e5-4db7-bce1-5e5dbb51e787 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:47.967617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:47.975904 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4162/8379] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:47.985648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de9bb5-3adb-4312-9fa0-82ec857c9bf3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:48.010728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:48.011438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:48.011710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:48.011994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] PATH_INFO: `/v3/projects/56d338ed1ec346b5b145b630bac81cbd/users/f9e607faf96b43f9a0c6e9053d9516ab/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:48.031668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d338ed1ec346b5b145b630bac81cbd, user_id=f9e607faf96b43f9a0c6e9053d9516ab, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:48.034964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:48.118188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4218/8380] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:47 2022] PUT /identity/v3/projects/56d338ed1ec346b5b145b630bac81cbd/users/f9e607faf96b43f9a0c6e9053d9516ab/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:48.123500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637b2e-c709-427d-8dff-478ada13e7df None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:48.124030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637b2e-c709-427d-8dff-478ada13e7df None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:48.124487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637b2e-c709-427d-8dff-478ada13e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:48.144428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b0637b2e-c709-427d-8dff-478ada13e7df None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:48.146018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b0637b2e-c709-427d-8dff-478ada13e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:48.232495 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4163/8381] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:48.235112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:48.237039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:48.386660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474469c3-211c-4cd5-b96d-81b2f4dc1dea admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:48.402849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:48.407392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:48.407668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:48.409048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:48.442308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:48.443793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:48.458831 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4219/8382] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:53:50.830756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2feb1-9748-48b2-9b92-6958b1b7e57d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:50.831308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2feb1-9748-48b2-9b92-6958b1b7e57d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:50.831419 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2feb1-9748-48b2-9b92-6958b1b7e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:50.868782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-02f2feb1-9748-48b2-9b92-6958b1b7e57d None None] MFA Rules not processed for user `f9e607faf96b43f9a0c6e9053d9516ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:50.870648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02f2feb1-9748-48b2-9b92-6958b1b7e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:50.994775 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4164/8383] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:51.002125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:51.015729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0d472-41bb-4c00-8582-0f3e559b298c service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:51.022479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:51.023417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:51.024955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:51.025926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:51.032843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:51.032843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:51.175028 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4220/8384] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:51 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:51.179630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2feb1-9748-48b2-9b92-6958b1b7e57d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:51.201910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2feb1-9748-48b2-9b92-6958b1b7e57d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:51.268868 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:51.281621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:51.282864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:51.283369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:51.283770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:51.284509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:51.286663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:51.392848 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4165/8385] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:53:51 2022] POST /identity/v3/users => generated 309 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:53:51.394906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:51.402724 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:51.411906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986beb-c4b4-449d-ab5d-81c6999c1da3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:51.417886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:51.418487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:51.418770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:51.419044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:51.419748 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:51.421372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:51.440837 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4221/8386] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:51.445057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:51.462282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076178ce-7fba-45a1-bac4-d32f0c2a1b61 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:51.463501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:51.464192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:51.464523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:51.464847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] PATH_INFO: `/v3/projects/1dcb013bf5504e9082a5274823478c83/users/1420bdc1ab684cdab727c8efa2f455a3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:51.486882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcb013bf5504e9082a5274823478c83, user_id=1420bdc1ab684cdab727c8efa2f455a3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:51.490665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:51.623255 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4166/8387] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:51 2022] PUT /identity/v3/projects/1dcb013bf5504e9082a5274823478c83/users/1420bdc1ab684cdab727c8efa2f455a3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:51.627918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:51.644394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175f09-9aa1-4f35-b076-3491acfa111f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:51.732316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d7012-88e1-4cd5-834f-44bc5f9e24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:51.732989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7012-88e1-4cd5-834f-44bc5f9e24c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:51.733428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7012-88e1-4cd5-834f-44bc5f9e24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:51.734135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d7012-88e1-4cd5-834f-44bc5f9e24c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:51.735060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d7012-88e1-4cd5-834f-44bc5f9e24c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:51.736710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d7012-88e1-4cd5-834f-44bc5f9e24c8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:51.752107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4222/8388] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:53:51.753334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:51.766747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab2248-c41c-47c4-9d57-8673230b55da admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:51.776734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7bb6-2efb-454c-a610-89c00b02cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:51.777482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7bb6-2efb-454c-a610-89c00b02cf99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:51.777838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7bb6-2efb-454c-a610-89c00b02cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:51.778145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7bb6-2efb-454c-a610-89c00b02cf99 admin admin] PATH_INFO: `/v3/projects/1dcb013bf5504e9082a5274823478c83/users/1420bdc1ab684cdab727c8efa2f455a3/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:51.780259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7bb6-2efb-454c-a610-89c00b02cf99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcb013bf5504e9082a5274823478c83, user_id=1420bdc1ab684cdab727c8efa2f455a3, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:51.783398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7bb6-2efb-454c-a610-89c00b02cf99 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:51.797293 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4167/8389] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:53:51 2022] PUT /identity/v3/projects/1dcb013bf5504e9082a5274823478c83/users/1420bdc1ab684cdab727c8efa2f455a3/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:53:53.657696 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d3a4-ade9-47fd-aa34-8f9e34392f07 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:53.658348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d3a4-ade9-47fd-aa34-8f9e34392f07 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:53.658434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d3a4-ade9-47fd-aa34-8f9e34392f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:53.713897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ab62d3a4-ade9-47fd-aa34-8f9e34392f07 None None] MFA Rules not processed for user `d7d8e24e5dee4a7899769c92c6754995`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:53.715272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab62d3a4-ade9-47fd-aa34-8f9e34392f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:53.833457 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4223/8390] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:54.236576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180490-7ba0-483d-9acd-1d837ab58238 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:54.237130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180490-7ba0-483d-9acd-1d837ab58238 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:54.237130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180490-7ba0-483d-9acd-1d837ab58238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:54.340399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b0180490-7ba0-483d-9acd-1d837ab58238 None None] MFA Rules not processed for user `1420bdc1ab684cdab727c8efa2f455a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:54.341949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b0180490-7ba0-483d-9acd-1d837ab58238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:54.526408 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4168/8391] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:56.972320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62d3a4-ade9-47fd-aa34-8f9e34392f07 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:57.063502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62d3a4-ade9-47fd-aa34-8f9e34392f07 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:57.067728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:57.068375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:57.068801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:57.068922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] PATH_INFO: `/v3/users/f9e607faf96b43f9a0c6e9053d9516ab` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:57.070079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e607faf96b43f9a0c6e9053d9516ab)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:57.072626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:57.304564 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:57.315646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e607faf96b43f9a0c6e9053d9516ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:57.316383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e607faf96b43f9a0c6e9053d9516ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:57.490729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e607faf96b43f9a0c6e9053d9516ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:57.503033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e607faf96b43f9a0c6e9053d9516ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:57.505988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e607faf96b43f9a0c6e9053d9516ab'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:57.549489 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4224/8392] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:56 2022] DELETE /identity/v3/users/f9e607faf96b43f9a0c6e9053d9516ab => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:57.892912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0180490-7ba0-483d-9acd-1d837ab58238 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:57.921923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0180490-7ba0-483d-9acd-1d837ab58238 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:58.014814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:58.014814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:58.014814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:58.014814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] PATH_INFO: `/v3/projects/56d338ed1ec346b5b145b630bac81cbd` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:58.015311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d338ed1ec346b5b145b630bac81cbd)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:58.015311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:58.194834 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:58.213160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d338ed1ec346b5b145b630bac81cbd', 'request_id': 'req-a7170901-8d46-46ee-b6c2-c12cc245f76a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.226267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d338ed1ec346b5b145b630bac81cbd', 'request_id': 'req-a7170901-8d46-46ee-b6c2-c12cc245f76a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.324884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d338ed1ec346b5b145b630bac81cbd', 'request_id': 'req-a7170901-8d46-46ee-b6c2-c12cc245f76a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.337257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] The token cache is being invalidate because project 56d338ed1ec346b5b145b630bac81cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:58.337666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.338358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.339941 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4169/8393] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:57 2022] DELETE /identity/v3/projects/56d338ed1ec346b5b145b630bac81cbd => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:58.343874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:58.345328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:58.360574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482949d-1f91-4d7f-bbb8-96744a847e3c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:58.425018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:58.427795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:58.427795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:58.427795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] PATH_INFO: `/v3/users/1420bdc1ab684cdab727c8efa2f455a3` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:58.427795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1420bdc1ab684cdab727c8efa2f455a3)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:58.429325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:58.707960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1420bdc1ab684cdab727c8efa2f455a3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.708648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1420bdc1ab684cdab727c8efa2f455a3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.819169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1420bdc1ab684cdab727c8efa2f455a3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.828298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1420bdc1ab684cdab727c8efa2f455a3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.829450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4b63fdd4-55b3-4f07-9114-6f53f44d970e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1420bdc1ab684cdab727c8efa2f455a3'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:58.851724 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4225/8394] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:53:58 2022] DELETE /identity/v3/users/1420bdc1ab684cdab727c8efa2f455a3 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:59.203226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:59.204737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:59.220085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170901-8d46-46ee-b6c2-c12cc245f76a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:59.293623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:59.301658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:59.301658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:59.301658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] PATH_INFO: `/v3/projects/1dcb013bf5504e9082a5274823478c83` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:59.301658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcb013bf5504e9082a5274823478c83)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:59.301658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:59.451392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcb013bf5504e9082a5274823478c83', 'request_id': 'req-4b53e2fd-999c-4477-9423-e4b05ad193f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:59.457851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcb013bf5504e9082a5274823478c83', 'request_id': 'req-4b53e2fd-999c-4477-9423-e4b05ad193f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:59.543153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcb013bf5504e9082a5274823478c83', 'request_id': 'req-4b53e2fd-999c-4477-9423-e4b05ad193f5'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:59.562148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] The token cache is being invalidate because project 1dcb013bf5504e9082a5274823478c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:53:59.562507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:59.564255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4b53e2fd-999c-4477-9423-e4b05ad193f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:53:59.566229 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4170/8395] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:53:59 2022] DELETE /identity/v3/projects/1dcb013bf5504e9082a5274823478c83 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:53:59.572203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc369e-a33c-4f11-aa0e-df22100670b4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:59.572710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc369e-a33c-4f11-aa0e-df22100670b4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:59.572799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc369e-a33c-4f11-aa0e-df22100670b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:59.593416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-80fc369e-a33c-4f11-aa0e-df22100670b4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:59.594968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-80fc369e-a33c-4f11-aa0e-df22100670b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:59.626341 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:59.664864 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4226/8396] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:59.764910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18b64-5d3e-4117-916f-216326cd086c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:59.765571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18b64-5d3e-4117-916f-216326cd086c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:59.765571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18b64-5d3e-4117-916f-216326cd086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:59.791254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fab18b64-5d3e-4117-916f-216326cd086c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:59.792920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fab18b64-5d3e-4117-916f-216326cd086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:59.806857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc369e-a33c-4f11-aa0e-df22100670b4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:59.807849 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4171/8397] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:59.818666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc369e-a33c-4f11-aa0e-df22100670b4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:59.824106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:59.824789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:59.827601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:59.827601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:59.827601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:53:59.827601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:59.828106 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:59.841072 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4227/8398] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:53:59.845599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18b64-5d3e-4117-916f-216326cd086c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:59.858104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18b64-5d3e-4117-916f-216326cd086c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:59.863126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:59.863829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:59.864345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:59.864854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:59.865704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:59.868238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:00.017624 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4172/8399] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:53:59 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:00.023211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:00.058345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a9c75-80b1-4c6d-8c08-c93278c80d63 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:00.133709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:00.134798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:00.135267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:00.135728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:00.137418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:00.140255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:00.275577 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4228/8400] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:54:00 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:00.279777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:00.296244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c71dd-21c0-4914-89a3-25ccc6756850 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:00.312730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:00.313446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:00.313645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:00.313979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:00.316898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:00.317742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:00.336675 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4173/8401] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:54:00.340443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:00.352460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e0b92-8e56-4457-aa1a-b821ff9d94c7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:00.358321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c630f8-6cdb-4023-bea2-cf2de4d303c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:00.359147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c630f8-6cdb-4023-bea2-cf2de4d303c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:00.359584 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c630f8-6cdb-4023-bea2-cf2de4d303c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:00.360008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c630f8-6cdb-4023-bea2-cf2de4d303c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:00.360832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c630f8-6cdb-4023-bea2-cf2de4d303c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:00.364191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c630f8-6cdb-4023-bea2-cf2de4d303c1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:00.380318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4229/8402] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:00.381329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:00.397285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80b4af-24b5-47da-9127-f55b7044a94b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:00.402946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:00.404004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:00.404555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:00.405076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] PATH_INFO: `/v3/projects/de05d100400f49de8513e3f68fcb7648/users/edfc8789e9994d58a209ef9112a936a8/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:00.410299 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:00.431005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de05d100400f49de8513e3f68fcb7648, user_id=edfc8789e9994d58a209ef9112a936a8, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:00.434607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:00.605753 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4174/8403] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:00 2022] PUT /identity/v3/projects/de05d100400f49de8513e3f68fcb7648/users/edfc8789e9994d58a209ef9112a936a8/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:00.615803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6c0-fe60-4572-99af-d3f0ee3826e6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:00.616249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6c0-fe60-4572-99af-d3f0ee3826e6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:00.616249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6c0-fe60-4572-99af-d3f0ee3826e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:00.646169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1b1fb6c0-fe60-4572-99af-d3f0ee3826e6 None None] MFA Rules not processed for user `edfc8789e9994d58a209ef9112a936a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:00.647373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b1fb6c0-fe60-4572-99af-d3f0ee3826e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:00.725312 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4230/8404] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:00.735513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:00.833338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e909994-2856-4049-b708-37e78c601f44 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:00.839310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:00.839924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:00.840207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:00.840481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:00.841123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:00.843074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:00.950550 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4175/8405] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:54:00 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:00.951670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb6c0-fe60-4572-99af-d3f0ee3826e6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:00.963387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb6c0-fe60-4572-99af-d3f0ee3826e6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:01.038126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:01.040301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:01.040613 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:01.041059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:01.041918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:01.044549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:01.175918 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4231/8406] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:54:00 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:54:01.177289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:01.190065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897e320-744d-4931-938b-e283060591d1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:01.209404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:01.210079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:01.210368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:01.210664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:01.211332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:01.212946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:01.234418 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4176/8407] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:01.240298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:01.259968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42bcd8-fecd-4964-ac39-0f246701992a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:01.267210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:01.268163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:01.268602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:01.269030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] PATH_INFO: `/v3/projects/d7d714cfcc2d488f82cea2adcf3dcce5/users/32cad466416f4bf9bba85eb5fb9f78d2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:01.287209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d714cfcc2d488f82cea2adcf3dcce5, user_id=32cad466416f4bf9bba85eb5fb9f78d2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:01.291622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:01.371841 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4232/8408] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:01 2022] PUT /identity/v3/projects/d7d714cfcc2d488f82cea2adcf3dcce5/users/32cad466416f4bf9bba85eb5fb9f78d2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:54:01.376485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:01.393182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b2670-6d89-40f9-b740-7eb905d013d0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:01.411347 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:01.472414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2318173-8d8c-461a-94f7-17b3a91e299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:01.473188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318173-8d8c-461a-94f7-17b3a91e299d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:01.473479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318173-8d8c-461a-94f7-17b3a91e299d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:01.473839 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318173-8d8c-461a-94f7-17b3a91e299d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:01.474648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2318173-8d8c-461a-94f7-17b3a91e299d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:01.476498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2318173-8d8c-461a-94f7-17b3a91e299d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:01.488579 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4177/8409] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:01.493485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:01.504536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b539f-aca0-4017-b230-1b8c47fcf632 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:01.510519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:01.511541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:01.511999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:01.512498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] PATH_INFO: `/v3/projects/d7d714cfcc2d488f82cea2adcf3dcce5/users/32cad466416f4bf9bba85eb5fb9f78d2/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:01.515057 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d714cfcc2d488f82cea2adcf3dcce5, user_id=32cad466416f4bf9bba85eb5fb9f78d2, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:01.518362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:01.531420 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4233/8410] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:01 2022] PUT /identity/v3/projects/d7d714cfcc2d488f82cea2adcf3dcce5/users/32cad466416f4bf9bba85eb5fb9f78d2/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:01.543690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7ee75-818a-4975-a92c-f265747050f6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:01.543978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7ee75-818a-4975-a92c-f265747050f6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:01.544449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7ee75-818a-4975-a92c-f265747050f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:01.588154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-34f7ee75-818a-4975-a92c-f265747050f6 None None] MFA Rules not processed for user `32cad466416f4bf9bba85eb5fb9f78d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:01.589726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-34f7ee75-818a-4975-a92c-f265747050f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:01.697933 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4178/8411] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:02.052682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:02.053152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:02.131284 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:02.136122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a6ee4-0c93-44be-9da3-023f3e89f874 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:02.140103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abcb48-832c-42eb-97fe-d2a63f272e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:02.140872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abcb48-832c-42eb-97fe-d2a63f272e7e service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:02.141152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abcb48-832c-42eb-97fe-d2a63f272e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:02.141426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abcb48-832c-42eb-97fe-d2a63f272e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:02.153740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abcb48-832c-42eb-97fe-d2a63f272e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:02.155027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abcb48-832c-42eb-97fe-d2a63f272e7e service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:02.166417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4234/8412] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:03.761620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7ee75-818a-4975-a92c-f265747050f6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:03.838787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7ee75-818a-4975-a92c-f265747050f6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:03.843439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:03.844077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:03.844360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:03.844634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] PATH_INFO: `/v3/users/edfc8789e9994d58a209ef9112a936a8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:03.845744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfc8789e9994d58a209ef9112a936a8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:03.847719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:04.104661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfc8789e9994d58a209ef9112a936a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:04.116552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfc8789e9994d58a209ef9112a936a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:04.124027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfc8789e9994d58a209ef9112a936a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:04.124707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfc8789e9994d58a209ef9112a936a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:04.193855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfc8789e9994d58a209ef9112a936a8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:04.202092 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4179/8413] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:54:03 2022] DELETE /identity/v3/users/edfc8789e9994d58a209ef9112a936a8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:04.207419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:04.207902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:04.208002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:04.230072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:04.232113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:04.299613 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4235/8414] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:04.309439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:04.316327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:04.377164 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55103e72-4124-4734-898f-ca0b47c1b7cc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:04.381106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:04.381670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:04.382031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:04.382530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:04.395712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:04.397192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:04.408072 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4180/8415] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:04.825670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:04.827314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:04.845004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8fcc-774d-4ba8-829a-8dd502c298c0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:04.849951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:04.850596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:04.850873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:04.851404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] PATH_INFO: `/v3/projects/de05d100400f49de8513e3f68fcb7648` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:04.852557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de05d100400f49de8513e3f68fcb7648)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:04.855087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:04.875974 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:04.993891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de05d100400f49de8513e3f68fcb7648', 'request_id': 'req-b8409ead-cc76-4072-8a19-4318475420d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.002538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de05d100400f49de8513e3f68fcb7648', 'request_id': 'req-b8409ead-cc76-4072-8a19-4318475420d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.070144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de05d100400f49de8513e3f68fcb7648', 'request_id': 'req-b8409ead-cc76-4072-8a19-4318475420d4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.082286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] The token cache is being invalidate because project de05d100400f49de8513e3f68fcb7648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:54:05.082586 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.083258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.084798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4236/8416] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:54:04 2022] DELETE /identity/v3/projects/de05d100400f49de8513e3f68fcb7648 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:05.089543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:05.094633 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:05.100216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23bf7c-8d2d-4144-b761-527f53437f03 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:05.162353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:05.162986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:05.163270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:05.163537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] PATH_INFO: `/v3/users/32cad466416f4bf9bba85eb5fb9f78d2` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:05.164682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=32cad466416f4bf9bba85eb5fb9f78d2)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:05.168129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:05.415759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32cad466416f4bf9bba85eb5fb9f78d2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.429306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32cad466416f4bf9bba85eb5fb9f78d2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.437744 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32cad466416f4bf9bba85eb5fb9f78d2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.438517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32cad466416f4bf9bba85eb5fb9f78d2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.504415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4776c4b2-8acc-43a6-98bc-6a6d8b334aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32cad466416f4bf9bba85eb5fb9f78d2'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:05.511678 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4181/8417] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:54:05 2022] DELETE /identity/v3/users/32cad466416f4bf9bba85eb5fb9f78d2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:05.998382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:06.000151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:06.019272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8409ead-cc76-4072-8a19-4318475420d4 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:06.102627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:06.102793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:06.103078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:06.103371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] PATH_INFO: `/v3/projects/d7d714cfcc2d488f82cea2adcf3dcce5` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:06.105467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d714cfcc2d488f82cea2adcf3dcce5)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:06.107573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:06.209270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d714cfcc2d488f82cea2adcf3dcce5', 'request_id': 'req-2c1fec08-3d06-4db5-8922-ea247aef9735'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:06.216468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d714cfcc2d488f82cea2adcf3dcce5', 'request_id': 'req-2c1fec08-3d06-4db5-8922-ea247aef9735'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:06.306086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d714cfcc2d488f82cea2adcf3dcce5', 'request_id': 'req-2c1fec08-3d06-4db5-8922-ea247aef9735'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:06.336043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] The token cache is being invalidate because project d7d714cfcc2d488f82cea2adcf3dcce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:54:06.336690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:06.337637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2c1fec08-3d06-4db5-8922-ea247aef9735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:06.340608 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4237/8418] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:54:05 2022] DELETE /identity/v3/projects/d7d714cfcc2d488f82cea2adcf3dcce5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:06.345431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3d5d-e3cf-496a-8a02-b7c9d50a5c61 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:06.346485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3d5d-e3cf-496a-8a02-b7c9d50a5c61 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:06.346942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f3d5d-e3cf-496a-8a02-b7c9d50a5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:06.368215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-049f3d5d-e3cf-496a-8a02-b7c9d50a5c61 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:06.370109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-049f3d5d-e3cf-496a-8a02-b7c9d50a5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:06.446838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4182/8419] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:06.455250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced652-5710-431e-9309-4d11ad20b578 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:06.460350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced652-5710-431e-9309-4d11ad20b578 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:06.460350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced652-5710-431e-9309-4d11ad20b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:06.477250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-deced652-5710-431e-9309-4d11ad20b578 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:06.478491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-deced652-5710-431e-9309-4d11ad20b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:06.487200 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4238/8420] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:06.491629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3d5d-e3cf-496a-8a02-b7c9d50a5c61 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:06.503412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f3d5d-e3cf-496a-8a02-b7c9d50a5c61 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:06.512465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:06.512465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:06.512465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:06.512465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:06.512846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:54:06.512846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:06.513216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:06.525334 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4183/8421] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:54:06.532809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced652-5710-431e-9309-4d11ad20b578 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:06.542851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced652-5710-431e-9309-4d11ad20b578 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:06.547609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:06.548216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:06.548547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:06.548758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:06.549399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:06.551447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:06.672814 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4239/8422] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:54:06 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:06.676991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:06.687594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501f12c-7351-4c37-8c42-75002fbf3852 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:06.692207 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:06.744358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:06.745055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:06.745334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:06.745607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:06.746269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:06.748343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:06.954203 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4184/8423] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:54:06 2022] POST /identity/v3/users => generated 282 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:06.960246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:06.971161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77d63c-2112-4ff3-bc03-85e0cb698fa9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:06.975652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:06.976248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:06.976515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:06.976789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:06.977419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:06.979061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:06.980315 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:06.989729 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4240/8424] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:06.993743 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.004227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57021122-68c4-4543-8537-e9b5b83c60f9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.008993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f759159-ed26-4ce0-8fe2-06fe59c368b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.009629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f759159-ed26-4ce0-8fe2-06fe59c368b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.010615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f759159-ed26-4ce0-8fe2-06fe59c368b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.010904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f759159-ed26-4ce0-8fe2-06fe59c368b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.011763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f759159-ed26-4ce0-8fe2-06fe59c368b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.013352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f759159-ed26-4ce0-8fe2-06fe59c368b2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.024691 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4185/8425] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:07.029600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.040223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33a33-0a27-4571-9cfe-33d3e2e91501 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.045110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.045764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.046147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.046427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] PATH_INFO: `/v3/projects/51591a0187af43a1be175a9574de6a29/users/9efed1517f514d19b8d482cf414052a6/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.060939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51591a0187af43a1be175a9574de6a29, user_id=9efed1517f514d19b8d482cf414052a6, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.063681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.124217 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4241/8426] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:07 2022] PUT /identity/v3/projects/51591a0187af43a1be175a9574de6a29/users/9efed1517f514d19b8d482cf414052a6/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:07.134389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16da6e-a336-45fc-a24d-84e72ae35a91 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.134757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16da6e-a336-45fc-a24d-84e72ae35a91 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.135863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16da6e-a336-45fc-a24d-84e72ae35a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.164846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4a16da6e-a336-45fc-a24d-84e72ae35a91 None None] MFA Rules not processed for user `9efed1517f514d19b8d482cf414052a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:07.168534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4a16da6e-a336-45fc-a24d-84e72ae35a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:07.234172 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4186/8427] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:07.238707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.307901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f1c8f-6d14-428f-8a19-eddf5fa2474b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.312719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.313535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.313641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.313891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.314538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.316445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.373470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a4de0-27ba-4722-a851-167b98f138b9 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.374046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a4de0-27ba-4722-a851-167b98f138b9 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.374046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a4de0-27ba-4722-a851-167b98f138b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.396909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-bc1a4de0-27ba-4722-a851-167b98f138b9 None None] MFA Rules not processed for user `2f9b4dd6a12f4060b25d95bb4c503c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:07.398153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bc1a4de0-27ba-4722-a851-167b98f138b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:07.417500 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4242/8428] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:54:07 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:07.421188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.464461 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4187/8429] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:54:07.489747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55315013-9307-421c-998b-e20b1cd8cf80 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.496018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.500916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.500916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.500916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.500916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.500916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.613778 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4243/8430] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:54:07 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:54:07.619856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a4de0-27ba-4722-a851-167b98f138b9 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.633366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a4de0-27ba-4722-a851-167b98f138b9 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.639925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.642919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.642919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.642919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.642919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.643478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.656139 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4188/8431] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:07.660166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.672016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b6281-7ae9-484d-aec5-4ec36b86913f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.677086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.677870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.678159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.678431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] PATH_INFO: `/v3/projects/7579f58654d04183a02ef769e94166a0/users/ea0507295c674539be0f7819c94e8f2c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.694792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7579f58654d04183a02ef769e94166a0, user_id=ea0507295c674539be0f7819c94e8f2c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.698456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.815919 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4244/8432] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:07 2022] PUT /identity/v3/projects/7579f58654d04183a02ef769e94166a0/users/ea0507295c674539be0f7819c94e8f2c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:07.823588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.834446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85fb7-5854-4ed8-a0c0-c4147881f76c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.890377 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:07.901513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af2b2d-7718-4472-b593-bbc402d6ece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.902516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2b2d-7718-4472-b593-bbc402d6ece9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.902516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2b2d-7718-4472-b593-bbc402d6ece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.902799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2b2d-7718-4472-b593-bbc402d6ece9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.903424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af2b2d-7718-4472-b593-bbc402d6ece9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.905011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af2b2d-7718-4472-b593-bbc402d6ece9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.917850 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4189/8433] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:07.921839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:07.932729 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13491d7-e360-4c87-b9cc-16da5f243285 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:07.937676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:07.938468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.938634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.939079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] PATH_INFO: `/v3/projects/7579f58654d04183a02ef769e94166a0/users/ea0507295c674539be0f7819c94e8f2c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:07.941042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7579f58654d04183a02ef769e94166a0, user_id=ea0507295c674539be0f7819c94e8f2c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:07.943899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:07.977948 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4245/8434] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:07 2022] PUT /identity/v3/projects/7579f58654d04183a02ef769e94166a0/users/ea0507295c674539be0f7819c94e8f2c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:07.987136 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:07.987436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:07.987676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:08.017527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] MFA Rules not processed for user `ea0507295c674539be0f7819c94e8f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:08.018894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:08.100153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:08.101836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:08.106127 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4190/8435] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:08.119974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:08.121529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:08.149836 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:08.175229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc46aa-2fc4-4bb5-b854-f29575dc0005 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:08.179776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:08.180623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:08.180891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:08.181150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:08.183616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:08.205017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:08.211144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:08.217508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a7da8-bd2a-4155-a3cb-0fb5a8379d2a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:08.222355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:08.223167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:08.223616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:08.224087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:08.233604 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4246/8436] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:54:08.254667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:08.256215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:08.272082 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4191/8437] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:54:08.598223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:08.611199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641bd0b-2d29-4b02-9f94-67ac2dbb6c26 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:08.617832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:08.617832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:08.617832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:08.617832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:08.673335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:08.674832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:08.684491 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4247/8438] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:17.150451 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:17.169770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a95a1-d5bc-4a18-9805-cda201f3d55f service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:17.178582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:17.179726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:17.182397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:17.182397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:17.183676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:17.225329 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:17.271748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:17.274149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:17.294173 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4192/8439] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:18.884648 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=50 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:19.566308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:19.567885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:19.687460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe01602-d776-491f-9878-8834176949eb service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:19.694140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:19.702453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:19.702453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:19.702453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:19.702453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:19.718615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:19.720580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:19.738952 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4248/8440] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:27.284400 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=14 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:29.730660 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=34 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:48.890307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:48.891778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:48.998268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43054d-5f02-458b-a29f-cd1aae2c9f93 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:49.003673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335a93b-4125-44e0-b769-f45d054945df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:49.005652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a93b-4125-44e0-b769-f45d054945df service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:49.005652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a93b-4125-44e0-b769-f45d054945df service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:49.005652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a93b-4125-44e0-b769-f45d054945df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:49.006833 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5335a93b-4125-44e0-b769-f45d054945df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:49.066493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335a93b-4125-44e0-b769-f45d054945df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:49.068039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335a93b-4125-44e0-b769-f45d054945df service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:49.077069 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4193/8441] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:54:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:54:51.319145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:51.410218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fa61a-7507-4e95-b607-31ae3680c336 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:51.415733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:51.416535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:51.416914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:51.417288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] PATH_INFO: `/v3/users/9efed1517f514d19b8d482cf414052a6` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:51.422449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efed1517f514d19b8d482cf414052a6)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:51.424493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:51.728546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efed1517f514d19b8d482cf414052a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:51.729342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efed1517f514d19b8d482cf414052a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:51.860956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efed1517f514d19b8d482cf414052a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:51.868947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efed1517f514d19b8d482cf414052a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:51.870362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efed1517f514d19b8d482cf414052a6'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:51.890002 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4249/8442] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:54:51 2022] DELETE /identity/v3/users/9efed1517f514d19b8d482cf414052a6 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:51.896564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:51.897059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:51.897181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:51.920178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:51.922137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:51.989883 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4194/8443] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:54:52.008221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:52.010051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:52.088451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6f8de-cc72-48a0-a529-af47194de4a1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:52.092125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:52.092789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:52.093272 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:52.093509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:52.103539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:52.108361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:52.115361 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4250/8444] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:52.855800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:52.857960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:52.878028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84117-a6b1-45a4-bbf7-c79a433fb6c3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:52.886843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:52.886843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:52.886843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:52.886843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] PATH_INFO: `/v3/projects/51591a0187af43a1be175a9574de6a29` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:52.887715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51591a0187af43a1be175a9574de6a29)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:52.889758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:52.994120 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:53.022752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51591a0187af43a1be175a9574de6a29', 'request_id': 'req-f7a24e82-08d5-4882-90c5-d492607ac94c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.028594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51591a0187af43a1be175a9574de6a29', 'request_id': 'req-f7a24e82-08d5-4882-90c5-d492607ac94c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.129137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51591a0187af43a1be175a9574de6a29', 'request_id': 'req-f7a24e82-08d5-4882-90c5-d492607ac94c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.142543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] The token cache is being invalidate because project 51591a0187af43a1be175a9574de6a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:54:53.142838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.143583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.145340 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4195/8445] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:54:52 2022] DELETE /identity/v3/projects/51591a0187af43a1be175a9574de6a29 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:53.149461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:53.160381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5d935-f3f3-4332-b793-8123aaab3968 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:53.179861 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:53.222363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:53.223010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:53.223298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:53.223579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] PATH_INFO: `/v3/users/ea0507295c674539be0f7819c94e8f2c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:53.224740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0507295c674539be0f7819c94e8f2c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:53.226776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:53.488879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0507295c674539be0f7819c94e8f2c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.489580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0507295c674539be0f7819c94e8f2c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.609950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0507295c674539be0f7819c94e8f2c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.622907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0507295c674539be0f7819c94e8f2c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.623442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-babfd403-cb95-4fac-a567-049e904821bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0507295c674539be0f7819c94e8f2c'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:53.651081 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4251/8446] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:54:53 2022] DELETE /identity/v3/users/ea0507295c674539be0f7819c94e8f2c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:54.378437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:54.380399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:54.410289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a24e82-08d5-4882-90c5-d492607ac94c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:54.485692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:54.486641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:54.487305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:54.492185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] PATH_INFO: `/v3/projects/7579f58654d04183a02ef769e94166a0` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:54.492185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7579f58654d04183a02ef769e94166a0)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:54.492185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:54.698039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7579f58654d04183a02ef769e94166a0', 'request_id': 'req-91f552f7-0799-4c1d-8252-b3f5a5bcf236'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:54.709429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7579f58654d04183a02ef769e94166a0', 'request_id': 'req-91f552f7-0799-4c1d-8252-b3f5a5bcf236'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:54.872057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7579f58654d04183a02ef769e94166a0', 'request_id': 'req-91f552f7-0799-4c1d-8252-b3f5a5bcf236'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:54.892804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] The token cache is being invalidate because project 7579f58654d04183a02ef769e94166a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:54:54.893242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:54.899361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91f552f7-0799-4c1d-8252-b3f5a5bcf236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:54.899361 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4196/8447] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:54:54 2022] DELETE /identity/v3/projects/7579f58654d04183a02ef769e94166a0 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:54.903362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57efc-7e2c-47ff-a2b9-44c75e39f4d2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:54.903895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57efc-7e2c-47ff-a2b9-44c75e39f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:54.903895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57efc-7e2c-47ff-a2b9-44c75e39f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:54.936187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-50a57efc-7e2c-47ff-a2b9-44c75e39f4d2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:54.936187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-50a57efc-7e2c-47ff-a2b9-44c75e39f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:55.066121 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4252/8448] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:54:55.074249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c3be6-41ae-4928-8b90-6c5c7d97169c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.074533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c3be6-41ae-4928-8b90-6c5c7d97169c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.074807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c3be6-41ae-4928-8b90-6c5c7d97169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.096822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6d6c3be6-41ae-4928-8b90-6c5c7d97169c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:55.098157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6d6c3be6-41ae-4928-8b90-6c5c7d97169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:55.110289 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4197/8449] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:55.111673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57efc-7e2c-47ff-a2b9-44c75e39f4d2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:55.122725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57efc-7e2c-47ff-a2b9-44c75e39f4d2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:55.129205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:55.129889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.130245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.130530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.131227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:54:55.131539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:55.133287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:55.147512 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4253/8450] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:54:55.152010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c3be6-41ae-4928-8b90-6c5c7d97169c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:55.162681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c3be6-41ae-4928-8b90-6c5c7d97169c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:55.167781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:55.172345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.172345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.172345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.172345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:55.172880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:55.313766 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4198/8451] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:54:55 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:55.317769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:55.337631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4ac19-a49e-4eac-a533-63bd4b833313 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:55.382852 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:55.447616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:55.448081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.448366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.448806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.449734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:55.452074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:55.620851 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4254/8452] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:54:55 2022] POST /identity/v3/users => generated 285 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:55.624910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:55.635308 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abc8ff-9e98-4c47-8b7a-fd23f11cf5a5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:55.640581 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:55.643759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.643759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.643759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.643759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:55.644214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:55.654823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4199/8453] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:55.659661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:55.669938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6023f-5a50-4d8f-89e4-edb241d6248e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:55.676014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f637e6-0da5-45c6-9e3e-191c68a1fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:55.741343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f637e6-0da5-45c6-9e3e-191c68a1fce5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.741343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f637e6-0da5-45c6-9e3e-191c68a1fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.741343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f637e6-0da5-45c6-9e3e-191c68a1fce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.741343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f637e6-0da5-45c6-9e3e-191c68a1fce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:55.741343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f637e6-0da5-45c6-9e3e-191c68a1fce5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:55.741343 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4255/8454] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:54:55.744217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:55.751044 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:55.754917 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f976f-4f02-4205-9d9e-7b661887c081 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:55.759597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:55.764217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.764217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.764217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] PATH_INFO: `/v3/projects/87be46f066284bb5be1cb87214a42eae/users/def210814d8f44438d34d55551bde23e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.783978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87be46f066284bb5be1cb87214a42eae, user_id=def210814d8f44438d34d55551bde23e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:55.787024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:55.910303 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4200/8455] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:55 2022] PUT /identity/v3/projects/87be46f066284bb5be1cb87214a42eae/users/def210814d8f44438d34d55551bde23e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:55.928451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f1ce-184b-45c2-b63f-c1a0e90845b2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.929007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f1ce-184b-45c2-b63f-c1a0e90845b2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.929098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f1ce-184b-45c2-b63f-c1a0e90845b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.973750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b638f1ce-184b-45c2-b63f-c1a0e90845b2 None None] MFA Rules not processed for user `def210814d8f44438d34d55551bde23e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:55.975396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b638f1ce-184b-45c2-b63f-c1a0e90845b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:56.069017 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4256/8456] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:56.073421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.154724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb0d12-9e46-41ea-865f-3cb05d36689f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.159442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.160052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.160334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.160610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.161243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.163174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.347226 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4201/8457] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:54:56 2022] POST /identity/v3/projects => generated 369 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:56.351529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f1ce-184b-45c2-b63f-c1a0e90845b2 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.363802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f1ce-184b-45c2-b63f-c1a0e90845b2 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.434424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.437419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.437419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.437419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.437419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.439194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.498328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.501362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:56.585846 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4257/8458] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:54:56 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:54:56.589770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.589939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b3bfc-509a-43c6-9e14-60dbd1968a4c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.595423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.596124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.596364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.596640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.598424 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:56.603408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82433fe2-43ca-4a98-a217-04264a35f4ca admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.610579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.612089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.612089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.612089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.612600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.614281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.617927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.619740 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.626989 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4258/8459] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:54:56.631230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.636415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4202/8460] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:54:56.643143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe06f7-aa60-4c68-ba27-aeba81e0c29a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.649408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.650252 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.650622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.650979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] PATH_INFO: `/v3/projects/c5623ca270e743a4b02df235c09a0515/users/ad29c1e17c78456f91df4dbd2454e14c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.669706 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:56.675465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5623ca270e743a4b02df235c09a0515, user_id=ad29c1e17c78456f91df4dbd2454e14c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.678074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.696244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.698121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:56.714258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dd5ca-fdeb-492a-bfd0-53cdff9b7d6c service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.721311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.722161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.722443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.722991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] PATH_INFO: `/v3/users/d7d8e24e5dee4a7899769c92c6754995` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.724661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d8e24e5dee4a7899769c92c6754995)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.728095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.805992 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4259/8461] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:56 2022] PUT /identity/v3/projects/c5623ca270e743a4b02df235c09a0515/users/ad29c1e17c78456f91df4dbd2454e14c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:54:56.809836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.901889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d598ff-6a1e-4e69-b9af-5c45ae252717 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.910267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.910898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.911185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.911465 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.912127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.914060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.929785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4260/8462] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:54:56.931350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:56.942698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9279724-4f86-4043-8489-d13f686e30df admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:56.948203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2b33b-d099-4fea-a259-96a6cd035091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:56.948964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2b33b-d099-4fea-a259-96a6cd035091 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.949246 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2b33b-d099-4fea-a259-96a6cd035091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.949558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2b33b-d099-4fea-a259-96a6cd035091 admin admin] PATH_INFO: `/v3/projects/c5623ca270e743a4b02df235c09a0515/users/ad29c1e17c78456f91df4dbd2454e14c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:56.951543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2b33b-d099-4fea-a259-96a6cd035091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5623ca270e743a4b02df235c09a0515, user_id=ad29c1e17c78456f91df4dbd2454e14c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:56.955293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2b33b-d099-4fea-a259-96a6cd035091 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:56.965903 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4261/8463] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:54:56 2022] PUT /identity/v3/projects/c5623ca270e743a4b02df235c09a0515/users/ad29c1e17c78456f91df4dbd2454e14c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:54:56.977129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335e05-50e3-485f-8923-faf0978a023d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:56.977423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335e05-50e3-485f-8923-faf0978a023d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:56.977707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82335e05-50e3-485f-8923-faf0978a023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:57.009543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-82335e05-50e3-485f-8923-faf0978a023d None None] MFA Rules not processed for user `ad29c1e17c78456f91df4dbd2454e14c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:57.010879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-82335e05-50e3-485f-8923-faf0978a023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:57.022033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d8e24e5dee4a7899769c92c6754995'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:57.024579 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:57.036793 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d8e24e5dee4a7899769c92c6754995'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:57.044159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d8e24e5dee4a7899769c92c6754995'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:57.044899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d8e24e5dee4a7899769c92c6754995'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:57.089348 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4262/8464] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:54:57.100801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335e05-50e3-485f-8923-faf0978a023d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:57.102297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-82335e05-50e3-485f-8923-faf0978a023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:57.167614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82335e05-50e3-485f-8923-faf0978a023d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:57.171902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:57.172066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d7a0fdb5-d1ba-4fef-b29a-3dd6bb5e64ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d8e24e5dee4a7899769c92c6754995'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:57.172556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:57.172834 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:57.173103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:57.178659 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4203/8465] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:54:56 2022] DELETE /identity/v3/users/d7d8e24e5dee4a7899769c92c6754995 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:57.183074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:57.183402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:57.183643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:57.185750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:57.187862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:57.198278 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4263/8466] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:54:57.204621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:57.205873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:57.266516 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4204/8467] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:54:57.277547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:57.279039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:57.284985 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:57.343751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afaa6ce-8c09-464a-88ac-4baf90341cd1 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:57.370183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:57.371603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:57.417803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:57.418402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:57.418692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:57.418966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:57.430369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:57.432013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:57.446420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb40ee-b0ad-422b-8f03-af86f18ff100 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:57.450042 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4264/8468] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:57.451154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:57.451884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:57.452216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:57.452664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:57.456250 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:57.540195 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:57.542533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:57.555221 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4205/8469] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:57.870690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:57.872243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:57.899855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062017-0e07-486d-bec0-3c9417ca82dc service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:57.904683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:57.906164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:57.906792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:57.907154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] PATH_INFO: `/v3/projects/e8a07ae3c92d4dad8c852a6331716d11` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:57.908470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a07ae3c92d4dad8c852a6331716d11)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:57.911199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:58.112386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a07ae3c92d4dad8c852a6331716d11', 'request_id': 'req-45e90e07-3ec3-499e-ba53-a8e21236f680'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.119003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a07ae3c92d4dad8c852a6331716d11', 'request_id': 'req-45e90e07-3ec3-499e-ba53-a8e21236f680'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.209163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a07ae3c92d4dad8c852a6331716d11', 'request_id': 'req-45e90e07-3ec3-499e-ba53-a8e21236f680'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.227367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] The token cache is being invalidate because project e8a07ae3c92d4dad8c852a6331716d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:54:58.227977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.228934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.235411 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4265/8470] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:54:57 2022] DELETE /identity/v3/projects/e8a07ae3c92d4dad8c852a6331716d11 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:58.236832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:58.254173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef540e9-7c14-408d-81fd-ae1230ab092a service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:58.287509 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:58.343599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:58.343599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:58.343599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:58.343599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] PATH_INFO: `/v3/users/4df545b96ef24138bd1574330b2d122c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:58.344025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df545b96ef24138bd1574330b2d122c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:58.344025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:58.680183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df545b96ef24138bd1574330b2d122c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.698720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df545b96ef24138bd1574330b2d122c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.707159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df545b96ef24138bd1574330b2d122c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.707993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df545b96ef24138bd1574330b2d122c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.828645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b33e41ee-b1b3-41c0-af2c-786f68d8e315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df545b96ef24138bd1574330b2d122c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:58.835896 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4206/8471] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:54:58 2022] DELETE /identity/v3/users/4df545b96ef24138bd1574330b2d122c => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:59.368161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:59.369997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:59.392267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90e07-3ec3-499e-ba53-a8e21236f680 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:59.441396 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:59.459953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:59.460650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:59.460958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:59.461234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] PATH_INFO: `/v3/projects/9e82387a479d49bea8f748d3b555fec7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:59.462436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e82387a479d49bea8f748d3b555fec7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:59.464580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:59.600094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e82387a479d49bea8f748d3b555fec7', 'request_id': 'req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:59.606986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e82387a479d49bea8f748d3b555fec7', 'request_id': 'req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:59.705540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e82387a479d49bea8f748d3b555fec7', 'request_id': 'req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:59.716987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] The token cache is being invalidate because project 9e82387a479d49bea8f748d3b555fec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:54:59.717306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:59.718722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-59ad2d52-1809-40f3-9d28-9dd1b2cb3366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:54:59.720667 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4266/8472] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:54:59 2022] DELETE /identity/v3/projects/9e82387a479d49bea8f748d3b555fec7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:54:59.727074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078aaf0-eeb7-4ac7-8dc2-24ad020edec2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:59.727566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078aaf0-eeb7-4ac7-8dc2-24ad020edec2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:59.727566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078aaf0-eeb7-4ac7-8dc2-24ad020edec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:59.748105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8078aaf0-eeb7-4ac7-8dc2-24ad020edec2 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:59.749876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8078aaf0-eeb7-4ac7-8dc2-24ad020edec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:59.814293 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4207/8473] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:59.824122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d296b-0b78-498d-9b42-2a7ff930803b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:59.824410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d296b-0b78-498d-9b42-2a7ff930803b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:59.827680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d296b-0b78-498d-9b42-2a7ff930803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:59.847655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5f6d296b-0b78-498d-9b42-2a7ff930803b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:59.848843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5f6d296b-0b78-498d-9b42-2a7ff930803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:59.857076 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4267/8474] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:59.862030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078aaf0-eeb7-4ac7-8dc2-24ad020edec2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:59.871923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078aaf0-eeb7-4ac7-8dc2-24ad020edec2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:59.876849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:59.877452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:59.877732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:59.878040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:59.878721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:54:59.879099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:59.880683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:59.892830 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4208/8475] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:54:59.897186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d296b-0b78-498d-9b42-2a7ff930803b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:59.907522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d296b-0b78-498d-9b42-2a7ff930803b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:59.912616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:59.913251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:59.913528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:59.913797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:59.914457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:59.916501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:00.052889 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4268/8476] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:54:59 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:00.059798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:00.076002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085b8b9-194b-4772-b720-4dabd96eb869 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:00.118073 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:00.152382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:00.153219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:00.153565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:00.153936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:00.154946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:00.157193 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:00.238194 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4209/8477] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:00 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:00.242508 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:00.253510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325ee2-00d2-428e-a7ae-6bf9b62c7fdf admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:00.258244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:00.258901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:00.259197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:00.259457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:00.260100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:00.261728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:00.273037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4269/8478] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:00.277924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:00.288666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0fe64-c03f-4b82-986f-b23f19587303 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:00.293422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379d3a4-d689-4439-8a71-8905935cca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:00.294267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379d3a4-d689-4439-8a71-8905935cca51 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:00.294725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379d3a4-d689-4439-8a71-8905935cca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:00.297963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379d3a4-d689-4439-8a71-8905935cca51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:00.297963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379d3a4-d689-4439-8a71-8905935cca51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:00.298594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379d3a4-d689-4439-8a71-8905935cca51 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:00.308725 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4210/8479] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:55:00.313917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:00.326301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28310-5027-4572-a628-6734b4f76d09 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:00.330435 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:00.331170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:00.331499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:00.331849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] PATH_INFO: `/v3/projects/e49a959c321b438c844395a88dcc7910/users/bb2ed2c7f298404f9e78d4a0590d3f52/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:00.354512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49a959c321b438c844395a88dcc7910, user_id=bb2ed2c7f298404f9e78d4a0590d3f52, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:00.354512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:00.434525 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4270/8480] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:00 2022] PUT /identity/v3/projects/e49a959c321b438c844395a88dcc7910/users/bb2ed2c7f298404f9e78d4a0590d3f52/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:55:00.441154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:00.441588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:00.441903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:00.470319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:00.471890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:00.541562 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4211/8481] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:00.555841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:00.557713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:00.625000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a3e-32be-420c-a81e-0ed32f7ff896 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:00.628924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317055-d73c-40d1-88ee-801dc0837e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:00.629367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317055-d73c-40d1-88ee-801dc0837e10 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:00.629744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317055-d73c-40d1-88ee-801dc0837e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:00.629955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317055-d73c-40d1-88ee-801dc0837e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:00.640163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317055-d73c-40d1-88ee-801dc0837e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:00.641684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317055-d73c-40d1-88ee-801dc0837e10 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:00.656801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4271/8482] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:03.453910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:03.455714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:03.470797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c67b6e-831c-4783-a32c-565b687e9f69 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:03.484620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:03.490219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:03.490219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:03.490219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] PATH_INFO: `/v3/users/def210814d8f44438d34d55551bde23e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:03.490219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def210814d8f44438d34d55551bde23e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:03.491222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:03.752340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def210814d8f44438d34d55551bde23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:03.812022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def210814d8f44438d34d55551bde23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:03.823200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def210814d8f44438d34d55551bde23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:03.824214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def210814d8f44438d34d55551bde23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:03.925271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def210814d8f44438d34d55551bde23e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:03.932971 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4212/8483] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:55:03 2022] DELETE /identity/v3/users/def210814d8f44438d34d55551bde23e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:55:03.938149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:03.938762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:03.939097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:03.984244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:03.985641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:03.996740 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:04.083395 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4272/8484] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:04.095062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:04.096802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:04.131045 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:04.178885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b7736-f7cc-4fd3-b187-62aec687d7f1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:04.183236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:04.184053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:04.184342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:04.184785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:04.197346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:04.199018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:04.226571 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4213/8485] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:04.933752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:04.935422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:04.958453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4788104-b552-429e-aa0a-8817d22d2979 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:04.974751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:04.975914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:04.977011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:04.977632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] PATH_INFO: `/v3/projects/87be46f066284bb5be1cb87214a42eae` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:04.982851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87be46f066284bb5be1cb87214a42eae)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:04.986210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:05.177935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87be46f066284bb5be1cb87214a42eae', 'request_id': 'req-ba35196d-abcc-4dfa-a773-78cd997c7334'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.185638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87be46f066284bb5be1cb87214a42eae', 'request_id': 'req-ba35196d-abcc-4dfa-a773-78cd997c7334'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.297369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87be46f066284bb5be1cb87214a42eae', 'request_id': 'req-ba35196d-abcc-4dfa-a773-78cd997c7334'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.325842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] The token cache is being invalidate because project 87be46f066284bb5be1cb87214a42eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:55:05.325842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.325842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.325842 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4273/8486] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:55:04 2022] DELETE /identity/v3/projects/87be46f066284bb5be1cb87214a42eae => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:05.333441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:05.352309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ababe3-7055-4c83-9cb6-1729a0107daf service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:05.432886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:05.433665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:05.434064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:05.434408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] PATH_INFO: `/v3/users/ad29c1e17c78456f91df4dbd2454e14c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:05.435829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad29c1e17c78456f91df4dbd2454e14c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:05.447827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:05.749770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad29c1e17c78456f91df4dbd2454e14c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.773558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad29c1e17c78456f91df4dbd2454e14c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.802990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad29c1e17c78456f91df4dbd2454e14c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.802990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad29c1e17c78456f91df4dbd2454e14c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.880625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d22bad4f-068d-4a02-8c97-3c8c1269d64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad29c1e17c78456f91df4dbd2454e14c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:05.892160 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4214/8487] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:55:05 2022] DELETE /identity/v3/users/ad29c1e17c78456f91df4dbd2454e14c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:06.496449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:06.497978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:06.529407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35196d-abcc-4dfa-a773-78cd997c7334 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:06.622284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:06.623090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:06.623434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:06.624374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] PATH_INFO: `/v3/projects/c5623ca270e743a4b02df235c09a0515` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:06.625693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5623ca270e743a4b02df235c09a0515)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:06.627840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:06.797360 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:06.813025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5623ca270e743a4b02df235c09a0515', 'request_id': 'req-66efaf4b-fe9d-4617-9e3b-c3c508033acd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:06.855752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5623ca270e743a4b02df235c09a0515', 'request_id': 'req-66efaf4b-fe9d-4617-9e3b-c3c508033acd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:07.037205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5623ca270e743a4b02df235c09a0515', 'request_id': 'req-66efaf4b-fe9d-4617-9e3b-c3c508033acd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:07.054037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] The token cache is being invalidate because project c5623ca270e743a4b02df235c09a0515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:55:07.054694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:07.056137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-66efaf4b-fe9d-4617-9e3b-c3c508033acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:07.065019 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4274/8488] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:55:06 2022] DELETE /identity/v3/projects/c5623ca270e743a4b02df235c09a0515 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:07.069155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efadb6-853b-4614-8b06-3046bd92c693 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.069155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efadb6-853b-4614-8b06-3046bd92c693 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.069155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efadb6-853b-4614-8b06-3046bd92c693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.090054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e6efadb6-853b-4614-8b06-3046bd92c693 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:07.093369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e6efadb6-853b-4614-8b06-3046bd92c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:07.146285 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:07.172077 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4215/8489] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:55:07.179762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d245-b623-410f-842b-0791b5014652 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.179953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d245-b623-410f-842b-0791b5014652 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.180235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d245-b623-410f-842b-0791b5014652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.223630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-06e0d245-b623-410f-842b-0791b5014652 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:07.224949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-06e0d245-b623-410f-842b-0791b5014652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:07.242177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4275/8490] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:07.247035 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efadb6-853b-4614-8b06-3046bd92c693 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:07.284966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efadb6-853b-4614-8b06-3046bd92c693 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:07.297895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:07.301395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.301395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.301680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.302502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:55:07.302951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:07.306700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:07.333564 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4216/8491] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:55:07.337695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d245-b623-410f-842b-0791b5014652 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:07.358842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d245-b623-410f-842b-0791b5014652 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:07.364129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:07.364764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.365055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.365326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.366064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:07.370341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:07.535817 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4276/8492] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:55:07 2022] POST /identity/v3/projects => generated 399 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:07.539304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:07.557094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5f28-0a13-4414-bbb8-49449fe4b51d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:07.691503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:07.692300 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.692690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.693096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.693908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:07.696214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:07.824969 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4217/8493] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:07 2022] POST /identity/v3/users => generated 300 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:07.829634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:07.844386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf1c76-55ea-4d9d-b9ee-c59b7584a45d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:07.849909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:07.849909 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.850519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.850803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.851483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:07.853091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:07.865299 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4277/8494] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:07.869020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:07.881178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfc44d-4064-4529-91ae-c3903dff784b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:07.886286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91950bc4-db0a-48a1-95d3-72b0707417f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:07.887098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950bc4-db0a-48a1-95d3-72b0707417f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.887445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950bc4-db0a-48a1-95d3-72b0707417f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.887786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91950bc4-db0a-48a1-95d3-72b0707417f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.888564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91950bc4-db0a-48a1-95d3-72b0707417f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:07.890972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91950bc4-db0a-48a1-95d3-72b0707417f3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:07.903472 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4218/8495] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:07.908567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:07.919654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6f4b8-c85c-4e20-aa5e-c8182639b689 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:07.925181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:07.926244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:07.926244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:07.926448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] PATH_INFO: `/v3/projects/1b5c5afa871b4a8aaaa6cb2fb4d545dc/users/2010b9f5ade8464b84eef3bfbf1b0442/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:07.943672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5c5afa871b4a8aaaa6cb2fb4d545dc, user_id=2010b9f5ade8464b84eef3bfbf1b0442, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:07.947646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:08.044149 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1995-2cd2-47b0-baf1-ac1ae1d028d1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.044441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1995-2cd2-47b0-baf1-ac1ae1d028d1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.044744 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4278/8496] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:07 2022] PUT /identity/v3/projects/1b5c5afa871b4a8aaaa6cb2fb4d545dc/users/2010b9f5ade8464b84eef3bfbf1b0442/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:08.045056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1995-2cd2-47b0-baf1-ac1ae1d028d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.097655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-549b1995-2cd2-47b0-baf1-ac1ae1d028d1 None None] MFA Rules not processed for user `2010b9f5ade8464b84eef3bfbf1b0442`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:08.099018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-549b1995-2cd2-47b0-baf1-ac1ae1d028d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:08.186974 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4219/8497] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:55:08.190717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:08.321011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10237acb-93c5-4d9b-8a38-cbda399e770f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:08.326224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b0327-c135-4a3f-8667-42d6158d2799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:08.328062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b0327-c135-4a3f-8667-42d6158d2799 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.328448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b0327-c135-4a3f-8667-42d6158d2799 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.329501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b0327-c135-4a3f-8667-42d6158d2799 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.329751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b0327-c135-4a3f-8667-42d6158d2799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:08.332103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b0327-c135-4a3f-8667-42d6158d2799 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:08.494794 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4279/8498] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:55:08 2022] POST /identity/v3/projects => generated 399 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:08.498638 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b1995-2cd2-47b0-baf1-ac1ae1d028d1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:08.515557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b1995-2cd2-47b0-baf1-ac1ae1d028d1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:08.543732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.545336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.545336 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.582398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] MFA Rules not processed for user `bb2ed2c7f298404f9e78d4a0590d3f52`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:08.584500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:08.623024 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:08.656433 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:08.668247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:08.669680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.670398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.674709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.674709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:08.674709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:08.693582 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4280/8499] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:55:08.694551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:08.697154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:08.713545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a3a2c-de29-4315-8c2e-3c2ce90c5294 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:08.724145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:08.725141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.725633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.726143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.726983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:08.729133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:08.790591 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4220/8500] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:08 2022] POST /identity/v3/users => generated 306 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:55:08.794603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:08.808881 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10bfeb-dba0-4a54-b77e-68e9a1e19ef6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:08.819801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:08.820446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.820878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.821160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.821834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:08.830127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:08.860655 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4221/8501] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:55:08.864965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:08.876762 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4281/8502] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:55:08 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:08.880786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:08.885274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc977-2821-4736-a201-514c0e540046 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:08.975269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:08.975941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.976221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.976491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] PATH_INFO: `/v3/projects/dc527e7ef3744cfa9be9e092e6189610/users/e27aa1894da941a296324f27d2baaf6c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.983046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028c45c-b6da-4b44-9cb5-047a91d28ed6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:08.993860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc527e7ef3744cfa9be9e092e6189610, user_id=e27aa1894da941a296324f27d2baaf6c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:08.996130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:08.996865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:08.997316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:08.997725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:08.997872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:08.998547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.001666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.117150 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4222/8503] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:08 2022] PUT /identity/v3/projects/dc527e7ef3744cfa9be9e092e6189610/users/e27aa1894da941a296324f27d2baaf6c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:09.119023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:09.149871 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4282/8504] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:08 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:55:09.154378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:09.168480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fabb47-e74d-49a3-b24b-c05aca4fd953 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:09.239225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923ef74-b6be-4a5c-b728-46f605dda4fb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:09.253659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:09.254524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.254897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.255133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.255778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.257411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.267576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:09.268301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.268676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.269222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.269349 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4223/8505] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:55:09.269707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.271863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.273283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:09.291324 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4283/8506] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:55:09.292523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270eee5-d4b6-47bb-a7a5-5801d604c8f8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:09.297357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:09.298796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef855b-5306-4106-bb37-034c38ad7487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:09.299496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef855b-5306-4106-bb37-034c38ad7487 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.299763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef855b-5306-4106-bb37-034c38ad7487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.300096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef855b-5306-4106-bb37-034c38ad7487 admin admin] PATH_INFO: `/v3/projects/dc527e7ef3744cfa9be9e092e6189610/users/e27aa1894da941a296324f27d2baaf6c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.302158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef855b-5306-4106-bb37-034c38ad7487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc527e7ef3744cfa9be9e092e6189610, user_id=e27aa1894da941a296324f27d2baaf6c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.305024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef855b-5306-4106-bb37-034c38ad7487 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.314040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2e7d-ab14-4d68-9cca-1d51771cd285 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:09.317823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4224/8507] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:09 2022] PUT /identity/v3/projects/dc527e7ef3744cfa9be9e092e6189610/users/e27aa1894da941a296324f27d2baaf6c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:55:09.327745 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.328010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.328594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.357229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] MFA Rules not processed for user `e27aa1894da941a296324f27d2baaf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:09.359292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:09.371204 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:09.374311 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:09.394014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:09.394751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.395313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.395313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] PATH_INFO: `/v3/projects/231b9c6a1d1e40d2a11fb810ea73b919/users/31097f3fe65f47909e7ec5140a4f4b60/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.414085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231b9c6a1d1e40d2a11fb810ea73b919, user_id=31097f3fe65f47909e7ec5140a4f4b60, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.416853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.453744 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4225/8508] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:55:09.465691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:09.467410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:09.505841 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4284/8509] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:09 2022] PUT /identity/v3/projects/231b9c6a1d1e40d2a11fb810ea73b919/users/31097f3fe65f47909e7ec5140a4f4b60/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:09.506838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:09.536752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db6b0c-494e-41cb-a108-64744faf4468 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:09.575606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf7d0d-c33b-41cf-8eaf-ffe4c1da3115 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:09.582181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:09.582791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.583067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.583515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.584472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.586409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.599343 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4285/8510] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:55:09.599979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbec23e-25fe-488a-9686-154f9b2e6217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:09.600827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbec23e-25fe-488a-9686-154f9b2e6217 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.601118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbec23e-25fe-488a-9686-154f9b2e6217 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.601629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbec23e-25fe-488a-9686-154f9b2e6217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.603398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:09.615391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142588d-03f2-4272-adbc-7ecbad02c2d2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:09.621060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:09.621961 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:09.622242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:09.622516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] PATH_INFO: `/v3/projects/231b9c6a1d1e40d2a11fb810ea73b919/users/31097f3fe65f47909e7ec5140a4f4b60/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:09.625048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231b9c6a1d1e40d2a11fb810ea73b919, user_id=31097f3fe65f47909e7ec5140a4f4b60, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.627703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.642168 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4286/8511] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:09 2022] PUT /identity/v3/projects/231b9c6a1d1e40d2a11fb810ea73b919/users/31097f3fe65f47909e7ec5140a4f4b60/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:55:09.677671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbec23e-25fe-488a-9686-154f9b2e6217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:09.679214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbec23e-25fe-488a-9686-154f9b2e6217 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:09.691838 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4226/8512] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:09.974746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:10.038578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89855c01-3d10-47cb-8b29-9eead2cdf239 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:10.042436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:10.043237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:10.043695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:10.044030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:10.173040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:10.175561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:10.213317 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4287/8513] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:17.884032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc2194-aa30-4d48-b3cb-de78ce720bc1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:17.884490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc2194-aa30-4d48-b3cb-de78ce720bc1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:17.884788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc2194-aa30-4d48-b3cb-de78ce720bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:17.927337 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:17.932327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-44fc2194-aa30-4d48-b3cb-de78ce720bc1 None None] MFA Rules not processed for user `31097f3fe65f47909e7ec5140a4f4b60`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:17.934274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44fc2194-aa30-4d48-b3cb-de78ce720bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:18.028352 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4227/8514] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:18.047580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:18.049376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:18.055855 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:18.153054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080f4b-46d1-45b0-b8ea-4ec973f8c460 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:18.159622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693f278-598e-4352-a239-fc6faa146214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:18.160265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693f278-598e-4352-a239-fc6faa146214 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:18.160612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693f278-598e-4352-a239-fc6faa146214 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:18.160926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693f278-598e-4352-a239-fc6faa146214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:18.232523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693f278-598e-4352-a239-fc6faa146214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:18.234663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693f278-598e-4352-a239-fc6faa146214 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:18.247550 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4288/8515] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:55:19.528588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc2194-aa30-4d48-b3cb-de78ce720bc1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:19.689264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc2194-aa30-4d48-b3cb-de78ce720bc1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:19.695408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:19.696076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:19.696361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:19.696691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] PATH_INFO: `/v3/users/2010b9f5ade8464b84eef3bfbf1b0442` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:19.697976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2010b9f5ade8464b84eef3bfbf1b0442)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:19.700737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:19.945924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2010b9f5ade8464b84eef3bfbf1b0442'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:19.959949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2010b9f5ade8464b84eef3bfbf1b0442'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:19.968059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2010b9f5ade8464b84eef3bfbf1b0442'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:19.969060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2010b9f5ade8464b84eef3bfbf1b0442'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:20.102253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2010b9f5ade8464b84eef3bfbf1b0442'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:20.109473 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4228/8516] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:55:19 2022] DELETE /identity/v3/users/2010b9f5ade8464b84eef3bfbf1b0442 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:20.114768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:20.115342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:20.115579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:20.139799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:20.142005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:20.271064 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4289/8517] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:20.288312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:20.289764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:20.335783 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:20.394392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bb243-91d0-4e32-9a41-e7ef578b924a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:20.394392 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:20.394909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:20.395263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:20.395534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:20.406676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:20.408243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:20.421178 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4229/8518] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:21.187632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:21.191341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:21.239582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe1e93-9bb1-40bb-beba-ae9070df5df3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:21.246727 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:21.247633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:21.248294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:21.248991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] PATH_INFO: `/v3/projects/1b5c5afa871b4a8aaaa6cb2fb4d545dc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:21.251542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5c5afa871b4a8aaaa6cb2fb4d545dc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:21.257859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:21.443433 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:21.458236 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5c5afa871b4a8aaaa6cb2fb4d545dc', 'request_id': 'req-988c4230-1734-4ce8-a4b3-83a1a68eaa64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:21.466061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5c5afa871b4a8aaaa6cb2fb4d545dc', 'request_id': 'req-988c4230-1734-4ce8-a4b3-83a1a68eaa64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:21.562918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5c5afa871b4a8aaaa6cb2fb4d545dc', 'request_id': 'req-988c4230-1734-4ce8-a4b3-83a1a68eaa64'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:21.575254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] The token cache is being invalidate because project 1b5c5afa871b4a8aaaa6cb2fb4d545dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:55:21.575572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:21.576214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-988c4230-1734-4ce8-a4b3-83a1a68eaa64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:21.581096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4290/8519] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:55:21 2022] DELETE /identity/v3/projects/1b5c5afa871b4a8aaaa6cb2fb4d545dc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:21.583844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:21.598246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81988b38-94c4-4828-85f6-ca91959e092b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:21.688412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:21.689185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:21.689473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:21.689747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] PATH_INFO: `/v3/users/e27aa1894da941a296324f27d2baaf6c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:21.690958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27aa1894da941a296324f27d2baaf6c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:21.692909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:22.025785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27aa1894da941a296324f27d2baaf6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:22.042676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27aa1894da941a296324f27d2baaf6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:22.051649 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27aa1894da941a296324f27d2baaf6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:22.052902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27aa1894da941a296324f27d2baaf6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:22.128365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27aa1894da941a296324f27d2baaf6c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:22.136450 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4230/8520] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:55:21 2022] DELETE /identity/v3/users/e27aa1894da941a296324f27d2baaf6c => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:22.260045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a224d-f10e-4caf-9809-b2044a57e7f5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:22.260928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a224d-f10e-4caf-9809-b2044a57e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:22.261417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a224d-f10e-4caf-9809-b2044a57e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:22.291951 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b48a224d-f10e-4caf-9809-b2044a57e7f5 None None] MFA Rules not processed for user `bb2ed2c7f298404f9e78d4a0590d3f52`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:22.294026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b48a224d-f10e-4caf-9809-b2044a57e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:22.374050 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4291/8521] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:22.945973 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:22.947560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:23.024190 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:23.054317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e35d8b-01bd-4c5c-8682-81c169d1cc6f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:23.062490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:23.063302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:23.063584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:23.067442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] PATH_INFO: `/v3/projects/dc527e7ef3744cfa9be9e092e6189610` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:23.067442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc527e7ef3744cfa9be9e092e6189610)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:23.078769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:23.267630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc527e7ef3744cfa9be9e092e6189610', 'request_id': 'req-9a03835e-8723-4866-8fb6-940d46dcbfef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:23.273243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc527e7ef3744cfa9be9e092e6189610', 'request_id': 'req-9a03835e-8723-4866-8fb6-940d46dcbfef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:23.360056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc527e7ef3744cfa9be9e092e6189610', 'request_id': 'req-9a03835e-8723-4866-8fb6-940d46dcbfef'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:23.399167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] The token cache is being invalidate because project dc527e7ef3744cfa9be9e092e6189610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:55:23.399912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:23.406445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:23.419779 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4231/8522] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:55:22 2022] DELETE /identity/v3/projects/dc527e7ef3744cfa9be9e092e6189610 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:23.424693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1d70-f014-470a-8026-a5b0ba19f1c4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:23.429079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1d70-f014-470a-8026-a5b0ba19f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:23.429079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be1d70-f014-470a-8026-a5b0ba19f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:23.472091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:23.477998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-17be1d70-f014-470a-8026-a5b0ba19f1c4 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:23.479319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:23.481007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17be1d70-f014-470a-8026-a5b0ba19f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:23.632322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03835e-8723-4866-8fb6-940d46dcbfef admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:23.633736 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4292/8523] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:23.645490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3360-4f76-4392-acb5-ee5adc2e25a6 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:23.645894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3360-4f76-4392-acb5-ee5adc2e25a6 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:23.649721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3360-4f76-4392-acb5-ee5adc2e25a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:23.649902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:23.650234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:23.650605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:23.650953 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:23.652847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:23.676247 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:23.680609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-946a3360-4f76-4392-acb5-ee5adc2e25a6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:23.682701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-946a3360-4f76-4392-acb5-ee5adc2e25a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:23.685432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:23.693393 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4293/8524] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:23.700737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3360-4f76-4392-acb5-ee5adc2e25a6 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:23.709594 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4232/8525] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:55:23.713701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3360-4f76-4392-acb5-ee5adc2e25a6 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:23.718833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:23.719528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:23.719741 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:23.719969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:23.720964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:55:23.721266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:23.722908 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:23.737868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4294/8526] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:55:23.742226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:23.760566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72503df1-6025-4b85-9b5d-ba66596cc570 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:23.767009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:23.767820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:23.768174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:23.768609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:23.769337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:23.771384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:23.878114 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4233/8527] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:55:23 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:55:23.882511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:23.896856 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfde14-827e-4956-a7e3-4c95ff57b481 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:23.987853 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:24.004318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:24.006002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:24.006320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:24.006597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:24.008167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:24.011179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:24.111083 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4295/8528] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:23 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:24.115909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:24.131452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf794a-b102-494c-9168-b18013bd6358 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:24.142421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:24.143377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:24.143800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:24.144257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:24.145173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:24.146893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:24.166357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4234/8529] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:24.171578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:24.186478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1786269-1352-4fac-a3db-9ecf4fe4cf05 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:24.193684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee79a-0c60-4f29-b442-3d8f6695e709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:24.194414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee79a-0c60-4f29-b442-3d8f6695e709 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:24.194773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee79a-0c60-4f29-b442-3d8f6695e709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:24.195111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee79a-0c60-4f29-b442-3d8f6695e709 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:24.196227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee79a-0c60-4f29-b442-3d8f6695e709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:24.200740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee79a-0c60-4f29-b442-3d8f6695e709 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:24.229908 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4296/8530] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:24.234181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:24.245167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02e2e-8cd4-40d9-aff7-8339b0b64e6f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:24.251265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:24.252091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:24.258469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:24.258469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] PATH_INFO: `/v3/projects/a9e04e384d6b486794db346eaa84bb2a/users/3d81711665884c799af0b7b98a48bb83/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:24.271206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e04e384d6b486794db346eaa84bb2a, user_id=3d81711665884c799af0b7b98a48bb83, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:24.273872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:24.405566 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4235/8531] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:24 2022] PUT /identity/v3/projects/a9e04e384d6b486794db346eaa84bb2a/users/3d81711665884c799af0b7b98a48bb83/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:24.415840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e83d0-60c8-48b9-ab65-91caaf2f6f88 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:24.416130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e83d0-60c8-48b9-ab65-91caaf2f6f88 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:24.416430 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e83d0-60c8-48b9-ab65-91caaf2f6f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:24.475406 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-bc4e83d0-60c8-48b9-ab65-91caaf2f6f88 None None] MFA Rules not processed for user `3d81711665884c799af0b7b98a48bb83`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:24.476660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bc4e83d0-60c8-48b9-ab65-91caaf2f6f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:24.552931 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4297/8532] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:55:24.557803 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:24.562602 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:24.707600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988fa9-1c8e-4976-a0a5-3817014fe1ec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:24.713696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:24.714386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:24.714778 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:24.715057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:24.715739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:24.718352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:24.908214 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4236/8533] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:55:24 2022] POST /identity/v3/projects => generated 383 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:24.912531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e83d0-60c8-48b9-ab65-91caaf2f6f88 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:24.928843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e83d0-60c8-48b9-ab65-91caaf2f6f88 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:25.017207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:25.018028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.018795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.018795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.019309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:25.021349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:25.152587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4298/8534] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:24 2022] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:25.157714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:25.168521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27365a4-34ee-427c-9509-4f9c0057e8bf admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:25.175070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:25.175832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.176210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.176713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.177436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:25.179169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:25.190969 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4237/8535] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:25.196098 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:25.207792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91666c3c-a0e1-4168-96d9-7cdafcbc576c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:25.212780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:25.213489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.213772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.214095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] PATH_INFO: `/v3/projects/662a9b3c6ea647b0a512b1cc62a82e0c/users/b4e9a130417f44d8b653467b9ef64469/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.230493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662a9b3c6ea647b0a512b1cc62a82e0c, user_id=b4e9a130417f44d8b653467b9ef64469, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:25.233937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:25.348997 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4299/8536] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:25 2022] PUT /identity/v3/projects/662a9b3c6ea647b0a512b1cc62a82e0c/users/b4e9a130417f44d8b653467b9ef64469/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:25.352708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:25.364868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b007481-2243-45d6-981a-1bdba937fb57 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:25.439082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8acfa0-ce8c-49ae-898f-563c659a73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:25.439712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8acfa0-ce8c-49ae-898f-563c659a73a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.440080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8acfa0-ce8c-49ae-898f-563c659a73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.440365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8acfa0-ce8c-49ae-898f-563c659a73a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.441020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8acfa0-ce8c-49ae-898f-563c659a73a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:25.442661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8acfa0-ce8c-49ae-898f-563c659a73a2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:25.456587 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4238/8537] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:25.458211 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:25.470163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68181f1e-63fb-4883-99b8-0ee68e8c2b19 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:25.475560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:25.476255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.476520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.477184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] PATH_INFO: `/v3/projects/662a9b3c6ea647b0a512b1cc62a82e0c/users/b4e9a130417f44d8b653467b9ef64469/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.479360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=662a9b3c6ea647b0a512b1cc62a82e0c, user_id=b4e9a130417f44d8b653467b9ef64469, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:25.482121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:25.494833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4300/8538] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:25 2022] PUT /identity/v3/projects/662a9b3c6ea647b0a512b1cc62a82e0c/users/b4e9a130417f44d8b653467b9ef64469/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:25.508341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.508639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.508921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.538775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] MFA Rules not processed for user `b4e9a130417f44d8b653467b9ef64469`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:25.540020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:25.614058 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:25.619471 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4239/8539] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:25.630055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:25.631733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:25.643067 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:25.693107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c3a70-66cc-4e02-a280-e83278f0f81e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:25.696944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:25.697564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.697874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.698158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.709290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:25.710786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:25.722475 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4301/8540] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:25.865126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:25.867016 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:25.889462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4ce3a-f6df-4624-ace7-23e8dfebe751 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:25.894676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f72d4-98c0-4ccd-8d3e-a4db862d11a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:25.896372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f72d4-98c0-4ccd-8d3e-a4db862d11a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:25.897049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f72d4-98c0-4ccd-8d3e-a4db862d11a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:25.897049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f72d4-98c0-4ccd-8d3e-a4db862d11a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:25.970428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f72d4-98c0-4ccd-8d3e-a4db862d11a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:25.971779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f72d4-98c0-4ccd-8d3e-a4db862d11a4 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:25.981153 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4240/8541] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:32.514262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:32.606851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eafd7-e076-4d78-a3c2-c770800d0e75 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:32.620297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:32.620966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:32.621260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:32.621522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] PATH_INFO: `/v3/users/3d81711665884c799af0b7b98a48bb83` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:32.623468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d81711665884c799af0b7b98a48bb83)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:32.625549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:32.861137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d81711665884c799af0b7b98a48bb83'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:32.862083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d81711665884c799af0b7b98a48bb83'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:32.953275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d81711665884c799af0b7b98a48bb83'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:32.962486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d81711665884c799af0b7b98a48bb83'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:32.963193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d81711665884c799af0b7b98a48bb83'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:32.993845 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4302/8542] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:55:32 2022] DELETE /identity/v3/users/3d81711665884c799af0b7b98a48bb83 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:32.994146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:32.994146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:32.994693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:33.019047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:33.020830 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:33.100326 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4241/8543] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:55:33.110890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:33.112365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:33.174978 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:33.206160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc4c8-4b32-4947-b5a0-c0fd55380f8a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:33.210087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:33.210807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:33.211193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:33.211569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:33.222355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:33.224102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:33.235620 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4303/8544] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:33.820715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:33.824471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:33.850345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220cbf6-3de6-4197-a333-b0e0391f4a89 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:33.865192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:33.865880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:33.866163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:33.866513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] PATH_INFO: `/v3/projects/a9e04e384d6b486794db346eaa84bb2a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:33.868971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e04e384d6b486794db346eaa84bb2a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:33.870407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:33.980287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e04e384d6b486794db346eaa84bb2a', 'request_id': 'req-99482921-f097-4bdf-9145-f024adf954a3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:33.988230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e04e384d6b486794db346eaa84bb2a', 'request_id': 'req-99482921-f097-4bdf-9145-f024adf954a3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.053171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e04e384d6b486794db346eaa84bb2a', 'request_id': 'req-99482921-f097-4bdf-9145-f024adf954a3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.070017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] The token cache is being invalidate because project a9e04e384d6b486794db346eaa84bb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:55:34.070377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.071181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.073026 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4242/8545] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:55:33 2022] DELETE /identity/v3/projects/a9e04e384d6b486794db346eaa84bb2a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:34.077151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:34.098560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4a798-eb9a-462f-8715-48fd789da080 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:34.201747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:34.201747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:34.201747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:34.201747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] PATH_INFO: `/v3/users/b4e9a130417f44d8b653467b9ef64469` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:34.203133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e9a130417f44d8b653467b9ef64469)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:34.203133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:34.437216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e9a130417f44d8b653467b9ef64469'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.438427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e9a130417f44d8b653467b9ef64469'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.519125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e9a130417f44d8b653467b9ef64469'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.527385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e9a130417f44d8b653467b9ef64469'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.528060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-75c58a11-a57c-42cd-a5fe-4638c21d38c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e9a130417f44d8b653467b9ef64469'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:34.549263 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4304/8546] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:55:34 2022] DELETE /identity/v3/users/b4e9a130417f44d8b653467b9ef64469 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:55:35.093056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:35.094537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:35.108772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99482921-f097-4bdf-9145-f024adf954a3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:35.129136 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:35.171695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:35.172337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.172618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.172893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] PATH_INFO: `/v3/projects/662a9b3c6ea647b0a512b1cc62a82e0c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.174085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662a9b3c6ea647b0a512b1cc62a82e0c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:35.175984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:35.297287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662a9b3c6ea647b0a512b1cc62a82e0c', 'request_id': 'req-2188e797-c620-4f8c-9ba0-e0706d7574f0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:35.303668 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662a9b3c6ea647b0a512b1cc62a82e0c', 'request_id': 'req-2188e797-c620-4f8c-9ba0-e0706d7574f0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:35.395338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662a9b3c6ea647b0a512b1cc62a82e0c', 'request_id': 'req-2188e797-c620-4f8c-9ba0-e0706d7574f0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:35.410005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] The token cache is being invalidate because project 662a9b3c6ea647b0a512b1cc62a82e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:55:35.410380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:35.411147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-2188e797-c620-4f8c-9ba0-e0706d7574f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:35.412895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4243/8547] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:55:35 2022] DELETE /identity/v3/projects/662a9b3c6ea647b0a512b1cc62a82e0c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:35.431286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeed7b-2587-4062-ab5e-5bcc26254bde None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.431286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeed7b-2587-4062-ab5e-5bcc26254bde None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.431286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeed7b-2587-4062-ab5e-5bcc26254bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.440793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d2aeed7b-2587-4062-ab5e-5bcc26254bde None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:35.442463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d2aeed7b-2587-4062-ab5e-5bcc26254bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:35.500089 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:35.512987 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4305/8548] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:35.521431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad1c0-37b4-4279-b57f-40a68c5dc0b0 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.521641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad1c0-37b4-4279-b57f-40a68c5dc0b0 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.521951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad1c0-37b4-4279-b57f-40a68c5dc0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.543252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ee7ad1c0-37b4-4279-b57f-40a68c5dc0b0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:35.544841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee7ad1c0-37b4-4279-b57f-40a68c5dc0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:35.554097 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4244/8549] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:35.558277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeed7b-2587-4062-ab5e-5bcc26254bde None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:35.570345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeed7b-2587-4062-ab5e-5bcc26254bde None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:35.575016 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:35.580087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.580087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.580087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.580087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:55:35.580087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:35.580581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:35.593562 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4306/8550] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:55:35.597988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad1c0-37b4-4279-b57f-40a68c5dc0b0 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:35.609265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad1c0-37b4-4279-b57f-40a68c5dc0b0 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:35.615322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:35.615931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.616207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.616478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.617119 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:35.619096 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:35.731706 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4245/8551] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:55:35 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:35.736851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:35.748441 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866b5f9-b86c-43fb-b4bb-8b2462e5124c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:35.808376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:35.809009 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.809292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.809571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.811001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:35.813538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:35.918318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4307/8552] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:35 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:35.923507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:35.936076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b7d7-ef0e-4d94-8587-a02dae5c8fa2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:35.940914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:35.941613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.941947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.942758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.942948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:35.944567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:35.955958 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4246/8553] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:55:35.963925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:35.975607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70b782-4dd4-4a1a-91aa-b1e0ea71c137 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:35.980867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2535-fa5f-4132-bf98-e191050f69ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:35.982816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2535-fa5f-4132-bf98-e191050f69ba admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:35.982816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2535-fa5f-4132-bf98-e191050f69ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:35.982816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2535-fa5f-4132-bf98-e191050f69ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:35.983711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2535-fa5f-4132-bf98-e191050f69ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:35.985625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd2535-fa5f-4132-bf98-e191050f69ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:36.001944 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4308/8554] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:36.004116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:36.016095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcfae4-8206-4e36-ae43-2f95d847667b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:36.021861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:36.022699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:36.022984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:36.023258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] PATH_INFO: `/v3/projects/52bda35c90a64fcb91c23ea37373ab53/users/ccf216490d964158983fedf3e81a500a/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:36.045868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bda35c90a64fcb91c23ea37373ab53, user_id=ccf216490d964158983fedf3e81a500a, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:36.049099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:36.154707 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4247/8555] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:36 2022] PUT /identity/v3/projects/52bda35c90a64fcb91c23ea37373ab53/users/ccf216490d964158983fedf3e81a500a/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:36.172667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:36.173007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:36.173288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:36.202540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] MFA Rules not processed for user `ccf216490d964158983fedf3e81a500a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:36.203757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:36.289334 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4309/8556] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:36.304570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:36.306800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:36.381439 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:36.389935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:36.390487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad55d29-5162-42ce-adb7-8c4bb1203b6f admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:36.391413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:36.394470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:36.400956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:36.400956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:36.400956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:36.414290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:36.415829 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:36.429151 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4248/8557] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:36.463562 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:36.492175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37b062-c5ab-49b1-aed2-fb4c42fca0b9 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:36.499576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:36.500303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:36.503226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:36.503226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:36.503226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:36.519875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:36.521529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:36.538990 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4310/8558] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:55:38.963485 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:38.965103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:39.029735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8ffba-bc90-4259-802f-330bc82c7f9a service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:39.033397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff94b-61c7-4272-8fdf-b83972de46fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:39.034053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff94b-61c7-4272-8fdf-b83972de46fd service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:39.039896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff94b-61c7-4272-8fdf-b83972de46fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:39.039896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff94b-61c7-4272-8fdf-b83972de46fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:39.039896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8afff94b-61c7-4272-8fdf-b83972de46fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:39.103755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff94b-61c7-4272-8fdf-b83972de46fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:39.105210 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff94b-61c7-4272-8fdf-b83972de46fd service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:39.116403 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4249/8559] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:47.170316 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=12 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:49.112143 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=55 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:50.533731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:50.640359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a24643-0cc1-46e5-9a57-d0407696dcac service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:50.646887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:50.647719 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:50.648264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:50.648449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] PATH_INFO: `/v3/users/ccf216490d964158983fedf3e81a500a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:50.649979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf216490d964158983fedf3e81a500a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:50.652473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:50.891215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf216490d964158983fedf3e81a500a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:50.891906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf216490d964158983fedf3e81a500a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:50.981096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf216490d964158983fedf3e81a500a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:50.994244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf216490d964158983fedf3e81a500a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:50.995484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf216490d964158983fedf3e81a500a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:51.020310 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4311/8560] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:55:50 2022] DELETE /identity/v3/users/ccf216490d964158983fedf3e81a500a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:51.024709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:51.032918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:51.032918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:51.045641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:51.047082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:51.124840 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4250/8561] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:51.144621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:51.146345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:51.230724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c705e04-22e8-43ba-9bac-a74c0a6b93fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:51.236158 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393f238-50b1-4ab5-bf02-c3c6ce195630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:51.236958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f238-50b1-4ab5-bf02-c3c6ce195630 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:51.237309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f238-50b1-4ab5-bf02-c3c6ce195630 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:51.237657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f238-50b1-4ab5-bf02-c3c6ce195630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:51.249335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393f238-50b1-4ab5-bf02-c3c6ce195630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:51.252012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393f238-50b1-4ab5-bf02-c3c6ce195630 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:51.272320 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4312/8562] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:51.738409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:51.740360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:51.766913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc597-b9a4-4984-a6a7-38949d356a1f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:51.772361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:51.773266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:51.773748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:51.774275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] PATH_INFO: `/v3/projects/52bda35c90a64fcb91c23ea37373ab53` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:51.775641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bda35c90a64fcb91c23ea37373ab53)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:51.777783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:51.925231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bda35c90a64fcb91c23ea37373ab53', 'request_id': 'req-378c2e98-68ea-42cb-914b-842d522a1f78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:51.930920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bda35c90a64fcb91c23ea37373ab53', 'request_id': 'req-378c2e98-68ea-42cb-914b-842d522a1f78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:52.047889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bda35c90a64fcb91c23ea37373ab53', 'request_id': 'req-378c2e98-68ea-42cb-914b-842d522a1f78'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:52.061242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] The token cache is being invalidate because project 52bda35c90a64fcb91c23ea37373ab53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:55:52.061652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:52.062463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-378c2e98-68ea-42cb-914b-842d522a1f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:55:52.064087 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4251/8563] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:55:51 2022] DELETE /identity/v3/projects/52bda35c90a64fcb91c23ea37373ab53 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:52.069143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb3b-e897-42d9-a31a-e1d8d986700f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.070122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb3b-e897-42d9-a31a-e1d8d986700f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.070408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb3b-e897-42d9-a31a-e1d8d986700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.094060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-df45eb3b-e897-42d9-a31a-e1d8d986700f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:52.095463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-df45eb3b-e897-42d9-a31a-e1d8d986700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:52.115390 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:52.160595 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4313/8564] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:52.179040 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c4f9-57f3-4489-b40b-d3825d14795d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.179443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c4f9-57f3-4489-b40b-d3825d14795d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.179797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c4f9-57f3-4489-b40b-d3825d14795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.203205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fde4c4f9-57f3-4489-b40b-d3825d14795d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:52.205013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fde4c4f9-57f3-4489-b40b-d3825d14795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:52.218247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4252/8565] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:55:52.232500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45eb3b-e897-42d9-a31a-e1d8d986700f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:52.242521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45eb3b-e897-42d9-a31a-e1d8d986700f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:52.247378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:52.248025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.248365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.248580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.249238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:55:52.249543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:52.252848 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:52.282318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4314/8566] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:55:52.291389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c4f9-57f3-4489-b40b-d3825d14795d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:52.304888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c4f9-57f3-4489-b40b-d3825d14795d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:52.318142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:52.318772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.320309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.320309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.320309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:52.322414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:52.446016 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4253/8567] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:55:52 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:52.450205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:52.461145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe131-08c0-4e92-9389-ccefd5142dfc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:52.526736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:52.527361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.527645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.528185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.528896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:52.530927 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:52.652064 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4315/8568] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:55:52 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:55:52.654217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:52.664875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9ab68-0830-4792-86fc-7b49e4c5dba9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:52.670767 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:52.671388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.671671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.671945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.672603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:52.674263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:52.685732 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4254/8569] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:55:52.690408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:52.701529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f0ce3-4675-4914-9592-d6255a875d88 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:52.706360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd0a0a-7eec-44a2-b367-abd0266b02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:52.707144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0a0a-7eec-44a2-b367-abd0266b02a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.707253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0a0a-7eec-44a2-b367-abd0266b02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.707500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0a0a-7eec-44a2-b367-abd0266b02a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.708144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd0a0a-7eec-44a2-b367-abd0266b02a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:52.709747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd0a0a-7eec-44a2-b367-abd0266b02a9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:52.721792 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4316/8570] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:55:52.728069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:52.737796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332927-7372-403b-9a37-2649d967d8c1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:52.742851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:52.743686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.743972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.744249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] PATH_INFO: `/v3/projects/e1f42bb9b5e642b197126fd99aee2a11/users/81ce0aab063848278473c014b9fce833/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.760257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f42bb9b5e642b197126fd99aee2a11, user_id=81ce0aab063848278473c014b9fce833, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:52.763024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:52.843401 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4255/8571] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:55:52 2022] PUT /identity/v3/projects/e1f42bb9b5e642b197126fd99aee2a11/users/81ce0aab063848278473c014b9fce833/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:55:52.853299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb507313-e2ec-4005-b03b-2885b46ec2de None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:52.853590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb507313-e2ec-4005-b03b-2885b46ec2de None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:52.853889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb507313-e2ec-4005-b03b-2885b46ec2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:52.884071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-eb507313-e2ec-4005-b03b-2885b46ec2de None None] MFA Rules not processed for user `81ce0aab063848278473c014b9fce833`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:52.885313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eb507313-e2ec-4005-b03b-2885b46ec2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:52.954506 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4317/8572] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:52.966459 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:52.968232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:52.991630 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:53.035223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a2612-84d9-4aba-84d4-bab8c9cd5288 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:53.038956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:53.039571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:53.039849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:53.041301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:53.049558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:53.051068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:53.061437 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4256/8573] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:56.723273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9ad6-cf06-4e64-84b6-9a68d76d3a42 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:56.726976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9ad6-cf06-4e64-84b6-9a68d76d3a42 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:56.726976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9ad6-cf06-4e64-84b6-9a68d76d3a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:56.744436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-883a9ad6-cf06-4e64-84b6-9a68d76d3a42 None None] MFA Rules not processed for user `2f9b4dd6a12f4060b25d95bb4c503c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:55:56.745675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-883a9ad6-cf06-4e64-84b6-9a68d76d3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:56.760205 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:55:56.810347 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4318/8574] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:55:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:55:57.067602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:55:57.069064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:57.138491 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db94b47-9244-458e-b509-3df83a76b40f service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:55:57.142883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:55:57.146099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:55:57.146099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:55:57.146099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:55:57.146099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:55:57.159291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:55:57.160742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:55:57.172548 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4257/8575] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:55:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:06.872155 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=17 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:07.165243 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=43 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:15.843818 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9ad6-cf06-4e64-84b6-9a68d76d3a42 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:15.865509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9ad6-cf06-4e64-84b6-9a68d76d3a42 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:15.869776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:15.871333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:15.871796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:15.872493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:15.875039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:15.892149 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:15.894485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:15.913137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4319/8576] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:25.901422 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:30.468606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:30.470642 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:30.548618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf014-1882-4bf9-b858-0225c0025b20 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:30.553765 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:30.554430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:30.554707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:30.554979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:30.556719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:30.570975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:30.572574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:30.586315 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4258/8577] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:33.821850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:33.824309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:33.839697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592686be-f8fb-4f7a-babe-2a4d315bd656 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:33.844869 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ac897-a88d-47de-97d9-a18ed0f8c362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:33.845580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ac897-a88d-47de-97d9-a18ed0f8c362 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:33.846177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ac897-a88d-47de-97d9-a18ed0f8c362 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:33.846574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ac897-a88d-47de-97d9-a18ed0f8c362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:33.848920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f84ac897-a88d-47de-97d9-a18ed0f8c362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:33.916554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ac897-a88d-47de-97d9-a18ed0f8c362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:33.918312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ac897-a88d-47de-97d9-a18ed0f8c362 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:33.930176 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4320/8578] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:40.579057 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=32 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:43.924335 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=28 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:47.077543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:47.147512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2062-9e71-4b64-9982-ac133ff10a8f service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:47.152473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:47.153117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:47.153547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:47.154063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] PATH_INFO: `/v3/users/81ce0aab063848278473c014b9fce833` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:47.155415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ce0aab063848278473c014b9fce833)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:47.157334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:47.367609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ce0aab063848278473c014b9fce833'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:47.383140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ce0aab063848278473c014b9fce833'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:47.392724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ce0aab063848278473c014b9fce833'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:47.393630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ce0aab063848278473c014b9fce833'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:47.453975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ce0aab063848278473c014b9fce833'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:47.460787 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4259/8579] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:56:47 2022] DELETE /identity/v3/users/81ce0aab063848278473c014b9fce833 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:47.465464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:47.466626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:47.466836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:47.493971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:47.495364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:47.571390 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4321/8580] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:47.583690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:47.585101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:47.664824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f164c-34b1-4429-b28c-fc3a88f8d48a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:47.668660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853ba30-2cac-4249-a041-be445137430d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:47.669919 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853ba30-2cac-4249-a041-be445137430d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:47.670196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853ba30-2cac-4249-a041-be445137430d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:47.670465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853ba30-2cac-4249-a041-be445137430d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:47.681374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853ba30-2cac-4249-a041-be445137430d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:47.682865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853ba30-2cac-4249-a041-be445137430d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:47.694612 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4260/8581] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:48.134637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:48.134637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:48.147129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9faf6-a0f4-4155-8bc8-0a79a197241f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:48.153135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:48.154832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.155353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.155860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] PATH_INFO: `/v3/projects/e1f42bb9b5e642b197126fd99aee2a11` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.157306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f42bb9b5e642b197126fd99aee2a11)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:48.163234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:48.283789 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f42bb9b5e642b197126fd99aee2a11', 'request_id': 'req-28289275-9b13-4268-8ea6-e6f7df2ff973'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:48.290669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f42bb9b5e642b197126fd99aee2a11', 'request_id': 'req-28289275-9b13-4268-8ea6-e6f7df2ff973'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:48.371197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f42bb9b5e642b197126fd99aee2a11', 'request_id': 'req-28289275-9b13-4268-8ea6-e6f7df2ff973'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:48.385496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] The token cache is being invalidate because project e1f42bb9b5e642b197126fd99aee2a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:56:48.385804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:48.386537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-28289275-9b13-4268-8ea6-e6f7df2ff973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:48.389318 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4322/8582] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:56:48 2022] DELETE /identity/v3/projects/e1f42bb9b5e642b197126fd99aee2a11 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:48.394538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb29fb-7232-4622-a823-f5b6e6878d2d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.395044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb29fb-7232-4622-a823-f5b6e6878d2d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.395148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb29fb-7232-4622-a823-f5b6e6878d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.421941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-54bb29fb-7232-4622-a823-f5b6e6878d2d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:48.421941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-54bb29fb-7232-4622-a823-f5b6e6878d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:48.443541 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:48.492594 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4261/8583] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:48.502654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb682b-c32e-4cb0-803a-116f47b4ccc1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.503329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb682b-c32e-4cb0-803a-116f47b4ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.503329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb682b-c32e-4cb0-803a-116f47b4ccc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.528040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0cfb682b-c32e-4cb0-803a-116f47b4ccc1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:48.529715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0cfb682b-c32e-4cb0-803a-116f47b4ccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:48.541162 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4323/8584] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:48.544874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb29fb-7232-4622-a823-f5b6e6878d2d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:48.555633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb29fb-7232-4622-a823-f5b6e6878d2d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:48.564655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:48.564789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.565017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.565294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.566150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:56:48.566458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:48.568233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:48.582931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4262/8585] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:56:48.587029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb682b-c32e-4cb0-803a-116f47b4ccc1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:48.606031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb682b-c32e-4cb0-803a-116f47b4ccc1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:48.611520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:48.612235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.612587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.612934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.613650 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:48.615703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:48.724386 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4324/8586] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:56:48 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:56:48.728781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:48.740584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269bef9-0209-4460-9924-0dcaf763f2fe admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:48.809022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:48.810181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.810819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.811420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.813051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:48.815014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:48.906571 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4263/8587] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:56:48 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:56:48.907851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:48.920718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fde43-bfad-4a29-90be-f979131f6fdc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:48.928223 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:48.929577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.930200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.930712 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.931661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:48.933842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:48.948344 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4325/8588] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:56:48.953727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:48.968312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34435c9f-e70c-4a46-9030-8da80afaa818 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:48.974240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec594ed-c2ff-48ab-bbc6-bff1ba98836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:48.975330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec594ed-c2ff-48ab-bbc6-bff1ba98836f admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:48.975562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec594ed-c2ff-48ab-bbc6-bff1ba98836f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:48.975840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec594ed-c2ff-48ab-bbc6-bff1ba98836f admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:48.976508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec594ed-c2ff-48ab-bbc6-bff1ba98836f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:48.978671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec594ed-c2ff-48ab-bbc6-bff1ba98836f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:49.013922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4264/8589] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:56:49.014374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:49.022447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e906a74-08b5-430c-bda1-5d9ba81625bd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:49.028853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:49.029436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.029982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.030337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] PATH_INFO: `/v3/projects/4b91ec4082ec4963bdc864818fd5fc60/users/c9df2a3a19cc41c8821c7735e0238c6d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.047467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b91ec4082ec4963bdc864818fd5fc60, user_id=c9df2a3a19cc41c8821c7735e0238c6d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:49.050444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:49.135726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4326/8590] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:56:49 2022] PUT /identity/v3/projects/4b91ec4082ec4963bdc864818fd5fc60/users/c9df2a3a19cc41c8821c7735e0238c6d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:49.138615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383966-7258-4338-8d6c-25265ff8e84f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.138910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383966-7258-4338-8d6c-25265ff8e84f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.139185 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383966-7258-4338-8d6c-25265ff8e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.173949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-02383966-7258-4338-8d6c-25265ff8e84f None None] MFA Rules not processed for user `c9df2a3a19cc41c8821c7735e0238c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:49.175353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-02383966-7258-4338-8d6c-25265ff8e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:49.243802 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4265/8591] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:49.248300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:49.271716 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:49.320367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae121e5-fe36-4c52-a3d6-6911f47e1219 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:49.326490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:49.327195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.327428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.327701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.328369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:49.330391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:49.444923 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4327/8592] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:56:49 2022] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:56:49.454186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02383966-7258-4338-8d6c-25265ff8e84f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:49.465467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02383966-7258-4338-8d6c-25265ff8e84f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:49.483317 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:49.541231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:49.542596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.543010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.543290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.543985 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:49.547572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:49.665357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4266/8593] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:56:49 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:56:49.666828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:49.682438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411222-c7d1-433d-a679-f36a642acfd7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:49.689325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:49.690419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.690925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.691405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.692264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:49.694122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:49.711584 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4328/8594] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:56:49.712576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:49.728697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443b803-82fb-4e68-9bc0-0c0a1ebec444 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:49.735563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85abbf-9d56-4cd5-8a1b-bba0b9cebcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:49.736714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85abbf-9d56-4cd5-8a1b-bba0b9cebcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.737229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85abbf-9d56-4cd5-8a1b-bba0b9cebcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.737731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85abbf-9d56-4cd5-8a1b-bba0b9cebcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.739455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85abbf-9d56-4cd5-8a1b-bba0b9cebcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:49.745851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85abbf-9d56-4cd5-8a1b-bba0b9cebcb4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:49.768501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:49.782771 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4267/8595] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:56:49.785206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eca2e6-d627-4173-8327-0e644f8be05d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:49.792541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:49.794012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.794954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.797956 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] PATH_INFO: `/v3/projects/60487088682144c7be27e013c1109356/users/84726543d0c94e919beac902a071ac3f/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.818697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=60487088682144c7be27e013c1109356, user_id=84726543d0c94e919beac902a071ac3f, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:49.821426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:49.894171 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4329/8596] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:56:49 2022] PUT /identity/v3/projects/60487088682144c7be27e013c1109356/users/84726543d0c94e919beac902a071ac3f/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:49.907127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce135e-c538-424e-9a30-0b0ffba053a6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:49.907422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce135e-c538-424e-9a30-0b0ffba053a6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:49.907785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce135e-c538-424e-9a30-0b0ffba053a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:49.947850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-84ce135e-c538-424e-9a30-0b0ffba053a6 None None] MFA Rules not processed for user `84726543d0c94e919beac902a071ac3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:49.949478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84ce135e-c538-424e-9a30-0b0ffba053a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:50.071360 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4268/8597] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:50.075926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:50.163824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032586d-3e02-4d78-925f-3e1fada17efc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:50.169226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:50.170038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:50.170497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:50.170930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:50.171723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:50.174117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:50.313488 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4330/8598] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:56:50 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:56:50.317747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce135e-c538-424e-9a30-0b0ffba053a6 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:50.330129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce135e-c538-424e-9a30-0b0ffba053a6 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:50.403775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:50.404394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:50.404671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:50.404941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:50.405569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:50.407526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:50.509565 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4269/8599] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:56:50 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:56:50.510965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:50.525320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1795c-9d57-45d6-8c6b-5d9edb811b06 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:50.535103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:50.535793 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:50.536228 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:50.536579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:50.537824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:50.539628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:50.554080 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4331/8600] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:56:50.558732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:50.572118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb17aff-49d7-4166-8063-934dd5f7f321 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:50.578544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:50.579397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:50.579782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:50.581346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] PATH_INFO: `/v3/projects/475f962c226f4c149d8adde8b2d35904/users/9228ce2509794ceeb895fd4550a9a1cd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:50.607873 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:50.611922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475f962c226f4c149d8adde8b2d35904, user_id=9228ce2509794ceeb895fd4550a9a1cd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:50.614898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:50.704571 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4270/8601] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:56:50 2022] PUT /identity/v3/projects/475f962c226f4c149d8adde8b2d35904/users/9228ce2509794ceeb895fd4550a9a1cd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:56:50.714589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:50.729486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84788b75-1902-45e9-a751-bdc71b3c2948 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:50.795772 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:50.843898 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84112e-141b-419e-b70c-21504cb4d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:50.844535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84112e-141b-419e-b70c-21504cb4d899 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:50.844866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84112e-141b-419e-b70c-21504cb4d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:50.845145 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84112e-141b-419e-b70c-21504cb4d899 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:50.845871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84112e-141b-419e-b70c-21504cb4d899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:50.848353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84112e-141b-419e-b70c-21504cb4d899 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:50.884889 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4332/8602] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:56:50.886349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:50.903007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f02535-c4eb-4780-bba0-92b1d6b021c0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:50.909599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:50.910463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:50.910838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:50.911309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] PATH_INFO: `/v3/projects/475f962c226f4c149d8adde8b2d35904/users/9228ce2509794ceeb895fd4550a9a1cd/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:50.913413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475f962c226f4c149d8adde8b2d35904, user_id=9228ce2509794ceeb895fd4550a9a1cd, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:50.922409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:50.952495 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4271/8603] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:56:50 2022] PUT /identity/v3/projects/475f962c226f4c149d8adde8b2d35904/users/9228ce2509794ceeb895fd4550a9a1cd/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:50.964080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:50.964700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:50.965217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:51.004474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] MFA Rules not processed for user `9228ce2509794ceeb895fd4550a9a1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:51.006080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:51.143267 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4333/8604] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:56:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:51.158991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:51.162315 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:51.289915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1925-4fe3-43d1-b2d2-0fa0ca438381 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:51.314752 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd71a5-5596-4d5e-b847-5293334de73d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:51.315611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd71a5-5596-4d5e-b847-5293334de73d service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:51.319108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd71a5-5596-4d5e-b847-5293334de73d service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:51.319108 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd71a5-5596-4d5e-b847-5293334de73d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:51.398925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd71a5-5596-4d5e-b847-5293334de73d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:51.401345 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd71a5-5596-4d5e-b847-5293334de73d service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:51.416868 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4272/8605] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:54.472180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:54.474148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:54.565014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9db94-868e-4b5a-be57-ba08478e26ac None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:54.569279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:54.569926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:54.570294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:54.570572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:54.583768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:54.585297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:54.599554 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4334/8606] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:57:01.412395 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:57:02.212537 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:02.212940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:02.213310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:02.247700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] MFA Rules not processed for user `c9df2a3a19cc41c8821c7735e0238c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:57:02.249989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:02.258391 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4273/8607] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:57:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:57:04.594673 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=69 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:57:11.890341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:11.892841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:11.924701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6cbe5-db43-4fa3-87f6-7129244cfddd service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:11.929115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:11.929743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:11.936715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:11.937072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:11.939857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:12.045452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:12.047332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:12.092879 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4335/8608] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:57:12.241043 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:57:12.584374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:12.587665 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:12.707243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14985-d6d1-46ac-b807-40c08575fdae None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:12.718416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:12.719076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:12.719359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:12.719633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:12.726367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:12.762949 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:12.764572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:12.782931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4274/8609] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:57:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:57:18.503309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:18.506081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:18.614420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265ccf2-1df3-4adc-bf25-1b2b24be5888 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:18.619074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:18.619707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:18.619990 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:18.620253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:18.626014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:18.712827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:18.714983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:18.727487 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4336/8610] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:57:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:57:22.070065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:22.072309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:22.117444 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d739908-6761-427e-938a-ee8d213ae6fa service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:22.127050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:22.128130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:22.128921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:22.129549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] PATH_INFO: `/v3/users/2680256107a841b6bba7b959a0952c02` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:22.133180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2680256107a841b6bba7b959a0952c02)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:22.138755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:22.392692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2680256107a841b6bba7b959a0952c02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:22.432194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2680256107a841b6bba7b959a0952c02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:22.442677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2680256107a841b6bba7b959a0952c02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:22.442677 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2680256107a841b6bba7b959a0952c02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:22.547291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2680256107a841b6bba7b959a0952c02'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:22.559992 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4275/8611] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:57:22 2022] DELETE /identity/v3/users/2680256107a841b6bba7b959a0952c02 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:57:22.981103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:22.995173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff38c1-96f1-4b52-925e-b97baa822429 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:23.049710 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:57:23.063999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:23.064652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:23.064934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:23.065413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] PATH_INFO: `/v3/projects/44551141b439487386b79d9daa5b1ace` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:23.066772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44551141b439487386b79d9daa5b1ace)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:23.068699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:23.187886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44551141b439487386b79d9daa5b1ace', 'request_id': 'req-cdd6d784-de89-47f2-9972-f390a1884fe1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.196242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44551141b439487386b79d9daa5b1ace', 'request_id': 'req-cdd6d784-de89-47f2-9972-f390a1884fe1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.320825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44551141b439487386b79d9daa5b1ace', 'request_id': 'req-cdd6d784-de89-47f2-9972-f390a1884fe1'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.345253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] The token cache is being invalidate because project 44551141b439487386b79d9daa5b1ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:57:23.345598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.346292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.348412 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4337/8612] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:57:22 2022] DELETE /identity/v3/projects/44551141b439487386b79d9daa5b1ace => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:57:23.352280 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:23.354606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:23.372877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6212cb-8d98-422b-b43f-6acf6f133bdd admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:23.434691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:23.435427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:23.435783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:23.436132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] PATH_INFO: `/v3/users/037c1a7dab6247f2b33162ca5b296747` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:23.437403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=037c1a7dab6247f2b33162ca5b296747)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:23.439449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:23.441867 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:57:23.642471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037c1a7dab6247f2b33162ca5b296747'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.656494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037c1a7dab6247f2b33162ca5b296747'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.664885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037c1a7dab6247f2b33162ca5b296747'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.669071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037c1a7dab6247f2b33162ca5b296747'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.735661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b9f49364-af60-457f-89d9-bc2a0b1c73a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037c1a7dab6247f2b33162ca5b296747'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:23.742634 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4276/8613] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:57:23 2022] DELETE /identity/v3/users/037c1a7dab6247f2b33162ca5b296747 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:57:23.991532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:23.993125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:24.017320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d784-de89-47f2-9972-f390a1884fe1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:24.091743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:24.092459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:24.092871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:24.093386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] PATH_INFO: `/v3/projects/88579203ca1b4d8fa92bac6eea795745` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:24.094986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88579203ca1b4d8fa92bac6eea795745)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:24.097190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:24.229453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88579203ca1b4d8fa92bac6eea795745', 'request_id': 'req-014f0479-7476-42ec-94e9-5daed25acb60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:24.237225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88579203ca1b4d8fa92bac6eea795745', 'request_id': 'req-014f0479-7476-42ec-94e9-5daed25acb60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:24.329938 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88579203ca1b4d8fa92bac6eea795745', 'request_id': 'req-014f0479-7476-42ec-94e9-5daed25acb60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:24.344210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] The token cache is being invalidate because project 88579203ca1b4d8fa92bac6eea795745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:57:24.344617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:24.346373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:57:24.348095 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4338/8614] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:57:23 2022] DELETE /identity/v3/projects/88579203ca1b4d8fa92bac6eea795745 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:57:33.739017 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:57:34.343266 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:57:58.028645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:58.028645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:58.028645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:58.050362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] MFA Rules not processed for user `c9df2a3a19cc41c8821c7735e0238c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:57:58.051798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:58.149116 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4277/8615] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:57:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:57:58.202348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:58.203846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:58.332095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0479-7476-42ec-94e9-5daed25acb60 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:58.338857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:58.339867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:58.340320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:58.340816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:58.343214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:58.443850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:58.445396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:58.463112 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4339/8616] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:57:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:57:58.781893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:57:58.783811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:58.880845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3cbce-ad32-4af1-8a0f-6123d45c4fcf None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:57:58.888590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:57:58.889186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:57:58.889463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:57:58.889734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:57:58.896440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:57:58.925050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:57:58.926536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:57:58.967807 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4278/8617] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:57:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:58:00.564313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:00.566637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:00.593445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc59ba6-edd3-407b-875b-a8f9fdb15f52 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:00.599456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:00.600195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:00.600538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:00.600877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:00.603394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:00.626781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:00.626781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:00.642468 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4340/8618] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:04.801292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:04.805331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:04.853981 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253a314-65f1-40e4-8832-103cd0343c1e service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:04.869574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:04.871475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:04.872462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:04.872851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:04.877442 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:04.895524 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:04.897704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:04.918136 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4279/8619] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:10.345043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:10.373597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420429-431b-41e3-a7ae-17c4fdd20e14 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:10.380377 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:10.381310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:10.381925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:10.382374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:10.384776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:10.415471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:10.418905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:10.449275 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4341/8620] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:14.905799 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=57 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:18.251869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:18.265532 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf037c-7213-4680-954a-87c3b56b3437 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:18.269542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:18.270449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:18.270591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:18.270759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:18.272513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:18.346837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:18.348278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:18.359479 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4280/8621] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:19.089079 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:19.092033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:19.110706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47136502-fee1-4ce9-89ad-65b0ae0536cb service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:19.115445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:19.116224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:19.116512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:19.116791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] PATH_INFO: `/v3/users/2f9b4dd6a12f4060b25d95bb4c503c9d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:19.117965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9b4dd6a12f4060b25d95bb4c503c9d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:19.119883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:19.303547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9b4dd6a12f4060b25d95bb4c503c9d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:19.304527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9b4dd6a12f4060b25d95bb4c503c9d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:19.426182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9b4dd6a12f4060b25d95bb4c503c9d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:19.434334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9b4dd6a12f4060b25d95bb4c503c9d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:19.435058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a27eff2-35fb-4f59-897f-d8567b8c8e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9b4dd6a12f4060b25d95bb4c503c9d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:19.440650 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:19.453507 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4342/8622] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:58:19 2022] DELETE /identity/v3/users/2f9b4dd6a12f4060b25d95bb4c503c9d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:19.716500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:19.764422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a57a6-6e3a-4fd5-b01a-3889cd4dde74 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:19.851157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:19.851859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:19.852147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:19.852429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] PATH_INFO: `/v3/projects/fd0c99a08ba748a484aff693b87979a8` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:19.853640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0c99a08ba748a484aff693b87979a8)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:19.856465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:19.982325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0c99a08ba748a484aff693b87979a8', 'request_id': 'req-9372f92c-b365-45d3-9d44-6f4c3e22da77'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:19.994792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0c99a08ba748a484aff693b87979a8', 'request_id': 'req-9372f92c-b365-45d3-9d44-6f4c3e22da77'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:20.073355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0c99a08ba748a484aff693b87979a8', 'request_id': 'req-9372f92c-b365-45d3-9d44-6f4c3e22da77'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:20.091707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] The token cache is being invalidate because project fd0c99a08ba748a484aff693b87979a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:58:20.097883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:20.097883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9372f92c-b365-45d3-9d44-6f4c3e22da77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:20.097883 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4281/8623] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:58:19 2022] DELETE /identity/v3/projects/fd0c99a08ba748a484aff693b87979a8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:20.102577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675eb0-b3a7-4cb1-a0e5-9d3edc663d2f None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.103082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675eb0-b3a7-4cb1-a0e5-9d3edc663d2f None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.103472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e675eb0-b3a7-4cb1-a0e5-9d3edc663d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.166495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1e675eb0-b3a7-4cb1-a0e5-9d3edc663d2f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:58:20.169634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1e675eb0-b3a7-4cb1-a0e5-9d3edc663d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:20.292666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6b6dc-9cc8-472d-b8df-ace35e5ac74f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.293517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6b6dc-9cc8-472d-b8df-ace35e5ac74f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.294002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6b6dc-9cc8-472d-b8df-ace35e5ac74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.297062 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4343/8624] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:58:20.322117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ddc6b6dc-9cc8-472d-b8df-ace35e5ac74f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:58:20.323461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ddc6b6dc-9cc8-472d-b8df-ace35e5ac74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:20.341198 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4282/8625] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:58:20.345587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e675eb0-b3a7-4cb1-a0e5-9d3edc663d2f None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:20.367321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e675eb0-b3a7-4cb1-a0e5-9d3edc663d2f None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:20.379954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:20.380640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.381131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.381502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.383455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:58:20.384045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:20.387621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:20.411803 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4344/8626] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 01:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:58:20.415862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6b6dc-9cc8-472d-b8df-ace35e5ac74f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:20.440836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6b6dc-9cc8-472d-b8df-ace35e5ac74f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:20.447277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:20.448120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.448258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.448479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.450183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:20.452044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:20.472043 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:20.576381 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4283/8627] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:58:20 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:58:20.582979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:20.611693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ef91-d5cd-4437-903d-d155cdaa83a6 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:20.693303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:20.695647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.695647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.695647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.696535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:20.700339 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:20.787815 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4345/8628] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:58:20 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:58:20.791796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:20.804390 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857fba5-61e7-4315-8c8a-aa00254a38a2 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:20.809726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:20.810387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.810647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.811009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.811653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:20.813292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:20.824835 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4284/8629] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:58:20.828745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:20.841261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bdf89-c52b-4a1d-80d5-2afdb94101d1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:20.846352 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d461cf-6a74-46a5-99bd-1d8326264ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:20.846959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d461cf-6a74-46a5-99bd-1d8326264ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.847242 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d461cf-6a74-46a5-99bd-1d8326264ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.847519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d461cf-6a74-46a5-99bd-1d8326264ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.848160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d461cf-6a74-46a5-99bd-1d8326264ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:20.849751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d461cf-6a74-46a5-99bd-1d8326264ea2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:20.865038 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4346/8630] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:58:20.866244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:20.876864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769503cf-313d-4c1b-a50c-a2a3d203daa4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:20.882192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:20.882894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:20.885861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:20.885861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] PATH_INFO: `/v3/projects/bd1266ca6f5e44b791882617087c532f/users/2d8f167db3e14ff4946c111a20f04de9/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:20.901956 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1266ca6f5e44b791882617087c532f, user_id=2d8f167db3e14ff4946c111a20f04de9, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:20.909226 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:21.044044 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4285/8631] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:58:20 2022] PUT /identity/v3/projects/bd1266ca6f5e44b791882617087c532f/users/2d8f167db3e14ff4946c111a20f04de9/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:21.045803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ce14-65e6-41bc-b2ae-13e4ff95ceb8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:21.046226 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ce14-65e6-41bc-b2ae-13e4ff95ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:21.046565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ce14-65e6-41bc-b2ae-13e4ff95ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:21.078262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fc72ce14-65e6-41bc-b2ae-13e4ff95ceb8 None None] MFA Rules not processed for user `2d8f167db3e14ff4946c111a20f04de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:58:21.079642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fc72ce14-65e6-41bc-b2ae-13e4ff95ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:21.129049 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:21.157206 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4347/8632] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:58:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:58:21.158912 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:21.231781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69527-55d1-4f70-97c7-8ad8cce73c86 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:21.236899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:21.237511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:21.237790 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:21.238132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:21.238762 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:21.240791 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:21.369473 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4286/8633] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 01:58:21 2022] POST /identity/v3/projects => generated 391 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:58:21.372189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ce14-65e6-41bc-b2ae-13e4ff95ceb8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:21.385969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ce14-65e6-41bc-b2ae-13e4ff95ceb8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:21.478439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:21.479074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:21.479991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:21.480305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:21.481747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:21.484263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:21.621851 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4348/8634] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 01:58:21 2022] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:58:21.625688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:21.638676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6049e-71c6-4dc0-88a8-315c88dfabce admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:21.643680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:21.644519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:21.644872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:21.645256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:21.646013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:21.648710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:21.666098 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4287/8635] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:58:21.670738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:21.682285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af03ba4-0a1d-4124-a5aa-813dc6d84c39 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:21.687954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:21.688768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:21.689132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:21.689767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] PATH_INFO: `/v3/projects/d0985713a86a451a8adefaf9a48d7189/users/6ac1e1ad36014b809467a43d0c9fec80/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:21.719493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0985713a86a451a8adefaf9a48d7189, user_id=6ac1e1ad36014b809467a43d0c9fec80, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:21.722449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:21.845390 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4349/8636] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:58:21 2022] PUT /identity/v3/projects/d0985713a86a451a8adefaf9a48d7189/users/6ac1e1ad36014b809467a43d0c9fec80/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:21.846568 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:21.860742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24801e-ef46-410a-8065-1425841e6ce4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:21.959071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbebc38-0252-400b-9a0c-8b64c9872189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:21.959702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebc38-0252-400b-9a0c-8b64c9872189 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:21.959984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebc38-0252-400b-9a0c-8b64c9872189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:21.960256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbebc38-0252-400b-9a0c-8b64c9872189 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:21.960935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebc38-0252-400b-9a0c-8b64c9872189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:21.962614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbebc38-0252-400b-9a0c-8b64c9872189 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:21.974942 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4288/8637] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 01:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:58:21.979701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:21.992403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7a26-f99e-486f-9769-824ff3676fb5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:21.997921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:21.998608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:21.998891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:21.999168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] PATH_INFO: `/v3/projects/d0985713a86a451a8adefaf9a48d7189/users/6ac1e1ad36014b809467a43d0c9fec80/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:22.001273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0985713a86a451a8adefaf9a48d7189, user_id=6ac1e1ad36014b809467a43d0c9fec80, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:22.004487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:22.022096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4350/8638] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 01:58:21 2022] PUT /identity/v3/projects/d0985713a86a451a8adefaf9a48d7189/users/6ac1e1ad36014b809467a43d0c9fec80/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:22.030090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:22.030381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:22.030646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:22.068118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] MFA Rules not processed for user `6ac1e1ad36014b809467a43d0c9fec80`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:58:22.069758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:22.094492 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:22.158913 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4289/8639] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:58:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:58:22.174217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:22.176295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:22.269610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5949-4a75-4b34-840d-774bc4af6716 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:22.278434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:22.279060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:22.279349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:22.279626 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:22.317838 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:22.349421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:22.351281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:22.362483 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4351/8640] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:27.937971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:27.940207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:28.019401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da28e2-d725-4107-bf01-25ec0fd797a3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:28.023334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:28.024253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:28.024538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:28.024810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:28.037317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:28.043379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:28.051582 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4290/8641] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:31.986021 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:31.988495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:32.070154 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f694445-ec04-4798-8a4b-d1149796995f service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:32.075194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:32.075836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:32.076118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:32.076785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:32.079120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:32.238775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:32.240937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:32.252831 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4352/8642] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:33.054999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:33.059636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:33.205920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96645a-8191-4a71-82ea-edb411ca85d8 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:33.211564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d9a45-477c-4724-bec7-b954afdc3834 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:33.217088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d9a45-477c-4724-bec7-b954afdc3834 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:33.217088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d9a45-477c-4724-bec7-b954afdc3834 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:33.217088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d9a45-477c-4724-bec7-b954afdc3834 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:33.220763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c22d9a45-477c-4724-bec7-b954afdc3834 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:33.239294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d9a45-477c-4724-bec7-b954afdc3834 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:33.241522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d9a45-477c-4724-bec7-b954afdc3834 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:33.290946 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4291/8643] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:33.397115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:33.408840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:33.507018 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d733fe-84e3-4adf-9f41-481825c26d60 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:33.507567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d733fe-84e3-4adf-9f41-481825c26d60 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:33.508025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d733fe-84e3-4adf-9f41-481825c26d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:33.524583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e91a-16a0-4e1b-b60c-fcbf18c4b824 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:33.530349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:33.531112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:33.531496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:33.531877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] PATH_INFO: `/v3/users/c9df2a3a19cc41c8821c7735e0238c6d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:33.533300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9df2a3a19cc41c8821c7735e0238c6d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:33.533777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-44d733fe-84e3-4adf-9f41-481825c26d60 None None] MFA Rules not processed for user `2d8f167db3e14ff4946c111a20f04de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:58:33.535413 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-44d733fe-84e3-4adf-9f41-481825c26d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:33.535692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:33.549352 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4292/8644] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:58:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:58:33.670471 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:33.832123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9df2a3a19cc41c8821c7735e0238c6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:33.833494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9df2a3a19cc41c8821c7735e0238c6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:33.921205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9df2a3a19cc41c8821c7735e0238c6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:33.934858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9df2a3a19cc41c8821c7735e0238c6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:33.936331 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9df2a3a19cc41c8821c7735e0238c6d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:33.968654 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4353/8645] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:58:33 2022] DELETE /identity/v3/users/c9df2a3a19cc41c8821c7735e0238c6d => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:33.973562 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:33.974110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:33.974573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:34.019457 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:58:34.033635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:34.110740 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:34.150283 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4293/8646] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 01:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:58:34.158604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:34.160078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:34.262491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e17f3-b2f6-435c-aa65-8cbb1b8015af admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:34.269042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:34.269629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:34.269972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:34.270255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:34.289633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:34.291271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:34.305123 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4354/8647] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:58:34.631330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:34.633534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:34.650172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a149-b1eb-4e99-b969-cdba3b57f4fc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:34.657977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:34.658963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:34.659544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:34.660048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] PATH_INFO: `/v3/projects/4b91ec4082ec4963bdc864818fd5fc60` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:34.661913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b91ec4082ec4963bdc864818fd5fc60)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:34.664328 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:34.881044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b91ec4082ec4963bdc864818fd5fc60', 'request_id': 'req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:34.896724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b91ec4082ec4963bdc864818fd5fc60', 'request_id': 'req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:34.993704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b91ec4082ec4963bdc864818fd5fc60', 'request_id': 'req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.006742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] The token cache is being invalidate because project 4b91ec4082ec4963bdc864818fd5fc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:58:35.007075 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.007786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.009415 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4294/8648] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:58:34 2022] DELETE /identity/v3/projects/4b91ec4082ec4963bdc864818fd5fc60 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:35.014084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:35.029004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f8136-92cd-4bc7-b7c9-8891567a392e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:35.100067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:35.100717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:35.101001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:35.101276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] PATH_INFO: `/v3/users/84726543d0c94e919beac902a071ac3f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:35.102433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84726543d0c94e919beac902a071ac3f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:35.104433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:35.319491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84726543d0c94e919beac902a071ac3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.320262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84726543d0c94e919beac902a071ac3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.325172 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:35.422455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84726543d0c94e919beac902a071ac3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.436657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84726543d0c94e919beac902a071ac3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.438159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84726543d0c94e919beac902a071ac3f'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:35.458832 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4355/8649] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:58:35 2022] DELETE /identity/v3/users/84726543d0c94e919beac902a071ac3f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:35.985874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:35.988510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:36.003710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dae5-f4a5-41b7-a2bb-9bf742e34d32 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:36.124190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:36.124190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:36.124190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:36.124190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] PATH_INFO: `/v3/projects/60487088682144c7be27e013c1109356` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:36.138840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60487088682144c7be27e013c1109356)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:36.138840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:36.257467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60487088682144c7be27e013c1109356', 'request_id': 'req-9c6731dc-4113-4b19-a811-a0ba14b43762'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.265695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60487088682144c7be27e013c1109356', 'request_id': 'req-9c6731dc-4113-4b19-a811-a0ba14b43762'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.410630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60487088682144c7be27e013c1109356', 'request_id': 'req-9c6731dc-4113-4b19-a811-a0ba14b43762'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.416077 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:36.429652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] The token cache is being invalidate because project 60487088682144c7be27e013c1109356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:58:36.430454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.431074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.432595 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4295/8650] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:58:35 2022] DELETE /identity/v3/projects/60487088682144c7be27e013c1109356 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:36.436892 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:36.439047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:36.455473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0bbb-f4ec-4404-b65e-eb599038a4c1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:36.534598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:36.539823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:36.539823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:36.539823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] PATH_INFO: `/v3/users/9228ce2509794ceeb895fd4550a9a1cd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:36.539823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9228ce2509794ceeb895fd4550a9a1cd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:36.539823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:36.765838 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9228ce2509794ceeb895fd4550a9a1cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.766579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9228ce2509794ceeb895fd4550a9a1cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.872191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9228ce2509794ceeb895fd4550a9a1cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.880665 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9228ce2509794ceeb895fd4550a9a1cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.881456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9228ce2509794ceeb895fd4550a9a1cd'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:36.907847 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4356/8651] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 01:58:36 2022] DELETE /identity/v3/users/9228ce2509794ceeb895fd4550a9a1cd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:37.226958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:58:37.228937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:58:37.248372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6731dc-4113-4b19-a811-a0ba14b43762 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:58:37.338477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:58:37.339215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:58:37.339496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:58:37.339772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] PATH_INFO: `/v3/projects/475f962c226f4c149d8adde8b2d35904` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:58:37.341062 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475f962c226f4c149d8adde8b2d35904)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:58:37.343174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:58:37.498350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475f962c226f4c149d8adde8b2d35904', 'request_id': 'req-242cfbfd-0f48-485a-85cf-1a1403301ec3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:37.512066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475f962c226f4c149d8adde8b2d35904', 'request_id': 'req-242cfbfd-0f48-485a-85cf-1a1403301ec3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:37.642797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475f962c226f4c149d8adde8b2d35904', 'request_id': 'req-242cfbfd-0f48-485a-85cf-1a1403301ec3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:37.673267 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] The token cache is being invalidate because project 475f962c226f4c149d8adde8b2d35904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:58:37.673570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:37.675225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:58:37.677001 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4296/8652] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 01:58:37 2022] DELETE /identity/v3/projects/475f962c226f4c149d8adde8b2d35904 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:58:46.902007 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:58:47.664110 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:59:25.052520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:25.054082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:25.128514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eae900-01f5-4b38-a578-a32e2e32fa97 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:25.189072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:25.189709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:25.190018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:25.190294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:25.192002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:25.206225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:25.207872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:25.221257 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4357/8653] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:59:25.691011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:25.692749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:25.773569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cfbfd-0f48-485a-85cf-1a1403301ec3 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:25.780008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:25.780920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:25.781381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:25.781887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:25.783994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:25.798885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:25.800342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:25.812690 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4297/8654] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:59:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:59:25.998449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:25.999870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:26.017074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbba86-a74e-4340-a1db-cc3a34b8bfa9 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:26.024028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:26.024630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:26.024953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:26.025378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:26.027007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:26.044615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:26.053411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:26.061796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4358/8655] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:59:26.365705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:26.377714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad113b9-4a1f-4160-a9fc-5f47b5417192 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:26.381313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:26.381942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:26.382223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:26.382496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:26.384186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:26.467234 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:26.468722 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:26.487451 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4298/8656] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:59:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:59:36.052500 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=64 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:59:36.480302 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=60 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:59:41.744485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:41.757094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c979506-8040-4e9e-835d-51464d758e2c service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:41.760763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:41.772259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:41.772259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:41.772259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:41.772259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:41.777568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:41.779102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:41.792848 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4359/8657] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:59:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:59:42.272494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:42.274067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:42.292624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd48f5-d65c-40e8-a9e2-fb3afa2e4a8f service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:42.300420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:42.301080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:42.301548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:42.301989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:42.303927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:42.321034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:42.323816 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:42.338298 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4299/8658] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 01:59:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:59:47.475823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:47.478562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:47.553616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7d852-295f-4e7c-9715-4eee26acbaca service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:47.558847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:47.565566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:47.565566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:47.565566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:47.565566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:47.632049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:47.634383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:47.644160 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4360/8659] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 01:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:59:52.330454 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:59:57.640019 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=60 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:20.657153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:20.658607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:20.677258 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0a946-3323-4c2d-b78d-e8460b2adf47 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:20.683192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:20.683806 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:20.684087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:20.684362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:20.686326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:20.761706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:20.763358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:20.774082 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4300/8660] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:00:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:00:27.749309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:27.751292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:27.773897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857a390-33f0-4fe5-a76a-ae2eb4b4456e service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:27.778531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:27.779426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:27.779718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:27.779998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:27.791912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:27.885899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:27.888783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:27.917874 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4361/8661] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:00:30.769367 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=28 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:32.056430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:32.073272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb578dd-c9fa-443c-ba91-302dd330c33b service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:32.078908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:32.079796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:32.080167 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:32.080509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:32.083249 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:32.115499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:32.119312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:32.143061 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4301/8662] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:00:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:00:36.625031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:36.625031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:36.638616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a5cac-236a-4c15-97b5-cd0a4dd77e35 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:36.645507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:36.646802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:36.647301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:36.647842 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] PATH_INFO: `/v3/users/bb2ed2c7f298404f9e78d4a0590d3f52` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:36.649399 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2ed2c7f298404f9e78d4a0590d3f52)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:36.651634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:36.865831 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2ed2c7f298404f9e78d4a0590d3f52'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:36.867060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2ed2c7f298404f9e78d4a0590d3f52'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:36.937030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2ed2c7f298404f9e78d4a0590d3f52'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:36.945429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2ed2c7f298404f9e78d4a0590d3f52'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:36.964534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2ed2c7f298404f9e78d4a0590d3f52'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:37.015105 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4362/8663] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:00:36 2022] DELETE /identity/v3/users/bb2ed2c7f298404f9e78d4a0590d3f52 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:00:37.379894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:37.396433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915af21f-53f4-4d14-8dc5-7dc3971fac50 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:37.511797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:37.512478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:37.512764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:37.513039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] PATH_INFO: `/v3/projects/e49a959c321b438c844395a88dcc7910` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:37.514492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49a959c321b438c844395a88dcc7910)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:37.520002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:37.695228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49a959c321b438c844395a88dcc7910', 'request_id': 'req-befdcc05-484e-4578-ab9c-2b74744a485d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:37.709289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49a959c321b438c844395a88dcc7910', 'request_id': 'req-befdcc05-484e-4578-ab9c-2b74744a485d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:37.803352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49a959c321b438c844395a88dcc7910', 'request_id': 'req-befdcc05-484e-4578-ab9c-2b74744a485d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:37.819011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] The token cache is being invalidate because project e49a959c321b438c844395a88dcc7910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:00:37.819542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:37.820321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:37.822332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4302/8664] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:00:37 2022] DELETE /identity/v3/projects/e49a959c321b438c844395a88dcc7910 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:00:37.826654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:37.829683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:37.853268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e67b2-637f-443c-b48f-c93c8e92b0cd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:37.980555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:37.982007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:37.982556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:37.983063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] PATH_INFO: `/v3/users/31097f3fe65f47909e7ec5140a4f4b60` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:37.984500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31097f3fe65f47909e7ec5140a4f4b60)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:37.987275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:37.995933 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:38.167055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31097f3fe65f47909e7ec5140a4f4b60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:38.167998 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31097f3fe65f47909e7ec5140a4f4b60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:38.331315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31097f3fe65f47909e7ec5140a4f4b60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:38.342491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31097f3fe65f47909e7ec5140a4f4b60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:38.343380 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-93359f27-2d7b-44d9-9abb-e49c39e311f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31097f3fe65f47909e7ec5140a4f4b60'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:38.367026 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4363/8665] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:00:37 2022] DELETE /identity/v3/users/31097f3fe65f47909e7ec5140a4f4b60 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:00:38.684033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:38.686127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:38.701222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdcc05-484e-4578-ab9c-2b74744a485d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:38.784626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:38.785272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:38.785558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:38.785854 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] PATH_INFO: `/v3/projects/231b9c6a1d1e40d2a11fb810ea73b919` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:38.787130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231b9c6a1d1e40d2a11fb810ea73b919)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:38.790644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:38.825283 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:38.953023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231b9c6a1d1e40d2a11fb810ea73b919', 'request_id': 'req-9ebdbcab-362c-4c59-8f00-3652e9787bc8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:38.960236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231b9c6a1d1e40d2a11fb810ea73b919', 'request_id': 'req-9ebdbcab-362c-4c59-8f00-3652e9787bc8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:39.039653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231b9c6a1d1e40d2a11fb810ea73b919', 'request_id': 'req-9ebdbcab-362c-4c59-8f00-3652e9787bc8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:39.077777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] The token cache is being invalidate because project 231b9c6a1d1e40d2a11fb810ea73b919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:00:39.079184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:39.080013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:39.083089 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4303/8666] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:00:38 2022] DELETE /identity/v3/projects/231b9c6a1d1e40d2a11fb810ea73b919 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:00:39.547782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:39.548375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:39.548488 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:39.582424 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] MFA Rules not processed for user `2d8f167db3e14ff4946c111a20f04de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:00:39.583797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:39.682370 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4364/8667] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:00:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:00:40.588945 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:40.597976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:40.733065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdbcab-362c-4c59-8f00-3652e9787bc8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:40.742091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:40.743077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:40.743461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:40.743819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:40.746719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:40.765327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:40.766975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:40.781246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4304/8668] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:00:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:00:49.662204 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:50.777620 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:52.983763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:52.985470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:53.065893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50d509-1b43-4db6-935b-e726588c1550 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:53.071759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2722f-11ca-4ea7-a7cf-c5b5b09b95b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:53.072409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2722f-11ca-4ea7-a7cf-c5b5b09b95b5 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:53.072690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2722f-11ca-4ea7-a7cf-c5b5b09b95b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:53.073083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2722f-11ca-4ea7-a7cf-c5b5b09b95b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:53.074836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-45f2722f-11ca-4ea7-a7cf-c5b5b09b95b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:53.091503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2722f-11ca-4ea7-a7cf-c5b5b09b95b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:53.093037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2722f-11ca-4ea7-a7cf-c5b5b09b95b5 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:53.111309 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4365/8669] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:00:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:00:57.476049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:57.478261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:57.574569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424530-498c-4614-8ff6-375e897a857d service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:57.579605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:57.580576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:57.580955 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:57.581331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] PATH_INFO: `/v3/users/dd154b1857874986a756b77f6f578bf9` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:57.582680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd154b1857874986a756b77f6f578bf9)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:57.584721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:57.805558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd154b1857874986a756b77f6f578bf9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:57.818855 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd154b1857874986a756b77f6f578bf9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:57.827969 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd154b1857874986a756b77f6f578bf9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:57.829298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd154b1857874986a756b77f6f578bf9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:57.885060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9a3593cb-cdf0-4a64-b36e-ba22f42cd1c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd154b1857874986a756b77f6f578bf9'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:57.894814 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4305/8670] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:00:57 2022] DELETE /identity/v3/users/dd154b1857874986a756b77f6f578bf9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:00:57.897168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32370f9-485e-4473-9276-a80fdb029f5a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:57.898134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32370f9-485e-4473-9276-a80fdb029f5a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:57.898433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32370f9-485e-4473-9276-a80fdb029f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:57.923456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e32370f9-485e-4473-9276-a80fdb029f5a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:00:57.927853 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e32370f9-485e-4473-9276-a80fdb029f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:57.993467 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4366/8671] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:00:58.002860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:58.003448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:58.003734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:58.051552 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:00:58.052848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:58.120047 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4306/8672] 10.222.0.59 () {58 vars in 1062 bytes} [Sun Aug 28 02:00:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:00:58.126512 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32370f9-485e-4473-9276-a80fdb029f5a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:58.136871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32370f9-485e-4473-9276-a80fdb029f5a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:58.140592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3bf30-2f48-43b6-a136-841f460655f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:58.141271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bf30-2f48-43b6-a136-841f460655f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:58.141621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bf30-2f48-43b6-a136-841f460655f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:58.141995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bf30-2f48-43b6-a136-841f460655f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:58.152253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3bf30-2f48-43b6-a136-841f460655f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:58.153774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3bf30-2f48-43b6-a136-841f460655f7 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:58.164188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4367/8673] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:00:58.454235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:58.455895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:58.480431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37555ff8-b2c7-49f1-8d77-76d122cdb336 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:58.495848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:58.495848 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:58.496306 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:58.502520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] PATH_INFO: `/v3/projects/59b29e1bde1f4dfba3545cc1443ede74` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:58.504148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b29e1bde1f4dfba3545cc1443ede74)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:58.506626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:58.520206 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:58.648364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b29e1bde1f4dfba3545cc1443ede74', 'request_id': 'req-91ab3abe-9ab9-4fba-9753-2bd387aef29a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:58.657186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b29e1bde1f4dfba3545cc1443ede74', 'request_id': 'req-91ab3abe-9ab9-4fba-9753-2bd387aef29a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:58.730920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b29e1bde1f4dfba3545cc1443ede74', 'request_id': 'req-91ab3abe-9ab9-4fba-9753-2bd387aef29a'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:58.752421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] The token cache is being invalidate because project 59b29e1bde1f4dfba3545cc1443ede74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:00:58.752794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:58.753527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-91ab3abe-9ab9-4fba-9753-2bd387aef29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:00:58.767693 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4307/8674] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:00:58 2022] DELETE /identity/v3/projects/59b29e1bde1f4dfba3545cc1443ede74 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:00:58.774510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348054-4490-4091-9fc8-dbe025fd6423 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:58.775180 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348054-4490-4091-9fc8-dbe025fd6423 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:58.775822 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348054-4490-4091-9fc8-dbe025fd6423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:58.799698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7c348054-4490-4091-9fc8-dbe025fd6423 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:00:58.801387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7c348054-4490-4091-9fc8-dbe025fd6423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:58.885261 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4368/8675] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:00:58.894582 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8573ce8-7df7-4b9e-833c-5186ebaaae76 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:58.895400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8573ce8-7df7-4b9e-833c-5186ebaaae76 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:58.895838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8573ce8-7df7-4b9e-833c-5186ebaaae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:58.918724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-d8573ce8-7df7-4b9e-833c-5186ebaaae76 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:00:58.919924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d8573ce8-7df7-4b9e-833c-5186ebaaae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:58.929711 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4308/8676] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:00:58.935060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c348054-4490-4091-9fc8-dbe025fd6423 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:58.945778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c348054-4490-4091-9fc8-dbe025fd6423 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:58.953244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:58.953995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:58.954379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:58.955159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:58.955451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:00:58.955832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:58.958459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:58.968800 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=100 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:00:58.972654 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4369/8677] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:00:58.977776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8573ce8-7df7-4b9e-833c-5186ebaaae76 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:58.988840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8573ce8-7df7-4b9e-833c-5186ebaaae76 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:58.995417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:58.996043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:58.996327 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:58.996653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:58.997312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:59.000445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:59.104943 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4309/8678] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:00:58 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:00:59.109273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:59.120891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0500c-0e11-4434-90e8-51f01b4b3b7a admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:59.185419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:59.186074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:59.191607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:59.191607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:59.191607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:59.191607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:59.280411 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4370/8679] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:00:59 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:00:59.284626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:59.296309 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6be77-f567-4447-a4ce-4cec30cec9d4 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:59.301127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:59.301728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:59.302037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:59.303213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:59.303213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:59.304543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:59.316037 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4310/8680] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:00:59.320310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:59.331510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b2ee2-c276-4c56-b24f-f798a5d84f84 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:59.336974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058299d3-3c8c-4165-a852-5414aeeec3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:59.338545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058299d3-3c8c-4165-a852-5414aeeec3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:59.339189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058299d3-3c8c-4165-a852-5414aeeec3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:59.339478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058299d3-3c8c-4165-a852-5414aeeec3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:59.340135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058299d3-3c8c-4165-a852-5414aeeec3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:59.341773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058299d3-3c8c-4165-a852-5414aeeec3c0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:59.356549 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4371/8681] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:00:59.360811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:59.372869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6bc70-719c-4c37-a25c-72f31327f962 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:59.377575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:59.378269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:59.378558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:59.378836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] PATH_INFO: `/v3/projects/2a5b96b9d70e4b46aeded368e88cd30f/users/2a8dbbbf6993421b9d784c24e405307d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:59.394463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5b96b9d70e4b46aeded368e88cd30f, user_id=2a8dbbbf6993421b9d784c24e405307d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:59.397396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:59.480141 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4311/8682] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:00:59 2022] PUT /identity/v3/projects/2a5b96b9d70e4b46aeded368e88cd30f/users/2a8dbbbf6993421b9d784c24e405307d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:00:59.490875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9f9bc-a508-4dab-9a9a-366b78ffbdd1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:59.491166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9f9bc-a508-4dab-9a9a-366b78ffbdd1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:59.491474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9f9bc-a508-4dab-9a9a-366b78ffbdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:59.522496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-83e9f9bc-a508-4dab-9a9a-366b78ffbdd1 None None] MFA Rules not processed for user `2a8dbbbf6993421b9d784c24e405307d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:00:59.523746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-83e9f9bc-a508-4dab-9a9a-366b78ffbdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:59.591878 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4372/8683] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:00:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:00:59.604522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:00:59.606395 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:00:59.676885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a71cb7-3977-40f8-9f56-e0af06dc7217 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:00:59.681242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:00:59.681895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:00:59.682184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:00:59.682462 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:00:59.691187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:00:59.692635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:00:59.701542 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4312/8684] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:00:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:01:09.588973 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:01:09.697663 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:01:32.386496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209b95f-fa9e-4086-b8bb-fe020dc73fcb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:01:32.387063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209b95f-fa9e-4086-b8bb-fe020dc73fcb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:01:32.387063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209b95f-fa9e-4086-b8bb-fe020dc73fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:01:32.468772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6209b95f-fa9e-4086-b8bb-fe020dc73fcb None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:01:32.470110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6209b95f-fa9e-4086-b8bb-fe020dc73fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:01:32.585857 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4373/8685] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:01:32.597883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:01:32.600508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:01:32.644796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e769e1-32c7-41df-9146-7e218ecd9c43 service glance] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:01:32.649924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:01:32.650528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:01:32.650808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:01:32.651080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:01:32.660681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:01:32.662727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:01:32.673059 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4313/8686] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:01:33.030498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:01:33.030795 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:01:33.031121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:01:33.052248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:01:33.053935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:01:33.062469 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4374/8687] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:01:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:01:33.074589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:01:33.087935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c9f2b-8137-429d-9104-c131927abf92 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:01:33.093175 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:01:33.093947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:01:33.094188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:01:33.094463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:01:33.105569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:01:33.107194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:01:33.119112 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4314/8688] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:01:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:01:33.425752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:01:33.427979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:01:33.447034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976120ab-0241-4e3c-a233-55d1929924c0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:01:33.453663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:01:33.454313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:01:33.454603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:01:33.454912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:01:33.457521 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:01:33.474549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:01:33.476155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:01:33.494020 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4375/8689] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:01:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:01:43.114969 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=23 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:01:43.482301 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=75 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:18.638329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:18.662882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8892d7b-57e8-4496-a970-b9bf5a9e0c40 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:18.668169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d633a0-6b0e-489f-a400-8268ca2f57b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:18.668781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d633a0-6b0e-489f-a400-8268ca2f57b8 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:18.669064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d633a0-6b0e-489f-a400-8268ca2f57b8 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:18.669342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d633a0-6b0e-489f-a400-8268ca2f57b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:18.671084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-52d633a0-6b0e-489f-a400-8268ca2f57b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:18.686102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d633a0-6b0e-489f-a400-8268ca2f57b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:18.687689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d633a0-6b0e-489f-a400-8268ca2f57b8 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:18.701087 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4315/8690] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:02:23.595213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:23.680545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d1e92-eebc-4412-8542-ce5e440611f8 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:23.685005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:23.685631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:23.685942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:23.686219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] PATH_INFO: `/v3/users/2a8dbbbf6993421b9d784c24e405307d` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:23.687678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8dbbbf6993421b9d784c24e405307d)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:23.689588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:23.883840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8dbbbf6993421b9d784c24e405307d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:23.884429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8dbbbf6993421b9d784c24e405307d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:23.948329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8dbbbf6993421b9d784c24e405307d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:23.955945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8dbbbf6993421b9d784c24e405307d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:23.956633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f0b2b1e2-e370-4f6b-8cc5-9ef49b4d5c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8dbbbf6993421b9d784c24e405307d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:23.975088 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4376/8691] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:02:23 2022] DELETE /identity/v3/users/2a8dbbbf6993421b9d784c24e405307d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:02:23.980291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b975-848f-4d14-9e28-284f5496d020 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:23.980796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b975-848f-4d14-9e28-284f5496d020 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:23.980895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b975-848f-4d14-9e28-284f5496d020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:24.024563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3b96b975-848f-4d14-9e28-284f5496d020 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:24.025799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3b96b975-848f-4d14-9e28-284f5496d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:24.086851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4316/8692] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:24.096385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:24.096674 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:24.096954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:24.129538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:24.130919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:24.177648 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:24.193146 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4377/8693] 10.222.0.59 () {58 vars in 1062 bytes} [Sun Aug 28 02:02:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:24.199113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b975-848f-4d14-9e28-284f5496d020 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:24.208569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b975-848f-4d14-9e28-284f5496d020 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:24.213191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6e78-4922-470a-9fca-b3a21093380f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:24.213798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6e78-4922-470a-9fca-b3a21093380f service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:24.214105 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6e78-4922-470a-9fca-b3a21093380f service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:24.214381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6e78-4922-470a-9fca-b3a21093380f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:24.223595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6e78-4922-470a-9fca-b3a21093380f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:24.225027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6e78-4922-470a-9fca-b3a21093380f service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:24.234814 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4317/8694] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:02:24.626082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:24.627659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:24.645028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0601-947a-4a20-b35f-b38c3c487dcb None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:24.649920 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:24.650565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:24.650917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:24.651113 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] PATH_INFO: `/v3/projects/2a5b96b9d70e4b46aeded368e88cd30f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:24.652306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5b96b9d70e4b46aeded368e88cd30f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:24.657608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:24.757450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5b96b9d70e4b46aeded368e88cd30f', 'request_id': 'req-2a860651-58fe-439e-97a6-ddbaf93e912e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:24.763697 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5b96b9d70e4b46aeded368e88cd30f', 'request_id': 'req-2a860651-58fe-439e-97a6-ddbaf93e912e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:24.836321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5b96b9d70e4b46aeded368e88cd30f', 'request_id': 'req-2a860651-58fe-439e-97a6-ddbaf93e912e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:24.847084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] The token cache is being invalidate because project 2a5b96b9d70e4b46aeded368e88cd30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:02:24.847383 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:24.848018 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-2a860651-58fe-439e-97a6-ddbaf93e912e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:24.849511 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4378/8695] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:02:24 2022] DELETE /identity/v3/projects/2a5b96b9d70e4b46aeded368e88cd30f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:02:24.855130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ffaa-a5cc-440b-b3bf-6d4fcc7b2283 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:24.857569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ffaa-a5cc-440b-b3bf-6d4fcc7b2283 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:24.857569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6ffaa-a5cc-440b-b3bf-6d4fcc7b2283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:24.895989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-14b6ffaa-a5cc-440b-b3bf-6d4fcc7b2283 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:24.897131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-14b6ffaa-a5cc-440b-b3bf-6d4fcc7b2283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:24.963007 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4318/8696] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:24.972368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f487b-e5bc-4308-b692-30b521bee193 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:24.972664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f487b-e5bc-4308-b692-30b521bee193 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:24.972945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f487b-e5bc-4308-b692-30b521bee193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:24.994684 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1b3f487b-e5bc-4308-b692-30b521bee193 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:24.995886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1b3f487b-e5bc-4308-b692-30b521bee193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:25.003733 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4379/8697] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:25.008072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6ffaa-a5cc-440b-b3bf-6d4fcc7b2283 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:25.018029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6ffaa-a5cc-440b-b3bf-6d4fcc7b2283 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:25.023351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:25.024003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.024619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.024895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.025534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:02:25.025853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:25.027438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:25.039388 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4319/8698] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:02:25.043514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f487b-e5bc-4308-b692-30b521bee193 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:25.052863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f487b-e5bc-4308-b692-30b521bee193 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:25.057459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:25.058071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.058354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.058628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.059262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:25.061153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:25.155798 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4380/8699] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:02:25 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:02:25.160127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:25.171984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b640282-2efc-4d16-a0ef-da62aa7a659b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:25.191577 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:25.234542 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:25.235154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.235439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.235717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.236360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:25.238325 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:25.316851 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4320/8700] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:02:25 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:02:25.321977 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:25.331707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66c4c-33a1-4484-a33c-2ece6f340723 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:25.336532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:25.337124 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.337410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.337685 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.338363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:25.339988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:25.351223 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4381/8701] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:02:25.359066 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:25.370503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44b25-3553-4bf0-aa2c-1470e2fc7e16 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:25.375260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df433cc8-c64a-4240-aabf-2238d9a446a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:25.375853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433cc8-c64a-4240-aabf-2238d9a446a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.376134 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433cc8-c64a-4240-aabf-2238d9a446a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.376406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433cc8-c64a-4240-aabf-2238d9a446a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.377039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df433cc8-c64a-4240-aabf-2238d9a446a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:25.378648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df433cc8-c64a-4240-aabf-2238d9a446a6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:25.389683 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4321/8702] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:02:25.394129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:25.404287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3883-94e2-4425-a0ba-67265e7ef1ec admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:25.409389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:25.410066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.410345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.410621 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] PATH_INFO: `/v3/projects/17c974cc4f33409fbd321ef7a1a9acec/users/78e8bc446ac844bdaea8686c694a08be/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.426341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c974cc4f33409fbd321ef7a1a9acec, user_id=78e8bc446ac844bdaea8686c694a08be, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:25.429649 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:25.539726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4382/8703] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:02:25 2022] PUT /identity/v3/projects/17c974cc4f33409fbd321ef7a1a9acec/users/78e8bc446ac844bdaea8686c694a08be/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:02:25.550050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeab52-90d7-4b96-a82e-3c6edbd43512 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.550332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeab52-90d7-4b96-a82e-3c6edbd43512 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.550629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aeab52-90d7-4b96-a82e-3c6edbd43512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.579514 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b4aeab52-90d7-4b96-a82e-3c6edbd43512 None None] MFA Rules not processed for user `78e8bc446ac844bdaea8686c694a08be`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:25.580717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b4aeab52-90d7-4b96-a82e-3c6edbd43512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:25.647420 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4322/8704] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:25.658950 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:25.660640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:25.742415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a79b4-922b-4dcb-93bb-b1d614afa72d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:25.746088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf4ec-98f6-4421-84ca-8f059ba0c2d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:25.746713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf4ec-98f6-4421-84ca-8f059ba0c2d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:25.746987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf4ec-98f6-4421-84ca-8f059ba0c2d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:25.747260 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf4ec-98f6-4421-84ca-8f059ba0c2d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:25.752693 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:25.756254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf4ec-98f6-4421-84ca-8f059ba0c2d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:25.758280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf4ec-98f6-4421-84ca-8f059ba0c2d2 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:25.767033 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4383/8705] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:02:32.059155 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aeab52-90d7-4b96-a82e-3c6edbd43512 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:32.124946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aeab52-90d7-4b96-a82e-3c6edbd43512 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:32.129405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:32.130124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:32.130346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:32.130619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] PATH_INFO: `/v3/users/78e8bc446ac844bdaea8686c694a08be` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:32.132089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e8bc446ac844bdaea8686c694a08be)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:32.134290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:32.317003 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:32.332439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e8bc446ac844bdaea8686c694a08be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:32.348556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e8bc446ac844bdaea8686c694a08be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:32.360218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e8bc446ac844bdaea8686c694a08be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:32.360218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e8bc446ac844bdaea8686c694a08be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:32.441900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e8bc446ac844bdaea8686c694a08be'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:32.449436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4323/8706] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:02:32 2022] DELETE /identity/v3/users/78e8bc446ac844bdaea8686c694a08be => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:02:32.460296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890778-9065-436d-9f97-36080946e445 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:32.460900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890778-9065-436d-9f97-36080946e445 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:32.460900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890778-9065-436d-9f97-36080946e445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:32.483944 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f7890778-9065-436d-9f97-36080946e445 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:32.485294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f7890778-9065-436d-9f97-36080946e445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:32.555471 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4384/8707] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:32.566114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:32.567522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:32.630584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d1ef9-d56a-4770-9f3e-97a9e055ffae admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:32.635094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccfc32-ee25-44db-bc4f-da830d259b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:32.635788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccfc32-ee25-44db-bc4f-da830d259b77 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:32.635991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccfc32-ee25-44db-bc4f-da830d259b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:32.636272 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccfc32-ee25-44db-bc4f-da830d259b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:32.647626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccfc32-ee25-44db-bc4f-da830d259b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:32.649053 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccfc32-ee25-44db-bc4f-da830d259b77 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:32.659920 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4324/8708] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:02:33.157604 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7890778-9065-436d-9f97-36080946e445 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:33.159644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f7890778-9065-436d-9f97-36080946e445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:33.175876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7890778-9065-436d-9f97-36080946e445 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:33.180215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:33.180923 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.181825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.182139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] PATH_INFO: `/v3/projects/17c974cc4f33409fbd321ef7a1a9acec` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.183553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c974cc4f33409fbd321ef7a1a9acec)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:33.185861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:33.304528 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c974cc4f33409fbd321ef7a1a9acec', 'request_id': 'req-8448f545-4f8b-432e-8585-073aca077add'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:33.311453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c974cc4f33409fbd321ef7a1a9acec', 'request_id': 'req-8448f545-4f8b-432e-8585-073aca077add'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:33.376841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c974cc4f33409fbd321ef7a1a9acec', 'request_id': 'req-8448f545-4f8b-432e-8585-073aca077add'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:33.388730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] The token cache is being invalidate because project 17c974cc4f33409fbd321ef7a1a9acec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:02:33.389024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:33.389679 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8448f545-4f8b-432e-8585-073aca077add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:02:33.391349 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4385/8709] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:02:33 2022] DELETE /identity/v3/projects/17c974cc4f33409fbd321ef7a1a9acec => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:02:33.396573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fcd8-a21c-43b5-8d22-7a71c3c16b37 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.400726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fcd8-a21c-43b5-8d22-7a71c3c16b37 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.400726 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0fcd8-a21c-43b5-8d22-7a71c3c16b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.418625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-68c0fcd8-a21c-43b5-8d22-7a71c3c16b37 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:33.420001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-68c0fcd8-a21c-43b5-8d22-7a71c3c16b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:33.482238 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4325/8710] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:02:33.491140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac2f7-d00b-4ebd-bde8-823b6e2985ec None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.491699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac2f7-d00b-4ebd-bde8-823b6e2985ec None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.491699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac2f7-d00b-4ebd-bde8-823b6e2985ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.512670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8deac2f7-d00b-4ebd-bde8-823b6e2985ec None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:33.513919 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8deac2f7-d00b-4ebd-bde8-823b6e2985ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:33.522243 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4386/8711] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:33.532154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0fcd8-a21c-43b5-8d22-7a71c3c16b37 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:33.543619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0fcd8-a21c-43b5-8d22-7a71c3c16b37 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:33.548603 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:33.549232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.549515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.549789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.550479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:02:33.550774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:33.552372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:33.564905 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4326/8712] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:02:33.569126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deac2f7-d00b-4ebd-bde8-823b6e2985ec None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:33.579539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deac2f7-d00b-4ebd-bde8-823b6e2985ec None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:33.586666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:33.586666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.586666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.586666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.587163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:33.589550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:33.672464 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4387/8713] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:02:33 2022] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:02:33.674644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:33.685654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db1355-ce40-4fce-ab1c-ee10678e04a8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:33.722162 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:33.751111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:33.751819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.752015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.752292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.752970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:33.754990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:33.825921 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4327/8714] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:02:33 2022] POST /identity/v3/users => generated 281 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:02:33.829970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:33.841293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48424e4-9dbe-4358-bb3a-46b9b5007cb2 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:33.845917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:33.846514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.846794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.847067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.847707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:33.849306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:33.859701 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4388/8715] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:02:33.868311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:33.879469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fa7b4-8e45-4ca2-86e8-760b94475890 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:33.884114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286171ad-558e-4f5b-b949-aab56aa6d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:33.884922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286171ad-558e-4f5b-b949-aab56aa6d9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.885223 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286171ad-558e-4f5b-b949-aab56aa6d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.885495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286171ad-558e-4f5b-b949-aab56aa6d9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.886181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286171ad-558e-4f5b-b949-aab56aa6d9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:33.887760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286171ad-558e-4f5b-b949-aab56aa6d9b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:33.898213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4328/8716] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 02:02:33.902776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:33.912857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f51b1-a26b-41a0-92bc-3e433c845e76 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:33.918193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:33.918841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:33.919127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:33.919408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] PATH_INFO: `/v3/projects/5a83fbfc3b584dd98ef8c1adf05451c5/users/6132aa5402b24707ae15acc2298eab9e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:33.934585 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a83fbfc3b584dd98ef8c1adf05451c5, user_id=6132aa5402b24707ae15acc2298eab9e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:33.937183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:34.033688 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4389/8717] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:02:33 2022] PUT /identity/v3/projects/5a83fbfc3b584dd98ef8c1adf05451c5/users/6132aa5402b24707ae15acc2298eab9e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:02:34.045082 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85ed8-5f9a-451d-86d1-37ac30aa8f7c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:34.045374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85ed8-5f9a-451d-86d1-37ac30aa8f7c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:34.045651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85ed8-5f9a-451d-86d1-37ac30aa8f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:34.073702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-33e85ed8-5f9a-451d-86d1-37ac30aa8f7c None None] MFA Rules not processed for user `6132aa5402b24707ae15acc2298eab9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:34.074934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-33e85ed8-5f9a-451d-86d1-37ac30aa8f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:34.139017 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4329/8718] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:34.150999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:34.152700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:34.167974 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:34.215518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20ba70-971e-4408-8f3c-8a35fca5f6bd admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:34.219240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:34.219872 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:34.220187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:34.220466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:34.229657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:34.231109 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:34.239812 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4390/8719] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:02:44.136022 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:44.284929 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=20 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:50.116288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd85b-1b41-4319-8454-ab57bccca8ca None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:50.116795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd85b-1b41-4319-8454-ab57bccca8ca None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:50.116879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd85b-1b41-4319-8454-ab57bccca8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:50.140139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-80cbd85b-1b41-4319-8454-ab57bccca8ca None None] MFA Rules not processed for user `2d8f167db3e14ff4946c111a20f04de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:50.141420 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-80cbd85b-1b41-4319-8454-ab57bccca8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:50.210400 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4330/8720] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:02:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:02:50.615669 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:50.617401 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:50.691179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292979e-eeb1-45b3-8f06-9823e9c7d676 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:50.695296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:50.696196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:50.697269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:50.697778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:50.699921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:50.715039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:50.716606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:50.730151 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4391/8721] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:02:51.212878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:51.213385 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:51.213644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:51.238007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:02:51.239224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:51.328548 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4331/8722] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:02:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:02:51.343971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:51.354769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:51.375478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d078a-9e02-4e31-bd2d-33726d11ad7d service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:51.383469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:51.384681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:51.385281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:51.385666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:51.395843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:51.397702 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:51.418003 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4392/8723] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:02:58.180550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:02:58.182577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:58.194324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035d7e9-d50f-49c8-a6d5-1b5dbaf1f755 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:02:58.198623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:02:58.199277 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:02:58.199601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:02:58.199984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:02:58.201840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:02:58.312841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:02:58.314342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:02:58.336066 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:02:58.341118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4332/8724] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:02:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:03:00.706040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:00.716750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882708c-0788-4fd3-8947-f250d69a7721 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:00.720551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:00.721279 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:00.721623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:00.721988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:00.723890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:00.744548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:00.746268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:00.762067 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4393/8725] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:03:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:03:05.833151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:05.839332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:05.860797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd4366-24d9-4a6e-bb2a-faf1c4cadb7d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:05.869927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:05.873937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:05.873937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:05.873937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:05.873937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:05.892644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:05.894348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:05.912485 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4333/8726] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:03:10.755158 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=38 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:03:15.905211 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:03:27.304409 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:27.319706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f749d-978a-41ef-a6d0-35775e1c9b83 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:27.326083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:27.326963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:27.327250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:27.327527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:27.329250 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:27.341844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:27.343774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:27.353651 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4394/8727] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:03:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:03:34.419754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:34.421452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:34.439293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c3d8c-3851-4e7d-9be1-6891a43f70b6 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:34.445148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:34.445760 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:34.446086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:34.446365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:34.448161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:34.513038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:34.514606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:34.524860 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4334/8728] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:03:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:03:37.349155 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:03:39.788188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:39.798096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0baa3-9e22-4f71-ad7f-33778c120023 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:39.801782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:39.802413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:39.802700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:39.802976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:39.804672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:39.817217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:39.818661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:39.829868 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4395/8729] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:03:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:03:44.520301 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=30 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:03:49.823286 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:03:57.236190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:57.237710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:57.256796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13341c-9ec8-472a-9788-e1c64fc77ddf service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:57.262402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84886b54-e331-4c31-ab04-c57b77f16f78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:57.263014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84886b54-e331-4c31-ab04-c57b77f16f78 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:57.272365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84886b54-e331-4c31-ab04-c57b77f16f78 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:57.272365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84886b54-e331-4c31-ab04-c57b77f16f78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:57.272365 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-84886b54-e331-4c31-ab04-c57b77f16f78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:57.280993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84886b54-e331-4c31-ab04-c57b77f16f78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:57.282625 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84886b54-e331-4c31-ab04-c57b77f16f78 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:57.298318 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4335/8730] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:03:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:03:58.230676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:58.302065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8612a3f-6931-4aa8-9926-58f68e58119f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:58.306714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:58.307410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:58.308516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:58.308867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] PATH_INFO: `/v3/users/6132aa5402b24707ae15acc2298eab9e` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:58.310133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6132aa5402b24707ae15acc2298eab9e)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:58.312118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:58.535369 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6132aa5402b24707ae15acc2298eab9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:58.536025 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6132aa5402b24707ae15acc2298eab9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:58.614315 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6132aa5402b24707ae15acc2298eab9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:58.622541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6132aa5402b24707ae15acc2298eab9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:58.623224 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6132aa5402b24707ae15acc2298eab9e'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:58.644820 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4396/8731] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:03:58 2022] DELETE /identity/v3/users/6132aa5402b24707ae15acc2298eab9e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:03:58.649126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:58.649671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:58.649671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:58.670550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:03:58.671763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:58.732494 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4336/8732] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:03:58.742543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:58.744277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:58.811877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925555-0bd8-4e7d-94d8-59b57fe9f363 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:58.815769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb921b-0c56-4a6f-9b9e-613c42f73222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:58.816376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb921b-0c56-4a6f-9b9e-613c42f73222 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:58.816662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb921b-0c56-4a6f-9b9e-613c42f73222 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:58.816939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb921b-0c56-4a6f-9b9e-613c42f73222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:58.828115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb921b-0c56-4a6f-9b9e-613c42f73222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:58.829572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb921b-0c56-4a6f-9b9e-613c42f73222 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:58.840031 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4397/8733] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:03:59.286988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:59.288410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:59.301001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda164-08fb-4e3e-9a3c-fe1bd8d883f7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:59.308461 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:59.309206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:59.309477 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:59.309844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] PATH_INFO: `/v3/projects/5a83fbfc3b584dd98ef8c1adf05451c5` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:59.311132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a83fbfc3b584dd98ef8c1adf05451c5)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:59.313181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:59.451814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a83fbfc3b584dd98ef8c1adf05451c5', 'request_id': 'req-d79eb6a2-1390-4de0-a514-238d326ec7d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:59.457486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a83fbfc3b584dd98ef8c1adf05451c5', 'request_id': 'req-d79eb6a2-1390-4de0-a514-238d326ec7d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:59.541849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a83fbfc3b584dd98ef8c1adf05451c5', 'request_id': 'req-d79eb6a2-1390-4de0-a514-238d326ec7d3'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:59.554736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] The token cache is being invalidate because project 5a83fbfc3b584dd98ef8c1adf05451c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:03:59.555033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:59.555685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-d79eb6a2-1390-4de0-a514-238d326ec7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:03:59.557443 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4337/8734] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:03:59 2022] DELETE /identity/v3/projects/5a83fbfc3b584dd98ef8c1adf05451c5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:03:59.562618 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98b56-2ee1-4822-8a4c-d95e097c8e3b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:59.563213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98b56-2ee1-4822-8a4c-d95e097c8e3b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:59.567926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98b56-2ee1-4822-8a4c-d95e097c8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:59.583355 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-78b98b56-2ee1-4822-8a4c-d95e097c8e3b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:03:59.584569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-78b98b56-2ee1-4822-8a4c-d95e097c8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:59.602844 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:03:59.646184 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4398/8735] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:03:59.759170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94770b76-b094-4709-8999-569adbe5a428 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:59.759730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94770b76-b094-4709-8999-569adbe5a428 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:59.759730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94770b76-b094-4709-8999-569adbe5a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:59.781190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-94770b76-b094-4709-8999-569adbe5a428 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:03:59.790785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-94770b76-b094-4709-8999-569adbe5a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:03:59.790785 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4338/8736] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:03:59.794716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b98b56-2ee1-4822-8a4c-d95e097c8e3b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:59.804581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b98b56-2ee1-4822-8a4c-d95e097c8e3b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:59.809496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:59.810128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:59.810428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:59.810683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:59.811332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:03:59.811635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:59.813233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:59.825801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4399/8737] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:03:59.830255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94770b76-b094-4709-8999-569adbe5a428 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:59.840604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94770b76-b094-4709-8999-569adbe5a428 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:03:59.845484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:03:59.846128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:03:59.846411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:03:59.846686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:03:59.847316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:03:59.849254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:03:59.973077 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4339/8738] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:03:59 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:03:59.978194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:03:59.988557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1c61c-af45-460e-b098-86cbd8c5add7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:00.051329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:00.051852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:00.052170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:00.052446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:00.053088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:00.055116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:00.146275 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4400/8739] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:03:59 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:04:00.151024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:00.162570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8ddf-0d08-411f-bec3-375d39de0a42 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:00.167375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:00.169159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:00.169159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:00.169407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:00.170099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:00.171688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:00.182257 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4340/8740] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:04:00.186601 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:00.196766 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46546803-54e3-49db-aed7-16dce7bed3d1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:00.201608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2edcd-20c7-4f94-b187-b9d449ffe1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:00.202230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2edcd-20c7-4f94-b187-b9d449ffe1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:00.203546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2edcd-20c7-4f94-b187-b9d449ffe1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:00.203546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2edcd-20c7-4f94-b187-b9d449ffe1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:00.203546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2edcd-20c7-4f94-b187-b9d449ffe1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:00.205107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2edcd-20c7-4f94-b187-b9d449ffe1e5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:00.216681 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4401/8741] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:04:00.220984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:00.231860 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135a8c-5112-4668-b854-1817ae718d96 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:00.236547 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77ff0d-08f3-494e-b8ba-a87a1986bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:00.237206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ff0d-08f3-494e-b8ba-a87a1986bd17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:00.237483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ff0d-08f3-494e-b8ba-a87a1986bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:00.237754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77ff0d-08f3-494e-b8ba-a87a1986bd17 admin admin] PATH_INFO: `/v3/projects/45a6f62e34184359aba9b6e3d2070c9f/users/0f724d8a3458469a93aa54e278c1fa47/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:00.253747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77ff0d-08f3-494e-b8ba-a87a1986bd17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a6f62e34184359aba9b6e3d2070c9f, user_id=0f724d8a3458469a93aa54e278c1fa47, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:00.256651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77ff0d-08f3-494e-b8ba-a87a1986bd17 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:00.343067 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:00.348856 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4341/8742] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:04:00 2022] PUT /identity/v3/projects/45a6f62e34184359aba9b6e3d2070c9f/users/0f724d8a3458469a93aa54e278c1fa47/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:04:00.360104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae58c3-08e0-4bbe-8f96-8890fff97db4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:00.360395 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae58c3-08e0-4bbe-8f96-8890fff97db4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:00.360675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae58c3-08e0-4bbe-8f96-8890fff97db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:00.389204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-63ae58c3-08e0-4bbe-8f96-8890fff97db4 None None] MFA Rules not processed for user `0f724d8a3458469a93aa54e278c1fa47`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:00.390997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-63ae58c3-08e0-4bbe-8f96-8890fff97db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:00.461195 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4402/8743] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:00.472057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7bf2-cc10-4c84-9b78-95155f7cdaaa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:00.472343 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7bf2-cc10-4c84-9b78-95155f7cdaaa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:00.472618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7bf2-cc10-4c84-9b78-95155f7cdaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:00.520864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-546d7bf2-cc10-4c84-9b78-95155f7cdaaa None None] MFA Rules not processed for user `10fe5abbf8c24c3882d8ad3addd241b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:00.522183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-546d7bf2-cc10-4c84-9b78-95155f7cdaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:00.576436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4342/8744] 10.222.0.59 () {58 vars in 1061 bytes} [Sun Aug 28 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:00.582420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae58c3-08e0-4bbe-8f96-8890fff97db4 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:00.596553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae58c3-08e0-4bbe-8f96-8890fff97db4 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:00.600334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:00.602954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:00.602954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:00.602954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:00.611187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:00.612641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:00.622239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4403/8745] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:04:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:04:06.178932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5b41-b497-4e53-beef-3c06037962b4 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:06.179421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5b41-b497-4e53-beef-3c06037962b4 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:06.179550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5b41-b497-4e53-beef-3c06037962b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:06.200877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a34d5b41-b497-4e53-beef-3c06037962b4 None None] MFA Rules not processed for user `2d8f167db3e14ff4946c111a20f04de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:06.202127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a34d5b41-b497-4e53-beef-3c06037962b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:06.272839 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4343/8746] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:10.617689 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:16.259299 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=59 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:22.759858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:22.833384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3005ff-f4ca-494e-865f-f7f8964fd909 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:22.838317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:22.838925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:22.839216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:22.839643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] PATH_INFO: `/v3/users/0f724d8a3458469a93aa54e278c1fa47` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:22.840906 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f724d8a3458469a93aa54e278c1fa47)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:22.843071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:23.090481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f724d8a3458469a93aa54e278c1fa47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:23.091263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f724d8a3458469a93aa54e278c1fa47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:23.181825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f724d8a3458469a93aa54e278c1fa47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:23.191473 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f724d8a3458469a93aa54e278c1fa47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:23.192102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f724d8a3458469a93aa54e278c1fa47'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:23.221795 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4404/8747] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:04:22 2022] DELETE /identity/v3/users/0f724d8a3458469a93aa54e278c1fa47 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:23.227067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:23.228228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:23.228703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:23.259804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:23.261647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:23.360871 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4344/8748] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:04:23.382664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:23.386730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:23.462660 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac4769-dbd1-4886-a8ba-cecc32b23113 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:23.467742 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866afaa-85f8-41d9-9840-d3feb670e8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:23.468505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866afaa-85f8-41d9-9840-d3feb670e8ad service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:23.468798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866afaa-85f8-41d9-9840-d3feb670e8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:23.469080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866afaa-85f8-41d9-9840-d3feb670e8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:23.480082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866afaa-85f8-41d9-9840-d3feb670e8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:23.481925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866afaa-85f8-41d9-9840-d3feb670e8ad service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:23.493236 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4405/8749] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:04:23.929322 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:23.930857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:23.944578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ad91c-64a6-48d3-921e-7e2839b0ed24 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:23.950287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:23.951027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:23.951270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:23.951548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] PATH_INFO: `/v3/projects/45a6f62e34184359aba9b6e3d2070c9f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:23.953032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a6f62e34184359aba9b6e3d2070c9f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:23.955147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:24.083775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a6f62e34184359aba9b6e3d2070c9f', 'request_id': 'req-240e7d3b-287a-4a15-9357-28a961f52bee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:24.090402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a6f62e34184359aba9b6e3d2070c9f', 'request_id': 'req-240e7d3b-287a-4a15-9357-28a961f52bee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:24.155681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a6f62e34184359aba9b6e3d2070c9f', 'request_id': 'req-240e7d3b-287a-4a15-9357-28a961f52bee'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:24.169031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] The token cache is being invalidate because project 45a6f62e34184359aba9b6e3d2070c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:04:24.169248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:24.169997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-240e7d3b-287a-4a15-9357-28a961f52bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:24.171632 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4345/8750] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:04:23 2022] DELETE /identity/v3/projects/45a6f62e34184359aba9b6e3d2070c9f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:24.176915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8cc8e-95b7-4e48-8527-4d4847657f17 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.177403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8cc8e-95b7-4e48-8527-4d4847657f17 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.177688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8cc8e-95b7-4e48-8527-4d4847657f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.199513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-1ec8cc8e-95b7-4e48-8527-4d4847657f17 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:24.200749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ec8cc8e-95b7-4e48-8527-4d4847657f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:24.218834 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:24.264810 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4406/8751] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:04:24.273725 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f93e-2dfa-4f41-b718-e8cc53449665 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.274452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f93e-2dfa-4f41-b718-e8cc53449665 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.274452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609f93e-2dfa-4f41-b718-e8cc53449665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.294002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4609f93e-2dfa-4f41-b718-e8cc53449665 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:24.295217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4609f93e-2dfa-4f41-b718-e8cc53449665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:24.303357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4346/8752] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:24.308034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8cc8e-95b7-4e48-8527-4d4847657f17 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:24.318022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8cc8e-95b7-4e48-8527-4d4847657f17 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:24.324291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:24.324989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.325275 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.325555 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.326391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:04:24.326744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:24.328392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:24.343322 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4407/8753] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 02:04:24.347379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609f93e-2dfa-4f41-b718-e8cc53449665 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:24.357455 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609f93e-2dfa-4f41-b718-e8cc53449665 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:24.362474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:24.363085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.363373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.363650 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.364302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:24.366237 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:24.485784 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4347/8754] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:04:24 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:04:24.490203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:24.501070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e7b4e-0112-4e31-801d-86251fcf215c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:24.558199 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:24.558820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.559095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.559373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.560008 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:24.562011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:24.678194 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4408/8755] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:04:24 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:04:24.682206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:24.693630 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887ca-d5fb-40dd-8fce-c136077a55bc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:24.698084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:24.698681 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.698961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.699235 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.699874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:24.701458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:24.711564 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4348/8756] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:04:24.715511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:24.725386 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7831ac1-9d8f-4d9a-8f42-39fc87ca86fa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:24.730558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42605fe0-258a-4bd6-bb9e-7ca42934f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:24.731139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605fe0-258a-4bd6-bb9e-7ca42934f671 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.731416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605fe0-258a-4bd6-bb9e-7ca42934f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.731687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42605fe0-258a-4bd6-bb9e-7ca42934f671 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.732318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42605fe0-258a-4bd6-bb9e-7ca42934f671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:24.733935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42605fe0-258a-4bd6-bb9e-7ca42934f671 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:24.744914 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4409/8757] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 02:04:24.749611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:24.759601 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f377-3d97-4783-a7f7-7e0cd6097aec admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:24.764152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:24.765060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.765337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.765617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] PATH_INFO: `/v3/projects/bb2c2b1af8794b8abf9f6b5e3271f322/users/3b5a9c9cceb04d95a1c68d6f7d695ebb/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.779952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2c2b1af8794b8abf9f6b5e3271f322, user_id=3b5a9c9cceb04d95a1c68d6f7d695ebb, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:24.782624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:24.872402 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4349/8758] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:04:24 2022] PUT /identity/v3/projects/bb2c2b1af8794b8abf9f6b5e3271f322/users/3b5a9c9cceb04d95a1c68d6f7d695ebb/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:24.877457 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1019b-07d4-46f9-b38b-da9763654e74 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:24.877752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1019b-07d4-46f9-b38b-da9763654e74 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:24.878064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1019b-07d4-46f9-b38b-da9763654e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:24.897953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b1a1019b-07d4-46f9-b38b-da9763654e74 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:24.899159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b1a1019b-07d4-46f9-b38b-da9763654e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:24.960097 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4410/8759] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:24.970410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:24.972110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:24.995433 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:25.029892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273993f9-5f4f-478f-81c6-6db47eeabeba admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:25.034430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:25.035069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:25.035349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:25.035628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:25.045397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:25.046863 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:25.056236 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4350/8760] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:04:26.265239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb0e01-c6f8-485a-b2aa-feee67bb0c91 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:26.265839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb0e01-c6f8-485a-b2aa-feee67bb0c91 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:26.265839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb0e01-c6f8-485a-b2aa-feee67bb0c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:26.294880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-41bb0e01-c6f8-485a-b2aa-feee67bb0c91 None None] MFA Rules not processed for user `3b5a9c9cceb04d95a1c68d6f7d695ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:26.296147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-41bb0e01-c6f8-485a-b2aa-feee67bb0c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:26.314672 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:26.367224 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4411/8761] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:26.372697 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:26.382662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a769875-96a4-410c-899e-35435b881c8b service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:26.387475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:26.388085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:26.388369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:26.388657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:26.389302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:26.391496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:26.489410 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4351/8762] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:04:26 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:04:26.493568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb0e01-c6f8-485a-b2aa-feee67bb0c91 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:26.504825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb0e01-c6f8-485a-b2aa-feee67bb0c91 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:26.562216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:26.562844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:26.563186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:26.563472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:26.564104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:26.566128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:26.675993 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4412/8763] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:04:26 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:04:26.679984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:26.690287 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cf2cc-2510-463c-8274-eb41ca4148ad admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:26.695011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:26.695608 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:26.695892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:26.696160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:26.696795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:26.698553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:26.709436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4352/8764] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:04:26.714347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:26.724384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bbb5d-6e04-4ced-8085-7b8bac8ae28e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:26.728959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:26.730309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:26.730614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:26.730868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] PATH_INFO: `/v3/projects/3c43d968711c4185b881ce2113f254d1/users/dadb867abcc44fc1969dc07534c5f36c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:26.745499 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c43d968711c4185b881ce2113f254d1, user_id=dadb867abcc44fc1969dc07534c5f36c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:26.748168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:26.820575 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4413/8765] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:04:26 2022] PUT /identity/v3/projects/3c43d968711c4185b881ce2113f254d1/users/dadb867abcc44fc1969dc07534c5f36c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:26.825297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:26.835364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66331e91-a23e-4c79-a758-7fe7c4f1b45b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:26.890543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e691b-fe93-4e32-a792-bbbd60fe66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:26.891138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e691b-fe93-4e32-a792-bbbd60fe66ce admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:26.891427 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e691b-fe93-4e32-a792-bbbd60fe66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:26.891719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e691b-fe93-4e32-a792-bbbd60fe66ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:26.892336 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e691b-fe93-4e32-a792-bbbd60fe66ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:26.893946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e691b-fe93-4e32-a792-bbbd60fe66ce admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:26.904748 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4353/8766] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:04:26.908982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:26.920381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebe4f6-a61e-44e4-a45f-76a257958ee9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:26.926022 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85645a5e-75b6-45cb-b66c-301ae022ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:26.926824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85645a5e-75b6-45cb-b66c-301ae022ccd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:26.927198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85645a5e-75b6-45cb-b66c-301ae022ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:26.927568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85645a5e-75b6-45cb-b66c-301ae022ccd5 admin admin] PATH_INFO: `/v3/projects/3c43d968711c4185b881ce2113f254d1/users/dadb867abcc44fc1969dc07534c5f36c/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:26.929662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85645a5e-75b6-45cb-b66c-301ae022ccd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c43d968711c4185b881ce2113f254d1, user_id=dadb867abcc44fc1969dc07534c5f36c, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:26.932717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85645a5e-75b6-45cb-b66c-301ae022ccd5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:26.943287 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4414/8767] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:04:26 2022] PUT /identity/v3/projects/3c43d968711c4185b881ce2113f254d1/users/dadb867abcc44fc1969dc07534c5f36c/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:28.156181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:28.156694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:28.156846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:28.188319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] MFA Rules not processed for user `dadb867abcc44fc1969dc07534c5f36c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:28.189704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:28.264023 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4354/8768] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:28.276177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c1ab-e2bc-4655-be3b-316d75af5b35 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:28.277175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c1ab-e2bc-4655-be3b-316d75af5b35 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:28.277265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c1ab-e2bc-4655-be3b-316d75af5b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:28.295885 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2013c1ab-e2bc-4655-be3b-316d75af5b35 None None] MFA Rules not processed for user `3b5a9c9cceb04d95a1c68d6f7d695ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:04:28.297110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2013c1ab-e2bc-4655-be3b-316d75af5b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:28.350972 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4415/8769] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:04:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:04:28.363061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:28.364446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:28.378363 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:28.441723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b0b0-b9ad-4964-94d7-8d44a10cdd49 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:28.447727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:28.448900 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:28.449269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:28.449540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:28.457341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:28.458937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:28.467634 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4355/8770] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:04:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:04:28.699454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013c1ab-e2bc-4655-be3b-316d75af5b35 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:28.717354 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:28.756070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013c1ab-e2bc-4655-be3b-316d75af5b35 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:28.759593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:28.760206 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:28.761036 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:28.761324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:28.763219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:28.775808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:28.777589 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:28.788839 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4416/8771] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:04:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:04:38.463602 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=29 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:38.832151 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=19 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:43.175702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:43.177286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:43.189622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f0509-412d-46ea-9577-88700f16e85a service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:43.193180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:43.193776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:43.194097 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:43.194372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:43.196002 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:43.210628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:43.211992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:43.223030 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4356/8772] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:04:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:04:53.005491 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:53.021769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a57fc-6a3b-4fb3-9c91-97d9136d391f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:53.027293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:53.027894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:53.028178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:53.028455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:53.030501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:53.045778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:53.047740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:53.064228 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4417/8773] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:04:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:04:53.217067 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:56.331222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:56.400254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290406de-8f05-44ac-978a-f7d2520af6ed service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:56.405517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:56.406177 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:56.408670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:56.408670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] PATH_INFO: `/v3/users/3b5a9c9cceb04d95a1c68d6f7d695ebb` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:56.408670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5a9c9cceb04d95a1c68d6f7d695ebb)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:56.409789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:56.598879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5a9c9cceb04d95a1c68d6f7d695ebb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:56.611304 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5a9c9cceb04d95a1c68d6f7d695ebb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:56.618595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5a9c9cceb04d95a1c68d6f7d695ebb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:56.619303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5a9c9cceb04d95a1c68d6f7d695ebb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:56.716329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5a9c9cceb04d95a1c68d6f7d695ebb'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:56.723194 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4357/8774] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:04:56 2022] DELETE /identity/v3/users/3b5a9c9cceb04d95a1c68d6f7d695ebb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:56.982349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:56.994563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef5c8-55ff-4dd1-a690-319e1233366a service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:57.054537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:57.055185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:57.055471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:57.055749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] PATH_INFO: `/v3/projects/bb2c2b1af8794b8abf9f6b5e3271f322` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:57.056897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2c2b1af8794b8abf9f6b5e3271f322)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:57.058979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:57.173234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2c2b1af8794b8abf9f6b5e3271f322', 'request_id': 'req-7d9ba7ec-442b-4126-9538-8785471359be'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.179421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2c2b1af8794b8abf9f6b5e3271f322', 'request_id': 'req-7d9ba7ec-442b-4126-9538-8785471359be'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.252755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2c2b1af8794b8abf9f6b5e3271f322', 'request_id': 'req-7d9ba7ec-442b-4126-9538-8785471359be'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.263644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] The token cache is being invalidate because project bb2c2b1af8794b8abf9f6b5e3271f322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:04:57.263937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.265560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.267091 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4418/8775] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:04:56 2022] DELETE /identity/v3/projects/bb2c2b1af8794b8abf9f6b5e3271f322 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:57.276647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:57.278610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:57.292779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c9572-e051-4e8f-a259-29883465584c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:57.353077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:57.353873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:57.358763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:57.358763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] PATH_INFO: `/v3/users/dadb867abcc44fc1969dc07534c5f36c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:57.358763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadb867abcc44fc1969dc07534c5f36c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:57.358763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:57.383229 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:57.588081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadb867abcc44fc1969dc07534c5f36c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.602493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadb867abcc44fc1969dc07534c5f36c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.610334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadb867abcc44fc1969dc07534c5f36c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.611056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadb867abcc44fc1969dc07534c5f36c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.672627 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadb867abcc44fc1969dc07534c5f36c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:57.679122 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4358/8776] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:04:57 2022] DELETE /identity/v3/users/dadb867abcc44fc1969dc07534c5f36c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:04:57.907982 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:04:57.909407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:04:57.922370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba7ec-442b-4126-9538-8785471359be admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:04:57.985225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:04:57.985976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:04:57.986262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:04:57.986535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] PATH_INFO: `/v3/projects/3c43d968711c4185b881ce2113f254d1` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:04:57.987671 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c43d968711c4185b881ce2113f254d1)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:04:57.990153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:04:58.011972 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:04:58.079235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c43d968711c4185b881ce2113f254d1', 'request_id': 'req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:58.085363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c43d968711c4185b881ce2113f254d1', 'request_id': 'req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:58.157518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c43d968711c4185b881ce2113f254d1', 'request_id': 'req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:58.168779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] The token cache is being invalidate because project 3c43d968711c4185b881ce2113f254d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:04:58.169072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:58.169706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:04:58.171988 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4419/8777] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:04:57 2022] DELETE /identity/v3/projects/3c43d968711c4185b881ce2113f254d1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:05:07.675418 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:05:08.167530 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:05:59.530799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:05:59.532405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:05:59.620634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e96ade-0d54-4f55-b6e9-fbbba8a05e89 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:05:59.699182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15223df3-5f59-484d-9c78-5c4af6f49048 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:05:59.700121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223df3-5f59-484d-9c78-5c4af6f49048 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:05:59.700407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223df3-5f59-484d-9c78-5c4af6f49048 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:05:59.700687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223df3-5f59-484d-9c78-5c4af6f49048 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:05:59.702535 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15223df3-5f59-484d-9c78-5c4af6f49048 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:05:59.724845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15223df3-5f59-484d-9c78-5c4af6f49048 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:05:59.726680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15223df3-5f59-484d-9c78-5c4af6f49048 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:05:59.741298 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4359/8778] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:05:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:00.001737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:00.003225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:00.077553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0d9b3-9ae9-4398-a89d-ffd3e5f56e80 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:00.082137 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:00.082768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:00.083051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:00.083326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] PATH_INFO: `/v3/users/2d8f167db3e14ff4946c111a20f04de9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:00.084449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8f167db3e14ff4946c111a20f04de9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:00.086428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:00.255505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8f167db3e14ff4946c111a20f04de9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:00.256182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8f167db3e14ff4946c111a20f04de9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:00.327800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8f167db3e14ff4946c111a20f04de9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:00.335501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8f167db3e14ff4946c111a20f04de9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:00.336150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8f167db3e14ff4946c111a20f04de9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:00.354587 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4420/8779] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:06:00 2022] DELETE /identity/v3/users/2d8f167db3e14ff4946c111a20f04de9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:00.359408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:00.359698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:00.359976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:00.378636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:00.379847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:00.441742 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4360/8780] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:00.452185 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:00.453588 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:00.511913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c8fe-0925-4dd6-9353-ac253029dfc3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:00.516179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:00.516825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:00.517115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:00.517393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:00.526721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:00.529066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:00.538819 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4421/8781] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:00.781415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:00.782909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:00.796026 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42444b-b8c6-4e64-b31f-ce450b2152e1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:00.800679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:00.801312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:00.801592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:00.801882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] PATH_INFO: `/v3/projects/bd1266ca6f5e44b791882617087c532f` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:00.803004 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1266ca6f5e44b791882617087c532f)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:00.804893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:00.919047 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:00.933487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1266ca6f5e44b791882617087c532f', 'request_id': 'req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:00.938962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1266ca6f5e44b791882617087c532f', 'request_id': 'req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.021529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1266ca6f5e44b791882617087c532f', 'request_id': 'req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.034219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] The token cache is being invalidate because project bd1266ca6f5e44b791882617087c532f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:06:01.034515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.035160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.036665 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4361/8782] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:06:00 2022] DELETE /identity/v3/projects/bd1266ca6f5e44b791882617087c532f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:01.040709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:01.051132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0915b-ae64-4c05-baba-844a9a1b2e68 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:01.069977 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:01.110483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:01.111142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:01.111446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:01.111721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] PATH_INFO: `/v3/users/6ac1e1ad36014b809467a43d0c9fec80` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:01.112840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac1e1ad36014b809467a43d0c9fec80)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:01.114851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:01.307724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac1e1ad36014b809467a43d0c9fec80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.308388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac1e1ad36014b809467a43d0c9fec80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.517088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac1e1ad36014b809467a43d0c9fec80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.524791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac1e1ad36014b809467a43d0c9fec80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.525419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8ef5c054-535c-4ff3-98fe-c3b60e895b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac1e1ad36014b809467a43d0c9fec80'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:01.544299 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4422/8783] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:06:01 2022] DELETE /identity/v3/users/6ac1e1ad36014b809467a43d0c9fec80 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:01.818484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:01.824203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:01.833943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a6ff-1fdf-4f4d-9b3f-52f4e3bc0ac0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:01.902179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:01.902957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:01.903242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:01.903519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] PATH_INFO: `/v3/projects/d0985713a86a451a8adefaf9a48d7189` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:01.904741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0985713a86a451a8adefaf9a48d7189)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:01.906606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:02.006693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0985713a86a451a8adefaf9a48d7189', 'request_id': 'req-110e52d1-ffaf-4641-bc43-976ac20a71ac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:02.012671 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0985713a86a451a8adefaf9a48d7189', 'request_id': 'req-110e52d1-ffaf-4641-bc43-976ac20a71ac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:02.096130 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0985713a86a451a8adefaf9a48d7189', 'request_id': 'req-110e52d1-ffaf-4641-bc43-976ac20a71ac'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:02.109324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] The token cache is being invalidate because project d0985713a86a451a8adefaf9a48d7189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:06:02.109706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:02.110480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-110e52d1-ffaf-4641-bc43-976ac20a71ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:02.112102 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4362/8784] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:06:01 2022] DELETE /identity/v3/projects/d0985713a86a451a8adefaf9a48d7189 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:11.539986 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:11.875809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853a4e-9a9b-47a1-b7b7-3c1ff3fdef7b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:11.876089 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853a4e-9a9b-47a1-b7b7-3c1ff3fdef7b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:11.876363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853a4e-9a9b-47a1-b7b7-3c1ff3fdef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:11.897019 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-84853a4e-9a9b-47a1-b7b7-3c1ff3fdef7b None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:11.898267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-84853a4e-9a9b-47a1-b7b7-3c1ff3fdef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:11.958715 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4423/8785] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:11.967916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b36c-c8f3-416d-8906-1a0c8d0fa6b3 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:11.968421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b36c-c8f3-416d-8906-1a0c8d0fa6b3 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:11.968550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b36c-c8f3-416d-8906-1a0c8d0fa6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:11.987974 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0429b36c-c8f3-416d-8906-1a0c8d0fa6b3 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:11.989170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0429b36c-c8f3-416d-8906-1a0c8d0fa6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:11.996893 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4363/8786] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:12.002099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853a4e-9a9b-47a1-b7b7-3c1ff3fdef7b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.012097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853a4e-9a9b-47a1-b7b7-3c1ff3fdef7b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.017689 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.020532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.020532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.020532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.020532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:06:12.020532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.021471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.033323 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4424/8787] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 02:06:12.047014 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b36c-c8f3-416d-8906-1a0c8d0fa6b3 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.056251 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b36c-c8f3-416d-8906-1a0c8d0fa6b3 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.061407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.062041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.062329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.062609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.063240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.065140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.149069 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4364/8788] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:06:12 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:06:12.153051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.163262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbe90e-063e-4cf8-9feb-acd6493e5859 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.222393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.223000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.223283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.223560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.224186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.226217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.330588 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4425/8789] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:06:12 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:06:12.334618 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.346246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214c0c-4867-4e1b-abe5-161b88a00022 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.350989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.351593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.351910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.352189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.352837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.354502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.364908 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4365/8790] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:06:12.368907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.379176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240d8a-35f1-4fb5-9a85-bba8a0f8e943 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.383740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b26a0f-c0b6-48f9-8907-d97bb005c97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.384328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26a0f-c0b6-48f9-8907-d97bb005c97a admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.384612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26a0f-c0b6-48f9-8907-d97bb005c97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.384886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26a0f-c0b6-48f9-8907-d97bb005c97a admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.385517 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b26a0f-c0b6-48f9-8907-d97bb005c97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.387144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b26a0f-c0b6-48f9-8907-d97bb005c97a admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.398785 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4426/8791] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:06:12.402890 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.413734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d586e4-9623-4e27-9dd7-2cfbccbdf2f0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.418632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.419318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.419629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.419910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] PATH_INFO: `/v3/projects/5a2fd5ce67664f43a78071699453425a/users/461d012660484a32adb5f7a4ee26cd91/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.422251 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:12.435541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2fd5ce67664f43a78071699453425a, user_id=461d012660484a32adb5f7a4ee26cd91, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.440146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.517333 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4366/8792] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:06:12 2022] PUT /identity/v3/projects/5a2fd5ce67664f43a78071699453425a/users/461d012660484a32adb5f7a4ee26cd91/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:06:12.531023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b3d1-73ec-4874-a7b0-95c3d9064bd1 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.531332 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b3d1-73ec-4874-a7b0-95c3d9064bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.531632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b3d1-73ec-4874-a7b0-95c3d9064bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.559068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6691b3d1-73ec-4874-a7b0-95c3d9064bd1 None None] MFA Rules not processed for user `461d012660484a32adb5f7a4ee26cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:12.560937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6691b3d1-73ec-4874-a7b0-95c3d9064bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:12.617097 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:12.626979 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4427/8793] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:12.631705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.694961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dde28-c841-4b94-a3e3-4a042015feb6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.699533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.700138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.701058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.701391 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.702030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.703963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.817199 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4367/8794] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:06:12 2022] POST /identity/v3/projects => generated 391 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:06:12.821340 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b3d1-73ec-4874-a7b0-95c3d9064bd1 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.832695 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b3d1-73ec-4874-a7b0-95c3d9064bd1 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.888786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.889394 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.889681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.890001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.890624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.892816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:12.975533 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4428/8795] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:06:12 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:06:12.979443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:12.990731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653efde9-d18c-4651-b62c-541a203521b5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:12.995402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:12.996001 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:12.996283 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:12.996558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:12.997200 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:12.999614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:13.010536 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4368/8796] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:06:13.014638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:13.025125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92321dd3-6cc1-49fe-b9ee-1afc96ba753f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:13.030245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:13.030893 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:13.031178 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:13.031456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] PATH_INFO: `/v3/projects/e202b8535c1f4cf0bb63069aee994a6c/users/89daaa95bceb45f78e3de1885d5fadc9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:13.047800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e202b8535c1f4cf0bb63069aee994a6c, user_id=89daaa95bceb45f78e3de1885d5fadc9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:13.051566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:13.113461 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4429/8797] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:06:13 2022] PUT /identity/v3/projects/e202b8535c1f4cf0bb63069aee994a6c/users/89daaa95bceb45f78e3de1885d5fadc9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:13.117486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:13.128577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e1de3-d760-488d-8d52-2470f11a27bb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:13.187269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057092fa-264f-4dd8-844a-c9a30fba4530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:13.187876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057092fa-264f-4dd8-844a-c9a30fba4530 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:13.188163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057092fa-264f-4dd8-844a-c9a30fba4530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:13.188441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057092fa-264f-4dd8-844a-c9a30fba4530 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:13.189079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057092fa-264f-4dd8-844a-c9a30fba4530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:13.190700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057092fa-264f-4dd8-844a-c9a30fba4530 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:13.200974 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4369/8798] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:06:13.205286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:13.215622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e81e6c-067c-42f4-834a-fa5d983a53b5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:13.220949 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451d06a-cabb-41af-8ebe-1ba43e94f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:13.221591 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d06a-cabb-41af-8ebe-1ba43e94f2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:13.221901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d06a-cabb-41af-8ebe-1ba43e94f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:13.222181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d06a-cabb-41af-8ebe-1ba43e94f2ab admin admin] PATH_INFO: `/v3/projects/e202b8535c1f4cf0bb63069aee994a6c/users/89daaa95bceb45f78e3de1885d5fadc9/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:13.224196 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451d06a-cabb-41af-8ebe-1ba43e94f2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e202b8535c1f4cf0bb63069aee994a6c, user_id=89daaa95bceb45f78e3de1885d5fadc9, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:13.226910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451d06a-cabb-41af-8ebe-1ba43e94f2ab admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:13.237517 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4430/8799] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:06:13 2022] PUT /identity/v3/projects/e202b8535c1f4cf0bb63069aee994a6c/users/89daaa95bceb45f78e3de1885d5fadc9/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:13.247610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:13.247902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:13.248183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:13.275569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] MFA Rules not processed for user `89daaa95bceb45f78e3de1885d5fadc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:13.276781 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:13.319795 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:13.348690 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4370/8800] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:13.362132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d439-29e2-41a3-a137-d3d63749ab4d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:13.362422 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d439-29e2-41a3-a137-d3d63749ab4d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:13.362700 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d439-29e2-41a3-a137-d3d63749ab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:13.381551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-fe58d439-29e2-41a3-a137-d3d63749ab4d None None] MFA Rules not processed for user `461d012660484a32adb5f7a4ee26cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:13.382786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fe58d439-29e2-41a3-a137-d3d63749ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:13.439531 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4431/8801] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:13.453544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:13.454936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:13.534034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4fb3-2f2a-47f2-9c43-6fa15c494c24 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:13.539637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:13.540261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:13.540526 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:13.540797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:13.549371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:13.550980 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:13.559773 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4371/8802] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:23.432097 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:23.555682 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=44 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:25.258778 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58d439-29e2-41a3-a137-d3d63749ab4d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:25.272056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58d439-29e2-41a3-a137-d3d63749ab4d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:25.277563 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57600221-166c-4c75-98a7-418529ff982a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:25.278217 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600221-166c-4c75-98a7-418529ff982a service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:25.278502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600221-166c-4c75-98a7-418529ff982a service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:25.279316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600221-166c-4c75-98a7-418529ff982a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:25.281487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-57600221-166c-4c75-98a7-418529ff982a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:25.297238 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57600221-166c-4c75-98a7-418529ff982a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:25.298824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57600221-166c-4c75-98a7-418529ff982a service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:25.313174 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4432/8803] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:06:27.081871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:27.083436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:27.101240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e4092-19fe-4d98-949d-820aa4bbcf19 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:27.106846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:27.108030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:27.108312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:27.108589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:27.117231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:27.118868 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:27.129080 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4372/8804] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:27.145229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d62b4-1e2f-4f63-b606-5cf7273e3648 None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:27.145647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d62b4-1e2f-4f63-b606-5cf7273e3648 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:27.145747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d62b4-1e2f-4f63-b606-5cf7273e3648 None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:27.147181 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4433/8805] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 02:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 02:06:27.151882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 02:06:27.165679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:27.174729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9ab34-21e5-4e01-bdfd-4d44e8cc841f service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:27.179476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89daaa95bceb45f78e3de1885d5fadc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e202b8535c1f4cf0bb63069aee994a6c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:27.180094 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:27.180377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:27.180652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] PATH_INFO: `/v3/projects/e202b8535c1f4cf0bb63069aee994a6c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:27.181768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] RBAC: Authorizing `identity:get_project(project_id=e202b8535c1f4cf0bb63069aee994a6c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:27.183738 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:27.186165 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4373/8806] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 02:06:27 2022] GET /identity/v3/projects/e202b8535c1f4cf0bb63069aee994a6c => generated 391 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 02:06:27.627139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b0e18-8971-4380-9418-97fa63fd2ddd None None] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:27.627560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b0e18-8971-4380-9418-97fa63fd2ddd None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:27.627964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b0e18-8971-4380-9418-97fa63fd2ddd None None] PATH_INFO: `/` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:27.629438 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4434/8807] 10.222.0.59 () {54 vars in 912 bytes} [Sun Aug 28 02:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 02:06:27.634145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] Authenticating service token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 02:06:27.650010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:27.659902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c8fd-8077-40b3-9c3a-16ffa7781beb tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:27.664466 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d6dbe-9d29-43db-ba2b-5c7e6e2cce8b tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89daaa95bceb45f78e3de1885d5fadc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e202b8535c1f4cf0bb63069aee994a6c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:27.665093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d6dbe-9d29-43db-ba2b-5c7e6e2cce8b tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:27.665383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d6dbe-9d29-43db-ba2b-5c7e6e2cce8b tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:27.665747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d6dbe-9d29-43db-ba2b-5c7e6e2cce8b tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] PATH_INFO: `/v3/projects/e202b8535c1f4cf0bb63069aee994a6c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:27.666858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d6dbe-9d29-43db-ba2b-5c7e6e2cce8b tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] RBAC: Authorizing `identity:get_project(project_id=e202b8535c1f4cf0bb63069aee994a6c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:27.668639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d6dbe-9d29-43db-ba2b-5c7e6e2cce8b tempest-ServersAdminNegativeTestJSON-251414796 tempest-ServersAdminNegativeTestJSON-251414796-project-admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:27.671256 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4374/8808] 10.222.0.59 () {58 vars in 1443 bytes} [Sun Aug 28 02:06:27 2022] GET /identity/v3/projects/e202b8535c1f4cf0bb63069aee994a6c => generated 391 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:06:31.961527 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b0e18-8971-4380-9418-97fa63fd2ddd None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:32.026826 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b0e18-8971-4380-9418-97fa63fd2ddd None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:32.031894 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:32.032514 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:32.032797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:32.033076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] PATH_INFO: `/v3/users/461d012660484a32adb5f7a4ee26cd91` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:32.034227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=461d012660484a32adb5f7a4ee26cd91)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:32.036164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:32.188567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461d012660484a32adb5f7a4ee26cd91'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.189165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461d012660484a32adb5f7a4ee26cd91'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.270720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461d012660484a32adb5f7a4ee26cd91'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.278053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461d012660484a32adb5f7a4ee26cd91'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.278703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461d012660484a32adb5f7a4ee26cd91'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.297304 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4435/8809] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:06:31 2022] DELETE /identity/v3/users/461d012660484a32adb5f7a4ee26cd91 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:32.301756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:32.302278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:32.302381 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:32.320971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:32.322196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:32.381083 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4375/8810] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:32.390803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:32.400403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:32.451747 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3a52-deae-41ca-8958-d0be4a360f9b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:32.455298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:32.455902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:32.456187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:32.456463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:32.465513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:32.466984 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:32.476802 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4436/8811] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:32.706758 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:32.709528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:32.722161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c17df1-e571-4d19-aa63-00136606fe0d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:32.726976 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:32.727612 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:32.728617 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:32.729241 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] PATH_INFO: `/v3/projects/5a2fd5ce67664f43a78071699453425a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:32.730586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2fd5ce67664f43a78071699453425a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:32.732554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:32.863242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2fd5ce67664f43a78071699453425a', 'request_id': 'req-b436cdf6-47d8-479e-891d-9a59d4b72936'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.868907 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2fd5ce67664f43a78071699453425a', 'request_id': 'req-b436cdf6-47d8-479e-891d-9a59d4b72936'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.947190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2fd5ce67664f43a78071699453425a', 'request_id': 'req-b436cdf6-47d8-479e-891d-9a59d4b72936'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.959836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] The token cache is being invalidate because project 5a2fd5ce67664f43a78071699453425a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:06:32.960064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.960699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:32.962243 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4376/8812] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:06:32 2022] DELETE /identity/v3/projects/5a2fd5ce67664f43a78071699453425a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:06:32.966524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:32.977469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72afce-83a7-4a0d-bdc0-277c2da6fe02 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:32.982336 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:33.036522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:33.036658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:33.036878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:33.037155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] PATH_INFO: `/v3/users/89daaa95bceb45f78e3de1885d5fadc9` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:33.038317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89daaa95bceb45f78e3de1885d5fadc9)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:33.040330 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:33.224439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89daaa95bceb45f78e3de1885d5fadc9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:33.225046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89daaa95bceb45f78e3de1885d5fadc9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:33.301187 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89daaa95bceb45f78e3de1885d5fadc9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:33.308809 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89daaa95bceb45f78e3de1885d5fadc9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:33.311408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afbf47d1-e7db-4769-a889-c6cf87bb9939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89daaa95bceb45f78e3de1885d5fadc9'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:33.328740 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4437/8813] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:06:32 2022] DELETE /identity/v3/users/89daaa95bceb45f78e3de1885d5fadc9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:06:33.765231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:33.767072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:33.782445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436cdf6-47d8-479e-891d-9a59d4b72936 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:33.836961 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:33.847525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:33.848216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:33.848437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:33.848736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] PATH_INFO: `/v3/projects/e202b8535c1f4cf0bb63069aee994a6c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:33.849915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e202b8535c1f4cf0bb63069aee994a6c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:33.854558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:33.979621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e202b8535c1f4cf0bb63069aee994a6c', 'request_id': 'req-9008e644-5ebf-4f42-9d16-9a67bca07810'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:33.986335 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e202b8535c1f4cf0bb63069aee994a6c', 'request_id': 'req-9008e644-5ebf-4f42-9d16-9a67bca07810'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:34.054554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e202b8535c1f4cf0bb63069aee994a6c', 'request_id': 'req-9008e644-5ebf-4f42-9d16-9a67bca07810'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:34.067577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] The token cache is being invalidate because project e202b8535c1f4cf0bb63069aee994a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:06:34.067869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:34.068593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9008e644-5ebf-4f42-9d16-9a67bca07810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:06:34.071641 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4377/8814] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:06:33 2022] DELETE /identity/v3/projects/e202b8535c1f4cf0bb63069aee994a6c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:34.078151 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f394eb3-86da-4f30-a2a8-fe3bac0ed69d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.083801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f394eb3-86da-4f30-a2a8-fe3bac0ed69d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.083801 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f394eb3-86da-4f30-a2a8-fe3bac0ed69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.101382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-0f394eb3-86da-4f30-a2a8-fe3bac0ed69d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:34.102140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0f394eb3-86da-4f30-a2a8-fe3bac0ed69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:34.170251 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4438/8815] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:06:34.179230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20869e4-db38-4f0b-8de3-f90e98a3de1a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.179513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20869e4-db38-4f0b-8de3-f90e98a3de1a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.179788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20869e4-db38-4f0b-8de3-f90e98a3de1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.199950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b20869e4-db38-4f0b-8de3-f90e98a3de1a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:34.201140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b20869e4-db38-4f0b-8de3-f90e98a3de1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:34.209000 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4378/8816] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:06:34.213460 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f394eb3-86da-4f30-a2a8-fe3bac0ed69d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:34.223997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f394eb3-86da-4f30-a2a8-fe3bac0ed69d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:34.228607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:34.229232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.229541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.229829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.230490 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:06:34.230792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:34.232390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:34.244629 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4439/8817] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:06:34.248939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20869e4-db38-4f0b-8de3-f90e98a3de1a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:34.258204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20869e4-db38-4f0b-8de3-f90e98a3de1a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:34.262836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:34.263428 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.263707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.263975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.264691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:34.266958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:34.362096 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4379/8818] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:06:34 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:06:34.366170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:34.376683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b36bed-3fd1-437f-8e95-ac13c929e61f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:34.388217 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:34.436222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:34.436859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.437415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.437415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.438091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:34.440048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:34.546655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4440/8819] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:06:34 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:06:34.551043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:34.561851 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25962221-09d9-4bce-98ca-b1366787a3fb admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:34.571433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:34.571433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.571433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.571433 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.571822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:34.571822 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:34.580605 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4380/8820] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:06:34.584553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:34.595730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fcba8-20f6-460f-90d1-e38b0c3f0489 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:34.600404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd060da-ec29-4c58-baad-e00f7f481a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:34.600997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd060da-ec29-4c58-baad-e00f7f481a53 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.601293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd060da-ec29-4c58-baad-e00f7f481a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.601578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd060da-ec29-4c58-baad-e00f7f481a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.602251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd060da-ec29-4c58-baad-e00f7f481a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:34.603874 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd060da-ec29-4c58-baad-e00f7f481a53 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:34.615137 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4441/8821] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:06:34.619248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:34.629548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090bd12-6081-4bab-ab9b-aa1c4f286de1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:34.634290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:34.634936 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.635225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.635503 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] PATH_INFO: `/v3/projects/696d8a00527d404492920b6a653ca632/users/3e7f5d9c55644d51b16edb77c248540e/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.651058 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696d8a00527d404492920b6a653ca632, user_id=3e7f5d9c55644d51b16edb77c248540e, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:34.653674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:34.757252 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4381/8822] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:06:34 2022] PUT /identity/v3/projects/696d8a00527d404492920b6a653ca632/users/3e7f5d9c55644d51b16edb77c248540e/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:06:34.762511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd704-68b5-4e0e-bc12-5eef174d8528 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.762800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd704-68b5-4e0e-bc12-5eef174d8528 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.763100 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd704-68b5-4e0e-bc12-5eef174d8528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.783293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-22dbd704-68b5-4e0e-bc12-5eef174d8528 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:34.788751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-22dbd704-68b5-4e0e-bc12-5eef174d8528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:34.843140 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4442/8823] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:34.853006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:34.854844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:34.913567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f6db-2cd8-49c5-a0d4-1f10348dbe75 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:34.917166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8be182-41fe-4f97-8e99-66f646e0c076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:34.917770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be182-41fe-4f97-8e99-66f646e0c076 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:34.918087 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be182-41fe-4f97-8e99-66f646e0c076 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:34.918363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be182-41fe-4f97-8e99-66f646e0c076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:34.927310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8be182-41fe-4f97-8e99-66f646e0c076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:34.928728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8be182-41fe-4f97-8e99-66f646e0c076 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:34.938653 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4382/8824] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:40.263570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:40.264083 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:40.264179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:40.299125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] MFA Rules not processed for user `3e7f5d9c55644d51b16edb77c248540e`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:40.300453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:40.369904 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4443/8825] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:40.381321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7420596-2e37-423c-907c-005ed22102fa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:40.381783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7420596-2e37-423c-907c-005ed22102fa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:40.381913 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7420596-2e37-423c-907c-005ed22102fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:40.400871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e7420596-2e37-423c-907c-005ed22102fa None None] MFA Rules not processed for user `3e7f5d9c55644d51b16edb77c248540e`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:06:40.402127 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e7420596-2e37-423c-907c-005ed22102fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:40.409941 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4383/8826] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:06:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:06:40.424134 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:40.425582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:40.453958 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:40.503376 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8505f7-cfba-4a4a-bc22-b020265df010 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:40.509285 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:40.510105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:40.510403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:40.510829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:40.522054 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:40.523746 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:40.533243 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4444/8827] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:41.200183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7420596-2e37-423c-907c-005ed22102fa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:41.211584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e7420596-2e37-423c-907c-005ed22102fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:41.236469 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:41.298684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7420596-2e37-423c-907c-005ed22102fa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:41.304086 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:41.304714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:41.305112 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:41.305400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:41.307376 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:41.321661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:41.323312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:41.333574 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4384/8828] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:42.384962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:42.386472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:42.404710 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ea866-74e6-495a-ae4e-96e1bb1c9487 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:42.410816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:42.411432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:42.412728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:42.412728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:42.413934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:42.429656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:42.431298 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:42.446336 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4445/8829] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:51.473208 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=25 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:52.440404 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=29 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:06:55.633399 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:55.634595 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:55.647422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdaee8-f870-4d98-9f73-bb5560b29391 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:55.651281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:55.651914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:55.652198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:55.652484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:55.654291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:55.667645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:55.669017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:55.680070 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4385/8830] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:55.798663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:55.812262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd86cc-8afe-4caf-9163-c92150a78e1f service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:55.818032 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:55.818624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:55.818901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:55.819172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:55.820875 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:55.833350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:55.834995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:55.845004 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4446/8831] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:06:56.125800 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:06:56.135589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cf000-5fa4-4fcd-99d1-a191ce603a71 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:06:56.139279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:06:56.139883 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:06:56.140166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:06:56.140441 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:06:56.142516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:06:56.159941 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:06:56.161412 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:06:56.175051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4386/8832] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:06:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:07:05.840825 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:07:06.167612 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=12 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:07:21.638129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:21.652786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108df46-8a73-4a39-9586-1a82730def2e service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:21.657743 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:21.658366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:21.658646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:21.658924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:21.660738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:21.677333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:21.678991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:21.692074 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4447/8833] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:07:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:07:31.685418 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:07:44.461113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:44.473294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e4a5-89f4-40be-ab7c-78a0b7916c97 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:44.479084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:44.479775 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:44.480101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:44.480346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] PATH_INFO: `/v3/users/3e7f5d9c55644d51b16edb77c248540e` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:44.481495 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7f5d9c55644d51b16edb77c248540e)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:44.483458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:44.658354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7f5d9c55644d51b16edb77c248540e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:44.672147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7f5d9c55644d51b16edb77c248540e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:44.679174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7f5d9c55644d51b16edb77c248540e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:44.679872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7f5d9c55644d51b16edb77c248540e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:44.736104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c8689ae9-fe65-4b20-80f5-4a30ea9d685b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7f5d9c55644d51b16edb77c248540e'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:44.742491 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4387/8834] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:07:44 2022] DELETE /identity/v3/users/3e7f5d9c55644d51b16edb77c248540e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:07:44.978780 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:44.990569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f159d78-4140-41e5-afc6-2ce1cefed9d1 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:45.051991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:45.052556 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.052844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.053125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] PATH_INFO: `/v3/projects/696d8a00527d404492920b6a653ca632` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.054277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=696d8a00527d404492920b6a653ca632)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:45.056782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:45.160511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696d8a00527d404492920b6a653ca632', 'request_id': 'req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:45.167576 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696d8a00527d404492920b6a653ca632', 'request_id': 'req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:45.233198 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696d8a00527d404492920b6a653ca632', 'request_id': 'req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:45.244388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] The token cache is being invalidate because project 696d8a00527d404492920b6a653ca632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:07:45.244678 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:45.245317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-afcc4e9e-aa8d-4eba-ae93-6e9b3ef715f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:07:45.246853 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4448/8835] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:07:44 2022] DELETE /identity/v3/projects/696d8a00527d404492920b6a653ca632 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:07:45.252042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bd370-17d1-4a35-80fb-bf4e32404dae None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.252379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bd370-17d1-4a35-80fb-bf4e32404dae None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.252686 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bd370-17d1-4a35-80fb-bf4e32404dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.274718 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-652bd370-17d1-4a35-80fb-bf4e32404dae None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:07:45.276003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-652bd370-17d1-4a35-80fb-bf4e32404dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:45.334678 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4388/8836] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:07:45.343781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8a857-d362-4c2b-989b-086405ba18f0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.344081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8a857-d362-4c2b-989b-086405ba18f0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.344361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8a857-d362-4c2b-989b-086405ba18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.365835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-54e8a857-d362-4c2b-989b-086405ba18f0 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:07:45.367056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-54e8a857-d362-4c2b-989b-086405ba18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:45.375061 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4449/8837] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:07:45.379352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bd370-17d1-4a35-80fb-bf4e32404dae None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:45.390019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bd370-17d1-4a35-80fb-bf4e32404dae None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:45.395133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:45.395815 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.396174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.396458 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.397115 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:07:45.397425 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:45.399828 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:45.412611 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4389/8838] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:07:45.416857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8a857-d362-4c2b-989b-086405ba18f0 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:45.427318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8a857-d362-4c2b-989b-086405ba18f0 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:45.432291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:45.432926 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.433207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.433482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.434184 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:45.436077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:45.529518 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4450/8839] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:07:45 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:07:45.533736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:45.544411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff40b3-9e6a-4424-8d46-a538f91218a9 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:45.607712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:45.608408 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.608741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.608967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.609596 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:45.611533 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:45.620279 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:07:45.751561 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4390/8840] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:07:45 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:07:45.753080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:45.764714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a334fdb-90c9-44ac-89df-e9c24504f629 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:45.769663 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:45.770310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.770594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.770868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.771505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:45.773105 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:45.785381 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4451/8841] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:07:45.789360 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:45.800166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38aede-5167-4f97-bcd1-1e8bbc40ce19 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:45.805008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedff34-cb6f-4393-bef7-7a3ac2d26788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:45.806351 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedff34-cb6f-4393-bef7-7a3ac2d26788 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.806920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedff34-cb6f-4393-bef7-7a3ac2d26788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.807202 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedff34-cb6f-4393-bef7-7a3ac2d26788 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.807852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedff34-cb6f-4393-bef7-7a3ac2d26788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:45.809473 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedff34-cb6f-4393-bef7-7a3ac2d26788 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:45.820850 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4391/8842] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:07:45.826088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:45.842966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6565a-f393-4233-aa1f-8ded36165415 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:45.842966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:45.842966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.842966 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.843387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] PATH_INFO: `/v3/projects/253e2a4a15b148b9b265b74aaf90412c/users/1365c679bf9045eaa1ad008c9e182404/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.857798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=253e2a4a15b148b9b265b74aaf90412c, user_id=1365c679bf9045eaa1ad008c9e182404, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:45.860506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:45.965957 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4452/8843] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:07:45 2022] PUT /identity/v3/projects/253e2a4a15b148b9b265b74aaf90412c/users/1365c679bf9045eaa1ad008c9e182404/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:07:45.971201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc5a8-74c6-4400-9fd3-75b009c6cc58 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:45.971494 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc5a8-74c6-4400-9fd3-75b009c6cc58 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:45.971772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc5a8-74c6-4400-9fd3-75b009c6cc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:45.994067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1f7dc5a8-74c6-4400-9fd3-75b009c6cc58 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:07:45.995353 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1f7dc5a8-74c6-4400-9fd3-75b009c6cc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:46.057840 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4392/8844] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:07:46.067718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:46.069524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:46.101266 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:07:46.129283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d719-a303-4f90-8b0d-7bff27cec37f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:46.133174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af781c50-24d2-4359-aff9-1f7e4bb3f71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:46.133947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781c50-24d2-4359-aff9-1f7e4bb3f71d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:46.134234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781c50-24d2-4359-aff9-1f7e4bb3f71d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:46.134513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781c50-24d2-4359-aff9-1f7e4bb3f71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:46.144539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af781c50-24d2-4359-aff9-1f7e4bb3f71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:46.146048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af781c50-24d2-4359-aff9-1f7e4bb3f71d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:46.156278 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4453/8845] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:07:51.759207 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:51.759735 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:51.759814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:51.793038 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] MFA Rules not processed for user `1365c679bf9045eaa1ad008c9e182404`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:07:51.794736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:51.885241 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4393/8846] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:07:51.887486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:51.887943 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:51.888055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:51.909962 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] MFA Rules not processed for user `1365c679bf9045eaa1ad008c9e182404`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:07:51.911271 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:51.919911 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4454/8847] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:07:51.933426 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:51.935282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:52.021361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ce626-42c0-4fde-8822-49b9388c8699 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:52.028479 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:52.029191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:52.029472 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:52.029746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:52.034674 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:07:52.038914 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:52.040624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:52.050118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4394/8848] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:07:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:07:52.314176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:52.315610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:52.328318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3030f-e058-47f9-ae76-f5b94bde9afc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:52.331940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:52.332543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:52.332828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:52.333107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:52.334812 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:52.347594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:52.349253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:52.361024 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4455/8849] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:07:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:07:58.619286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:58.628667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf15f-215e-411a-a7aa-3ce4fc19f484 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:58.632384 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:58.633005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:58.633296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:58.633678 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:58.635482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:58.652160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:58.653579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:58.667978 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4395/8850] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:07:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:07:59.845418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:07:59.854258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a64a4-7a2d-4210-9299-ce05a3d2a224 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:07:59.858557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4cbfc-321f-4d99-9551-cdd5b4eef778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:07:59.859111 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cbfc-321f-4d99-9551-cdd5b4eef778 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:07:59.859389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cbfc-321f-4d99-9551-cdd5b4eef778 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:07:59.859661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cbfc-321f-4d99-9551-cdd5b4eef778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:07:59.861371 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c5b4cbfc-321f-4d99-9551-cdd5b4eef778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:07:59.878779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4cbfc-321f-4d99-9551-cdd5b4eef778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:07:59.882291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4cbfc-321f-4d99-9551-cdd5b4eef778 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:07:59.894822 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4456/8851] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:07:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:08:07.551978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:08:07.553402 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:08:07.625273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211bd6c-f02a-428d-a9d2-e6a49129b955 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:08:07.630239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:08:07.630843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:08:07.631124 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:08:07.631397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:08:07.633120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:08:07.644492 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:08:07.646076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:08:07.656297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4396/8852] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:08:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:08:09.887130 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=29 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:08:17.652261 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=41 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:08:28.918357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90389f-b653-4458-86bd-075187eb86fb None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:08:28.918867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90389f-b653-4458-86bd-075187eb86fb None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:08:28.918985 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90389f-b653-4458-86bd-075187eb86fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:08:28.938841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5d90389f-b653-4458-86bd-075187eb86fb None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:08:28.940048 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d90389f-b653-4458-86bd-075187eb86fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:08:28.949458 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4457/8853] 10.222.0.71 () {58 vars in 1015 bytes} [Sun Aug 28 02:08:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:08:28.962286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:08:28.963996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:08:28.980464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005673c5-8e7f-421a-9342-95a255f9e9a9 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:08:28.985909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:08:28.986510 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:08:28.986787 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:08:28.987057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:08:28.997560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:08:28.999230 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:08:29.009729 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4397/8854] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:08:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:08:33.521004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd737-5058-4212-a99b-1e0f6ed3c1b2 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:08:33.521713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd737-5058-4212-a99b-1e0f6ed3c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:08:33.521713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd737-5058-4212-a99b-1e0f6ed3c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:08:33.540957 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-69cfd737-5058-4212-a99b-1e0f6ed3c1b2 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:08:33.542203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-69cfd737-5058-4212-a99b-1e0f6ed3c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:08:33.551148 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4458/8855] 10.222.0.72 () {58 vars in 1015 bytes} [Sun Aug 28 02:08:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:08:33.564154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:08:33.578553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1750-fd7e-4ecc-83ca-08fb9628ba7f service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:08:33.583742 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:08:33.584356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:08:33.584636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:08:33.584918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:08:33.593528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:08:33.595132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:08:33.604986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4398/8856] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:08:37.785144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0278bd-739c-47c3-bf9b-52a5a8d05541 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:08:37.785646 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0278bd-739c-47c3-bf9b-52a5a8d05541 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:08:37.785769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0278bd-739c-47c3-bf9b-52a5a8d05541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:08:37.804997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-8b0278bd-739c-47c3-bf9b-52a5a8d05541 None None] MFA Rules not processed for user `1365c679bf9045eaa1ad008c9e182404`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:08:37.806405 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-8b0278bd-739c-47c3-bf9b-52a5a8d05541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:08:37.814202 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4459/8857] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:08:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:08:41.718239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:08:41.727841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5b8e1-2de4-4423-af71-d2c2966addf2 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:08:41.731569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:08:41.732179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:08:41.732679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:08:41.732961 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:08:41.735599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:08:41.749569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:08:41.751034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:08:41.762849 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4399/8858] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:08:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:08:47.799432 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=9 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:08:51.755979 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=18 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:09:36.006031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0278bd-739c-47c3-bf9b-52a5a8d05541 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:36.021210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0278bd-739c-47c3-bf9b-52a5a8d05541 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:36.026261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:36.026844 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:36.027121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:36.027393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:36.029080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:36.044059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:36.045652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:36.058739 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4460/8859] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:09:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:09:36.137559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:36.153409 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894b3e-ecab-448f-8401-caf6f94671a2 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:36.158085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:36.164475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:36.164475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:36.164475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] PATH_INFO: `/v3/users/1365c679bf9045eaa1ad008c9e182404` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:36.164475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1365c679bf9045eaa1ad008c9e182404)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:36.164475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:36.412696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1365c679bf9045eaa1ad008c9e182404'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:36.427647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1365c679bf9045eaa1ad008c9e182404'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:36.435150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1365c679bf9045eaa1ad008c9e182404'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:36.435893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1365c679bf9045eaa1ad008c9e182404'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:36.507622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-865e8269-7449-40ff-88ac-b93d63f4da05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1365c679bf9045eaa1ad008c9e182404'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:36.515242 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4400/8860] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:09:36 2022] DELETE /identity/v3/users/1365c679bf9045eaa1ad008c9e182404 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:09:36.793091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:36.806384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995aa37-47c7-456f-a2f0-ac97216df666 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:36.871195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:36.871832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:36.872116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:36.872392 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] PATH_INFO: `/v3/projects/253e2a4a15b148b9b265b74aaf90412c` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:36.873511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253e2a4a15b148b9b265b74aaf90412c)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:36.875468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:36.981205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253e2a4a15b148b9b265b74aaf90412c', 'request_id': 'req-11551190-a217-43de-bc8f-935000ef6a54'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:36.989325 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253e2a4a15b148b9b265b74aaf90412c', 'request_id': 'req-11551190-a217-43de-bc8f-935000ef6a54'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:37.079013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253e2a4a15b148b9b265b74aaf90412c', 'request_id': 'req-11551190-a217-43de-bc8f-935000ef6a54'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:37.091489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] The token cache is being invalidate because project 253e2a4a15b148b9b265b74aaf90412c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:09:37.091783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:37.092462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-11551190-a217-43de-bc8f-935000ef6a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:09:37.094234 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4461/8861] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:09:36 2022] DELETE /identity/v3/projects/253e2a4a15b148b9b265b74aaf90412c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:09:37.100168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2212-49f5-4d64-a799-18252870587a None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.100579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2212-49f5-4d64-a799-18252870587a None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.100880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2212-49f5-4d64-a799-18252870587a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.121098 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-651e2212-49f5-4d64-a799-18252870587a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:09:37.122350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-651e2212-49f5-4d64-a799-18252870587a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:37.182661 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4401/8862] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:09:37.192132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dbae9-cdae-4ab3-a0a1-ddc412717567 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.192538 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dbae9-cdae-4ab3-a0a1-ddc412717567 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.192820 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dbae9-cdae-4ab3-a0a1-ddc412717567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.213028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c61dbae9-cdae-4ab3-a0a1-ddc412717567 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:09:37.214268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c61dbae9-cdae-4ab3-a0a1-ddc412717567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:37.222221 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4462/8863] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:09:37.226571 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e2212-49f5-4d64-a799-18252870587a None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:37.236394 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e2212-49f5-4d64-a799-18252870587a None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:37.241003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:37.241600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.241920 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.242201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.242876 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:09:37.243183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:37.244776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:37.257118 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4402/8864] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:09:37.261127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dbae9-cdae-4ab3-a0a1-ddc412717567 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:37.271479 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dbae9-cdae-4ab3-a0a1-ddc412717567 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:37.276155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:37.276752 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.277034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.277311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.278150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:37.280076 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:37.403139 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4463/8865] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:09:37 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:09:37.405795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:37.416215 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b6f7e-873a-4386-97f6-3d138a404ee1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:37.475138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:37.475749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.476029 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.476302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.477027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:37.479081 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:37.487523 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:09:37.551723 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4403/8866] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:09:37 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:09:37.553017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:37.564317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b66b83-769b-4043-8460-01d7e1aace9c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:37.570055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:37.570667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.570936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.571214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.571862 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:37.573483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:37.585543 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4464/8867] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:09:37.589564 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:37.600811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a6b8d-bfc6-4d44-bee7-2838f80604b5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:37.605916 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdb054-4180-46a0-b863-461235c41e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:37.606508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb054-4180-46a0-b863-461235c41e84 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.606846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb054-4180-46a0-b863-461235c41e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.607028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdb054-4180-46a0-b863-461235c41e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.607675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb054-4180-46a0-b863-461235c41e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:37.609269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdb054-4180-46a0-b863-461235c41e84 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:37.621071 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4404/8868] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:09:37.625280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:37.636031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee31a-b55c-481b-a76d-ce2f418c31ba admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:37.640637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:37.641287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.641568 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.641877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] PATH_INFO: `/v3/projects/f1b964c67360498ab681bbd7c65380a8/users/44eacb309fef43de8514215a66b50f8c/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.657788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b964c67360498ab681bbd7c65380a8, user_id=44eacb309fef43de8514215a66b50f8c, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:37.660590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:37.730107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4465/8869] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:09:37 2022] PUT /identity/v3/projects/f1b964c67360498ab681bbd7c65380a8/users/44eacb309fef43de8514215a66b50f8c/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:09:37.735598 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448d8e5-42a4-447e-ad54-2cfb321d98d6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.735891 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448d8e5-42a4-447e-ad54-2cfb321d98d6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.736173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448d8e5-42a4-447e-ad54-2cfb321d98d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.757344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2448d8e5-42a4-447e-ad54-2cfb321d98d6 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:09:37.758574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2448d8e5-42a4-447e-ad54-2cfb321d98d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:37.817393 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4405/8870] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:09:37.827159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:37.828881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:37.844231 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:09:37.888443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121bc69-d014-437f-b38d-d9b43e0fa77c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:37.892062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:37.893546 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:37.893858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:37.894174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:37.903045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:37.904561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:37.914595 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4466/8871] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:09:43.314644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ace69-8919-4668-bcc2-c8105c88b0cc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:43.315227 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ace69-8919-4668-bcc2-c8105c88b0cc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:43.315511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ace69-8919-4668-bcc2-c8105c88b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:43.344418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8b1ace69-8919-4668-bcc2-c8105c88b0cc None None] MFA Rules not processed for user `44eacb309fef43de8514215a66b50f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:09:43.347696 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8b1ace69-8919-4668-bcc2-c8105c88b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:43.413435 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4406/8872] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:09:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:09:43.430060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:43.431486 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:43.509930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5fda6-1193-404f-8c50-a86ab0c56270 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:43.515438 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:43.516052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:43.516335 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:43.516606 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:43.526417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:43.528781 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:43.539987 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4467/8873] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:09:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:09:46.018724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d022-54f4-4044-a241-f90093498c39 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:46.019741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d022-54f4-4044-a241-f90093498c39 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:46.020180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d022-54f4-4044-a241-f90093498c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:46.041873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8881d022-54f4-4044-a241-f90093498c39 None None] MFA Rules not processed for user `44eacb309fef43de8514215a66b50f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:09:46.043113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8881d022-54f4-4044-a241-f90093498c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:46.051253 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4407/8874] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:09:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:09:46.417188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:46.432162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078aed9-13a9-453f-8b10-0eb9b288ef9f service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:46.436337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655f322-81e6-469e-8a4b-a7f41b0cb4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:46.437031 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f322-81e6-469e-8a4b-a7f41b0cb4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:46.437379 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f322-81e6-469e-8a4b-a7f41b0cb4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:46.437717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f322-81e6-469e-8a4b-a7f41b0cb4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:46.439456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d655f322-81e6-469e-8a4b-a7f41b0cb4e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:46.453045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655f322-81e6-469e-8a4b-a7f41b0cb4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:46.454535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655f322-81e6-469e-8a4b-a7f41b0cb4e5 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:46.468091 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4468/8875] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:09:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:09:56.036082 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:09:56.460705 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=60 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:09:58.921574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881d022-54f4-4044-a241-f90093498c39 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:09:58.923101 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8881d022-54f4-4044-a241-f90093498c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:58.942388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881d022-54f4-4044-a241-f90093498c39 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:09:58.948060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606f79-7354-42cb-94f0-54b53ccd9dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:09:58.948679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606f79-7354-42cb-94f0-54b53ccd9dfe service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:09:58.948991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606f79-7354-42cb-94f0-54b53ccd9dfe service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:09:58.949242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606f79-7354-42cb-94f0-54b53ccd9dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:09:58.951168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4e606f79-7354-42cb-94f0-54b53ccd9dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:09:58.967653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e606f79-7354-42cb-94f0-54b53ccd9dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:09:58.969240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e606f79-7354-42cb-94f0-54b53ccd9dfe service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:09:58.983409 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4408/8876] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:09:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:10:08.976271 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:10:35.291628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab540-eee3-45f2-9576-cb195e821ed0 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:35.292207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab540-eee3-45f2-9576-cb195e821ed0 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:35.292313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab540-eee3-45f2-9576-cb195e821ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:35.329366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ddcab540-eee3-45f2-9576-cb195e821ed0 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:10:35.330609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ddcab540-eee3-45f2-9576-cb195e821ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:35.340893 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4469/8877] 10.222.0.59 () {58 vars in 1059 bytes} [Sun Aug 28 02:10:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:10:35.523637 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767b76-65a8-42c8-aca6-bc7f2be7356c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:35.524169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767b76-65a8-42c8-aca6-bc7f2be7356c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:35.524169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767b76-65a8-42c8-aca6-bc7f2be7356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:35.545556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3c767b76-65a8-42c8-aca6-bc7f2be7356c None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:10:35.547028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3c767b76-65a8-42c8-aca6-bc7f2be7356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:35.556312 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4409/8878] 10.222.0.59 () {58 vars in 1059 bytes} [Sun Aug 28 02:10:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:10:35.562207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dc041-ab05-4902-bb0e-800bdf544248 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:35.562540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dc041-ab05-4902-bb0e-800bdf544248 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:35.562828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dc041-ab05-4902-bb0e-800bdf544248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:35.582733 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ee0dc041-ab05-4902-bb0e-800bdf544248 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:10:35.583935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ee0dc041-ab05-4902-bb0e-800bdf544248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:35.594240 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4470/8879] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:10:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:10:35.604856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767b76-65a8-42c8-aca6-bc7f2be7356c None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:10:35.614286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767b76-65a8-42c8-aca6-bc7f2be7356c None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:10:35.618084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:10:35.618693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:35.618978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:35.619255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:35.629989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:10:35.631546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:10:35.643717 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4410/8880] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:10:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:10:38.616091 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78c36-be05-4782-912e-843eb29348d8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:38.616583 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78c36-be05-4782-912e-843eb29348d8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:38.616774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78c36-be05-4782-912e-843eb29348d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:38.637444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2dc78c36-be05-4782-912e-843eb29348d8 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:10:38.638756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2dc78c36-be05-4782-912e-843eb29348d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:38.651332 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4471/8881] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:10:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:10:38.671389 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:10:38.673344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:38.689145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ca143-8619-4d45-9f1d-50c65b0e0a2d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:10:38.695011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:10:38.698574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:38.698574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:38.698574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:38.707708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:10:38.709138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:10:38.721058 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4411/8882] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:10:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:10:48.631663 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=15 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:10:48.716043 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=15 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:10:51.158544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620a0d-a7a2-4f75-a6f0-58264304be4d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:51.159116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620a0d-a7a2-4f75-a6f0-58264304be4d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:51.159116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620a0d-a7a2-4f75-a6f0-58264304be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:51.178552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f9620a0d-a7a2-4f75-a6f0-58264304be4d None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:10:51.179730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f9620a0d-a7a2-4f75-a6f0-58264304be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:51.186224 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4472/8883] 10.222.0.71 () {58 vars in 1015 bytes} [Sun Aug 28 02:10:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:10:51.199820 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:10:51.208415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb55207-85e4-4496-8dca-c1f561138427 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:10:51.212123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7ed9-128a-4080-b98c-d6403586f8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:10:51.212753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7ed9-128a-4080-b98c-d6403586f8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:51.213034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7ed9-128a-4080-b98c-d6403586f8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:51.213310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7ed9-128a-4080-b98c-d6403586f8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:51.220984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c7ed9-128a-4080-b98c-d6403586f8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:10:51.222484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c7ed9-128a-4080-b98c-d6403586f8b8 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:10:51.230545 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4412/8884] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:10:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:10:51.687808 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9620a0d-a7a2-4f75-a6f0-58264304be4d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:10:51.696633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9620a0d-a7a2-4f75-a6f0-58264304be4d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:10:51.701177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:10:51.701711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:51.702144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:51.702295 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:51.704080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:51.717177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:10:51.719562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:10:51.731086 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4473/8885] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:10:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:10:52.126811 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eee6b-772d-4147-a4c4-ed6b4385f9d2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:52.126938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eee6b-772d-4147-a4c4-ed6b4385f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:52.127214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eee6b-772d-4147-a4c4-ed6b4385f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:52.147733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-573eee6b-772d-4147-a4c4-ed6b4385f9d2 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:10:52.148958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-573eee6b-772d-4147-a4c4-ed6b4385f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:52.158548 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4413/8886] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:10:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:10:52.171974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:10:52.185681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e8c4f-3290-449e-a994-782b497df99e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:10:52.191393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:10:52.192011 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:52.192302 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:52.192565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:52.202173 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:10:52.203974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:10:52.225551 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4474/8887] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:10:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:10:55.123965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd48a00-3d92-4a40-b3db-52c5d1cf82fc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:55.124474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd48a00-3d92-4a40-b3db-52c5d1cf82fc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:55.124651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd48a00-3d92-4a40-b3db-52c5d1cf82fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:55.145211 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1bd48a00-3d92-4a40-b3db-52c5d1cf82fc None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:10:55.146578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1bd48a00-3d92-4a40-b3db-52c5d1cf82fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:10:55.154426 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4414/8888] 10.222.0.72 () {58 vars in 1015 bytes} [Sun Aug 28 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:10:55.177921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:10:55.187639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df26cbf-d704-4083-a1d4-11016105a2e8 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:10:55.191289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1029d-3cbd-4597-a9fa-0b303d4e514a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:10:55.191889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1029d-3cbd-4597-a9fa-0b303d4e514a service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:10:55.192168 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1029d-3cbd-4597-a9fa-0b303d4e514a service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:10:55.192439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1029d-3cbd-4597-a9fa-0b303d4e514a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:10:55.200427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1029d-3cbd-4597-a9fa-0b303d4e514a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:10:55.201881 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1029d-3cbd-4597-a9fa-0b303d4e514a service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:10:55.210441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4475/8889] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:10:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:11:02.495114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044cb5a-ec2f-4a30-9206-b9c29385ce00 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:11:02.495590 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044cb5a-ec2f-4a30-9206-b9c29385ce00 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:11:02.495682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044cb5a-ec2f-4a30-9206-b9c29385ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:11:02.515575 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5044cb5a-ec2f-4a30-9206-b9c29385ce00 None None] MFA Rules not processed for user `44eacb309fef43de8514215a66b50f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:11:02.516821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5044cb5a-ec2f-4a30-9206-b9c29385ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:11:02.524043 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4415/8890] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:11:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:11:05.207270 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=21 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:11:12.509066 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=15 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:11:14.025420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a4d1-e905-44c2-889d-3f7cb2e3ab5a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:11:14.025967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a4d1-e905-44c2-889d-3f7cb2e3ab5a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:11:14.026103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a4d1-e905-44c2-889d-3f7cb2e3ab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:11:14.047519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f9c7a4d1-e905-44c2-889d-3f7cb2e3ab5a None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:11:14.048771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f9c7a4d1-e905-44c2-889d-3f7cb2e3ab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:11:14.058191 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4476/8891] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:11:14.072712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044cb5a-ec2f-4a30-9206-b9c29385ce00 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:11:14.085957 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044cb5a-ec2f-4a30-9206-b9c29385ce00 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:11:14.092190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3febcf7-5e75-4e6b-a301-461b9039b5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:11:14.092798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3febcf7-5e75-4e6b-a301-461b9039b5c8 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:11:14.093079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3febcf7-5e75-4e6b-a301-461b9039b5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:11:14.093352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3febcf7-5e75-4e6b-a301-461b9039b5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:11:14.102282 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3febcf7-5e75-4e6b-a301-461b9039b5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:11:14.103858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3febcf7-5e75-4e6b-a301-461b9039b5c8 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:11:14.114939 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4416/8892] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:11:24.041507 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:11:24.110504 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:12:01.766061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7a4d1-e905-44c2-889d-3f7cb2e3ab5a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:12:01.786506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7a4d1-e905-44c2-889d-3f7cb2e3ab5a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:12:01.790294 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:12:01.790895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:01.791177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:01.791451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:01.793172 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:12:01.824595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:12:01.826078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:12:01.836589 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4477/8893] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:12:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:12:01.995153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17920d80-a2ce-40d3-8978-478ff89ded19 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:01.995634 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17920d80-a2ce-40d3-8978-478ff89ded19 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:01.995733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17920d80-a2ce-40d3-8978-478ff89ded19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:02.054971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-17920d80-a2ce-40d3-8978-478ff89ded19 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:12:02.056182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-17920d80-a2ce-40d3-8978-478ff89ded19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:12:02.137206 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4417/8894] 10.222.0.59 () {58 vars in 1058 bytes} [Sun Aug 28 02:12:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:12:02.143924 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:12:02.156116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699947af-71f0-4a14-a2f8-d36fba50da55 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:12:02.161082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb475a2-ca86-4e43-ab95-0847218dd6ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:12:02.161672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb475a2-ca86-4e43-ab95-0847218dd6ca service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:02.162000 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb475a2-ca86-4e43-ab95-0847218dd6ca service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:02.162274 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb475a2-ca86-4e43-ab95-0847218dd6ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:02.163973 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-eeb475a2-ca86-4e43-ab95-0847218dd6ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:12:02.175094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb475a2-ca86-4e43-ab95-0847218dd6ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:12:02.176667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb475a2-ca86-4e43-ab95-0847218dd6ca service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:12:02.186408 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4478/8895] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:12:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:12:02.494519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17920d80-a2ce-40d3-8978-478ff89ded19 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:12:02.505232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17920d80-a2ce-40d3-8978-478ff89ded19 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:12:02.508938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929cb2-8d31-4d42-822c-79bd415f0d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:12:02.509546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929cb2-8d31-4d42-822c-79bd415f0d6d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:02.509871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929cb2-8d31-4d42-822c-79bd415f0d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:02.510158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929cb2-8d31-4d42-822c-79bd415f0d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:02.511926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3d929cb2-8d31-4d42-822c-79bd415f0d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:12:02.529847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929cb2-8d31-4d42-822c-79bd415f0d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:12:02.531505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929cb2-8d31-4d42-822c-79bd415f0d6d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:12:02.546667 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4418/8896] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:12:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:12:12.182270 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=25 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:12:12.538027 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=59 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:12:21.101119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4db3c6-7bde-4768-bd1c-ba352914886a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:21.101622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4db3c6-7bde-4768-bd1c-ba352914886a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:21.101726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4db3c6-7bde-4768-bd1c-ba352914886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:21.121033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-cf4db3c6-7bde-4768-bd1c-ba352914886a None None] MFA Rules not processed for user `44eacb309fef43de8514215a66b50f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:12:21.122273 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-cf4db3c6-7bde-4768-bd1c-ba352914886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:12:21.129742 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4479/8897] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:12:21.428153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ddf81-9367-4047-a8d3-eba8fba54a3d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:21.428825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ddf81-9367-4047-a8d3-eba8fba54a3d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:21.428825 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ddf81-9367-4047-a8d3-eba8fba54a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:21.467788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1c7ddf81-9367-4047-a8d3-eba8fba54a3d None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:12:21.469047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1c7ddf81-9367-4047-a8d3-eba8fba54a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:12:21.475672 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4419/8898] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:12:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:12:21.488117 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4db3c6-7bde-4768-bd1c-ba352914886a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:12:21.498672 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4db3c6-7bde-4768-bd1c-ba352914886a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:12:21.502254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ec015-837a-444f-8f23-4a499ec4abdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:12:21.502854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec015-837a-444f-8f23-4a499ec4abdd service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:21.503144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec015-837a-444f-8f23-4a499ec4abdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:21.503418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec015-837a-444f-8f23-4a499ec4abdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:21.510737 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ec015-837a-444f-8f23-4a499ec4abdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:12:21.512174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ec015-837a-444f-8f23-4a499ec4abdd service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:12:21.520692 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4480/8899] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:12:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:12:21.921217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ddf81-9367-4047-a8d3-eba8fba54a3d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:12:21.944129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ddf81-9367-4047-a8d3-eba8fba54a3d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:12:21.949126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:12:21.949739 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:12:21.950120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:12:21.950728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:12:21.952085 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:12:21.963780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:12:21.965346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:12:21.976213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4420/8900] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:12:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:12:31.517043 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=9 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:12:31.971781 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=19 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:13:09.275579 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7835c-23e0-412b-b942-137203318456 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:09.276115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7835c-23e0-412b-b942-137203318456 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:09.276115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7835c-23e0-412b-b942-137203318456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:09.307656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-20b7835c-23e0-412b-b942-137203318456 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:13:09.310114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-20b7835c-23e0-412b-b942-137203318456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:09.326193 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4481/8901] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:13:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:13:09.337784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:13:09.348436 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3c36-6b00-40a4-9652-e222e5c2c01d service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:13:09.352137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:13:09.356400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:09.356400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:09.356400 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:09.361895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:13:09.363401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:13:09.371829 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4421/8902] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:13:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:13:09.767619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d16c42-b4d5-4cbb-9971-3c39242a538a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:09.767907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d16c42-b4d5-4cbb-9971-3c39242a538a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:09.768183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d16c42-b4d5-4cbb-9971-3c39242a538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:09.799918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-60d16c42-b4d5-4cbb-9971-3c39242a538a None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:13:09.801129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-60d16c42-b4d5-4cbb-9971-3c39242a538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:09.826730 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4482/8903] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:13:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:13:09.837774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:13:09.847152 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429092e0-f3fd-4f37-ab02-aed0eaf5c99d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:13:09.850962 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:13:09.851559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:09.851840 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:09.852114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:09.862623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:13:09.864031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:13:09.875122 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4422/8904] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:13:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:13:09.938994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773fac-1dd7-4ee0-99ff-5a6a09110975 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:09.939288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773fac-1dd7-4ee0-99ff-5a6a09110975 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:09.939570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773fac-1dd7-4ee0-99ff-5a6a09110975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:09.960034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-f4773fac-1dd7-4ee0-99ff-5a6a09110975 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:13:09.961234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f4773fac-1dd7-4ee0-99ff-5a6a09110975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:09.970572 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4483/8905] 10.222.0.59 () {58 vars in 1058 bytes} [Sun Aug 28 02:13:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:13:09.976467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:13:09.988042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09300-c3a1-4c53-8b9a-a6ac97b1431e service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:13:09.993091 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:13:09.993684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:09.993995 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:09.994274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:09.995960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:10.006997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:13:10.008556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:13:10.018611 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4423/8906] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:13:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:13:19.955206 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=30 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:13:20.014095 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=18 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:13:30.362237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773fac-1dd7-4ee0-99ff-5a6a09110975 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:13:30.372143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773fac-1dd7-4ee0-99ff-5a6a09110975 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:13:30.377914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3aa47-566f-4d4d-800a-46f5c6ced803 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:13:30.378442 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3aa47-566f-4d4d-800a-46f5c6ced803 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:30.378717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3aa47-566f-4d4d-800a-46f5c6ced803 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:30.378987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3aa47-566f-4d4d-800a-46f5c6ced803 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:30.380699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1bd3aa47-566f-4d4d-800a-46f5c6ced803 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:30.392439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3aa47-566f-4d4d-800a-46f5c6ced803 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:13:30.394065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3aa47-566f-4d4d-800a-46f5c6ced803 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:13:30.404365 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4484/8907] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:13:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:13:37.285188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:13:37.296550 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d382ea-22d1-4bf0-883d-d14962f6327a service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:13:37.302616 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2861392-d33a-45c7-acb2-a7478b57d68b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:13:37.303255 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861392-d33a-45c7-acb2-a7478b57d68b service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:37.303539 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861392-d33a-45c7-acb2-a7478b57d68b service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:37.303819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2861392-d33a-45c7-acb2-a7478b57d68b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:37.305614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e2861392-d33a-45c7-acb2-a7478b57d68b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:37.320405 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861392-d33a-45c7-acb2-a7478b57d68b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:13:37.322208 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2861392-d33a-45c7-acb2-a7478b57d68b service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:13:37.335318 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4424/8908] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:13:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:13:40.400475 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:13:46.596507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c40b9-87dd-44e3-a255-52676595c584 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:46.597148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c40b9-87dd-44e3-a255-52676595c584 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:46.597641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c40b9-87dd-44e3-a255-52676595c584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:46.619739 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2e9c40b9-87dd-44e3-a255-52676595c584 None None] MFA Rules not processed for user `44eacb309fef43de8514215a66b50f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:13:46.621093 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2e9c40b9-87dd-44e3-a255-52676595c584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:46.628596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4485/8909] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:13:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:13:46.940915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:46.941382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:46.941382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:46.965245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:13:46.965245 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:13:46.971316 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4425/8910] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:13:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:13:46.983287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c40b9-87dd-44e3-a255-52676595c584 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:13:46.992934 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c40b9-87dd-44e3-a255-52676595c584 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:13:46.996543 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:13:46.997141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:13:46.997420 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:13:46.997698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:13:47.004878 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:13:47.006347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:13:47.014120 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4486/8911] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:13:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:13:56.957547 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:13:57.010704 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=9 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:14:42.369585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:14:42.371054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:14:42.451882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19d304-f819-4e4b-acbc-5ebe929474e2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:14:42.455504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:14:42.456109 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:14:42.456388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:14:42.456662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:14:42.464792 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:14:42.466243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:14:42.474848 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4426/8912] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:14:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:14:52.470919 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=35 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:15:36.688010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:15:36.696921 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5b05-7b62-4332-bb0a-2aa4df940881 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:15:36.700704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:15:36.701323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:15:36.701605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:15:36.701903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:15:36.712070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:15:36.713493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:15:36.724770 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4487/8913] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:15:40.261044 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:15:40.271397 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec47647-7514-4976-b112-24df568c2ac7 service cinder] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:15:40.275017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2450-c2c8-4ac2-8e2f-26f4a2829247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:15:40.289052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2450-c2c8-4ac2-8e2f-26f4a2829247 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:15:40.289052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2450-c2c8-4ac2-8e2f-26f4a2829247 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:15:40.289052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2450-c2c8-4ac2-8e2f-26f4a2829247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:15:40.289052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab2450-c2c8-4ac2-8e2f-26f4a2829247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:15:40.289422 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab2450-c2c8-4ac2-8e2f-26f4a2829247 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:15:40.300353 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4427/8914] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:15:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:15:46.720146 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:15:50.295594 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:15:59.764725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:15:59.773706 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b710e9-7e6b-4668-b3d0-10ae90dd719f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:15:59.777318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:15:59.777970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:15:59.778254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:15:59.778526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:15:59.788179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:15:59.789598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:15:59.817088 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4488/8915] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:16:03.296565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e41400-7b0e-4c72-a30a-f9f4edcc60f8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:03.297088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e41400-7b0e-4c72-a30a-f9f4edcc60f8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:03.297088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e41400-7b0e-4c72-a30a-f9f4edcc60f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:03.328291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-67e41400-7b0e-4c72-a30a-f9f4edcc60f8 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:03.329646 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-67e41400-7b0e-4c72-a30a-f9f4edcc60f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:03.338682 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4428/8916] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:16:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:03.354160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:03.365631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a411ec-c9d5-42be-b611-7d37251fe89b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:03.370533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:03.371495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:03.371495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:03.371731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:03.380464 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:03.382070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:03.392235 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4489/8917] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:16:03.430622 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e41400-7b0e-4c72-a30a-f9f4edcc60f8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:03.443196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e41400-7b0e-4c72-a30a-f9f4edcc60f8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:03.448070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:03.448708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:03.448986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:03.449260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] PATH_INFO: `/v3/users/44eacb309fef43de8514215a66b50f8c` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:03.450417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44eacb309fef43de8514215a66b50f8c)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:03.452565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:03.647356 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44eacb309fef43de8514215a66b50f8c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:03.659355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44eacb309fef43de8514215a66b50f8c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:03.666140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44eacb309fef43de8514215a66b50f8c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:03.666866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44eacb309fef43de8514215a66b50f8c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:03.731060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e2dc1976-bdaf-4044-bc91-c30cb8d61b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44eacb309fef43de8514215a66b50f8c'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:03.738639 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4429/8918] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:16:03 2022] DELETE /identity/v3/users/44eacb309fef43de8514215a66b50f8c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:16:03.990522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:04.003645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df698c8-6481-44d8-835f-c34dbb38f0dd service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:04.064754 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:04.083040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.083040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.083040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] PATH_INFO: `/v3/projects/f1b964c67360498ab681bbd7c65380a8` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.083040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b964c67360498ab681bbd7c65380a8)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:04.083040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:04.176824 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b964c67360498ab681bbd7c65380a8', 'request_id': 'req-3e40ace5-13e8-400e-bbb9-b4286398af1d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:04.183063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b964c67360498ab681bbd7c65380a8', 'request_id': 'req-3e40ace5-13e8-400e-bbb9-b4286398af1d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:04.245323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b964c67360498ab681bbd7c65380a8', 'request_id': 'req-3e40ace5-13e8-400e-bbb9-b4286398af1d'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:04.269070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] The token cache is being invalidate because project f1b964c67360498ab681bbd7c65380a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:16:04.269361 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:04.270017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-3e40ace5-13e8-400e-bbb9-b4286398af1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:04.271505 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4490/8919] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:16:03 2022] DELETE /identity/v3/projects/f1b964c67360498ab681bbd7c65380a8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:16:04.276421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbdf0-c7e3-487c-a37f-12166f657ac7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.276706 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbdf0-c7e3-487c-a37f-12166f657ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.276978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debbdf0-c7e3-487c-a37f-12166f657ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.325909 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9debbdf0-c7e3-487c-a37f-12166f657ac7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:04.327648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9debbdf0-c7e3-487c-a37f-12166f657ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:04.393126 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4430/8920] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:04.401044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ebdd-70d6-4dad-8221-e3fe734e3138 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.401553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ebdd-70d6-4dad-8221-e3fe734e3138 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.407366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ebdd-70d6-4dad-8221-e3fe734e3138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.424222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7758ebdd-70d6-4dad-8221-e3fe734e3138 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:04.425451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7758ebdd-70d6-4dad-8221-e3fe734e3138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:04.433637 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4491/8921] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:16:04.438511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbdf0-c7e3-487c-a37f-12166f657ac7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:04.449022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debbdf0-c7e3-487c-a37f-12166f657ac7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:04.455168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:04.456659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.456948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.457225 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.457899 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:16:04.458206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:04.459818 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:04.472335 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4431/8922] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:16:04.476772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758ebdd-70d6-4dad-8221-e3fe734e3138 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:04.486946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758ebdd-70d6-4dad-8221-e3fe734e3138 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:04.492081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:04.493221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.493221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.493221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.493858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:04.496023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:04.611429 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:16:04.617825 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4492/8923] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:16:04 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:16:04.622253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:04.633157 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cc96a-3d70-4c26-95cc-14c73db07fd1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:04.652534 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:16:04.690951 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:04.691591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.691877 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.692153 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.692780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:04.694732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:04.792549 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4432/8924] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:16:04 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:16:04.797385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:04.808045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3a30-9135-4cf1-9aa7-44c17a7b8002 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:04.813102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:04.813701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.814103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.814402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.815045 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:04.816647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:04.827828 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4493/8925] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:16:04.831713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:04.841753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578351b9-b7e6-413d-831c-96701d862ba6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:04.847137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce8108-aa8a-4dbd-8a86-2ac0ffcad782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:04.847734 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8108-aa8a-4dbd-8a86-2ac0ffcad782 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.848017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8108-aa8a-4dbd-8a86-2ac0ffcad782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.848293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8108-aa8a-4dbd-8a86-2ac0ffcad782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.848932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce8108-aa8a-4dbd-8a86-2ac0ffcad782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:04.850556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce8108-aa8a-4dbd-8a86-2ac0ffcad782 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:04.861537 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4433/8926] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:16:04.865647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:04.875647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91795-62d1-450f-82d3-ad43c12d25cc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:04.880449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:04.881101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.881391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.881694 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] PATH_INFO: `/v3/projects/173343309ec64c8b8f57168959b81bfc/users/8ce87b2269a8420fbead1e13d7f1e46d/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.897385 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=173343309ec64c8b8f57168959b81bfc, user_id=8ce87b2269a8420fbead1e13d7f1e46d, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:04.900060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:04.970389 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4494/8927] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:16:04 2022] PUT /identity/v3/projects/173343309ec64c8b8f57168959b81bfc/users/8ce87b2269a8420fbead1e13d7f1e46d/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:16:04.975563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c618535-058c-4498-a302-78bf737515b7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:04.975853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c618535-058c-4498-a302-78bf737515b7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:04.976178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c618535-058c-4498-a302-78bf737515b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:04.995050 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0c618535-058c-4498-a302-78bf737515b7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:04.996253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0c618535-058c-4498-a302-78bf737515b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:05.055601 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4434/8928] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:05.066552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:05.068261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:05.126816 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a56841-8169-4998-a88c-362260330b1e admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:05.130467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b03d8-925e-4f64-ace3-f8c7e03dad6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:05.131066 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b03d8-925e-4f64-ace3-f8c7e03dad6b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:05.131345 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b03d8-925e-4f64-ace3-f8c7e03dad6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:05.131616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b03d8-925e-4f64-ace3-f8c7e03dad6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:05.141571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b03d8-925e-4f64-ace3-f8c7e03dad6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:05.143026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b03d8-925e-4f64-ace3-f8c7e03dad6b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:05.152450 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4495/8929] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:16:10.164372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:10.164882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:10.164988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:10.227009 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] MFA Rules not processed for user `8ce87b2269a8420fbead1e13d7f1e46d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:10.228338 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:10.309035 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4435/8930] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:10.311038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d430-8395-4886-9517-d18cd68da408 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:10.311603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d430-8395-4886-9517-d18cd68da408 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:10.311989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d430-8395-4886-9517-d18cd68da408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:10.332578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-d596d430-8395-4886-9517-d18cd68da408 None None] MFA Rules not processed for user `8ce87b2269a8420fbead1e13d7f1e46d`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:10.333958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d596d430-8395-4886-9517-d18cd68da408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:10.341023 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4496/8931] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:10.354850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:10.356415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:10.394246 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:16:10.438926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e3bf-fa0a-42e5-976c-79f89b862645 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:10.446095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:10.446749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:10.452302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:10.452302 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:10.456019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:10.457611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:10.470756 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4436/8932] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:16:14.729667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d430-8395-4886-9517-d18cd68da408 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:14.739359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596d430-8395-4886-9517-d18cd68da408 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:14.742896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:14.743489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:14.743768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:14.744038 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:14.745699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:14.754972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:14.756382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:14.765010 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4497/8933] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:16:15.486835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:15.489132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:15.508275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3002908-0423-40e2-9754-129a97ac59d4 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:15.516056 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530f58-f028-462f-8b49-93a1e7147ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:15.516751 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530f58-f028-462f-8b49-93a1e7147ec7 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:15.517102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530f58-f028-462f-8b49-93a1e7147ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:15.517467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530f58-f028-462f-8b49-93a1e7147ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:15.519523 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-27530f58-f028-462f-8b49-93a1e7147ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:15.540657 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530f58-f028-462f-8b49-93a1e7147ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:15.542281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530f58-f028-462f-8b49-93a1e7147ec7 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:15.553955 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4437/8934] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:16:21.227565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:21.241833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f335aa-105e-4491-87d4-b9dcdf4a7913 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:21.247357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:21.252897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:21.252897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:21.252897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:21.252897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:21.263063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:21.265571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:21.276242 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4498/8935] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:16:23.952298 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41934fcc-3f5c-4d85-b5e1-8cdb2cc4c99e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:23.952797 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41934fcc-3f5c-4d85-b5e1-8cdb2cc4c99e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:23.952918 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41934fcc-3f5c-4d85-b5e1-8cdb2cc4c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:23.972160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-41934fcc-3f5c-4d85-b5e1-8cdb2cc4c99e None None] MFA Rules not processed for user `8ce87b2269a8420fbead1e13d7f1e46d`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:23.973310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-41934fcc-3f5c-4d85-b5e1-8cdb2cc4c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:23.980290 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4438/8936] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:27.443425 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:27.453866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6051-f5d1-4d06-889f-69957425686b service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:27.459976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:27.459976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:27.459976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:27.459976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:27.462175 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:27.473899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:27.475757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:27.485655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4499/8937] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:16:33.966511 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=29 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:16:37.480906 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:16:49.050378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41934fcc-3f5c-4d85-b5e1-8cdb2cc4c99e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:49.062470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41934fcc-3f5c-4d85-b5e1-8cdb2cc4c99e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:49.070256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:49.071292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:49.071759 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:49.072209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] PATH_INFO: `/v3/users/8ce87b2269a8420fbead1e13d7f1e46d` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:49.074072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce87b2269a8420fbead1e13d7f1e46d)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:49.076102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:49.281587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce87b2269a8420fbead1e13d7f1e46d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.294238 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce87b2269a8420fbead1e13d7f1e46d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.301932 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce87b2269a8420fbead1e13d7f1e46d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.302654 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce87b2269a8420fbead1e13d7f1e46d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.387434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-da2a45e5-62ff-4b84-8185-93e4015e4e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce87b2269a8420fbead1e13d7f1e46d'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.394675 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4439/8938] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:16:49 2022] DELETE /identity/v3/users/8ce87b2269a8420fbead1e13d7f1e46d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:16:49.644954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:49.659532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668e775-f030-47b9-81d5-411a70e34001 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:49.721023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:49.721688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:49.722006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:49.722284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] PATH_INFO: `/v3/projects/173343309ec64c8b8f57168959b81bfc` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:49.723911 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=173343309ec64c8b8f57168959b81bfc)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:49.725914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:49.830092 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173343309ec64c8b8f57168959b81bfc', 'request_id': 'req-4c46cd5e-20ba-412f-8392-62a954ed5ded'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.836693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173343309ec64c8b8f57168959b81bfc', 'request_id': 'req-4c46cd5e-20ba-412f-8392-62a954ed5ded'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.907276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173343309ec64c8b8f57168959b81bfc', 'request_id': 'req-4c46cd5e-20ba-412f-8392-62a954ed5ded'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.918229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] The token cache is being invalidate because project 173343309ec64c8b8f57168959b81bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:16:49.918516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.919136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-4c46cd5e-20ba-412f-8392-62a954ed5ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:16:49.920619 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4500/8939] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:16:49 2022] DELETE /identity/v3/projects/173343309ec64c8b8f57168959b81bfc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:16:49.925864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f4ea-7d24-4068-a2ab-1a45ca2d0e8e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:49.926150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f4ea-7d24-4068-a2ab-1a45ca2d0e8e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:49.926434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f4ea-7d24-4068-a2ab-1a45ca2d0e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:49.947717 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3762f4ea-7d24-4068-a2ab-1a45ca2d0e8e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:49.948929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3762f4ea-7d24-4068-a2ab-1a45ca2d0e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:50.007470 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4440/8940] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:50.017443 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52912c9-b6c3-4287-a738-3c097f60fdc5 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.017728 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52912c9-b6c3-4287-a738-3c097f60fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.018029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52912c9-b6c3-4287-a738-3c097f60fdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.038052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b52912c9-b6c3-4287-a738-3c097f60fdc5 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:50.039240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b52912c9-b6c3-4287-a738-3c097f60fdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:50.048217 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4501/8941] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:50.052429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f4ea-7d24-4068-a2ab-1a45ca2d0e8e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:50.062352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f4ea-7d24-4068-a2ab-1a45ca2d0e8e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:50.067042 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:50.067675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.068142 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.068415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.069064 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:16:50.069369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:50.070994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:50.083197 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4441/8942] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:16:50.087461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52912c9-b6c3-4287-a738-3c097f60fdc5 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:50.097724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52912c9-b6c3-4287-a738-3c097f60fdc5 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:50.102605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:50.103235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.103518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.103823 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.104462 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:50.106446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:50.194840 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4502/8943] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:16:50 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:16:50.198780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:50.209350 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3600a-3cc8-4b99-be59-832dc7aafe8e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:50.263786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:50.264393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.264674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.265567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.266183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:50.268088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:50.275855 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:16:50.353032 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4442/8944] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:16:50 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:16:50.357052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:50.368303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be917e-9b54-43cd-8a08-6751fd01d2cb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:50.373056 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:50.373713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.374095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.375070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.375715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:50.377316 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:50.388187 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4503/8945] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 02:16:50.392548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:50.402609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa78637-cf6c-4a9c-a27b-dfe5acf42d21 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:50.407254 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6473-9ca5-4d1d-ae59-2f3754511128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:50.407869 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6473-9ca5-4d1d-ae59-2f3754511128 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.408159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6473-9ca5-4d1d-ae59-2f3754511128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.408431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6473-9ca5-4d1d-ae59-2f3754511128 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.409276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6473-9ca5-4d1d-ae59-2f3754511128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:50.411496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6473-9ca5-4d1d-ae59-2f3754511128 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:50.423653 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4443/8946] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:16:50.427451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:50.438557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c0054-0d1b-42da-830f-71256f2d46f9 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:50.443244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:50.443888 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.444171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.444447 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] PATH_INFO: `/v3/projects/a1fcd1b6d9ed41fe9b9c66411f0a2f6f/users/18f519c7d6374973a7e3739629dc9635/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.459229 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fcd1b6d9ed41fe9b9c66411f0a2f6f, user_id=18f519c7d6374973a7e3739629dc9635, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:50.461967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:50.558797 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4504/8947] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:16:50 2022] PUT /identity/v3/projects/a1fcd1b6d9ed41fe9b9c66411f0a2f6f/users/18f519c7d6374973a7e3739629dc9635/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:16:50.569509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4d9f-651d-4924-a3ab-3c2af3beb99c None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.569802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4d9f-651d-4924-a3ab-3c2af3beb99c None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.570116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4d9f-651d-4924-a3ab-3c2af3beb99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.598794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f86c4d9f-651d-4924-a3ab-3c2af3beb99c None None] MFA Rules not processed for user `18f519c7d6374973a7e3739629dc9635`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:16:50.600011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f86c4d9f-651d-4924-a3ab-3c2af3beb99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:50.665922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4444/8948] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:16:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:16:50.676658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:16:50.678440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:16:50.710443 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:16:50.737163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf601f9-d8e1-409b-a53d-dfc7a4fb265d admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:16:50.741064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:16:50.741837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:16:50.742493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:16:50.742814 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:16:50.752129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:16:50.753564 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:16:50.762545 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4505/8949] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:16:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:00.662954 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:00.798548 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=14 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:08.870530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50645-4cfc-45f6-b3b3-cfe5f46ed54b None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:08.871013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50645-4cfc-45f6-b3b3-cfe5f46ed54b None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:08.871295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50645-4cfc-45f6-b3b3-cfe5f46ed54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:08.891755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-f5a50645-4cfc-45f6-b3b3-cfe5f46ed54b None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:08.893030 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f5a50645-4cfc-45f6-b3b3-cfe5f46ed54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:08.959015 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4445/8950] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:17:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:08.970101 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:08.972107 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:08.986432 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5369e7-4bf0-4ebe-9584-f7ab5083f54d service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:08.991313 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d4f2b-e8d7-478e-b626-17ea65c99a1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:08.991912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4f2b-e8d7-478e-b626-17ea65c99a1a service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:08.992193 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4f2b-e8d7-478e-b626-17ea65c99a1a service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:08.992469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4f2b-e8d7-478e-b626-17ea65c99a1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:09.002635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d4f2b-e8d7-478e-b626-17ea65c99a1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:09.004170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d4f2b-e8d7-478e-b626-17ea65c99a1a service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:09.006417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a50645-4cfc-45f6-b3b3-cfe5f46ed54b None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:09.015538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4506/8951] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:09.074393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a50645-4cfc-45f6-b3b3-cfe5f46ed54b None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:09.079597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:09.080228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:09.080509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:09.080785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] PATH_INFO: `/v3/users/18f519c7d6374973a7e3739629dc9635` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:09.081959 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f519c7d6374973a7e3739629dc9635)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:09.083866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:09.281145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f519c7d6374973a7e3739629dc9635'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.293856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f519c7d6374973a7e3739629dc9635'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.302214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f519c7d6374973a7e3739629dc9635'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.302994 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f519c7d6374973a7e3739629dc9635'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.386852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f519c7d6374973a7e3739629dc9635'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.394169 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4446/8952] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:17:09 2022] DELETE /identity/v3/users/18f519c7d6374973a7e3739629dc9635 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:17:09.399029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:09.399029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:09.399280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:09.418968 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:09.420192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:09.483773 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4507/8953] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:09.494007 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:09.495432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:09.514371 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:09.555055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517cdd2-b167-4094-a47c-6f66bba80c5e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:09.558709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13d873-979c-46d8-be13-d9d2a87c5d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:09.559323 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d873-979c-46d8-be13-d9d2a87c5d21 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:09.559607 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d873-979c-46d8-be13-d9d2a87c5d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:09.559885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13d873-979c-46d8-be13-d9d2a87c5d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:09.570067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d873-979c-46d8-be13-d9d2a87c5d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:09.573222 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13d873-979c-46d8-be13-d9d2a87c5d21 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:09.582188 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4447/8954] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:09.815012 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:09.816725 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:09.830351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5a1ff-33b5-4c74-9c51-bb866d250f58 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:09.836836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:09.837680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:09.838003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:09.838289 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] PATH_INFO: `/v3/projects/a1fcd1b6d9ed41fe9b9c66411f0a2f6f` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:09.839624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fcd1b6d9ed41fe9b9c66411f0a2f6f)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:09.841636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:09.936620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fcd1b6d9ed41fe9b9c66411f0a2f6f', 'request_id': 'req-8a1559db-95e3-4693-a2f6-cf89b8daf881'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.943312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fcd1b6d9ed41fe9b9c66411f0a2f6f', 'request_id': 'req-8a1559db-95e3-4693-a2f6-cf89b8daf881'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.986691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fcd1b6d9ed41fe9b9c66411f0a2f6f', 'request_id': 'req-8a1559db-95e3-4693-a2f6-cf89b8daf881'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.997305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] The token cache is being invalidate because project a1fcd1b6d9ed41fe9b9c66411f0a2f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:17:09.997605 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.998253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-8a1559db-95e3-4693-a2f6-cf89b8daf881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:09.999745 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4508/8955] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:17:09 2022] DELETE /identity/v3/projects/a1fcd1b6d9ed41fe9b9c66411f0a2f6f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:17:10.005270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754382d-ca69-4280-8a18-65d52001f3fd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.005748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754382d-ca69-4280-8a18-65d52001f3fd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.005894 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754382d-ca69-4280-8a18-65d52001f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.026121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6754382d-ca69-4280-8a18-65d52001f3fd None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:10.027370 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6754382d-ca69-4280-8a18-65d52001f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:10.088297 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4448/8956] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:10.096513 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91456f0d-98e4-4d0f-a9f5-f04f23907d6c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.096804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91456f0d-98e4-4d0f-a9f5-f04f23907d6c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.097084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91456f0d-98e4-4d0f-a9f5-f04f23907d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.116983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-91456f0d-98e4-4d0f-a9f5-f04f23907d6c None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:10.118218 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-91456f0d-98e4-4d0f-a9f5-f04f23907d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:10.126151 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4509/8957] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:10.130324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754382d-ca69-4280-8a18-65d52001f3fd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:10.140429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754382d-ca69-4280-8a18-65d52001f3fd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:10.145584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:10.146221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.146500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.146776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.147430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:17:10.147730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:10.149305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:10.161499 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4449/8958] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:17:10.165800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91456f0d-98e4-4d0f-a9f5-f04f23907d6c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:10.175268 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91456f0d-98e4-4d0f-a9f5-f04f23907d6c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:10.179963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:10.180560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.180840 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.181118 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.181757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:10.183765 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:10.279269 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4510/8959] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:17:10 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:17:10.284117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:10.294137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ba430-ae41-44a4-9a80-2df50148f10c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:10.349861 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:10.350375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.350663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.350943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.351574 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:10.353481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:10.434454 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4450/8960] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:17:10 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:17:10.438614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:10.449276 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226ff9-a3f5-4364-83c9-31a681129dc3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:10.454994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:10.455587 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.455865 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.456156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.456786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:10.458423 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:10.468665 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4511/8961] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:17:10.472983 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:10.483015 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c27edf-9d66-4161-8aff-b332f726500a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:10.487755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874167a-6d40-45fe-b9a2-822b6cd6ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:10.491798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874167a-6d40-45fe-b9a2-822b6cd6ace9 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.491798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874167a-6d40-45fe-b9a2-822b6cd6ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.491798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874167a-6d40-45fe-b9a2-822b6cd6ace9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.491798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874167a-6d40-45fe-b9a2-822b6cd6ace9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:10.491798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874167a-6d40-45fe-b9a2-822b6cd6ace9 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:10.502709 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4451/8962] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:17:10.507050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:10.518322 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764b7fc-ea59-4c26-9741-b57d9f2cecfb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:10.522991 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:10.523615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.523940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.524244 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] PATH_INFO: `/v3/projects/128de7fe09f0478eb272ea63bb2427cd/users/7761113663d74f6d93be407d2cb6ea50/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.538942 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128de7fe09f0478eb272ea63bb2427cd, user_id=7761113663d74f6d93be407d2cb6ea50, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:10.541619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:10.614295 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4512/8963] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:17:10 2022] PUT /identity/v3/projects/128de7fe09f0478eb272ea63bb2427cd/users/7761113663d74f6d93be407d2cb6ea50/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:17:10.624266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c32f33-70ba-47a8-8ad9-2151f6a60faa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.624585 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c32f33-70ba-47a8-8ad9-2151f6a60faa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.624866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c32f33-70ba-47a8-8ad9-2151f6a60faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.654178 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b4c32f33-70ba-47a8-8ad9-2151f6a60faa None None] MFA Rules not processed for user `7761113663d74f6d93be407d2cb6ea50`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:10.655401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b4c32f33-70ba-47a8-8ad9-2151f6a60faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:10.667361 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:10.721589 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4452/8964] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:10.731770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:10.733494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:10.743579 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:10.792687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed16a9-8e7d-4d6b-98e9-97c97ff44b92 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:10.796832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea99f7-e425-4356-962e-ae471961a851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:10.798033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea99f7-e425-4356-962e-ae471961a851 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:10.798351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea99f7-e425-4356-962e-ae471961a851 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:10.798627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea99f7-e425-4356-962e-ae471961a851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:10.807087 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea99f7-e425-4356-962e-ae471961a851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:10.808534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea99f7-e425-4356-962e-ae471961a851 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:10.818289 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4513/8965] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:16.947892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c32f33-70ba-47a8-8ad9-2151f6a60faa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:17.011902 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c32f33-70ba-47a8-8ad9-2151f6a60faa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:17.016880 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:17.017511 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:17.017795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:17.018116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] PATH_INFO: `/v3/users/7761113663d74f6d93be407d2cb6ea50` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:17.019221 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7761113663d74f6d93be407d2cb6ea50)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:17.021231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:17.160517 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7761113663d74f6d93be407d2cb6ea50'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.173041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7761113663d74f6d93be407d2cb6ea50'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.179908 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7761113663d74f6d93be407d2cb6ea50'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.180593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7761113663d74f6d93be407d2cb6ea50'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.220452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7761113663d74f6d93be407d2cb6ea50'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.226452 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4453/8966] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:17:16 2022] DELETE /identity/v3/users/7761113663d74f6d93be407d2cb6ea50 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:17:17.230975 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:17.232013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:17.232013 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:17.251989 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:17.253186 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:17.313388 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4514/8967] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:17.323191 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:17.324592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:17.360748 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:17.382545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2699c-10b5-4d45-8145-d3bc0fd16376 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:17.386467 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6356e-c5be-45f0-aeac-71754919f071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:17.387090 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6356e-c5be-45f0-aeac-71754919f071 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:17.387559 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6356e-c5be-45f0-aeac-71754919f071 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:17.387885 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6356e-c5be-45f0-aeac-71754919f071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:17.397645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6356e-c5be-45f0-aeac-71754919f071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:17.399188 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6356e-c5be-45f0-aeac-71754919f071 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:17.411073 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4454/8968] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:17.730504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:17.731933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:17.747768 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4886-90cc-4010-b960-508a032bc42a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:17.754071 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:17.754721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:17.755007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:17.755284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] PATH_INFO: `/v3/projects/128de7fe09f0478eb272ea63bb2427cd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:17.756627 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128de7fe09f0478eb272ea63bb2427cd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:17.758595 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:17.879524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128de7fe09f0478eb272ea63bb2427cd', 'request_id': 'req-ebb83452-1922-4f31-9129-01aefeef1287'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.885779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128de7fe09f0478eb272ea63bb2427cd', 'request_id': 'req-ebb83452-1922-4f31-9129-01aefeef1287'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.963811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128de7fe09f0478eb272ea63bb2427cd', 'request_id': 'req-ebb83452-1922-4f31-9129-01aefeef1287'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.981324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] The token cache is being invalidate because project 128de7fe09f0478eb272ea63bb2427cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:17:17.981324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.981324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-ebb83452-1922-4f31-9129-01aefeef1287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:17:17.981324 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4515/8969] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:17:17 2022] DELETE /identity/v3/projects/128de7fe09f0478eb272ea63bb2427cd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:17:17.983777 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3012-c83a-43b7-b91e-1d86f071ce9f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:17.984311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3012-c83a-43b7-b91e-1d86f071ce9f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:17.984311 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3012-c83a-43b7-b91e-1d86f071ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.004652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0dae3012-c83a-43b7-b91e-1d86f071ce9f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:18.005887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0dae3012-c83a-43b7-b91e-1d86f071ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:18.065818 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4455/8970] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:18.074682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae10ded-7a27-4754-8a1d-939e9645812d None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.074970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae10ded-7a27-4754-8a1d-939e9645812d None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.075245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae10ded-7a27-4754-8a1d-939e9645812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.095890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dae10ded-7a27-4754-8a1d-939e9645812d None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:18.097104 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dae10ded-7a27-4754-8a1d-939e9645812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:18.104928 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4516/8971] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:18.109068 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae3012-c83a-43b7-b91e-1d86f071ce9f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:18.119126 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae3012-c83a-43b7-b91e-1d86f071ce9f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:18.123756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:18.124363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.124651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.125454 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.126166 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:17:18.126475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:18.128061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:18.139922 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4456/8972] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:17:18.144794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae10ded-7a27-4754-8a1d-939e9645812d None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:18.154164 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae10ded-7a27-4754-8a1d-939e9645812d None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:18.159181 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:18.159771 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.160053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.160326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.160969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:18.162914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:18.237056 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4517/8973] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:17:18 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:17:18.238470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:18.248712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fc4ad-9d8c-4b21-9d09-55fa9c812745 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:18.306143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:18.306748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.307033 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.307314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.307937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:18.309931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:18.386979 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4457/8974] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:17:18 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:17:18.391450 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:18.398303 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:18.402127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa88fb-9906-4174-9b2c-c104e08656aa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:18.407416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:18.408183 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.408393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.408670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.409318 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:18.410963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:18.421606 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4518/8975] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:17:18.426470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:18.436710 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8d64-7cab-4472-8f59-19f453fa5f86 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:18.442146 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a48cf-e91d-4630-8429-e7c568833976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:18.442757 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a48cf-e91d-4630-8429-e7c568833976 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.443048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a48cf-e91d-4630-8429-e7c568833976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.443326 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a48cf-e91d-4630-8429-e7c568833976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.443998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a48cf-e91d-4630-8429-e7c568833976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:18.445631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a48cf-e91d-4630-8429-e7c568833976 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:18.456811 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4458/8976] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:17:18.460905 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:18.471655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bace1de-412c-402b-8410-65b21f91ef40 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:18.476240 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:18.476883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.477157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.477429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] PATH_INFO: `/v3/projects/20e9bb9c1fae4558ab0ad596f682ff10/users/e5d7f0db5bd140bfaf909a0e60504d33/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.492542 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e9bb9c1fae4558ab0ad596f682ff10, user_id=e5d7f0db5bd140bfaf909a0e60504d33, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:18.495320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:18.570249 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4519/8977] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:17:18 2022] PUT /identity/v3/projects/20e9bb9c1fae4558ab0ad596f682ff10/users/e5d7f0db5bd140bfaf909a0e60504d33/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:17:18.575318 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc125-f808-4984-befa-d52ac6c28ece None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.575606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc125-f808-4984-befa-d52ac6c28ece None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.575884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc125-f808-4984-befa-d52ac6c28ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.596011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e78cc125-f808-4984-befa-d52ac6c28ece None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:18.597224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e78cc125-f808-4984-befa-d52ac6c28ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:18.636265 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:18.657518 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4459/8978] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:18.667334 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:18.669033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:18.726570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d868-136c-41e7-a07d-a69fff3cea62 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:18.730282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:18.730884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:18.731231 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:18.731515 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:18.741381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:18.742899 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:18.753239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4520/8979] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:23.916295 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d91f67-1d7b-41d7-9e4d-4787ce1f41b2 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:23.916756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d91f67-1d7b-41d7-9e4d-4787ce1f41b2 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:23.916940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d91f67-1d7b-41d7-9e4d-4787ce1f41b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:23.951884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-e1d91f67-1d7b-41d7-9e4d-4787ce1f41b2 None None] MFA Rules not processed for user `e5d7f0db5bd140bfaf909a0e60504d33`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:23.954703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e1d91f67-1d7b-41d7-9e4d-4787ce1f41b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:24.029120 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4460/8980] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:24.033994 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:24.044775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199543e2-faa9-4e6f-ad5b-02c970c9f34f service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:24.049791 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:24.050593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:24.050882 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:24.051495 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:24.051798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:24.054003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:24.127916 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4521/8981] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:17:24 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:17:24.132644 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d91f67-1d7b-41d7-9e4d-4787ce1f41b2 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:24.147261 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d91f67-1d7b-41d7-9e4d-4787ce1f41b2 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:24.215095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:24.215732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:24.216072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:24.216486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:24.217162 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:24.220290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:24.313129 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4461/8982] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:17:24 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:17:24.317115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:24.327810 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c728043-a9d7-45cb-ae6d-25ec0a073782 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:24.333152 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:24.333839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:24.334132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:24.334407 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:24.335064 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:24.336715 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:24.348940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4522/8983] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 02:17:24.353307 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:24.363938 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016cad-1330-4c07-8867-b448341328d0 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:24.368621 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:24.369271 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:24.369553 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:24.369858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] PATH_INFO: `/v3/projects/89520de701af41969e35a0aee33fd2c4/users/4bc83b174e894bcdb18f38d3994fe860/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:24.384705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89520de701af41969e35a0aee33fd2c4, user_id=4bc83b174e894bcdb18f38d3994fe860, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:24.387378 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:24.465887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4462/8984] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:17:24 2022] PUT /identity/v3/projects/89520de701af41969e35a0aee33fd2c4/users/4bc83b174e894bcdb18f38d3994fe860/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:17:24.470757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:24.480903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644292-3fb9-45ea-9cca-863657f3f52b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:24.540489 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d56a40-54ac-45e8-8684-1145f1e644df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:24.541114 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d56a40-54ac-45e8-8684-1145f1e644df admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:24.541381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d56a40-54ac-45e8-8684-1145f1e644df admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:24.541654 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d56a40-54ac-45e8-8684-1145f1e644df admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:24.542329 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d56a40-54ac-45e8-8684-1145f1e644df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:24.543925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d56a40-54ac-45e8-8684-1145f1e644df admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:24.554419 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4523/8985] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:17:24.558737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:24.569799 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe76e-d9fb-4b67-9569-485c2ec90349 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:24.574486 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:24.575137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:24.575421 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:24.575699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] PATH_INFO: `/v3/projects/89520de701af41969e35a0aee33fd2c4/users/4bc83b174e894bcdb18f38d3994fe860/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:24.577615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89520de701af41969e35a0aee33fd2c4, user_id=4bc83b174e894bcdb18f38d3994fe860, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:24.580925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:24.591266 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4463/8986] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:17:24 2022] PUT /identity/v3/projects/89520de701af41969e35a0aee33fd2c4/users/4bc83b174e894bcdb18f38d3994fe860/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:17:30.317718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6fe3-10d1-4c47-a242-d992564783cc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:30.318783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6fe3-10d1-4c47-a242-d992564783cc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:30.319305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6fe3-10d1-4c47-a242-d992564783cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:30.350615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-ef2a6fe3-10d1-4c47-a242-d992564783cc None None] MFA Rules not processed for user `4bc83b174e894bcdb18f38d3994fe860`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:30.353714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ef2a6fe3-10d1-4c47-a242-d992564783cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:30.390896 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:30.448114 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4524/8987] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:30.465324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:30.467321 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:30.505191 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:30.556110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fbe19-8bff-42c1-abfa-ed71068f8b0c admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:30.562879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:30.564810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:30.564810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:30.564810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:30.624536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:30.626268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:30.635464 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4464/8988] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:30.769577 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:30.769902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:30.770188 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:30.789197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] MFA Rules not processed for user `e5d7f0db5bd140bfaf909a0e60504d33`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:30.790421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:30.797282 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4525/8989] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:17:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:17:31.070669 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:31.126609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2732d-376b-49e6-819b-e7bc6359f213 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:31.130173 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4f07e-4fdb-4fd0-b296-afe9c5148342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:31.130807 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4f07e-4fdb-4fd0-b296-afe9c5148342 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:31.131065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4f07e-4fdb-4fd0-b296-afe9c5148342 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:31.131341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4f07e-4fdb-4fd0-b296-afe9c5148342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:31.133220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9bb4f07e-4fdb-4fd0-b296-afe9c5148342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:31.143992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4f07e-4fdb-4fd0-b296-afe9c5148342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:31.145430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4f07e-4fdb-4fd0-b296-afe9c5148342 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:31.153231 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4465/8990] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:31.598570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:31.600123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:31.682282 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c062d5-c595-4c0c-b5a4-3d36cb67e36e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:31.689668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:31.690624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:31.690910 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:31.691191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:31.692976 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:31.705351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:31.706999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:31.717081 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4526/8991] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:41.149842 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=71 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:41.712903 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=53 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:44.677317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b69b-43cc-40dc-9801-51dac3059acf None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:44.677782 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b69b-43cc-40dc-9801-51dac3059acf None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:44.677989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904b69b-43cc-40dc-9801-51dac3059acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:44.715784 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6904b69b-43cc-40dc-9801-51dac3059acf None None] MFA Rules not processed for user `10fe5abbf8c24c3882d8ad3addd241b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:17:44.717003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6904b69b-43cc-40dc-9801-51dac3059acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:17:44.768943 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4466/8992] 10.222.0.59 () {58 vars in 1061 bytes} [Sun Aug 28 02:17:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:17:44.774819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:17:44.784115 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066cf1d-6332-4dc5-842f-ccab46b779e5 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:17:44.787645 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fe5abbf8c24c3882d8ad3addd241b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:17:44.788239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:17:44.788518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:17:44.788794 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:17:44.798235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:17:44.799657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:17:44.809193 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4527/8993] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:17:44 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:17:54.762801 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=29 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:17:54.804920 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:18:13.674924 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a18c7-658d-48df-817f-1e6243d22a61 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:18:13.676975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a18c7-658d-48df-817f-1e6243d22a61 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:18:13.676975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a18c7-658d-48df-817f-1e6243d22a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:18:13.698888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6b7a18c7-658d-48df-817f-1e6243d22a61 None None] MFA Rules not processed for user `e5d7f0db5bd140bfaf909a0e60504d33`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:18:13.700095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6b7a18c7-658d-48df-817f-1e6243d22a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:18:13.707072 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4467/8994] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:18:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:18:14.373305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:18:14.385364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66b81-a8db-4b11-909f-d944653b93b5 service cinder] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:18:14.390701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:18:14.391421 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:18:14.391707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:18:14.391986 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:18:14.393723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:18:14.413195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:18:14.414918 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:18:14.425830 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4528/8995] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:18:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:18:23.691318 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:18:24.422084 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:18:36.577366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a18c7-658d-48df-817f-1e6243d22a61 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:18:36.589694 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a18c7-658d-48df-817f-1e6243d22a61 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:18:36.594736 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999d830-a2a2-41cd-8876-01318eabdc9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:18:36.595276 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d830-a2a2-41cd-8876-01318eabdc9a service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:18:36.595560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d830-a2a2-41cd-8876-01318eabdc9a service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:18:36.595836 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d830-a2a2-41cd-8876-01318eabdc9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:18:36.597540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d999d830-a2a2-41cd-8876-01318eabdc9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:18:36.610128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999d830-a2a2-41cd-8876-01318eabdc9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:18:36.611708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999d830-a2a2-41cd-8876-01318eabdc9a service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:18:36.623748 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4468/8996] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:18:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:18:46.620018 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:18:51.354504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:18:51.360127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:18:51.371065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788dc3-d5d4-46c8-8468-2a5f42861082 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:18:51.376412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:18:51.377049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:18:51.377373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:18:51.378192 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:18:51.379504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:18:51.393610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:18:51.395300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:18:51.410645 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4529/8997] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:18:56.354233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68049-0ac7-465e-a618-cc811a93851e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:18:56.354779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68049-0ac7-465e-a618-cc811a93851e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:18:56.354879 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68049-0ac7-465e-a618-cc811a93851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:18:56.373592 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-35d68049-0ac7-465e-a618-cc811a93851e None None] MFA Rules not processed for user `e5d7f0db5bd140bfaf909a0e60504d33`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:18:56.374841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-35d68049-0ac7-465e-a618-cc811a93851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:18:56.381575 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4469/8998] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:18:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:19:01.401538 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:19:06.368502 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:19:45.061651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:45.126559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc1b00-c95d-4866-b1cc-e2b22b37c161 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:45.131037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:45.131661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:45.131946 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:45.132222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] PATH_INFO: `/v3/users/e5d7f0db5bd140bfaf909a0e60504d33` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:45.133338 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d7f0db5bd140bfaf909a0e60504d33)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:45.135299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:45.323040 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d7f0db5bd140bfaf909a0e60504d33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:45.323703 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d7f0db5bd140bfaf909a0e60504d33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:45.401167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d7f0db5bd140bfaf909a0e60504d33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:45.415761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d7f0db5bd140bfaf909a0e60504d33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:45.416518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d7f0db5bd140bfaf909a0e60504d33'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:45.436536 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4530/8999] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:19:45 2022] DELETE /identity/v3/users/e5d7f0db5bd140bfaf909a0e60504d33 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:19:45.699720 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68049-0ac7-465e-a618-cc811a93851e None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:45.728182 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68049-0ac7-465e-a618-cc811a93851e None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:45.791972 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:45.792640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:45.792926 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:45.793480 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] PATH_INFO: `/v3/projects/20e9bb9c1fae4558ab0ad596f682ff10` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:45.794653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e9bb9c1fae4558ab0ad596f682ff10)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:45.797194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:45.904727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e9bb9c1fae4558ab0ad596f682ff10', 'request_id': 'req-13b15102-2d49-44ae-9325-40a895d23248'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:45.912407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e9bb9c1fae4558ab0ad596f682ff10', 'request_id': 'req-13b15102-2d49-44ae-9325-40a895d23248'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.018352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e9bb9c1fae4558ab0ad596f682ff10', 'request_id': 'req-13b15102-2d49-44ae-9325-40a895d23248'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.031171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] The token cache is being invalidate because project 20e9bb9c1fae4558ab0ad596f682ff10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:19:46.031358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.032092 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.033716 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4470/9000] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:19:45 2022] DELETE /identity/v3/projects/20e9bb9c1fae4558ab0ad596f682ff10 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:19:46.037698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:46.039153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:46.053635 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0f4aa-d9b6-43c9-82ed-53dc7717c935 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:46.116755 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:46.117445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:46.117670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:46.118052 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] PATH_INFO: `/v3/users/4bc83b174e894bcdb18f38d3994fe860` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:46.119210 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc83b174e894bcdb18f38d3994fe860)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:46.121150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:46.145501 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:19:46.311063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc83b174e894bcdb18f38d3994fe860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.311800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc83b174e894bcdb18f38d3994fe860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.382559 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc83b174e894bcdb18f38d3994fe860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.391574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc83b174e894bcdb18f38d3994fe860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.392233 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-1e7b2284-7e7e-4e1a-b5c7-fe3357a7d4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc83b174e894bcdb18f38d3994fe860'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.410694 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4531/9001] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:19:46 2022] DELETE /identity/v3/users/4bc83b174e894bcdb18f38d3994fe860 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:19:46.692999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:46.694114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:46.710299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15102-2d49-44ae-9325-40a895d23248 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:46.768950 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:46.769586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:46.769897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:46.770171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] PATH_INFO: `/v3/projects/89520de701af41969e35a0aee33fd2c4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:46.771285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89520de701af41969e35a0aee33fd2c4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:46.773156 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:46.856355 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:19:46.868216 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89520de701af41969e35a0aee33fd2c4', 'request_id': 'req-a3caf90b-2c3e-448d-8b78-e3161c2a5271'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.873761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89520de701af41969e35a0aee33fd2c4', 'request_id': 'req-a3caf90b-2c3e-448d-8b78-e3161c2a5271'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.972313 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89520de701af41969e35a0aee33fd2c4', 'request_id': 'req-a3caf90b-2c3e-448d-8b78-e3161c2a5271'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.985019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] The token cache is being invalidate because project 89520de701af41969e35a0aee33fd2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:19:46.985362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.986031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-a3caf90b-2c3e-448d-8b78-e3161c2a5271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:19:46.987525 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4471/9002] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:19:46 2022] DELETE /identity/v3/projects/89520de701af41969e35a0aee33fd2c4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:19:46.992470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a95301-edc9-4afe-a1cb-c3c6942a9cb7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:46.992763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a95301-edc9-4afe-a1cb-c3c6942a9cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:46.993041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a95301-edc9-4afe-a1cb-c3c6942a9cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.013148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-80a95301-edc9-4afe-a1cb-c3c6942a9cb7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:19:47.016347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-80a95301-edc9-4afe-a1cb-c3c6942a9cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:47.074092 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4532/9003] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:19:47.082404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e8af-2876-414a-81d6-4725bfcb5868 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.082691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e8af-2876-414a-81d6-4725bfcb5868 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.082964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e8af-2876-414a-81d6-4725bfcb5868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.102714 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2302e8af-2876-414a-81d6-4725bfcb5868 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:19:47.103904 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2302e8af-2876-414a-81d6-4725bfcb5868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:47.112071 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4472/9004] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:19:47.116130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a95301-edc9-4afe-a1cb-c3c6942a9cb7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:47.126847 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a95301-edc9-4afe-a1cb-c3c6942a9cb7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:47.131549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:47.132156 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.132436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.132713 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.133363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:19:47.133666 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:47.135311 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:47.148666 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4533/9005] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:19:47.152978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e8af-2876-414a-81d6-4725bfcb5868 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:47.162505 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e8af-2876-414a-81d6-4725bfcb5868 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:47.171525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:47.171525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.171525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.171525 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.171935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:47.171935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:47.247565 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4473/9006] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:19:47 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:19:47.252799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:47.263459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e71433-4ce7-4800-a988-2d1c8f818716 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:47.321437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:47.322061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.322344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.322614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.323237 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:47.325155 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:47.413701 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4534/9007] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:19:47 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:19:47.417856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:47.429003 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a3ce-a88b-4152-97a5-4c04ff188241 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:47.433788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:47.434490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.434773 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.435052 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.435729 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:47.438398 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:47.448986 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4474/9008] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:19:47.454061 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:47.464362 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b955e-e2fd-412b-82be-8b1699f679fc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:47.469287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b58919-6086-4037-ab9c-fc49dde0c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:47.469925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58919-6086-4037-ab9c-fc49dde0c395 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.470207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58919-6086-4037-ab9c-fc49dde0c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.470481 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b58919-6086-4037-ab9c-fc49dde0c395 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.471126 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58919-6086-4037-ab9c-fc49dde0c395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:47.472718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b58919-6086-4037-ab9c-fc49dde0c395 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:47.484553 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4535/9009] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:19:47.488915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:47.499606 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408877-dc5e-467d-8021-87604d24d9f5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:47.504256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:47.504905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.505187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.505464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] PATH_INFO: `/v3/projects/d8da6126aa0c4da2b1c61e6d1f1eb5b6/users/6794190dda144da1af58242ac4970916/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.520449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8da6126aa0c4da2b1c61e6d1f1eb5b6, user_id=6794190dda144da1af58242ac4970916, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:47.523135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:47.589869 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4475/9010] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:19:47 2022] PUT /identity/v3/projects/d8da6126aa0c4da2b1c61e6d1f1eb5b6/users/6794190dda144da1af58242ac4970916/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:19:47.595082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70281d9-b071-4d6f-b821-9ffc2b8c75de None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.595374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70281d9-b071-4d6f-b821-9ffc2b8c75de None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.595651 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70281d9-b071-4d6f-b821-9ffc2b8c75de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.604003 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:19:47.615428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e70281d9-b071-4d6f-b821-9ffc2b8c75de None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:19:47.616648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e70281d9-b071-4d6f-b821-9ffc2b8c75de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:47.677006 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4536/9011] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:19:47.687205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:47.689013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:47.746858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec98f2-e59f-42d2-8c60-6082a8a64ea8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:47.751659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:47.752303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:47.752588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:47.752872 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:47.763239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:47.765602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:47.775106 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4476/9012] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:19:53.190522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437444-387b-451a-b28a-04cab27ace7e None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:53.191047 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437444-387b-451a-b28a-04cab27ace7e None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:53.191132 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437444-387b-451a-b28a-04cab27ace7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:53.225941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c8437444-387b-451a-b28a-04cab27ace7e None None] MFA Rules not processed for user `6794190dda144da1af58242ac4970916`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:19:53.227195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c8437444-387b-451a-b28a-04cab27ace7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:53.308441 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4537/9013] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:19:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:19:53.313566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:53.323715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25450eb-be93-4f52-b5b5-9ad33766e50d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:53.329401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:53.330269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:53.330557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:53.330889 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:53.331727 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:53.333453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:53.460154 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4477/9014] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:19:53 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:19:53.461384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437444-387b-451a-b28a-04cab27ace7e None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:53.475615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437444-387b-451a-b28a-04cab27ace7e None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:53.540254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:53.540857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:53.541136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:53.541408 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:53.542068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:53.543978 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:53.646178 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4538/9015] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:19:53 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:19:53.650214 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:53.661445 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f08a-a2f8-4993-a45c-ea94c5c10056 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:53.668037 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:53.669076 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:53.669599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:53.670163 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:53.671794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:53.674874 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:53.689414 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4478/9016] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:19:53.693648 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:53.705176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75c4d-959c-46bd-bd37-5f5293c5daaa admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:53.709970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:53.710628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:53.710913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:53.711607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] PATH_INFO: `/v3/projects/a19d53ff8e304bdabb95a7bda04eb54a/users/250eb6ca9a114c22b917d2772eff6992/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:53.726763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19d53ff8e304bdabb95a7bda04eb54a, user_id=250eb6ca9a114c22b917d2772eff6992, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:53.729414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:53.789914 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:19:53.794616 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4539/9017] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:19:53 2022] PUT /identity/v3/projects/a19d53ff8e304bdabb95a7bda04eb54a/users/250eb6ca9a114c22b917d2772eff6992/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:19:53.798675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:53.808882 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342eedf-83bf-4a72-bc7f-b124feb3597d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:53.833805 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:19:53.881776 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cbbb8-64e1-4934-a34d-58fa94d6257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:53.881952 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cbbb8-64e1-4934-a34d-58fa94d6257a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:53.882218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cbbb8-64e1-4934-a34d-58fa94d6257a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:53.882498 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cbbb8-64e1-4934-a34d-58fa94d6257a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:53.883150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cbbb8-64e1-4934-a34d-58fa94d6257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:53.884847 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cbbb8-64e1-4934-a34d-58fa94d6257a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:53.897572 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4479/9018] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:19:53.901485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:53.916353 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a04996-4c9d-42ef-b399-43d8cb11da1f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:53.921659 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7eee8-10a6-4170-8743-22539c9bfd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:53.922373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7eee8-10a6-4170-8743-22539c9bfd21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:53.922657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7eee8-10a6-4170-8743-22539c9bfd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:53.922933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7eee8-10a6-4170-8743-22539c9bfd21 admin admin] PATH_INFO: `/v3/projects/a19d53ff8e304bdabb95a7bda04eb54a/users/250eb6ca9a114c22b917d2772eff6992/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:53.924880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7eee8-10a6-4170-8743-22539c9bfd21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19d53ff8e304bdabb95a7bda04eb54a, user_id=250eb6ca9a114c22b917d2772eff6992, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:53.928080 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7eee8-10a6-4170-8743-22539c9bfd21 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:53.940711 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4540/9019] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:19:53 2022] PUT /identity/v3/projects/a19d53ff8e304bdabb95a7bda04eb54a/users/250eb6ca9a114c22b917d2772eff6992/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:19:59.395407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09c967-ccfd-47cd-bf76-6ed74c2b7dc5 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:59.396000 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09c967-ccfd-47cd-bf76-6ed74c2b7dc5 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:59.396120 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09c967-ccfd-47cd-bf76-6ed74c2b7dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:59.437679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-ed09c967-ccfd-47cd-bf76-6ed74c2b7dc5 None None] MFA Rules not processed for user `250eb6ca9a114c22b917d2772eff6992`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:19:59.439067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ed09c967-ccfd-47cd-bf76-6ed74c2b7dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:59.516019 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4480/9020] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:19:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:19:59.557485 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc4cd-98b2-4c95-a9d3-c1a7dd4ba785 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:59.558146 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc4cd-98b2-4c95-a9d3-c1a7dd4ba785 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:59.560253 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc4cd-98b2-4c95-a9d3-c1a7dd4ba785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:59.622317 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b3cfc4cd-98b2-4c95-a9d3-c1a7dd4ba785 None None] MFA Rules not processed for user `55ea28229f144d47826791bcade28b24`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:19:59.623602 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b3cfc4cd-98b2-4c95-a9d3-c1a7dd4ba785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:19:59.691005 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4541/9021] 10.222.0.59 () {58 vars in 1064 bytes} [Sun Aug 28 02:19:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:19:59.697117 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09c967-ccfd-47cd-bf76-6ed74c2b7dc5 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:19:59.707371 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09c967-ccfd-47cd-bf76-6ed74c2b7dc5 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:19:59.711599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ed64f-16aa-4268-ac78-f613b89656ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:19:59.712213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed64f-16aa-4268-ac78-f613b89656ca service glance] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:19:59.712496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed64f-16aa-4268-ac78-f613b89656ca service glance] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:19:59.712769 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed64f-16aa-4268-ac78-f613b89656ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:19:59.771010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ed64f-16aa-4268-ac78-f613b89656ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:19:59.772469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ed64f-16aa-4268-ac78-f613b89656ca service glance] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:19:59.782672 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4481/9022] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:19:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:20:00.160466 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ff7a-a489-44ec-ac34-3c54b94c066c None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:00.160879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ff7a-a489-44ec-ac34-3c54b94c066c None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:00.161219 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ff7a-a489-44ec-ac34-3c54b94c066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:00.223846 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9847ff7a-a489-44ec-ac34-3c54b94c066c None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:20:00.225402 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9847ff7a-a489-44ec-ac34-3c54b94c066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:00.300450 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4542/9023] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:20:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:20:00.473584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576ec52-780e-4052-8bbb-ff87879261fe None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:00.474159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576ec52-780e-4052-8bbb-ff87879261fe None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:00.474159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576ec52-780e-4052-8bbb-ff87879261fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:00.528670 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-2576ec52-780e-4052-8bbb-ff87879261fe None None] MFA Rules not processed for user `33919497efcb42f49a4b9034352f3045`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:20:00.531449 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-2576ec52-780e-4052-8bbb-ff87879261fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:00.548792 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:20:00.610039 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4482/9024] 10.222.0.59 () {58 vars in 1040 bytes} [Sun Aug 28 02:20:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:20:00.616891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ff7a-a489-44ec-ac34-3c54b94c066c None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:20:00.629426 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847ff7a-a489-44ec-ac34-3c54b94c066c None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:20:00.635417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f25a-52a5-4998-975f-6c818691b5b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:20:00.636033 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f25a-52a5-4998-975f-6c818691b5b9 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:00.636309 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f25a-52a5-4998-975f-6c818691b5b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:00.636581 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f25a-52a5-4998-975f-6c818691b5b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:00.645792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111f25a-52a5-4998-975f-6c818691b5b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:20:00.647412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111f25a-52a5-4998-975f-6c818691b5b9 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:20:00.656174 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4543/9025] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:20:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 02:20:10.605952 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=23 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:20:10.652458 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:20:10.764843 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69193a08-6413-4ea3-98e4-6d33d5978fdd None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:10.765132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69193a08-6413-4ea3-98e4-6d33d5978fdd None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:10.765411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69193a08-6413-4ea3-98e4-6d33d5978fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:10.784416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-69193a08-6413-4ea3-98e4-6d33d5978fdd None None] MFA Rules not processed for user `6794190dda144da1af58242ac4970916`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:20:10.785682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-69193a08-6413-4ea3-98e4-6d33d5978fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:10.792864 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4483/9026] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:20:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:20:14.367593 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:14.368074 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:14.368189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:14.388391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:20:14.390112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:14.397838 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4544/9027] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:20:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:20:14.411680 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69193a08-6413-4ea3-98e4-6d33d5978fdd None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:20:14.425465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69193a08-6413-4ea3-98e4-6d33d5978fdd None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:20:14.430709 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:20:14.431407 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:14.431764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:14.432133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:14.441520 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:20:14.443387 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:20:14.452715 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4484/9028] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:20:24.382785 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:20:24.448352 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:20:48.701871 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:20:48.703446 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:48.762373 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb577e8-7208-417b-b5f6-f722d6f7b967 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:20:48.765971 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d2f7f-7388-448c-8a22-1a0d0ca32d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:20:48.766574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2f7f-7388-448c-8a22-1a0d0ca32d1c service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:48.766855 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2f7f-7388-448c-8a22-1a0d0ca32d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:48.767129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d2f7f-7388-448c-8a22-1a0d0ca32d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:48.769599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ad8d2f7f-7388-448c-8a22-1a0d0ca32d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:48.840090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d2f7f-7388-448c-8a22-1a0d0ca32d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:20:48.841444 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d2f7f-7388-448c-8a22-1a0d0ca32d1c service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:20:48.852257 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4545/9029] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:20:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:20:48.983366 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:20:48.993643 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f15219-435c-45f5-988d-041d0c1862f8 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:20:48.997290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:20:48.997910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:48.998198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:48.998475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:49.008296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:20:49.009713 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:20:49.019843 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4485/9030] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:20:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:20:51.106877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29a2d-7deb-4f3a-af95-4bac6c5234d8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:51.107333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29a2d-7deb-4f3a-af95-4bac6c5234d8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:51.107510 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29a2d-7deb-4f3a-af95-4bac6c5234d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:51.148596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c5a29a2d-7deb-4f3a-af95-4bac6c5234d8 None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:20:51.149722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c5a29a2d-7deb-4f3a-af95-4bac6c5234d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:51.159483 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4546/9031] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:20:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:20:51.176288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:20:51.177700 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:20:51.194823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1894500-0fb8-44dd-99b9-6232fe659f84 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:20:51.201256 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:20:51.202189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:20:51.202538 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:20:51.202871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:20:51.213239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:20:51.215019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:20:51.227379 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4486/9032] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:20:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:21:01.146028 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=63 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:21:01.223117 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=12 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:21:33.242662 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29a2d-7deb-4f3a-af95-4bac6c5234d8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:21:33.252121 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29a2d-7deb-4f3a-af95-4bac6c5234d8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:21:33.255745 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:21:33.256337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:21:33.256643 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:21:33.256917 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:21:33.258670 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:21:33.268632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:21:33.270068 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:21:33.277734 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4547/9033] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:21:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:21:43.274396 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:22:31.575290 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:22:31.596201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a53b3-1c01-4f40-90a1-4294c6941a92 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:22:31.600471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:22:31.600737 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:22:31.601017 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:22:31.601288 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:22:31.603150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:22:31.660010 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:22:31.661361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:22:31.673238 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4487/9034] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:22:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:22:41.668392 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=28 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:23:40.524804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:23:40.526234 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:23:40.646757 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305558d-5c4a-4d45-a3ef-e72b35bc71f1 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:23:40.651832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:23:40.652440 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:23:40.652724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:23:40.653001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:23:40.655624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:23:40.666839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:23:40.668359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:23:40.679231 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4548/9035] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:23:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:23:46.151802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:23:46.159095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:23:46.259682 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df311e26-13d2-4e83-8272-45e6bd5d933a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:23:46.274965 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f24f0d-ea71-46f5-9c85-d2ad55690575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:23:46.275611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f24f0d-ea71-46f5-9c85-d2ad55690575 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:23:46.275901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f24f0d-ea71-46f5-9c85-d2ad55690575 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:23:46.276179 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f24f0d-ea71-46f5-9c85-d2ad55690575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:23:46.280723 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-81f24f0d-ea71-46f5-9c85-d2ad55690575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:23:46.293990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f24f0d-ea71-46f5-9c85-d2ad55690575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:23:46.296150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f24f0d-ea71-46f5-9c85-d2ad55690575 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:23:46.307946 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4488/9036] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:23:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:23:50.674890 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=54 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:23:52.395615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:23:52.397043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:23:52.411094 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b092ac-4f49-4621-b2b9-4b066f926f1b service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:23:52.416357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:23:52.416960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:23:52.417251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:23:52.417529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:23:52.419299 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:23:52.431699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:23:52.433413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:23:52.444516 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4549/9037] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:23:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:23:56.302941 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=18 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:24:01.055501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5910-4268-4115-bf26-570eb9e3db80 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:01.056039 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5910-4268-4115-bf26-570eb9e3db80 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:01.056140 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5910-4268-4115-bf26-570eb9e3db80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:01.076903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-b18d5910-4268-4115-bf26-570eb9e3db80 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:24:01.078132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-b18d5910-4268-4115-bf26-570eb9e3db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:01.085246 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4489/9038] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 02:24:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:24:01.129382 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:24:01.141786 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd850b-15b1-4a74-870d-94755c672356 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:24:01.146774 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:24:01.147398 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:01.147681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:01.147954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:01.155992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:24:01.157567 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:24:01.165558 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4550/9039] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:24:02.223330 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aba35-1610-4960-85e3-6b5c723de70d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:02.223837 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aba35-1610-4960-85e3-6b5c723de70d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:02.223937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aba35-1610-4960-85e3-6b5c723de70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:02.243192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-562aba35-1610-4960-85e3-6b5c723de70d None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:24:02.244403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-562aba35-1610-4960-85e3-6b5c723de70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:02.253353 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4490/9040] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:24:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:24:02.266545 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:24:02.276903 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015188c-e68c-40fb-8375-fafa8d21b974 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:24:02.282258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:24:02.282850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:02.283135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:02.283414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:02.292004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:24:02.293590 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:24:02.301886 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4551/9041] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:24:12.021610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f059e-5b97-4cd0-88fb-7fad0a3fb627 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:12.022171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f059e-5b97-4cd0-88fb-7fad0a3fb627 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:12.022171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f059e-5b97-4cd0-88fb-7fad0a3fb627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:12.041921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-8e7f059e-5b97-4cd0-88fb-7fad0a3fb627 None None] MFA Rules not processed for user `6794190dda144da1af58242ac4970916`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:24:12.043110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8e7f059e-5b97-4cd0-88fb-7fad0a3fb627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:12.050213 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4491/9042] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:24:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:24:12.298624 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=18 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:24:12.320890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:24:12.340060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06438-f595-4009-bc9a-232ca5b0773b service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:24:12.343804 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa4d45-4369-420d-9c65-051272ddbd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:24:12.344400 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4d45-4369-420d-9c65-051272ddbd3d service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:12.344682 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4d45-4369-420d-9c65-051272ddbd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:12.344960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa4d45-4369-420d-9c65-051272ddbd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:12.346687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-f6aa4d45-4369-420d-9c65-051272ddbd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:12.368907 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa4d45-4369-420d-9c65-051272ddbd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:24:12.370656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa4d45-4369-420d-9c65-051272ddbd3d service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:24:12.379241 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4552/9043] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:24:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:24:13.780813 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f059e-5b97-4cd0-88fb-7fad0a3fb627 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:24:13.792827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f059e-5b97-4cd0-88fb-7fad0a3fb627 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:24:13.798102 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:24:13.798707 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:13.798991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:13.799269 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:13.800990 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:13.813113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:24:13.814808 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:24:13.824708 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4492/9044] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:24:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:24:18.303825 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044041a9-13ae-41f8-8eac-f249989f53fa None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:18.304413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044041a9-13ae-41f8-8eac-f249989f53fa None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:18.304413 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044041a9-13ae-41f8-8eac-f249989f53fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:18.324692 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-044041a9-13ae-41f8-8eac-f249989f53fa None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:24:18.325972 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-044041a9-13ae-41f8-8eac-f249989f53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:18.334175 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4553/9045] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:24:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:24:18.347563 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:24:18.359895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861814-efec-4851-bb3b-6dbfa3a9f499 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:24:18.365285 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:24:18.365940 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:18.366224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:18.366507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:18.376416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:24:18.378027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:24:18.386768 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4493/9046] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:24:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:24:26.006112 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044041a9-13ae-41f8-8eac-f249989f53fa None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:24:26.016431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044041a9-13ae-41f8-8eac-f249989f53fa None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:24:26.020042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:24:26.020647 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:26.020929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:26.021204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:26.022939 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:26.033534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:24:26.036388 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:24:26.042899 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4554/9047] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:24:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:24:28.383353 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=21 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:24:32.433691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:24:32.446954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375492-4288-4e19-a1ed-b0937bfd7339 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:24:32.452928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:24:32.453536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:24:32.454346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:24:32.454346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:24:32.456008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:24:32.468556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:24:32.470341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:24:32.481430 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4494/9048] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:24:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:24:36.039311 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=24 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:24:42.476763 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:25:05.848912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:25:05.862436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7bae4-1671-4202-9dff-7bd4efd7afdc service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:25:05.867967 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:25:05.868565 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:25:05.868851 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:25:05.869147 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:25:05.877779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:25:05.879500 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:25:05.889071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4555/9049] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:25:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:25:15.884870 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:25:50.600158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:25:50.609478 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48679d-87ed-4ecd-838f-bbab54c51432 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:25:50.613106 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba468e95-4c4c-4849-964b-bb9fe2d110ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:25:50.613704 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468e95-4c4c-4849-964b-bb9fe2d110ab service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:25:50.614020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468e95-4c4c-4849-964b-bb9fe2d110ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:25:50.614296 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba468e95-4c4c-4849-964b-bb9fe2d110ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:25:50.625352 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba468e95-4c4c-4849-964b-bb9fe2d110ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:25:50.626802 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba468e95-4c4c-4849-964b-bb9fe2d110ab service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:25:50.638465 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4495/9050] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:25:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:25:51.137367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:25:51.151127 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc9aba-398a-4f13-873b-f1f76d03716f service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:25:51.157326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:25:51.157980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:25:51.158267 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:25:51.158547 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:25:51.175929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:25:51.177182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:25:51.194307 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4556/9051] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:25:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:00.633805 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:01.188901 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:05.369019 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc29efa-3eb1-49a5-b908-ee7ae3196174 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:05.369502 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc29efa-3eb1-49a5-b908-ee7ae3196174 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:05.369609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc29efa-3eb1-49a5-b908-ee7ae3196174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:05.399689 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5fc29efa-3eb1-49a5-b908-ee7ae3196174 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:26:05.400903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5fc29efa-3eb1-49a5-b908-ee7ae3196174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:05.408500 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4496/9052] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:26:05.450891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:05.462205 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37a06-2c10-44ab-a50c-3decf27cf757 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:05.467191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:05.467777 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:05.468055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:05.468327 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:05.476414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:05.477954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:05.485796 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4557/9053] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:26:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:26:06.279415 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc29efa-3eb1-49a5-b908-ee7ae3196174 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:06.289437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc29efa-3eb1-49a5-b908-ee7ae3196174 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:06.293025 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:06.293626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:06.293942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:06.294219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:06.363929 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:06.365375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:06.384738 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4497/9054] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:09.951014 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:09.962609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b2f5c-c9fe-4ec9-878f-05706103ef7b service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:09.967597 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:09.968191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:09.968471 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:09.968749 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:09.970480 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:09.982350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:09.983941 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:09.994702 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4558/9055] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:13.633232 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:13.644931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c105a-f5c1-4374-833d-aa649478a27e service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:13.650942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:13.651785 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:13.652074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:13.652348 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:13.654240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:13.667187 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:13.668771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:13.679318 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4498/9056] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:13.740723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:13.752024 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1528d-0a24-4682-8cf4-b04e5c451fd1 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:13.757531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:13.758195 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:13.758474 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:13.758744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] PATH_INFO: `/v3/users/6794190dda144da1af58242ac4970916` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:13.759880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6794190dda144da1af58242ac4970916)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:13.761785 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:13.993366 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6794190dda144da1af58242ac4970916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:13.994050 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6794190dda144da1af58242ac4970916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.081836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6794190dda144da1af58242ac4970916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.090303 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6794190dda144da1af58242ac4970916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.096526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6794190dda144da1af58242ac4970916'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.113356 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4559/9057] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:26:13 2022] DELETE /identity/v3/users/6794190dda144da1af58242ac4970916 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:26:14.363691 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:14.375810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109ac07-80ee-4636-9c3f-3e7f55e07079 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:14.435114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:14.435977 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:14.436260 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:14.436540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] PATH_INFO: `/v3/projects/d8da6126aa0c4da2b1c61e6d1f1eb5b6` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:14.437698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8da6126aa0c4da2b1c61e6d1f1eb5b6)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:14.439639 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:14.539354 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8da6126aa0c4da2b1c61e6d1f1eb5b6', 'request_id': 'req-467b64a1-b5ec-47cd-b59b-38fe25c2a156'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.540545 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:14.545369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8da6126aa0c4da2b1c61e6d1f1eb5b6', 'request_id': 'req-467b64a1-b5ec-47cd-b59b-38fe25c2a156'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.632065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8da6126aa0c4da2b1c61e6d1f1eb5b6', 'request_id': 'req-467b64a1-b5ec-47cd-b59b-38fe25c2a156'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.656186 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] The token cache is being invalidate because project d8da6126aa0c4da2b1c61e6d1f1eb5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:26:14.656846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.657114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.658758 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4499/9058] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:26:14 2022] DELETE /identity/v3/projects/d8da6126aa0c4da2b1c61e6d1f1eb5b6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:26:14.663296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:14.664772 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:14.677707 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994258-da92-4a96-8d7f-54522e57abcc admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:14.733680 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:14.734333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:14.734612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:14.734883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] PATH_INFO: `/v3/users/250eb6ca9a114c22b917d2772eff6992` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:14.736007 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=250eb6ca9a114c22b917d2772eff6992)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:14.737947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:14.931454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250eb6ca9a114c22b917d2772eff6992'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.932150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250eb6ca9a114c22b917d2772eff6992'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:14.933872 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:15.008467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250eb6ca9a114c22b917d2772eff6992'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.015880 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250eb6ca9a114c22b917d2772eff6992'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.016511 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-f064bdd1-d202-4642-bcf2-6c8f10b0df34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250eb6ca9a114c22b917d2772eff6992'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.034655 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4560/9059] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:26:14 2022] DELETE /identity/v3/users/250eb6ca9a114c22b917d2772eff6992 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:26:15.250206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:15.251755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:15.265690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b64a1-b5ec-47cd-b59b-38fe25c2a156 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:15.323846 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:15.324482 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.324761 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.325031 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] PATH_INFO: `/v3/projects/a19d53ff8e304bdabb95a7bda04eb54a` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.326168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19d53ff8e304bdabb95a7bda04eb54a)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:15.328083 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:15.426922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19d53ff8e304bdabb95a7bda04eb54a', 'request_id': 'req-52526aad-67f7-43d2-ba6d-4aa7344370d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.433116 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19d53ff8e304bdabb95a7bda04eb54a', 'request_id': 'req-52526aad-67f7-43d2-ba6d-4aa7344370d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.477832 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19d53ff8e304bdabb95a7bda04eb54a', 'request_id': 'req-52526aad-67f7-43d2-ba6d-4aa7344370d8'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.488911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] The token cache is being invalidate because project a19d53ff8e304bdabb95a7bda04eb54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:26:15.489199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.489849 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-52526aad-67f7-43d2-ba6d-4aa7344370d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:26:15.491379 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4500/9060] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:26:15 2022] DELETE /identity/v3/projects/a19d53ff8e304bdabb95a7bda04eb54a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:26:15.497428 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e6e0-fc36-40f3-a6e4-853622804fb8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.497652 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e6e0-fc36-40f3-a6e4-853622804fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.497953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76e6e0-fc36-40f3-a6e4-853622804fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.556419 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-7a76e6e0-fc36-40f3-a6e4-853622804fb8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:26:15.557623 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7a76e6e0-fc36-40f3-a6e4-853622804fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:15.616046 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4561/9061] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:26:15.624362 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bd364-9640-4232-aa9e-4dcd6a844ac7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.624651 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bd364-9640-4232-aa9e-4dcd6a844ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.624928 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bd364-9640-4232-aa9e-4dcd6a844ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.644475 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-045bd364-9640-4232-aa9e-4dcd6a844ac7 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:26:15.645666 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-045bd364-9640-4232-aa9e-4dcd6a844ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:15.654078 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4501/9062] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:26:15.658270 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76e6e0-fc36-40f3-a6e4-853622804fb8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:15.668792 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76e6e0-fc36-40f3-a6e4-853622804fb8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:15.673367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:15.674003 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.674287 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.674561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.675215 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:26:15.675520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:15.677120 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:15.688895 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4562/9063] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:26:15.693012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bd364-9640-4232-aa9e-4dcd6a844ac7 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:15.702316 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bd364-9640-4232-aa9e-4dcd6a844ac7 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:15.706905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:15.707499 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.707779 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.708054 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.708687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:15.711317 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:15.786823 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4502/9064] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:26:15 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:26:15.791531 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:15.801718 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd846f6-a38a-4fa9-a781-dc5b7bf9a217 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:15.858088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:15.858686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.858964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.859235 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.859859 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:15.861761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:15.911096 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4563/9065] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:26:15 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:26:15.915927 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:15.926228 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63266b3f-2df7-412f-ab1c-1b3aae031289 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:15.931104 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:15.931702 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.931986 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.932259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.932922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:15.934569 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:15.944997 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4503/9066] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:26:15.949136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:15.959456 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301677e-72ad-4830-a705-377878b3c5f1 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:15.965436 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674da61-8aa9-41db-ae98-d1227a75ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:15.966390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674da61-8aa9-41db-ae98-d1227a75ca0e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:15.966390 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674da61-8aa9-41db-ae98-d1227a75ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:15.966661 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674da61-8aa9-41db-ae98-d1227a75ca0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:15.967301 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674da61-8aa9-41db-ae98-d1227a75ca0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:15.968902 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674da61-8aa9-41db-ae98-d1227a75ca0e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:15.974513 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:15.983188 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4564/9067] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:26:15.987297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:15.997464 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef801b2-c88f-4353-a23d-bfe7a69d02b6 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:16.002363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:16.003022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.003303 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.003578 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] PATH_INFO: `/v3/projects/00be910dfdcd49af9c3070b2946a6192/users/1f96d6da2356415ba19800b7ddb9fcd4/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.007508 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:16.020148 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00be910dfdcd49af9c3070b2946a6192, user_id=1f96d6da2356415ba19800b7ddb9fcd4, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:16.023536 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:16.112247 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4504/9068] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:26:15 2022] PUT /identity/v3/projects/00be910dfdcd49af9c3070b2946a6192/users/1f96d6da2356415ba19800b7ddb9fcd4/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:26:16.123062 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad5a6-6040-4606-bd23-4f2f4b4a32c3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.123349 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad5a6-6040-4606-bd23-4f2f4b4a32c3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.123637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad5a6-6040-4606-bd23-4f2f4b4a32c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.151673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-3f2ad5a6-6040-4606-bd23-4f2f4b4a32c3 None None] MFA Rules not processed for user `1f96d6da2356415ba19800b7ddb9fcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:26:16.152900 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3f2ad5a6-6040-4606-bd23-4f2f4b4a32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:16.218417 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4565/9069] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:26:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:26:16.223259 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:16.286673 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5436151-9de4-4c1d-850c-a88139abb348 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:16.292624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:16.293229 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.293628 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.293946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.294591 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:16.296515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:16.398130 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4505/9070] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:26:16 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:26:16.402533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad5a6-6040-4606-bd23-4f2f4b4a32c3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:16.414343 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad5a6-6040-4606-bd23-4f2f4b4a32c3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:16.470764 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:16.471370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.471657 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.471935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.472566 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:16.474539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:16.574555 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4566/9071] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:26:16 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:26:16.578453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:16.589831 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9415-9f33-4684-b07d-4c51265faf9d admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:16.594411 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:16.595006 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.595286 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.595556 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.596190 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:16.597804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:16.610729 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4506/9072] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:26:16.614904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:16.625135 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcc474-c106-426f-a4bd-2e2412b41425 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:16.629762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:16.630437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.630722 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.631259 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] PATH_INFO: `/v3/projects/868364d04f9e4e26ae72d430df6f4838/users/04f0520c2a94477689239954bab9805a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.646630 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868364d04f9e4e26ae72d430df6f4838, user_id=04f0520c2a94477689239954bab9805a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:16.650041 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:16.712028 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4567/9073] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:26:16 2022] PUT /identity/v3/projects/868364d04f9e4e26ae72d430df6f4838/users/04f0520c2a94477689239954bab9805a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:26:16.716005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:16.727675 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a054c-6de0-48cf-88ac-65f75a103611 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:16.784396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e121e6-43fe-4aa2-b6a4-7700a4b52d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:16.784997 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e121e6-43fe-4aa2-b6a4-7700a4b52d2e admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.785274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e121e6-43fe-4aa2-b6a4-7700a4b52d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.785540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e121e6-43fe-4aa2-b6a4-7700a4b52d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.786209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e121e6-43fe-4aa2-b6a4-7700a4b52d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:16.787772 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e121e6-43fe-4aa2-b6a4-7700a4b52d2e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:16.797583 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4507/9074] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 02:26:16.801736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:16.812374 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cff11-e5e6-4dc6-951a-d475b571b9e3 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:16.817221 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:16.817890 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.818177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.818455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] PATH_INFO: `/v3/projects/868364d04f9e4e26ae72d430df6f4838/users/04f0520c2a94477689239954bab9805a/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.821143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868364d04f9e4e26ae72d430df6f4838, user_id=04f0520c2a94477689239954bab9805a, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:16.823819 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:16.833744 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4568/9075] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:26:16 2022] PUT /identity/v3/projects/868364d04f9e4e26ae72d430df6f4838/users/04f0520c2a94477689239954bab9805a/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:26:16.845661 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:16.845993 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:16.846268 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:16.873253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] MFA Rules not processed for user `04f0520c2a94477689239954bab9805a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:26:16.874481 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:16.918135 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:16.941663 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4508/9076] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:26:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:26:16.958469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:16.960760 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:17.006576 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:17.034535 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0db909-a77b-4696-b3ee-e30de13751f7 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:17.040530 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b02c6f-264c-41ef-93ac-0328198a74b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:17.041131 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02c6f-264c-41ef-93ac-0328198a74b6 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:17.041411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02c6f-264c-41ef-93ac-0328198a74b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:17.041683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b02c6f-264c-41ef-93ac-0328198a74b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:17.096375 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02c6f-264c-41ef-93ac-0328198a74b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:17.097987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b02c6f-264c-41ef-93ac-0328198a74b6 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:17.106950 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4569/9077] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:21.942297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:21.943903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:22.004279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4daa5-3ccd-4ec6-abb9-40783571b3b1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:22.009361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:22.010013 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:22.010301 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:22.010579 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:22.019857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:22.021294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:22.039833 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4509/9078] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:25.244773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:25.245284 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:25.245391 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:25.266387 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] MFA Rules not processed for user `1f96d6da2356415ba19800b7ddb9fcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:26:25.267599 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:25.275129 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4570/9079] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:26:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:26:25.639528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:25.650150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074da29a-5cb1-47f6-b432-679c51363c8a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:25.656133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:25.656754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:25.657034 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:25.657310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:25.659089 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:25.671795 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:25.673406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:25.683949 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4510/9080] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:26.137608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:26.139277 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:26.227638 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de933a-9950-4328-b076-4c6659dadb21 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:26.232677 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a666b1-dcbd-4906-8458-aa346e009b7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:26.233291 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a666b1-dcbd-4906-8458-aa346e009b7a service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:26.233578 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a666b1-dcbd-4906-8458-aa346e009b7a service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:26.233884 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a666b1-dcbd-4906-8458-aa346e009b7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:26.235634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b7a666b1-dcbd-4906-8458-aa346e009b7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:26.247461 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a666b1-dcbd-4906-8458-aa346e009b7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:26.251493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a666b1-dcbd-4906-8458-aa346e009b7a service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:26.259772 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4571/9081] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:35.679128 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=41 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:36.254952 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=72 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:26:36.367070 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:26:36.376375 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a352df-466e-4fe3-9b6d-29f4cf0b5e5a service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:26:36.380132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:26:36.381046 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:26:36.381329 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:26:36.381658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:26:36.383410 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:26:36.393028 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:26:36.394489 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:26:36.402887 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4511/9082] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:26:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:26:46.399408 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:27:31.852414 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:27:31.852983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:27:31.852983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:27:31.875055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] MFA Rules not processed for user `1f96d6da2356415ba19800b7ddb9fcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:27:31.877416 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:27:31.886375 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4572/9083] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:27:32.788453 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:27:32.797827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5c0f1-e14e-4557-9e46-2196d98768c5 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:27:32.803519 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:27:32.804393 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:27:32.804771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:27:32.805145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:27:32.807147 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:27:32.823069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:27:32.824513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:27:32.847710 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4512/9084] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:27:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:27:41.868589 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:27:42.832393 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:28:45.537930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:28:45.539541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:28:45.555571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9866b56-cae1-4087-b424-8951a5dad36b None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:28:45.560610 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:28:45.561209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:28:45.561494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:28:45.561857 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:28:45.563612 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:28:45.575632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:28:45.577258 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:28:45.587561 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4573/9085] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:28:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:28:55.583234 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:28:58.393080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:28:58.404429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac10121-6cc2-49a3-975c-f19e324b0e04 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:28:58.417218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a99b8f-abd4-44fe-acea-acec78c06766 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:28:58.417218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a99b8f-abd4-44fe-acea-acec78c06766 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:28:58.417218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a99b8f-abd4-44fe-acea-acec78c06766 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:28:58.417218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a99b8f-abd4-44fe-acea-acec78c06766 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:28:58.417623 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-e3a99b8f-abd4-44fe-acea-acec78c06766 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:28:58.424509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a99b8f-abd4-44fe-acea-acec78c06766 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:28:58.426121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a99b8f-abd4-44fe-acea-acec78c06766 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:28:58.436311 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4513/9086] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:28:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:29:08.432068 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:29:12.685119 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:29:12.687363 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:29:12.703609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c3980-b353-49cc-acd5-6890dd0ad1c3 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:29:12.709177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:29:12.709828 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:29:12.710292 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:29:12.710569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:29:12.712263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:29:12.724841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:29:12.726492 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:29:12.738844 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4574/9087] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:29:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:29:22.734151 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:29:25.919008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf543f1-e379-487f-8367-f4207aa8eeda None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:29:25.919895 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf543f1-e379-487f-8367-f4207aa8eeda None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:29:25.920417 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf543f1-e379-487f-8367-f4207aa8eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:29:25.945059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-0cf543f1-e379-487f-8367-f4207aa8eeda None None] MFA Rules not processed for user `1f96d6da2356415ba19800b7ddb9fcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:29:25.946439 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-0cf543f1-e379-487f-8367-f4207aa8eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:29:25.954841 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4514/9088] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:29:26.340758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:29:26.342498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:29:26.355141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bc663-1f9f-4e9f-a48a-d0b7d7dc0d57 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:29:26.359525 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d166d-76a1-4edc-8939-98f696a288bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:29:26.360130 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d166d-76a1-4edc-8939-98f696a288bc service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:29:26.360411 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d166d-76a1-4edc-8939-98f696a288bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:29:26.360686 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d166d-76a1-4edc-8939-98f696a288bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:29:26.362455 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9d9d166d-76a1-4edc-8939-98f696a288bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:29:26.372734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d166d-76a1-4edc-8939-98f696a288bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:29:26.374470 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d166d-76a1-4edc-8939-98f696a288bc service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:29:26.383415 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4575/9089] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:29:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:29:35.938972 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:29:36.379656 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:29:37.227452 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf543f1-e379-487f-8367-f4207aa8eeda None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:29:37.242231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf543f1-e379-487f-8367-f4207aa8eeda None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:29:37.247964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:29:37.248507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:29:37.248859 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:29:37.249239 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:29:37.251093 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:29:37.266074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:29:37.267786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:29:37.279996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4515/9090] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:29:47.275206 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:30:15.221758 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8aedf-1417-47dd-82f4-b2e63b983ded None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:15.222364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8aedf-1417-47dd-82f4-b2e63b983ded None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:15.222364 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8aedf-1417-47dd-82f4-b2e63b983ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:15.260947 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-9ca8aedf-1417-47dd-82f4-b2e63b983ded None None] MFA Rules not processed for user `9db493faf16349169f9199f922ff3646`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:30:15.262171 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-9ca8aedf-1417-47dd-82f4-b2e63b983ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:30:15.268740 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4576/9091] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:30:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:30:15.281576 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:30:15.290934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d1ae-0b86-4817-97f3-1b0930af6ed7 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:30:15.294558 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:30:15.295150 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:15.295430 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:15.295703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:15.302613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:30:15.304023 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:30:15.311730 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4516/9092] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:30:15.480932 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47270de-7f25-46b8-aec4-49a43ce480f4 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:15.481216 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47270de-7f25-46b8-aec4-49a43ce480f4 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:15.481497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47270de-7f25-46b8-aec4-49a43ce480f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:15.520139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-e47270de-7f25-46b8-aec4-49a43ce480f4 None None] MFA Rules not processed for user `1a6e2642bd934f6b856bcdcbcf5751a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:30:15.522269 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e47270de-7f25-46b8-aec4-49a43ce480f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:30:15.531039 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4577/9093] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:30:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:30:15.542662 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:30:15.555161 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb822b88-aed7-4fc5-bcad-f68acaf53442 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:30:15.560279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:30:15.560875 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:15.561159 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:15.561432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:15.570508 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:30:15.572079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:30:15.581639 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4517/9094] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:30:15.868358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2cb87-93d7-4ca0-998f-c11b1d419e0a None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:15.868762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2cb87-93d7-4ca0-998f-c11b1d419e0a None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:15.869150 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2cb87-93d7-4ca0-998f-c11b1d419e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:15.890454 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-2da2cb87-93d7-4ca0-998f-c11b1d419e0a None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:30:15.891676 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2da2cb87-93d7-4ca0-998f-c11b1d419e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:30:15.901183 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4578/9095] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:30:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:30:15.912463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:30:15.921690 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7791fbb-683f-423d-8442-ba94f8a39e59 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:30:15.925334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:30:15.925975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:15.926262 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:15.926545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:15.937580 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:30:15.939133 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:30:15.950102 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4518/9096] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:30:16.015070 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2cb87-93d7-4ca0-998f-c11b1d419e0a None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:30:16.026449 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2cb87-93d7-4ca0-998f-c11b1d419e0a None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:30:16.031483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:30:16.032077 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:16.032359 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:16.032634 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:16.034372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:30:16.046381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:30:16.047901 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:30:16.058362 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4579/9097] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:30:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:30:25.945454 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=18 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:30:26.054220 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=27 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:30:30.790071 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:30:30.799137 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9ce2-e518-41cd-8c70-c12ef74df024 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:30:30.802947 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:30:30.803577 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:30:30.803884 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:30:30.804154 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:30:30.806516 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:30:30.816103 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:30:30.817583 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:30:30.826437 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4519/9098] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:30:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:30:40.822710 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:31:07.354493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:31:07.364691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952465b-53d6-4f78-9223-86485675a503 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:31:07.368347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:31:07.368945 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:31:07.369227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:31:07.369503 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:31:07.371241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:31:07.385539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:31:07.389699 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:31:07.399239 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4580/9099] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:31:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:31:13.042824 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:31:13.056501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cd65e-2190-4e38-8770-2ec65b7fa679 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:31:13.062756 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7b1df-e907-407c-afa8-0342461b7342 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:31:13.063373 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7b1df-e907-407c-afa8-0342461b7342 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:31:13.063658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7b1df-e907-407c-afa8-0342461b7342 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:31:13.063935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7b1df-e907-407c-afa8-0342461b7342 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:31:13.065674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6dd7b1df-e907-407c-afa8-0342461b7342 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:31:13.078871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7b1df-e907-407c-afa8-0342461b7342 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:31:13.080471 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7b1df-e907-407c-afa8-0342461b7342 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:31:13.091621 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4520/9100] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:31:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:31:16.424043 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:31:16.432762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c8f0b-b814-41b3-9cb2-8799814e1b55 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:31:16.436534 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:31:16.437125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:31:16.437404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:31:16.437675 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:31:16.445841 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:31:16.447263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:31:16.456885 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4581/9101] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:31:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:31:21.699151 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913b0d-4f67-49c3-a38c-04104550dd5d None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:31:21.699699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913b0d-4f67-49c3-a38c-04104550dd5d None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:31:21.699699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913b0d-4f67-49c3-a38c-04104550dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:31:21.723857 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7b913b0d-4f67-49c3-a38c-04104550dd5d None None] MFA Rules not processed for user `1f96d6da2356415ba19800b7ddb9fcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:31:21.725099 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7b913b0d-4f67-49c3-a38c-04104550dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:31:21.738590 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4521/9102] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:31:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:31:26.452681 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=12 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:31:31.718013 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:31:35.988427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:31:35.996963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b390854-49b2-48df-892f-b69904488279 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:31:36.000959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:31:36.004858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:31:36.004858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:31:36.004858 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:31:36.011281 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:31:36.013417 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:31:36.023258 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4582/9103] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:31:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:31:38.041600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913b0d-4f67-49c3-a38c-04104550dd5d None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:31:38.052388 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913b0d-4f67-49c3-a38c-04104550dd5d None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:31:38.056194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c63573-a06a-46db-baa5-7438f988ce53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:31:38.057057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c63573-a06a-46db-baa5-7438f988ce53 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:31:38.057540 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c63573-a06a-46db-baa5-7438f988ce53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:31:38.058074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c63573-a06a-46db-baa5-7438f988ce53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:31:38.070263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c63573-a06a-46db-baa5-7438f988ce53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:31:38.071814 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c63573-a06a-46db-baa5-7438f988ce53 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:31:38.082357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4522/9104] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:31:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:31:46.018717 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:31:48.078617 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:32:56.324266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:32:56.334174 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b281a-518c-4dd7-8cc8-c68565713db9 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:32:56.338468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:32:56.338468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:32:56.338803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:32:56.339081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:32:56.370367 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:32:56.371811 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:32:56.383881 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4583/9105] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:32:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:33:06.378456 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=15 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:33:10.762930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be573b6-adf0-4dbe-8e6f-ac4af61c9088 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:33:10.762930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be573b6-adf0-4dbe-8e6f-ac4af61c9088 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:33:10.762930 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be573b6-adf0-4dbe-8e6f-ac4af61c9088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:33:10.782921 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-1be573b6-adf0-4dbe-8e6f-ac4af61c9088 None None] MFA Rules not processed for user `1f96d6da2356415ba19800b7ddb9fcd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:33:10.784289 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-1be573b6-adf0-4dbe-8e6f-ac4af61c9088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:33:10.793679 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4523/9106] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:33:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:33:11.132306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:33:11.141393 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967f6ab-a37f-4f4f-9b88-71782ac54582 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:33:11.145140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:33:11.145740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:33:11.146059 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:33:11.146410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:33:11.155213 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:33:11.156744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:33:11.165760 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4584/9107] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:33:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:33:20.777085 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:33:21.161529 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:33:24.364996 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be573b6-adf0-4dbe-8e6f-ac4af61c9088 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:33:24.384903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be573b6-adf0-4dbe-8e6f-ac4af61c9088 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:33:24.386838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:33:24.387469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:33:24.387970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:33:24.388240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:33:24.390372 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:33:24.405626 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:33:24.407664 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:33:24.420802 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4524/9108] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:33:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:33:34.414712 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:33:49.468723 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:33:49.511136 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa6f4-2012-4ca8-b974-427e9f360b78 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:33:49.516312 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:33:49.516912 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:33:49.517190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:33:49.517463 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:33:49.526027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:33:49.527619 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:33:49.537381 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4585/9109] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:33:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:33:59.533360 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=18 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:03.552294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:03.576823 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474763ad-bc21-45cc-88dd-d5348a69e2e4 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:03.582347 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1960380-3f7d-4d32-b81a-dcb70a29cb8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:03.582960 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960380-3f7d-4d32-b81a-dcb70a29cb8d service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:03.583246 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960380-3f7d-4d32-b81a-dcb70a29cb8d service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:03.583527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960380-3f7d-4d32-b81a-dcb70a29cb8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:03.593753 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1960380-3f7d-4d32-b81a-dcb70a29cb8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:03.595367 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1960380-3f7d-4d32-b81a-dcb70a29cb8d service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:03.606792 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4525/9110] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:08.764609 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:08.826995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bb9c2-f918-49d0-a478-e0a605c3dbf6 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:08.835141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:08.835141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:08.835141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:08.835141 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] PATH_INFO: `/v3/users/1f96d6da2356415ba19800b7ddb9fcd4` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:08.835558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f96d6da2356415ba19800b7ddb9fcd4)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:08.835558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:08.964060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f96d6da2356415ba19800b7ddb9fcd4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:08.964783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f96d6da2356415ba19800b7ddb9fcd4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.006520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f96d6da2356415ba19800b7ddb9fcd4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.014225 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f96d6da2356415ba19800b7ddb9fcd4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.014936 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f96d6da2356415ba19800b7ddb9fcd4'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.032518 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4586/9111] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:34:08 2022] DELETE /identity/v3/users/1f96d6da2356415ba19800b7ddb9fcd4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:34:09.037114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:09.037611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:09.037712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:09.065496 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:34:09.066733 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:09.126170 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4526/9112] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:34:09.136837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:09.138384 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:09.199044 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a9f50-db5c-4424-9dca-d9f1344c977f admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:09.203058 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:09.203866 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:09.204254 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:09.204641 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:09.215241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:09.216850 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:09.227107 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4587/9113] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:34:09.459887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:09.461314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:09.474172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35ac80-92f7-4390-bb02-0efa492e82e1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:09.479131 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:09.479783 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:09.480074 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:09.480357 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] PATH_INFO: `/v3/projects/00be910dfdcd49af9c3070b2946a6192` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:09.481501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00be910dfdcd49af9c3070b2946a6192)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:09.483549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:09.595968 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00be910dfdcd49af9c3070b2946a6192', 'request_id': 'req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.601549 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00be910dfdcd49af9c3070b2946a6192', 'request_id': 'req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.675692 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00be910dfdcd49af9c3070b2946a6192', 'request_id': 'req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.688264 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] The token cache is being invalidate because project 00be910dfdcd49af9c3070b2946a6192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:34:09.693588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.693588 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.693588 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4527/9114] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:34:09 2022] DELETE /identity/v3/projects/00be910dfdcd49af9c3070b2946a6192 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:34:09.694914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:09.705108 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cc16d-c83b-4f4a-bf83-df633d334941 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:09.723193 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:09.763726 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:09.764357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:09.764642 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:09.765227 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] PATH_INFO: `/v3/users/04f0520c2a94477689239954bab9805a` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:09.766129 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f0520c2a94477689239954bab9805a)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:09.768053 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:09.947182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f0520c2a94477689239954bab9805a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:09.947776 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f0520c2a94477689239954bab9805a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.012767 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f0520c2a94477689239954bab9805a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.020200 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f0520c2a94477689239954bab9805a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.037549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-22c7bb24-d3de-4f0e-9e45-061d0a88893f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f0520c2a94477689239954bab9805a'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.038751 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4588/9115] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:34:09 2022] DELETE /identity/v3/users/04f0520c2a94477689239954bab9805a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:34:10.414685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:10.416801 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:10.435291 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5d22-f7a3-4e8b-80de-28e4b0354933 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:10.496506 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:10.512560 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:10.513217 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:10.513506 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:10.513789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] PATH_INFO: `/v3/projects/868364d04f9e4e26ae72d430df6f4838` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:10.515176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868364d04f9e4e26ae72d430df6f4838)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:10.517274 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:10.665169 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868364d04f9e4e26ae72d430df6f4838', 'request_id': 'req-584b6ba1-f65d-4e7e-913c-e8f650eaf891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.671446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868364d04f9e4e26ae72d430df6f4838', 'request_id': 'req-584b6ba1-f65d-4e7e-913c-e8f650eaf891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.738586 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868364d04f9e4e26ae72d430df6f4838', 'request_id': 'req-584b6ba1-f65d-4e7e-913c-e8f650eaf891'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.751845 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] The token cache is being invalidate because project 868364d04f9e4e26ae72d430df6f4838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82006) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:34:10.752060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.752728 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-584b6ba1-f65d-4e7e-913c-e8f650eaf891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:34:10.754263 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4528/9116] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:34:10 2022] DELETE /identity/v3/projects/868364d04f9e4e26ae72d430df6f4838 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:34:10.760482 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c77e-f97c-47a1-a678-81341d5a86c8 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:10.760799 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c77e-f97c-47a1-a678-81341d5a86c8 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:10.761082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c77e-f97c-47a1-a678-81341d5a86c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:10.782574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c7a5c77e-f97c-47a1-a678-81341d5a86c8 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:34:10.783860 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7a5c77e-f97c-47a1-a678-81341d5a86c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:10.851976 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4589/9117] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:34:10.860819 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866142-1357-425b-b576-fbafd5ab224f None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:10.861110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866142-1357-425b-b576-fbafd5ab224f None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:10.861332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39866142-1357-425b-b576-fbafd5ab224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:10.882275 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-39866142-1357-425b-b576-fbafd5ab224f None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:34:10.883509 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-39866142-1357-425b-b576-fbafd5ab224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:10.892594 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4529/9118] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:34:10.898324 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c77e-f97c-47a1-a678-81341d5a86c8 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:10.908849 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c77e-f97c-47a1-a678-81341d5a86c8 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:10.913572 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:10.914220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:10.914504 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:10.914783 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] PATH_INFO: `/v3/domains` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:10.915439 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82007) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:34:10.916297 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:10.917954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:10.933013 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4590/9119] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:34:10.940206 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866142-1357-425b-b576-fbafd5ab224f None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:10.951072 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39866142-1357-425b-b576-fbafd5ab224f None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:10.956041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:10.956679 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:10.963731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:10.963731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:10.963731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:10.963731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:11.067332 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4530/9120] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:34:10 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:34:11.070928 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:11.082194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f23278-9eb2-424e-baed-dad3f23d7726 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:11.108212 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:11.141095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:11.141704 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:11.142027 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:11.142306 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:11.142937 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:11.144845 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:11.241693 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4591/9121] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:34:11 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:34:11.246652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:11.257201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c58d39-e0b4-451e-b3c6-24e02815b3b5 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:11.262045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:11.262699 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:11.262984 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:11.263263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:11.263910 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:11.265513 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:11.275996 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4531/9122] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:34:11.280084 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:11.290429 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982796f-883d-4987-853c-c1fa69c734f8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:11.295496 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165e46a-7680-49b7-a84d-fc11298b193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:11.296088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165e46a-7680-49b7-a84d-fc11298b193e admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:11.296412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165e46a-7680-49b7-a84d-fc11298b193e admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:11.296687 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165e46a-7680-49b7-a84d-fc11298b193e admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:11.297320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165e46a-7680-49b7-a84d-fc11298b193e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:11.298940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165e46a-7680-49b7-a84d-fc11298b193e admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:11.310035 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4592/9123] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:34:11.314355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:11.324748 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32998-9e8a-4cee-a811-27e46f26130a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:11.329359 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:11.330048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:11.330333 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:11.330611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] PATH_INFO: `/v3/projects/f9ab36987951410fb338caa5297733aa/users/8ed9658cb4a145428711a2c448907699/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:11.345110 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ab36987951410fb338caa5297733aa, user_id=8ed9658cb4a145428711a2c448907699, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:11.347788 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:11.413905 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4532/9124] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:34:11 2022] PUT /identity/v3/projects/f9ab36987951410fb338caa5297733aa/users/8ed9658cb4a145428711a2c448907699/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:34:11.426681 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90de1b-c206-41e8-9dca-34c6185cf627 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:11.426965 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90de1b-c206-41e8-9dca-34c6185cf627 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:11.427239 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90de1b-c206-41e8-9dca-34c6185cf627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:11.447103 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-5d90de1b-c206-41e8-9dca-34c6185cf627 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:34:11.448293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-5d90de1b-c206-41e8-9dca-34c6185cf627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:11.508283 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4593/9125] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:34:11.518570 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:11.520358 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:11.588487 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044d14-c410-4b2a-88e7-7135cd375e8e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:11.592521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:11.593180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:11.593493 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:11.593794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:11.605922 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:11.607708 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:11.618433 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4533/9126] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:17.013467 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47dba-dbdf-404c-90fa-43ba616ee2c3 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:17.014039 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47dba-dbdf-404c-90fa-43ba616ee2c3 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:17.014163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47dba-dbdf-404c-90fa-43ba616ee2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:17.043891 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4ae47dba-dbdf-404c-90fa-43ba616ee2c3 None None] MFA Rules not processed for user `8ed9658cb4a145428711a2c448907699`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:34:17.045261 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4ae47dba-dbdf-404c-90fa-43ba616ee2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:17.120725 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4594/9127] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:34:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:34:17.125624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:17.137294 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49900c60-fad5-4760-bf83-0ae1e6f0637d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:17.142344 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:17.143049 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:17.143406 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:17.143688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] PATH_INFO: `/v3/projects` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:17.144364 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:17.146447 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:17.236180 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:17.244127 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4534/9128] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:34:17 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:34:17.248807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae47dba-dbdf-404c-90fa-43ba616ee2c3 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:17.260769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae47dba-dbdf-404c-90fa-43ba616ee2c3 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:17.304509 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:17.321305 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:17.322716 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:17.322992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:17.323266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] PATH_INFO: `/v3/users` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:17.323915 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:17.325958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:17.402034 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4595/9129] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:34:17 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 02:34:17.405705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:17.419201 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385f16a-f442-4009-b756-d6e182a55646 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:17.428189 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:17.428817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:17.429095 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:17.429368 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:17.430055 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:17.431719 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:17.443428 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4535/9130] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:34:17.448396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:17.458925 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920f6e2-48f2-4aa9-b624-8b5e0ec9469c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:17.465370 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:17.466099 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:17.466381 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:17.466658 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] PATH_INFO: `/v3/projects/5d064635a3e64e69a5335a418dabfddd/users/f4c752b655ed47ed8eea511d6b368e29/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:17.484709 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d064635a3e64e69a5335a418dabfddd, user_id=f4c752b655ed47ed8eea511d6b368e29, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:17.487497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:17.573083 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4596/9131] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:34:17 2022] PUT /identity/v3/projects/5d064635a3e64e69a5335a418dabfddd/users/f4c752b655ed47ed8eea511d6b368e29/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:34:17.577184 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:17.587948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743279a3-94fe-46df-8433-579c9c4f71f1 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:17.644958 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc0f8b-2e89-4004-9e9e-8f502df6bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:17.645566 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0f8b-2e89-4004-9e9e-8f502df6bc25 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:17.645878 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0f8b-2e89-4004-9e9e-8f502df6bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:17.646158 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0f8b-2e89-4004-9e9e-8f502df6bc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:17.646798 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc0f8b-2e89-4004-9e9e-8f502df6bc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:17.648382 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc0f8b-2e89-4004-9e9e-8f502df6bc25 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:17.658959 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4536/9132] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:34:17.663434 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:17.674876 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55592c-5d87-4f7a-a253-ece11c9beafb admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:17.679557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:17.680208 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:17.680487 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:17.680761 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] PATH_INFO: `/v3/projects/5d064635a3e64e69a5335a418dabfddd/users/f4c752b655ed47ed8eea511d6b368e29/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:17.683365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d064635a3e64e69a5335a418dabfddd, user_id=f4c752b655ed47ed8eea511d6b368e29, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:17.686664 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:17.697037 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4597/9133] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:34:17 2022] PUT /identity/v3/projects/5d064635a3e64e69a5335a418dabfddd/users/f4c752b655ed47ed8eea511d6b368e29/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 02:34:23.122693 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e0ae4-2a68-4bff-b761-0db7fbda4ec8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:23.123143 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e0ae4-2a68-4bff-b761-0db7fbda4ec8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:23.123278 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e0ae4-2a68-4bff-b761-0db7fbda4ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:23.156401 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-417e0ae4-2a68-4bff-b761-0db7fbda4ec8 None None] MFA Rules not processed for user `f4c752b655ed47ed8eea511d6b368e29`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:34:23.157636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-417e0ae4-2a68-4bff-b761-0db7fbda4ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:23.255108 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4537/9134] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:34:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:34:23.275065 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:23.290886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:23.398029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1e14b-103d-4ce4-86ea-3a72e8438827 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:23.404333 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:23.404960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:23.405245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:23.405519 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:23.465516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:23.467179 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:23.472198 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:23.477082 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4598/9135] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:25.925118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:25.925674 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:25.925886 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:25.945937 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] MFA Rules not processed for user `8ed9658cb4a145428711a2c448907699`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:34:25.948194 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:25.954339 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4538/9136] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:34:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:34:26.324790 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:26.416042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cee50e-95ce-4c8c-bed0-5fecd8f44d13 service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:26.423549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:26.424624 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:26.425582 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:26.426102 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:26.430249 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:26.456544 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:26.458060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:26.471443 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4599/9137] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:27.949565 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:27.951059 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:28.025106 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=100 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:28.043008 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2131b7-0efd-4350-a25a-416e5174cf18 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:28.047998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:28.048611 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:28.048897 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:28.049174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:28.050942 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:28.063293 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:28.064864 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:28.075293 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4539/9138] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:32.142477 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:32.157506 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4564-7469-49bb-8e87-3edd5e0deb00 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:32.163529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:32.164232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:32.164516 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:32.164803 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:32.166867 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:32.179974 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:32.181561 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:32.192605 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4600/9139] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:38.070523 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=9 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:38.679123 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:38.680557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:38.695771 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1bef-a430-4a3e-ad76-f05c661f9c5a service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:38.701240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:38.707476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:38.707476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:38.707476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:38.707476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:38.716346 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:38.717923 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:38.728895 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4540/9140] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:41.083368 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:34:41.084815 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:34:41.095964 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2cf0-474f-4c43-8be9-8fca6f7f559d service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:34:41.099458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:34:41.100046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:34:41.100328 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:34:41.100596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:34:41.110063 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:34:41.111498 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:34:41.121691 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4601/9141] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:34:48.724408 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:34:51.117143 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=47 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:36:39.603633 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:36:39.613240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87afa99-f206-4c78-bc3e-0a77675cf18b service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:36:39.617862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab810e3-7f0e-4bbf-a177-e3ed0dfcd5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:36:39.622521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab810e3-7f0e-4bbf-a177-e3ed0dfcd5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:36:39.622521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab810e3-7f0e-4bbf-a177-e3ed0dfcd5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:36:39.622521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab810e3-7f0e-4bbf-a177-e3ed0dfcd5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:36:39.622521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-bab810e3-7f0e-4bbf-a177-e3ed0dfcd5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:36:39.635213 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab810e3-7f0e-4bbf-a177-e3ed0dfcd5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:36:39.636635 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab810e3-7f0e-4bbf-a177-e3ed0dfcd5b4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:36:39.648058 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4541/9142] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:36:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:36:45.277162 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:36:45.286569 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68be2b-e51f-46aa-a65d-770c24dcdd2b service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:36:45.290410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:36:45.291017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:36:45.291286 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:36:45.291562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:36:45.293763 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:36:45.303415 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:36:45.304839 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:36:45.312834 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4602/9143] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:36:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:36:49.642690 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:36:53.376939 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2ada-4179-4e93-b760-f8522e038fed None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:36:53.377544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2ada-4179-4e93-b760-f8522e038fed None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:36:53.377544 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2ada-4179-4e93-b760-f8522e038fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:36:53.440730 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-87cb2ada-4179-4e93-b760-f8522e038fed None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:36:53.441979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-87cb2ada-4179-4e93-b760-f8522e038fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:36:53.512167 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4542/9144] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:36:53.658523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:36:53.659988 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:36:53.754220 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336581-d522-44fd-bbfb-2db39817a39e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:36:53.760049 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:36:53.760655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:36:53.760935 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:36:53.761207 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:36:53.769431 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:36:53.771042 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:36:53.779883 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4603/9145] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:36:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 02:37:03.509026 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=44 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:37:03.776599 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=47 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:37:07.527174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7ab7-28ff-44c5-a3a5-96d1caff59aa None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:07.527746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7ab7-28ff-44c5-a3a5-96d1caff59aa None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:07.527746 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7ab7-28ff-44c5-a3a5-96d1caff59aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:07.579515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-279f7ab7-28ff-44c5-a3a5-96d1caff59aa None None] MFA Rules not processed for user `0ef7d679c29544eeb884f2172e643a59`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:37:07.580688 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-279f7ab7-28ff-44c5-a3a5-96d1caff59aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:07.591298 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4543/9146] 10.222.0.59 () {58 vars in 1018 bytes} [Sun Aug 28 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:37:07.608963 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:37:07.610929 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:07.691529 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389723-d611-4769-831e-84407ffc5a62 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:37:07.695854 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:37:07.696549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:07.696832 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:07.697110 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:07.707598 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:37:07.709096 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:37:07.720023 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4604/9147] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:37:07.908988 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7ab7-28ff-44c5-a3a5-96d1caff59aa None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:37:07.918989 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7ab7-28ff-44c5-a3a5-96d1caff59aa None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:37:07.922597 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:37:07.923203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:07.923555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:07.923835 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:07.925541 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:07.936183 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:37:07.937683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:37:07.946010 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4544/9148] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:37:08.023580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:37:08.032883 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eafa6-e42d-4e7a-96c4-0eaf414a1754 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:37:08.036472 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:37:08.037607 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:08.038072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:08.045453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:08.045453 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:08.053732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:37:08.055212 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:37:08.066538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4605/9149] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:37:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:37:08.126554 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:37:08.127967 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:08.142992 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dab22-6cd6-4d91-8262-8256582da267 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:37:08.148604 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223b216-0c77-4347-83c8-5f751edf9d85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:37:08.149209 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b216-0c77-4347-83c8-5f751edf9d85 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:08.149521 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b216-0c77-4347-83c8-5f751edf9d85 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:08.149842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b216-0c77-4347-83c8-5f751edf9d85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:08.151512 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4223b216-0c77-4347-83c8-5f751edf9d85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:08.163812 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223b216-0c77-4347-83c8-5f751edf9d85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:37:08.165319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223b216-0c77-4347-83c8-5f751edf9d85 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:37:08.175259 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4545/9150] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:37:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:37:09.452633 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:37:09.462296 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ddd55-7e49-457f-ab90-03aa3c6c642e service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:37:09.466708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:37:09.467320 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:09.467608 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:09.467889 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:09.469667 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:09.479688 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:37:09.481122 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:37:09.489100 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4606/9151] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:37:11.186805 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cece0d0-5da2-45c7-87dc-ac48eebab7a7 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:11.187281 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cece0d0-5da2-45c7-87dc-ac48eebab7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:11.187396 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cece0d0-5da2-45c7-87dc-ac48eebab7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:11.206555 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-7cece0d0-5da2-45c7-87dc-ac48eebab7a7 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:37:11.207780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-7cece0d0-5da2-45c7-87dc-ac48eebab7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:11.215907 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4546/9152] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:37:11.228404 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:37:11.240870 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d900fa7-6be1-4005-988a-93d31a9e9ce6 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:37:11.246396 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:37:11.246999 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:11.247280 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:11.247552 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:11.256501 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:37:11.258128 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:37:11.283983 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4607/9153] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:37:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:37:21.201533 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=28 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:37:21.263161 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=53 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:37:25.331440 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3da43-23e2-4457-894b-2a0e5ddadb20 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:25.331963 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3da43-23e2-4457-894b-2a0e5ddadb20 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:25.332065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3da43-23e2-4457-894b-2a0e5ddadb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:25.351978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-aae3da43-23e2-4457-894b-2a0e5ddadb20 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:37:25.353180 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-aae3da43-23e2-4457-894b-2a0e5ddadb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:37:25.360326 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4547/9154] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:37:25.374028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:37:25.384625 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a36a9-3043-4d5a-8335-d4ee8b1e8a00 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:37:25.389721 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf63f09-9073-4de2-94a2-29bf85ffa7a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:37:25.390372 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63f09-9073-4de2-94a2-29bf85ffa7a0 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:37:25.390656 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63f09-9073-4de2-94a2-29bf85ffa7a0 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:37:25.390933 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63f09-9073-4de2-94a2-29bf85ffa7a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:37:25.400484 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf63f09-9073-4de2-94a2-29bf85ffa7a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:37:25.405523 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf63f09-9073-4de2-94a2-29bf85ffa7a0 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:37:25.411071 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4608/9155] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:37:35.346031 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:37:35.407387 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:38:39.145667 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3da43-23e2-4457-894b-2a0e5ddadb20 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:38:39.156925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3da43-23e2-4457-894b-2a0e5ddadb20 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:38:39.160903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:38:39.161573 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:38:39.161892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:38:39.162172 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:38:39.164011 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:38:39.179423 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:38:39.181724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:38:39.194040 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4548/9156] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:38:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:38:45.721879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43da3-ace6-4dd1-833e-37762719e4b7 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:38:45.722451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43da3-ace6-4dd1-833e-37762719e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:38:45.722451 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43da3-ace6-4dd1-833e-37762719e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:38:45.742639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-24b43da3-ace6-4dd1-833e-37762719e4b7 None None] MFA Rules not processed for user `8ed9658cb4a145428711a2c448907699`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:38:45.743770 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-24b43da3-ace6-4dd1-833e-37762719e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:38:45.751361 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4609/9157] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:38:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:38:49.188689 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:38:54.455145 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:38:54.466721 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfba78-423b-4b48-965c-ee45cc8ada35 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:38:54.471935 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:38:54.472584 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:38:54.472866 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:38:54.473141 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:38:54.474971 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:38:54.489456 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:38:54.491377 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:38:54.502345 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4549/9158] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:38:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:38:55.737323 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:39:04.498045 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:39:09.342262 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43da3-ace6-4dd1-833e-37762719e4b7 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:39:09.353987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43da3-ace6-4dd1-833e-37762719e4b7 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:39:09.359843 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:39:09.360539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:39:09.360922 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:39:09.361203 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:39:09.363028 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:39:09.376744 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:39:09.378639 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:39:09.389736 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4610/9159] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:39:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:39:19.384902 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:39:23.735645 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:39:23.748079 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294d4-b509-455c-8c0a-d247c0fc5a5a service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:39:23.753484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:39:23.754129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:39:23.754414 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:39:23.754698 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:39:23.762380 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:39:23.763948 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:39:23.773273 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4550/9160] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:39:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:39:33.769176 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:41:51.199283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:41:51.209835 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dd60a-9039-486c-b5d8-6111f22a5dd8 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:41:51.213437 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:41:51.214067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:41:51.214356 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:41:51.214636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:41:51.222191 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:41:51.223640 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:41:51.231538 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4611/9161] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:41:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:41:55.560901 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:41:55.570856 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501d6ac-6ded-4106-aa9a-c686fdfc745e service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:41:55.574429 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:41:55.575027 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:41:55.575310 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:41:55.575587 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:41:55.585838 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:41:55.587252 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:41:55.598858 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4551/9162] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:41:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:42:01.228146 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:42:05.593389 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:42:11.165161 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:42:11.174030 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d06790-b100-4446-bfde-96a2df4352bb service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:42:11.178290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:42:11.178877 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:42:11.179190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:42:11.179458 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:42:11.186536 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:42:11.187959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:42:11.195779 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4612/9163] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:42:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:42:11.583061 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:42:11.591763 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642d67-8c64-4717-8f09-0fa73b7f0c4d service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:42:11.597022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:42:11.597022 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:42:11.597319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:42:11.597844 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:42:11.605685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:42:11.607205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:42:11.616204 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4552/9164] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:42:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:42:12.730782 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:42:12.742116 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2eb9-3c4b-40ba-8d73-2454b2a44907 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:42:12.746953 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:42:12.747711 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:42:12.748002 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:42:12.748520 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:42:12.761342 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:42:12.763051 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:42:12.775104 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4613/9165] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:42:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:42:12.793416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:42:12.807810 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b7206-cf04-4271-8528-e8bfa1a3f6ca service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:42:12.814233 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:42:12.814865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:42:12.815205 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:42:12.816020 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:42:12.825903 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:42:12.827504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:42:12.838846 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4553/9166] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:42:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:42:12.873580 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:42:12.887222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693d06c-44b3-4ed4-b87f-663fe43af906 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:42:12.892995 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:42:12.893644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:42:12.893954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:42:12.894769 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:42:12.903800 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:42:12.905389 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:42:12.915872 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4614/9167] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:42:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:42:22.834388 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=12 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:42:22.911519 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=18 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:43:59.587764 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:43:59.640265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab009f8-2f05-48d7-b85c-cfb543b168c2 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:43:59.645483 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:43:59.646135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:43:59.646418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:43:59.646695 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:43:59.655060 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:43:59.656631 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:43:59.667244 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4554/9168] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:43:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:09.663976 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=22 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:12.282378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:12.332148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331879b7-7b00-4951-96c6-c3cbecf2fccf service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:12.339622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:12.340245 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:12.340526 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:12.340797 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:12.351095 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:12.352714 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:12.367126 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4615/9169] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:13.364528 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:13.386299 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd15b3a-abca-4fd6-bbed-a0d2c7eb3279 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:13.391231 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:13.391827 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:13.392111 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:13.392386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:13.401543 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:13.403170 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:13.414274 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4555/9170] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:13.772827 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:13.782182 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e20cb0-4d30-4469-89c1-67cb6c9135fe service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:13.785738 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:13.786357 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:13.786636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:13.786913 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:13.797992 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:13.799412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:13.810862 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4616/9171] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:20.912432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:20.923774 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc38a4-1a61-4eeb-baa9-cb8eac0c2123 service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:20.928129 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:20.928873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:20.929263 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:20.929652 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:20.931755 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:21.031273 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:21.032632 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:21.057930 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4556/9172] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:23.806169 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=26 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:24.714524 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:24.726459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107b32a-a943-4222-85fa-1ff18dc23ae4 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:24.735251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:24.735987 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:24.736879 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:24.737163 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:24.739078 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:24.752290 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:24.753930 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:24.765314 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4617/9173] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:28.257731 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:28.259842 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:28.272297 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb657f3-b03c-48a9-b5b5-05de6f801612 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:28.277342 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:28.278048 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:28.291236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:28.291236 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] PATH_INFO: `/v3/users/8ed9658cb4a145428711a2c448907699` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:28.293850 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed9658cb4a145428711a2c448907699)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:28.295770 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:28.460448 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed9658cb4a145428711a2c448907699'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:28.472118 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed9658cb4a145428711a2c448907699'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:28.479684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed9658cb4a145428711a2c448907699'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:28.480361 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed9658cb4a145428711a2c448907699'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:28.483204 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:28.572490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed9658cb4a145428711a2c448907699'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:28.578781 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4557/9174] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:44:28 2022] DELETE /identity/v3/users/8ed9658cb4a145428711a2c448907699 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:44:28.843314 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:28.855821 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec556727-1811-4fd3-a927-aba125629e68 service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:28.914553 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:28.915189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:28.915475 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:28.915756 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] PATH_INFO: `/v3/projects/f9ab36987951410fb338caa5297733aa` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:28.926139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ab36987951410fb338caa5297733aa)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:28.928085 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:29.035720 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ab36987951410fb338caa5297733aa', 'request_id': 'req-0681ac00-958d-40fb-91e3-64860ae25124'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.042326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ab36987951410fb338caa5297733aa', 'request_id': 'req-0681ac00-958d-40fb-91e3-64860ae25124'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.121001 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ab36987951410fb338caa5297733aa', 'request_id': 'req-0681ac00-958d-40fb-91e3-64860ae25124'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.132189 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] The token cache is being invalidate because project f9ab36987951410fb338caa5297733aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:44:29.132571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.134433 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.134726 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4618/9175] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:44:28 2022] DELETE /identity/v3/projects/f9ab36987951410fb338caa5297733aa => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:44:29.139077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:29.140663 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:29.154319 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be35a-9b4b-4322-b567-486d20f2003a admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:29.211834 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:29.212470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:29.212749 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:29.213024 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] PATH_INFO: `/v3/users/f4c752b655ed47ed8eea511d6b368e29` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:29.227853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c752b655ed47ed8eea511d6b368e29)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:29.229841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:29.385659 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c752b655ed47ed8eea511d6b368e29'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.398515 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c752b655ed47ed8eea511d6b368e29'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.406047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c752b655ed47ed8eea511d6b368e29'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.406786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c752b655ed47ed8eea511d6b368e29'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.498334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-16f9dadb-6282-461b-9d12-a1baa6e14f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c752b655ed47ed8eea511d6b368e29'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.504757 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4558/9176] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:44:29 2022] DELETE /identity/v3/users/f4c752b655ed47ed8eea511d6b368e29 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:44:29.746067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:29.747522 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:29.760548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681ac00-958d-40fb-91e3-64860ae25124 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:29.819097 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:29.819731 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:29.820017 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:29.820293 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] PATH_INFO: `/v3/projects/5d064635a3e64e69a5335a418dabfddd` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:29.830644 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d064635a3e64e69a5335a418dabfddd)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:29.832562 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:29.833989 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:29.938204 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d064635a3e64e69a5335a418dabfddd', 'request_id': 'req-91efdac1-c54e-4119-ada5-ab9bcfe022bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:29.945029 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d064635a3e64e69a5335a418dabfddd', 'request_id': 'req-91efdac1-c54e-4119-ada5-ab9bcfe022bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:30.006403 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d064635a3e64e69a5335a418dabfddd', 'request_id': 'req-91efdac1-c54e-4119-ada5-ab9bcfe022bc'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:30.017348 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] The token cache is being invalidate because project 5d064635a3e64e69a5335a418dabfddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:44:30.020190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:30.020190 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-91efdac1-c54e-4119-ada5-ab9bcfe022bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:44:30.020190 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4619/9177] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:44:29 2022] DELETE /identity/v3/projects/5d064635a3e64e69a5335a418dabfddd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:44:30.025862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3453a-3a9a-4096-a81d-3f463cbf73d1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.026171 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3453a-3a9a-4096-a81d-3f463cbf73d1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.026443 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3453a-3a9a-4096-a81d-3f463cbf73d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.074715 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-6cd3453a-3a9a-4096-a81d-3f463cbf73d1 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:44:30.075934 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-6cd3453a-3a9a-4096-a81d-3f463cbf73d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:30.111277 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:30.136219 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4559/9178] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:44:30.144140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51801-0b68-4c72-bd60-f1db2cfee371 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.144427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51801-0b68-4c72-bd60-f1db2cfee371 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.149959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51801-0b68-4c72-bd60-f1db2cfee371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.165655 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-c7b51801-0b68-4c72-bd60-f1db2cfee371 None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:44:30.166895 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7b51801-0b68-4c72-bd60-f1db2cfee371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:30.174801 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4620/9179] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:44:30.178979 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3453a-3a9a-4096-a81d-3f463cbf73d1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:30.188548 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3453a-3a9a-4096-a81d-3f463cbf73d1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:30.193139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:30.193925 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.194557 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.195021 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] PATH_INFO: `/v3/domains` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.195999 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82006) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 02:44:30.196314 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:30.197954 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:30.210360 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4560/9180] 10.222.0.59 () {58 vars in 1153 bytes} [Sun Aug 28 02:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 02:44:30.214594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51801-0b68-4c72-bd60-f1db2cfee371 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:30.224006 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51801-0b68-4c72-bd60-f1db2cfee371 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:30.229997 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:30.230631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.230916 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.231194 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.231837 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:30.233759 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:30.351355 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4621/9181] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:44:30 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:44:30.355379 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:30.365534 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596bbf5-7cbd-4896-ac89-513cd473addc admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:30.423331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:30.423964 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.424224 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.424500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.425128 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:30.427084 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:30.486374 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4561/9182] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:44:30 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:44:30.490736 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:30.501554 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d899d0b-6f97-40bb-8468-e64a1c53de38 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:30.506802 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:30.507483 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.507807 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.508081 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.508724 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:30.510341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:30.520515 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4622/9183] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:44:30.525041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:30.535279 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d981e-6ee9-45f6-a8a2-4e7adde1c97b admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:30.540432 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887b740-0aa9-40af-b784-1f8d3de7d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:30.541047 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b740-0aa9-40af-b784-1f8d3de7d936 admin admin] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.541337 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b740-0aa9-40af-b784-1f8d3de7d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.541613 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887b740-0aa9-40af-b784-1f8d3de7d936 admin admin] PATH_INFO: `/v3/roles` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.542312 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887b740-0aa9-40af-b784-1f8d3de7d936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:30.543970 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887b740-0aa9-40af-b784-1f8d3de7d936 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:30.555373 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4562/9184] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:44:30.560344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:30.571143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d29f7-747b-4fb6-b2c1-7952aca2454b admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:30.575751 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:30.576397 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.576683 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.576960 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] PATH_INFO: `/v3/projects/927feed18efd4866bff7f6f79aebc144/users/e5569d61ca234c008f774513c7012150/roles/8af003ee18d04126ab4eb7661d7a6dd7` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.592897 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927feed18efd4866bff7f6f79aebc144, user_id=e5569d61ca234c008f774513c7012150, role_id=8af003ee18d04126ab4eb7661d7a6dd7)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:30.595636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:30.658253 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4623/9185] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:44:30 2022] PUT /identity/v3/projects/927feed18efd4866bff7f6f79aebc144/users/e5569d61ca234c008f774513c7012150/roles/8af003ee18d04126ab4eb7661d7a6dd7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:44:30.663340 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a392-4d4b-446d-a3b7-aa39ebb23b2e None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.663624 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a392-4d4b-446d-a3b7-aa39ebb23b2e None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.663898 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541a392-4d4b-446d-a3b7-aa39ebb23b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.683852 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4541a392-4d4b-446d-a3b7-aa39ebb23b2e None None] MFA Rules not processed for user `e9cd3966716148c5879c1ebdf2fbb39a`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:44:30.685067 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4541a392-4d4b-446d-a3b7-aa39ebb23b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:30.744022 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4563/9186] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:44:30.754412 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:30.756177 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:30.836337 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689aac2-5365-4f8b-abf3-5aa1b47f70a8 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:30.840072 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:30.840673 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:30.840955 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:30.841232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:30.850708 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:30.852148 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:30.857148 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:30.861958 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4624/9187] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:36.073620 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce19779-10fa-4ce2-9813-060822f356b1 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:36.074589 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce19779-10fa-4ce2-9813-060822f356b1 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:36.074871 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce19779-10fa-4ce2-9813-060822f356b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:36.111032 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-5ce19779-10fa-4ce2-9813-060822f356b1 None None] MFA Rules not processed for user `e5569d61ca234c008f774513c7012150`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:44:36.112305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-5ce19779-10fa-4ce2-9813-060822f356b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:36.151734 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:36.185636 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4564/9188] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:44:36.190037 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:36.200176 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f651f-8502-4bb5-9ad6-141734ed59fd service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:36.204750 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:36.205351 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:36.205631 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:36.205940 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] PATH_INFO: `/v3/projects` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:36.206570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:36.208548 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:36.294177 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4625/9189] 10.222.0.59 () {60 vars in 1153 bytes} [Sun Aug 28 02:44:36 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:44:36.298265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce19779-10fa-4ce2-9813-060822f356b1 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:36.309446 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce19779-10fa-4ce2-9813-060822f356b1 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:36.370600 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:36.371242 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:36.371522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:36.371796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:36.372450 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:36.374567 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:36.484506 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4565/9190] 10.222.0.59 () {60 vars in 1144 bytes} [Sun Aug 28 02:44:36 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 02:44:36.490169 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:36.501668 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6a4b-fa35-47a3-b0af-995a27e0a948 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:36.506636 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:36.507251 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:36.507532 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:36.507806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:36.508469 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:36.510133 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:36.522940 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4626/9191] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:44:36.526594 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:36.538139 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15bfab-9e33-4b57-b7c8-4ade636791f7 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:36.543181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:36.543911 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:36.544192 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:36.544469 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] PATH_INFO: `/v3/projects/028dbc9797a04bdd91339b053d5969a0/users/0367419f124c4b9bbeea89b36d5219a4/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:36.562416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028dbc9797a04bdd91339b053d5969a0, user_id=0367419f124c4b9bbeea89b36d5219a4, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:36.565383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:36.648215 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4566/9192] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:44:36 2022] PUT /identity/v3/projects/028dbc9797a04bdd91339b053d5969a0/users/0367419f124c4b9bbeea89b36d5219a4/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:44:36.652573 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:36.664300 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05804d4-ec28-4cfd-a911-48f67668d96c admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:36.743594 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9258-59f7-4169-949d-e2a9062e49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:36.744222 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9258-59f7-4169-949d-e2a9062e49d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:36.744873 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9258-59f7-4169-949d-e2a9062e49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:36.745153 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9258-59f7-4169-949d-e2a9062e49d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:36.745833 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc9258-59f7-4169-949d-e2a9062e49d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:36.747775 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc9258-59f7-4169-949d-e2a9062e49d8 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:36.760596 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4627/9193] 10.222.0.59 () {58 vars in 1122 bytes} [Sun Aug 28 02:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 02:44:36.765931 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:36.788841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133ff0c-8970-4eb8-99cc-192a1dc3e650 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:36.788841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:36.788841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] REQUEST_METHOD: `PUT` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:36.788841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:36.789355 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] PATH_INFO: `/v3/projects/028dbc9797a04bdd91339b053d5969a0/users/0367419f124c4b9bbeea89b36d5219a4/roles/6ef968d350d64b4496757a252fa42707` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:36.791005 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] RBAC: Authorizing `identity:create_grant(project_id=028dbc9797a04bdd91339b053d5969a0, user_id=0367419f124c4b9bbeea89b36d5219a4, role_id=6ef968d350d64b4496757a252fa42707)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:36.793683 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:36.806436 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4567/9194] 10.222.0.59 () {60 vars in 1483 bytes} [Sun Aug 28 02:44:36 2022] PUT /identity/v3/projects/028dbc9797a04bdd91339b053d5969a0/users/0367419f124c4b9bbeea89b36d5219a4/roles/6ef968d350d64b4496757a252fa42707 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:44:42.461088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1b933-85b8-458f-87b3-6040190c48b9 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:42.461596 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1b933-85b8-458f-87b3-6040190c48b9 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:42.461861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1b933-85b8-458f-87b3-6040190c48b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:42.494603 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-b9f1b933-85b8-458f-87b3-6040190c48b9 None None] MFA Rules not processed for user `0367419f124c4b9bbeea89b36d5219a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:44:42.498288 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-b9f1b933-85b8-458f-87b3-6040190c48b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:42.574385 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4628/9195] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:44:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:44:42.591545 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:42.593474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:42.723168 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:42.732741 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3a847-6e4f-4b7c-8ad4-78e70edf911e admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:42.738629 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:42.739240 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:42.739522 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:42.739796 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:42.804135 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:42.805998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:42.820200 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4568/9196] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:45.299310 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:45.299852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:45.299852 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:45.320365 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] MFA Rules not processed for user `e5569d61ca234c008f774513c7012150`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:44:45.321574 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:45.328739 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4629/9197] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:44:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 02:44:45.669369 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:45.670893 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:45.731754 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ebf90-2f29-47e5-a08b-a22ddd4c4d13 service nova] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:45.735374 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:45.735987 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:45.736270 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:45.736546 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:45.738305 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:45.750132 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:45.752892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:45.764020 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4569/9198] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:46.251896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:46.253507 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:46.315317 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:46.358427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36056d34-15be-4a8f-922b-a46f758cdbbc None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:46.364628 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:46.365248 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:46.366459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:46.366459 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:46.368632 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:44:46.386034 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:46.387617 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:46.399300 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4630/9199] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:44:55.760841 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=54 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:56.486593 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=18 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:44:58.308248 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:44:58.317043 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600d9db-6aa3-4bf2-bb30-06e64100f1f8 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:44:58.320599 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:44:58.321243 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:44:58.321703 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:44:58.322041 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:44:58.331121 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:44:58.332602 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:44:58.342801 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4570/9200] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:44:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:45:00.163088 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:45:00.164551 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:45:00.180887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede263cd-4db3-4598-a276-ca235e5ad3af service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:45:00.186954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:45:00.187575 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:45:00.187863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:45:00.188144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:45:00.190005 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:45:00.204015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:45:00.205550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:45:00.217988 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4631/9201] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:45:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:45:08.338582 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=6 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:45:10.212073 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=6 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:46:54.194658 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:46:54.204386 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291db55-fa0f-46c1-a52f-c51d121ec1c4 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:46:54.208080 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a713ce-d4c8-40a0-847d-5f1eac8daf35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:46:54.208687 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a713ce-d4c8-40a0-847d-5f1eac8daf35 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:46:54.208978 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a713ce-d4c8-40a0-847d-5f1eac8daf35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:46:54.209257 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a713ce-d4c8-40a0-847d-5f1eac8daf35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:46:54.211051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-00a713ce-d4c8-40a0-847d-5f1eac8daf35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:46:54.221012 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a713ce-d4c8-40a0-847d-5f1eac8daf35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:46:54.222490 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a713ce-d4c8-40a0-847d-5f1eac8daf35 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:46:54.230357 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4571/9202] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:46:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:46:55.512571 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:46:55.514214 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:46:55.569983 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858aad3d-970f-49a9-bbf4-dd6df24e3bcb service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:46:55.573779 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ea28229f144d47826791bcade28b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:46:55.574448 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:46:55.574732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:46:55.575004 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:46:55.576796 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:46:55.590698 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:46:55.592144 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:46:55.603833 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4632/9203] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:46:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:47:00.443383 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e9e5a-da81-4b00-a431-610810584ad6 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:00.443887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e9e5a-da81-4b00-a431-610810584ad6 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:00.443887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e9e5a-da81-4b00-a431-610810584ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:00.504504 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-3e3e9e5a-da81-4b00-a431-610810584ad6 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:47:00.505705 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-3e3e9e5a-da81-4b00-a431-610810584ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:00.569289 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4572/9204] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:47:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:47:00.724616 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:47:00.726090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:00.817139 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6286f-0957-4a8a-99ac-74ff8a03da52 service glance] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:47:00.822354 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:47:00.822969 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:00.823255 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:00.823533 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:00.832615 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:47:00.834241 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:47:00.842473 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4633/9205] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:47:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:47:10.566431 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=50 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:47:10.839204 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=67 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:47:11.541434 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d293-87db-4b2f-8b45-b712a519bcc8 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:11.541768 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d293-87db-4b2f-8b45-b712a519bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:11.542088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d293-87db-4b2f-8b45-b712a519bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:11.561174 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-4885d293-87db-4b2f-8b45-b712a519bcc8 None None] MFA Rules not processed for user `e5569d61ca234c008f774513c7012150`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:47:11.562431 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4885d293-87db-4b2f-8b45-b712a519bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:11.569973 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4573/9206] 10.222.0.59 () {58 vars in 958 bytes} [Sun Aug 28 02:47:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:47:11.889427 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:47:11.898954 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952198c-8c5d-4225-aeb0-bf2d687a70c9 service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:47:11.902494 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:47:11.903082 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:11.903360 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:11.903629 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:11.905283 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:11.914478 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:47:11.915886 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:47:11.923563 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4634/9207] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:47:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:47:12.439747 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d293-87db-4b2f-8b45-b712a519bcc8 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:47:12.451530 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d293-87db-4b2f-8b45-b712a519bcc8 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:47:12.457114 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47252fb-9542-4dcf-a20b-765f70371c5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:47:12.457712 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47252fb-9542-4dcf-a20b-765f70371c5c service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:12.458051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47252fb-9542-4dcf-a20b-765f70371c5c service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:12.458331 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47252fb-9542-4dcf-a20b-765f70371c5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:12.460045 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-c47252fb-9542-4dcf-a20b-765f70371c5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:12.471915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47252fb-9542-4dcf-a20b-765f70371c5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:47:12.473484 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47252fb-9542-4dcf-a20b-765f70371c5c service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:47:12.483217 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4574/9208] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:47:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:47:14.062817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:47:14.077159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438dd8-7f52-4dd6-87ea-8939c028bcb0 service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:47:14.083166 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:47:14.083773 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:14.084165 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:14.084445 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:14.086265 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:14.098732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:47:14.100537 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:47:14.111329 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4635/9209] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:47:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:47:16.063349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde7cd-d4ed-47a6-ab9a-16fc418db0cc None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:16.063858 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde7cd-d4ed-47a6-ab9a-16fc418db0cc None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:16.064065 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde7cd-d4ed-47a6-ab9a-16fc418db0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:16.083780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-9fcde7cd-d4ed-47a6-ab9a-16fc418db0cc None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:47:16.084998 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9fcde7cd-d4ed-47a6-ab9a-16fc418db0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:16.092549 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4575/9210] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:47:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:47:16.105347 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:47:16.117691 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589ec4f-05fe-4e15-bdb0-66b59f680e7d service nova] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:47:16.123160 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:47:16.123817 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:16.124067 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:16.124341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:16.133717 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:47:16.135346 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:47:16.143716 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4636/9211] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:47:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:47:24.343334 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde7cd-d4ed-47a6-ab9a-16fc418db0cc None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:47:24.353641 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde7cd-d4ed-47a6-ab9a-16fc418db0cc None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:47:24.357437 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a88ff-c1bc-4973-931b-7120b1921223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:47:24.358088 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a88ff-c1bc-4973-931b-7120b1921223 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:47:24.358403 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a88ff-c1bc-4973-931b-7120b1921223 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:47:24.358676 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a88ff-c1bc-4973-931b-7120b1921223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:47:24.360476 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-344a88ff-c1bc-4973-931b-7120b1921223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:47:24.370266 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a88ff-c1bc-4973-931b-7120b1921223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:47:24.371660 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a88ff-c1bc-4973-931b-7120b1921223 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:47:24.379825 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4576/9212] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:47:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:47:26.140305 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=18 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:47:34.376088 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=18 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:49:04.479734 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:04.491321 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62bff-e881-4437-b746-b43e1be5c4ce service swift] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:04.497341 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:04.497980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:04.498266 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:04.498570 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:04.500319 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:04.511904 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:04.513540 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:04.524752 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4637/9213] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:49:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:49:05.721966 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] REQUEST_METHOD: `POST` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:05.722501 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:05.722615 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:05.744218 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.auth.core [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82006) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:49:05.745416 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:05.752664 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4577/9214] 10.222.0.59 () {58 vars in 1009 bytes} [Sun Aug 28 02:49:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:49:05.794209 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:05.807170 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84acc45-0fef-4647-8b21-d4ffe32f5bad service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:05.812142 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66d970-bc99-473c-af19-4a538d03e864 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:05.812740 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d970-bc99-473c-af19-4a538d03e864 service swift] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:05.813026 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d970-bc99-473c-af19-4a538d03e864 service swift] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:05.813308 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66d970-bc99-473c-af19-4a538d03e864 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:05.821914 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66d970-bc99-473c-af19-4a538d03e864 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:05.823502 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66d970-bc99-473c-af19-4a538d03e864 service swift] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:05.831887 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4638/9215] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:49:15.738378 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=3 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:49:15.828311 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=12 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:49:16.461203 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:16.463438 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:16.479653 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f3e33-030a-49a2-a776-e16184ec7592 None None] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:16.484685 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:16.485292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:16.485572 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:16.485870 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:16.487609 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:16.499991 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:16.501605 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:16.512051 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4578/9216] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:49:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:49:16.766326 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d74f0-f896-46dc-9565-072bb014a671 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:16.766701 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d74f0-f896-46dc-9565-072bb014a671 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:16.767046 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d74f0-f896-46dc-9565-072bb014a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:16.789323 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-446d74f0-f896-46dc-9565-072bb014a671 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:49:16.791090 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-446d74f0-f896-46dc-9565-072bb014a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:16.798738 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4639/9217] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 02:49:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:49:16.811614 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:16.829168 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c22a1-070e-4659-9724-383be52b7ceb service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:16.834865 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:16.835500 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:16.835780 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:16.836051 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:16.844888 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:16.846474 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:16.854463 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4579/9218] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 02:49:18.752243 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d74f0-f896-46dc-9565-072bb014a671 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:18.766788 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d74f0-f896-46dc-9565-072bb014a671 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:18.773125 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66268e-e834-40f8-be03-aa4e6fa0a539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef7d679c29544eeb884f2172e643a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:18.774060 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66268e-e834-40f8-be03-aa4e6fa0a539 service nova] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:18.774505 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66268e-e834-40f8-be03-aa4e6fa0a539 service nova] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:18.774863 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66268e-e834-40f8-be03-aa4e6fa0a539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:18.777557 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-ed66268e-e834-40f8-be03-aa4e6fa0a539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:18.793015 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66268e-e834-40f8-be03-aa4e6fa0a539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:18.794787 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66268e-e834-40f8-be03-aa4e6fa0a539 service nova] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:18.807156 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4640/9219] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:49:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:49:19.117892 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:19.128057 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836dc5-9e91-47fa-bf7f-6ab399979b04 service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:19.131786 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:19.132470 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:19.132821 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:19.133332 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:19.135640 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:19.149181 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:19.155648 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:19.165403 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4580/9220] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:49:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:49:22.655614 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785261b-7150-4725-903a-b8a0d7bfc352 None None] REQUEST_METHOD: `POST` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:22.656086 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785261b-7150-4725-903a-b8a0d7bfc352 None None] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:22.656197 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785261b-7150-4725-903a-b8a0d7bfc352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:22.675157 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.auth.core [None req-4785261b-7150-4725-903a-b8a0d7bfc352 None None] MFA Rules not processed for user `7c105d176ec44ab890a6ce4c0f50b2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82007) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 02:49:22.676350 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-4785261b-7150-4725-903a-b8a0d7bfc352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:22.683562 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4641/9221] 10.222.0.59 () {58 vars in 967 bytes} [Sun Aug 28 02:49:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 02:49:22.695463 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:22.707465 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad19ea-6fba-4bcd-810e-f2fbeecc6389 service neutron] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:22.712418 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33919497efcb42f49a4b9034352f3045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:22.713732 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:22.714063 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:22.714341 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:22.722363 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:22.723933 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:22.732625 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4581/9222] 10.222.0.59 () {60 vars in 1384 bytes} [Sun Aug 28 02:49:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 02:49:31.683959 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785261b-7150-4725-903a-b8a0d7bfc352 None None] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:31.693600 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785261b-7150-4725-903a-b8a0d7bfc352 None None] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:31.697264 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9db493faf16349169f9199f922ff3646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:31.702020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:31.702020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:31.702020 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:31.765979 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:31.767732 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:31.779567 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4642/9223] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:49:32.617069 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:32.629841 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88147d71-353d-4c21-81ce-22baee5bec5f service swift] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:32.634915 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:32.635655 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:32.635943 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:32.636220 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:32.638113 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:32.650077 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:32.651853 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:32.663339 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4582/9224] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:49:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 02:49:35.997497 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:36.009887 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897ff22-f86f-45b7-9010-b08954631bcc service neutron] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:36.015806 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:36.016410 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:36.016836 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:36.017123 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:36.018896 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:36.031010 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:36.032637 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:36.043104 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4643/9225] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:49:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:49:36.148817 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:36.160138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169df42-64df-4c7a-85e3-87edb4a8f84c service placement] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:36.164873 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:36.165507 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:36.165789 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:36.166160 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] PATH_INFO: `/v3/users/e5569d61ca234c008f774513c7012150` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:36.168138 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5569d61ca234c008f774513c7012150)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:36.170219 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:36.337647 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5569d61ca234c008f774513c7012150'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:36.349724 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5569d61ca234c008f774513c7012150'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:36.357636 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5569d61ca234c008f774513c7012150'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:36.369199 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5569d61ca234c008f774513c7012150'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:36.444324 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5569d61ca234c008f774513c7012150'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:36.451505 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4583/9226] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:49:36 2022] DELETE /identity/v3/users/e5569d61ca234c008f774513c7012150 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:49:36.714539 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:36.725452 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbb682-ae5d-4f60-ac03-9072b395169a service placement] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:36.787592 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:36.788232 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:36.788518 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:36.788798 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] PATH_INFO: `/v3/projects/927feed18efd4866bff7f6f79aebc144` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:36.789980 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=927feed18efd4866bff7f6f79aebc144)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:36.791970 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:36.886167 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927feed18efd4866bff7f6f79aebc144', 'request_id': 'req-c7932881-df36-454b-854f-dd2fede8d8a5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:36.892378 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927feed18efd4866bff7f6f79aebc144', 'request_id': 'req-c7932881-df36-454b-854f-dd2fede8d8a5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:36.894890 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:49:37.003690 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927feed18efd4866bff7f6f79aebc144', 'request_id': 'req-c7932881-df36-454b-854f-dd2fede8d8a5'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.014762 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] The token cache is being invalidate because project 927feed18efd4866bff7f6f79aebc144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:49:37.015055 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.015693 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.017224 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4644/9227] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:49:36 2022] DELETE /identity/v3/projects/927feed18efd4866bff7f6f79aebc144 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:49:37.021253 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:37.022684 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:37.035905 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4763e7-d93b-435d-a432-8c04656c26f8 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:37.095975 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:37.096610 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:37.096896 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:37.097176 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] PATH_INFO: `/v3/users/0367419f124c4b9bbeea89b36d5219a4` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:37.098349 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0367419f124c4b9bbeea89b36d5219a4)` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:37.100265 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:37.106386 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:49:37.297593 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0367419f124c4b9bbeea89b36d5219a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.309292 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0367419f124c4b9bbeea89b36d5219a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.316204 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0367419f124c4b9bbeea89b36d5219a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.316946 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0367419f124c4b9bbeea89b36d5219a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.386862 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.notifications [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0367419f124c4b9bbeea89b36d5219a4'} {{(pid=82006) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.393196 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4584/9228] 10.222.0.59 () {58 vars in 1224 bytes} [Sun Aug 28 02:49:37 2022] DELETE /identity/v3/users/0367419f124c4b9bbeea89b36d5219a4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:49:37.721468 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:49:37.722958 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:49:37.737358 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7932881-df36-454b-854f-dd2fede8d8a5 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:49:37.796230 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cd3966716148c5879c1ebdf2fbb39a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '651780a5477f4d4a87199d4613e97281', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:49:37.796861 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:49:37.797143 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:49:37.797418 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] PATH_INFO: `/v3/projects/028dbc9797a04bdd91339b053d5969a0` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:49:37.798620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028dbc9797a04bdd91339b053d5969a0)` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:49:37.800558 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:49:37.895730 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028dbc9797a04bdd91339b053d5969a0', 'request_id': 'req-fab34160-b5fe-4bd1-b3ab-19c53dc27040'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.902560 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028dbc9797a04bdd91339b053d5969a0', 'request_id': 'req-fab34160-b5fe-4bd1-b3ab-19c53dc27040'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.970023 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028dbc9797a04bdd91339b053d5969a0', 'request_id': 'req-fab34160-b5fe-4bd1-b3ab-19c53dc27040'} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.981159 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] The token cache is being invalidate because project 028dbc9797a04bdd91339b053d5969a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82007) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 02:49:37.981493 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.982140 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.notifications [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82007) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 02:49:37.983654 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4645/9229] 10.222.0.59 () {58 vars in 1233 bytes} [Sun Aug 28 02:49:37 2022] DELETE /identity/v3/projects/028dbc9797a04bdd91339b053d5969a0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 02:49:47.390055 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:49:47.978128 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:DELETE=10,keystone:SELECT=55,keystone:INSERT=1 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:54:07.488404 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Authenticating user token {{(pid=82006) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:54:07.489887 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:54:07.586196 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cac5c-82df-4541-af7f-c45af6015c97 admin admin] Validating token access rules against request {{(pid=82006) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:54:07.646619 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c854-2431-4c09-a007-94daae4e06f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82006) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:54:07.647244 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c854-2431-4c09-a007-94daae4e06f2 service placement] REQUEST_METHOD: `GET` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:54:07.647527 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c854-2431-4c09-a007-94daae4e06f2 service placement] SCRIPT_NAME: `/identity` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:54:07.647804 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c854-2431-4c09-a007-94daae4e06f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82006) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:54:07.649529 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.fernet_utils [None req-4364c854-2431-4c09-a007-94daae4e06f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82006) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:54:07.661198 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c854-2431-4c09-a007-94daae4e06f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:54:07.662794 n-d-master-1 devstack@keystone.service[82006]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c854-2431-4c09-a007-94daae4e06f2 service placement] RBAC: Authorization granted {{(pid=82006) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:54:07.672931 n-d-master-1 devstack@keystone.service[82006]: [pid: 82006|app: 0|req: 4585/9230] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:54:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:54:17.668897 n-d-master-1 devstack@keystone.service[82006]: DEBUG dbcounter [-] [82006] Writing DB stats keystone:SELECT=66 {{(pid=82006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 02:54:19.353509 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Authenticating user token {{(pid=82007) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 02:54:19.355620 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:54:19.404344 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab34160-b5fe-4bd1-b3ab-19c53dc27040 admin admin] Validating token access rules against request {{(pid=82007) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 02:54:19.409622 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75039719-e970-4604-928e-2002aa32e911 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6e2642bd934f6b856bcdcbcf5751a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '673aef12c24946c3ba53dc5db0e25c0e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82007) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 02:54:19.410263 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75039719-e970-4604-928e-2002aa32e911 service placement] REQUEST_METHOD: `GET` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 02:54:19.410550 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75039719-e970-4604-928e-2002aa32e911 service placement] SCRIPT_NAME: `/identity` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 02:54:19.410829 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75039719-e970-4604-928e-2002aa32e911 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82007) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 02:54:19.412549 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.fernet_utils [None req-75039719-e970-4604-928e-2002aa32e911 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82007) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 02:54:19.424868 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75039719-e970-4604-928e-2002aa32e911 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 02:54:19.426541 n-d-master-1 devstack@keystone.service[82007]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75039719-e970-4604-928e-2002aa32e911 service placement] RBAC: Authorization granted {{(pid=82007) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 02:54:19.437871 n-d-master-1 devstack@keystone.service[82007]: [pid: 82007|app: 0|req: 4646/9231] 10.222.0.59 () {60 vars in 1365 bytes} [Sun Aug 28 02:54:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 02:54:29.432387 n-d-master-1 devstack@keystone.service[82007]: DEBUG dbcounter [-] [82007] Writing DB stats keystone:SELECT=20 {{(pid=82007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}